-- Logs begin at Sun 2022-10-23 00:10:36 UTC, end at Sun 2022-10-23 03:00:07 UTC. -- Oct 23 00:49:20.121311 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 23 00:49:20.129276 n-d-master-1 devstack@keystone.service[81923]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 00:49:20 2022] *** Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: nodename: n-d-master-1 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: machine: x86_64 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: clock source: unix Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: pcre jit disabled Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: detected number of CPU cores: 4 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: current working directory: / Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: detected binary path: /usr/bin/uwsgi-core Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: your processes number limit is 47680 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: your memory page size is 4096 bytes Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: detected max file descriptor number: 2048 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: lock engine: pthread robust mutexes Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: thunder lock: enabled Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 23 00:49:20.133755 n-d-master-1 devstack@keystone.service[81923]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 00:49:20.170733 n-d-master-1 devstack@keystone.service[81923]: Python main interpreter initialized at 0x55c34e1169c0 Oct 23 00:49:20.170733 n-d-master-1 devstack@keystone.service[81923]: python threads support enabled Oct 23 00:49:20.170733 n-d-master-1 devstack@keystone.service[81923]: your server socket listen backlog is limited to 100 connections Oct 23 00:49:20.170733 n-d-master-1 devstack@keystone.service[81923]: your mercy for graceful operations on workers is 90 seconds Oct 23 00:49:20.178285 n-d-master-1 devstack@keystone.service[81923]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 00:49:20.178285 n-d-master-1 devstack@keystone.service[81923]: *** Operational MODE: preforking *** Oct 23 00:49:20.178285 n-d-master-1 devstack@keystone.service[81923]: *** uWSGI is running in multiple interpreter mode *** Oct 23 00:49:20.178285 n-d-master-1 devstack@keystone.service[81923]: spawned uWSGI master process (pid: 81923) Oct 23 00:49:20.178285 n-d-master-1 devstack@keystone.service[81923]: spawned uWSGI worker 1 (pid: 81936, cores: 1) Oct 23 00:49:20.178285 n-d-master-1 devstack@keystone.service[81923]: spawned uWSGI worker 2 (pid: 81937, cores: 1) Oct 23 00:49:20.178285 n-d-master-1 devstack@keystone.service[81923]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 00:49:20.171643 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 23 00:49:24.460509 n-d-master-1 devstack@keystone.service[81937]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:49:24.460509 n-d-master-1 devstack@keystone.service[81937]: from cryptography.utils import int_from_bytes Oct 23 00:49:24.461306 n-d-master-1 devstack@keystone.service[81937]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:49:24.461306 n-d-master-1 devstack@keystone.service[81937]: from cryptography.utils import int_from_bytes Oct 23 00:49:24.461432 n-d-master-1 devstack@keystone.service[81936]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:49:24.461432 n-d-master-1 devstack@keystone.service[81936]: from cryptography.utils import int_from_bytes Oct 23 00:49:24.461432 n-d-master-1 devstack@keystone.service[81936]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:49:24.461432 n-d-master-1 devstack@keystone.service[81936]: from cryptography.utils import int_from_bytes Oct 23 00:49:24.510148 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:49:24.510344 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:49:24.510481 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:49:24.510581 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] command line args: [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:49:24.510663 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:49:24.510744 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] command line args: [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:49:24.510821 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:49:24.510936 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ================================================================================ {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:49:24.511017 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:49:24.511133 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ================================================================================ {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:49:24.511214 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] admin_token = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.511387 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] admin_token = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.511474 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] config_dir = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.511584 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.511664 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] config_dir = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.511766 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] config_source = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.511853 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.511932 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] debug = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512012 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] config_source = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512125 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512370 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] debug = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512370 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512515 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512588 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512655 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512718 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512874 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.512960 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513114 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513210 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513340 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] list_limit = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513420 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] list_limit = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513529 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] log_config_append = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513611 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] log_config_append = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513678 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513746 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513862 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] log_dir = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.513936 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] log_dir = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514035 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] log_file = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514107 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] log_file = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514261 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514355 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514503 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514585 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514752 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.514879 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515017 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515108 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515182 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515299 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515381 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515498 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515585 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515658 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515773 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515849 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.515972 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516056 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516169 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516254 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516395 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516472 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516622 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516754 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516863 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.516949 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.517098 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.517170 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.517364 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.517451 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.517841 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.518004 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.518168 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] publish_errors = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.518872 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] publish_errors = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.518956 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519076 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519156 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519328 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519454 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519531 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519652 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519749 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519834 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519913 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.519993 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] standard_threads = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520066 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] standard_threads = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520137 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520254 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520338 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520411 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520480 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520549 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520621 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] use_journal = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520698 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] use_journal = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520780 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] use_json = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520853 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] use_json = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.520969 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] use_stderr = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.521045 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] use_stderr = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.521115 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] use_syslog = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.521184 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] use_syslog = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.521307 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.521393 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:49:24.521556 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.521642 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.521789 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.521868 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522067 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522161 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522301 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522380 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522544 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522632 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522773 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.522849 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523013 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523089 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523242 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523327 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523481 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523569 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523719 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523798 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.523962 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524052 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524190 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524268 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524432 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524516 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524661 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524794 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524883 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.524956 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525131 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525213 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525360 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525445 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525609 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525686 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525854 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.525931 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526124 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526215 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526356 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526434 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526603 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526679 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526854 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.526942 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527100 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527178 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527345 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527423 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527569 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527721 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527796 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.527872 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528007 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528091 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528236 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528324 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528479 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528556 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528721 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528797 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.528944 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529028 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529169 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529245 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529407 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529483 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529648 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529726 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529877 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.529953 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530142 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530233 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530372 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530459 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530602 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530680 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530831 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.530913 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531054 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531131 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531280 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531355 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531504 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531614 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531729 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531819 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.531957 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532034 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532198 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532284 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532423 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532502 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532652 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532729 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532877 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.532954 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533106 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533194 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533335 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533422 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533575 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533653 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533814 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.533899 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534080 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534162 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534314 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534392 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534544 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534634 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534774 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.534859 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535005 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535082 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535229 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535316 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535469 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535550 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535698 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535776 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.535927 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536014 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536153 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536231 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536405 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536492 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536638 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536715 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536864 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.536942 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537094 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537171 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537324 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537432 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537585 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537691 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537817 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.537923 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538084 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538190 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538327 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538450 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538569 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538650 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538776 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.538855 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539044 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539122 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539239 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539315 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539453 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539579 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539666 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539783 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539907 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.539986 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540138 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540217 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540394 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540494 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540608 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540693 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540820 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.540897 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541054 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541145 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541283 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541357 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541510 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541586 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541763 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.541852 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542023 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542106 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542257 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542338 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542514 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542634 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542746 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542821 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.542955 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543031 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543160 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543249 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543389 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543466 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543618 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543722 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543837 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.543924 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544055 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544134 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544276 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544353 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544504 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544592 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544729 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544806 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.544958 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545035 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545188 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545277 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545426 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545511 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545657 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545744 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.545904 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546008 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546183 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546261 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546416 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546525 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546645 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] auth.external = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546726 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] auth.external = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546871 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.546957 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547160 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547239 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547388 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547467 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547613 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] auth.password = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547704 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] auth.password = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547838 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] auth.token = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.547916 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] auth.token = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548068 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548145 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548299 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548380 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548539 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548616 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548761 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.548837 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549001 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549081 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549240 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549317 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549489 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549581 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549723 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] credential.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549802 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] credential.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.549962 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.550072 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.550226 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.550572 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.550736 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.550817 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.550982 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551060 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551221 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551307 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551453 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551533 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551690 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551767 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.551937 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552015 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552168 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552248 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552413 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552491 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552689 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552769 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552918 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.552995 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553175 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553254 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553414 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553492 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553664 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553743 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553896 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.553993 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554152 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554232 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554394 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554474 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554635 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554714 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554861 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.554939 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555101 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555190 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555331 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555410 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555577 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555655 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555806 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.555886 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556053 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556131 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556283 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556360 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556525 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556604 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556754 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556832 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.556996 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557073 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557234 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557314 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557464 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557542 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557694 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557774 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.557935 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558061 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558183 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558318 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558398 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558483 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558646 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558725 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558890 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.558968 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559114 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559200 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559340 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559418 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559562 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559639 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559805 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.559895 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560045 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560123 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560287 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560372 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560537 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560623 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560777 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.560855 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561040 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561124 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561276 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561366 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561504 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561582 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561729 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561807 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.561961 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562071 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562210 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562290 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562443 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562520 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562676 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562762 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562910 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.562989 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563150 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563234 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563376 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563462 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563615 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563694 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563856 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.563935 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564087 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564173 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564323 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564402 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564561 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564639 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564784 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.564874 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.565016 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.565583 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.565753 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.565832 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566032 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566135 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566241 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566321 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566578 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566657 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566816 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.566903 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567049 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567127 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567295 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567373 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567537 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567624 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567763 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567841 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.567988 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568066 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568229 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568316 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568470 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568550 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568701 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568780 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.568934 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569020 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569164 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569241 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569390 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569467 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569621 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569708 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569874 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.569952 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570124 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570205 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570366 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570458 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570609 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570687 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570852 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.570929 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571082 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571168 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571306 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571384 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571537 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571615 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571766 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571846 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.571997 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572075 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572220 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572297 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572469 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572555 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572694 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572773 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.572935 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573019 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573173 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573253 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573412 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573492 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573638 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573716 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573878 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.573958 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574133 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574214 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574366 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574445 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574599 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574681 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574828 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.574911 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575067 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575146 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575307 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575388 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575541 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575619 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575787 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.575865 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576008 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576083 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576242 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576320 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576473 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576551 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576701 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576781 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.576932 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577010 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577171 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577250 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577408 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577489 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577635 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577715 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.577916 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578078 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578165 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578231 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578363 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578444 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578605 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578685 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578836 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.578917 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579076 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579154 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579319 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579398 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579550 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579630 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579787 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.579865 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.580018 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.580096 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.580250 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.580329 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.580480 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] role.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.580558 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] role.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.580770 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] role.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.581370 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] role.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.581525 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.581606 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.581775 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.581861 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582040 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582127 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582282 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582364 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582523 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582601 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582761 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.582839 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583002 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583089 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583240 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583318 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583481 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583567 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583706 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583784 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.583946 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.584025 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.584183 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.584269 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.584423 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.584502 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.584661 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.584739 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585044 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585132 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585258 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585334 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585505 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585585 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585744 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585831 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.585996 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586077 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586252 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586330 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586481 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586572 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586728 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586807 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.586973 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587051 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587205 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587293 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587431 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587509 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587656 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587733 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587880 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.587967 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588122 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588200 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588369 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588447 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588610 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588696 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588842 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.588921 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589073 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589151 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589296 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589376 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589527 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589606 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589758 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.589836 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590018 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590101 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590256 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590335 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590506 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590584 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590744 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590825 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.590975 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591053 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591213 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591291 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591452 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591533 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591690 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591768 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.591922 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592001 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592156 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592234 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592384 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592461 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592622 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592701 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592889 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.592968 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593112 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593201 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593351 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593440 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593605 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593684 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593856 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.connection = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.593943 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.connection = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594119 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594199 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594361 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594440 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594592 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594682 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594826 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.594906 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595057 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595135 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595285 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595445 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595523 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595595 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595733 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595812 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.595969 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596056 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596197 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596275 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596460 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596539 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596692 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596780 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.596930 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597008 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597160 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597237 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597395 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597482 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597619 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597697 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597850 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.597928 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.598102 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.598195 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:49:24.598271 n-d-master-1 devstack@keystone.service[81936]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:49:24.598342 n-d-master-1 devstack@keystone.service[81937]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:49:24.627485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.628317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.628418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.628550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.628634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.628774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.636801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.637056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.665529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.665764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.666011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.666246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.717694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.717947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.766184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.766415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.767091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.767325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.920389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.920618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.920708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.920849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.921728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.945488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.945721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.945817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.945938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.946920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.947069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.958383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.958621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.971067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.971245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.972022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.972243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.972457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.972668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.972748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.972878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81937) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.972982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.973205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.973423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.973638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.973850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.974091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81936) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:49:24.989495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.989703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:49:24.989821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.990057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:49:24.990141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.990269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:49:24.990398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.990545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.990627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:49:24.990806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.990886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.991101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.991315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.991578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.991656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:24.991845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.000837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.001081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.001166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.001357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.001438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.001624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.001713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.001902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.009331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.009491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.012200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.012386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.012482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.012673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.012754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.012956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.013037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.013243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.013325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.013529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.013607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.013787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.013875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.014082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.014165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.014358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.014467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.014742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.014831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.015010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.015090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.015281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.038136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.038790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.039588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.039872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.040235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.040517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.046251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.046541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.046825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.046906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.047136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.047418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.053541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.053830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.054099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.054388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.057992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.058301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.058518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.058598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.058814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.058893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.059099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.059182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.059385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.059464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.059657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.059735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.059929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.060011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.060206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.060486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.075949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.076231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.076391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.076670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.080086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.080491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.083845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.084144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.084255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.084550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.088415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.088735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.091548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.091847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.094794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.095053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.095173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.095350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.095447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.095650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.095735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.095939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.096033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.096219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.096303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.096520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.111903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.112141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.112226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.112428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.112510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.112697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.112781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.112961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.119529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.119838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.121064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.121358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.122634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.122903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.122986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.123185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.125521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.125789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.125872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.126097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.126214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.126482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.126565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.126764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.126845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.127045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.138353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.138544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.138628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.138826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.139000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.139199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.139295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.139481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.139567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.139771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.139852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.140051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.140134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.140323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.155919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.156087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.158859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.158990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.161704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.161820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.163210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.163301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.164810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.164894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.165104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.165186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.165384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.165474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.171643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.171734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.173087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.173171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.176368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.176509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.176654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.176737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.176934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.177025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.177210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.177292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.184873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.184997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.185161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.185288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.185438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.185569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.193584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81936) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.193774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81937) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:49:25.193859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.194087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.194173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.194375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.194457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.194653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.194737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.194928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.195010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.195199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.195289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.195473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.195553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.195740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.195820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.196947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.197128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.197207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81936) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.197400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81937) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:49:25.230091 n-d-master-1 devstack@keystone.service[81936]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c34e1169c0 pid: 81936 (default app) Oct 23 00:49:25.230476 n-d-master-1 devstack@keystone.service[81937]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c34e1169c0 pid: 81937 (default app) Oct 23 00:49:25.233337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610b28-0f21-43c3-88df-4f1d18dba617 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:25.233620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610b28-0f21-43c3-88df-4f1d18dba617 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:25.233889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610b28-0f21-43c3-88df-4f1d18dba617 None None] PATH_INFO: `/v3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:25.238024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Sun Oct 23 00:49:25 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:32.884828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e1d0-70b1-4bb7-8dce-473b8b03539f None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:32.885316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e1d0-70b1-4bb7-8dce-473b8b03539f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:32.885316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e1d0-70b1-4bb7-8dce-473b8b03539f None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:32.889562 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:49:32.894804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:32.895229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:32.895346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:32.964911 n-d-master-1 devstack@keystone.service[81936]: INFO dbcounter [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] Registered counter for database keystone Oct 23 00:49:32.984164 n-d-master-1 devstack@keystone.service[81936]: DEBUG oslo_db.sqlalchemy.engines [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:49:32.990959 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writer thread running {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:49:33.167879 n-d-master-1 devstack@keystone.service[81936]: DEBUG passlib.handlers.bcrypt [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81936) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 00:49:33.168180 n-d-master-1 devstack@keystone.service[81936]: DEBUG passlib.handlers.bcrypt [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81936) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 00:49:33.226194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:33.227794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:33.351921 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 23 00:49:33.833391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20e1d0-70b1-4bb7-8dce-473b8b03539f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:33.901416 n-d-master-1 devstack@keystone.service[81937]: INFO dbcounter [None req-bf20e1d0-70b1-4bb7-8dce-473b8b03539f None None] Registered counter for database keystone Oct 23 00:49:33.922842 n-d-master-1 devstack@keystone.service[81937]: DEBUG oslo_db.sqlalchemy.engines [None req-bf20e1d0-70b1-4bb7-8dce-473b8b03539f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:49:33.929797 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writer thread running {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:49:34.046951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20e1d0-70b1-4bb7-8dce-473b8b03539f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:34.051475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34de24-174c-4ece-8081-7f4fafc5ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:34.052089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34de24-174c-4ece-8081-7f4fafc5ff36 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:34.052367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34de24-174c-4ece-8081-7f4fafc5ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:34.052634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34de24-174c-4ece-8081-7f4fafc5ff36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:34.060696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34de24-174c-4ece-8081-7f4fafc5ff36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:34.111539 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cb34de24-174c-4ece-8081-7f4fafc5ff36 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 00:49:34.111830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34de24-174c-4ece-8081-7f4fafc5ff36 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:34.121095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Sun Oct 23 00:49:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 00:49:34.127158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:34.143718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465fdf4-6a5a-4b77-853c-3325e016c837 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:34.148587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082de15-7e34-492f-b3ec-2c12bd8f92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:34.149692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082de15-7e34-492f-b3ec-2c12bd8f92fe admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:34.150001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082de15-7e34-492f-b3ec-2c12bd8f92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:34.150275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082de15-7e34-492f-b3ec-2c12bd8f92fe admin admin] PATH_INFO: `/v3/projects/598c49694334495883fc0f61f918bb99` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:34.154040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082de15-7e34-492f-b3ec-2c12bd8f92fe admin admin] RBAC: Authorizing `identity:get_project(project_id=598c49694334495883fc0f61f918bb99)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:34.203727 n-d-master-1 devstack@keystone.service[81936]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c082de15-7e34-492f-b3ec-2c12bd8f92fe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 00:49:34.204068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082de15-7e34-492f-b3ec-2c12bd8f92fe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:34.209050 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 23 00:49:34 2022] GET /identity/v3/projects/598c49694334495883fc0f61f918bb99 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:36.307429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67215a52-f40d-4153-bea8-f9d4f7fba5d5 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:36.307939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67215a52-f40d-4153-bea8-f9d4f7fba5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:36.308018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67215a52-f40d-4153-bea8-f9d4f7fba5d5 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:36.312041 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:36.317332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a260-02b3-4414-bacd-100b6133f802 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:36.317800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a260-02b3-4414-bacd-100b6133f802 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:36.317887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a260-02b3-4414-bacd-100b6133f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:36.337767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0fe5a260-02b3-4414-bacd-100b6133f802 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:36.339280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0fe5a260-02b3-4414-bacd-100b6133f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:36.346923 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:49:36.612494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67215a52-f40d-4153-bea8-f9d4f7fba5d5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:36.624357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67215a52-f40d-4153-bea8-f9d4f7fba5d5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:36.629006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054571-1c03-4c64-8229-93914df1a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:36.629601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054571-1c03-4c64-8229-93914df1a942 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:36.629877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054571-1c03-4c64-8229-93914df1a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:36.630195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054571-1c03-4c64-8229-93914df1a942 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:36.637691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1054571-1c03-4c64-8229-93914df1a942 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:36.639501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1054571-1c03-4c64-8229-93914df1a942 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:36.648627 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Sun Oct 23 00:49:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:49:36.653842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a260-02b3-4414-bacd-100b6133f802 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:36.662738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a260-02b3-4414-bacd-100b6133f802 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:36.667054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cf72b-ee39-428d-a2e3-bfe8a8b3a835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:36.667675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cf72b-ee39-428d-a2e3-bfe8a8b3a835 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:36.667954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cf72b-ee39-428d-a2e3-bfe8a8b3a835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:36.668230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cf72b-ee39-428d-a2e3-bfe8a8b3a835 admin admin] PATH_INFO: `/v3/users/aff16e16e402486ab43ace4b1e3cc4c1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:36.669531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cf72b-ee39-428d-a2e3-bfe8a8b3a835 admin admin] RBAC: Authorizing `identity:get_user(user_id=aff16e16e402486ab43ace4b1e3cc4c1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:36.671367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cf72b-ee39-428d-a2e3-bfe8a8b3a835 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:36.672872 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Sun Oct 23 00:49:36 2022] GET /identity/v3/users/aff16e16e402486ab43ace4b1e3cc4c1 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:38.857954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb98d6-007c-4200-936c-0eae5c8c6c3c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:38.858453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb98d6-007c-4200-936c-0eae5c8c6c3c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:38.858453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb98d6-007c-4200-936c-0eae5c8c6c3c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:38.859776 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:38.865580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef80a-1f21-40d3-8115-2bc85e006d0d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:38.866015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef80a-1f21-40d3-8115-2bc85e006d0d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:38.866161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef80a-1f21-40d3-8115-2bc85e006d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:38.884218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3baef80a-1f21-40d3-8115-2bc85e006d0d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:38.885379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3baef80a-1f21-40d3-8115-2bc85e006d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:38.895538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8e6e-05fe-40e5-8b3d-7535347eab5e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:38.895818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8e6e-05fe-40e5-8b3d-7535347eab5e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:38.896094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e8e6e-05fe-40e5-8b3d-7535347eab5e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:38.897460 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:49:38.902585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:38.902870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:38.903141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:38.944874 n-d-master-1 devstack@keystone.service[81937]: DEBUG passlib.handlers.bcrypt [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81937) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 00:49:38.945260 n-d-master-1 devstack@keystone.service[81937]: DEBUG passlib.handlers.bcrypt [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81937) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 00:49:38.967171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:38.993986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:38.995567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:39.093246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:49:39.237044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef80a-1f21-40d3-8115-2bc85e006d0d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.261588 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.338978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef80a-1f21-40d3-8115-2bc85e006d0d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.358944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.372342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.372984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.373261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.373533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.384711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:49:39.394439 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:39.395372 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:49:39.396280 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:49:39.398276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:49:39.401189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.458341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41182b5-718e-4b60-8468-aa229f33da38 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.460550 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.483800 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.496044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.496856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.497136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.497412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.498408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:39.499901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:39.509126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95a005-2bef-4d5c-98bc-cb5001925fb5 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.542816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.sql.core [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:49:39.542816 n-d-master-1 devstack@keystone.service[81937]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:49:39.542816 n-d-master-1 devstack@keystone.service[81937]: [parameters: {'id': '76c3d2c1acdf4bb6b4a7f42e2b2de9fb', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:49:39.542816 n-d-master-1 devstack@keystone.service[81937]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81937) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:49:39.543113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.543669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.543953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.544226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.544918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:39.545222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:39.546624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:39.558451 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:49:39.561583 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 00:49:39.562644 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application yield resource Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise self.value Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.commit() Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:49:39.563681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:49:39.564619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:49:39.566388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:49:39.567306 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [parameters: {'id': '76c3d2c1acdf4bb6b4a7f42e2b2de9fb', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 00:49:39.568187 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:39.568969 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.569851 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 8/16] 10.222.0.42 () {60 vars in 1137 bytes} [Sun Oct 23 00:49:39 2022] POST /identity/v3/domains => generated 190 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:49:39.570913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.570987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.665484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4859f32-6ba6-408d-8857-9dc4bb448258 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.670416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8082f0-b042-4522-a854-76e74a9d2394 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.698502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.699132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.699426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.699684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] PATH_INFO: `/v3/users/aff16e16e402486ab43ace4b1e3cc4c1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.700820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] RBAC: Authorizing `identity:get_user(user_id=aff16e16e402486ab43ace4b1e3cc4c1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:39.702293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:39.703847 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:49:39 2022] GET /identity/v3/users/aff16e16e402486ab43ace4b1e3cc4c1 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:49:39.704038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.704883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.705215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.705480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.709889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.723692 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.724106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:39.725595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:49:39.741149 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:39.742065 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:49:39.742968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:49:39.742968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:49:39.742968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:39.742968 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:49:39.747997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.773150 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.810368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f950-3f6a-4608-91f6-60534a974994 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.843802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.844438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.844717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.844991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.846137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:39.847565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:39.848630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16e369-d6bb-414b-86a6-59075668d796 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.849106 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:49:39.854689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.883900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d762d3-f5ef-49f4-9679-423483bb4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.884542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d762d3-f5ef-49f4-9679-423483bb4b54 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.884825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d762d3-f5ef-49f4-9679-423483bb4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.885135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d762d3-f5ef-49f4-9679-423483bb4b54 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.885785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d762d3-f5ef-49f4-9679-423483bb4b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:39.886116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d762d3-f5ef-49f4-9679-423483bb4b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:39.887500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d762d3-f5ef-49f4-9679-423483bb4b54 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:39.905414 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:49:39.939458 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.960300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c3dc-6a6a-41aa-9afb-f8568b036489 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.997023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1f1e-aaf2-433d-af48-81137989f3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.997694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1f1e-aaf2-433d-af48-81137989f3b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.997968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1f1e-aaf2-433d-af48-81137989f3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.998323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1f1e-aaf2-433d-af48-81137989f3b7 None admin] PATH_INFO: `/v3/domains/default/users/aff16e16e402486ab43ace4b1e3cc4c1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:40.000214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1f1e-aaf2-433d-af48-81137989f3b7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=aff16e16e402486ab43ace4b1e3cc4c1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:40.001665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1f1e-aaf2-433d-af48-81137989f3b7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:40.180967 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 11/21] 10.222.0.42 () {58 vars in 1361 bytes} [Sun Oct 23 00:49:39 2022] PUT /identity/v3/domains/default/users/aff16e16e402486ab43ace4b1e3cc4c1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:49:42.584918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0c71-b21c-4fda-bdb2-6d7abb8cb9be None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.585435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0c71-b21c-4fda-bdb2-6d7abb8cb9be None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.585435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0c71-b21c-4fda-bdb2-6d7abb8cb9be None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.586898 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:42.592999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2827-0984-46bf-ac41-5674c078f32b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.593893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2827-0984-46bf-ac41-5674c078f32b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.594450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2827-0984-46bf-ac41-5674c078f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.620334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1d1a2827-0984-46bf-ac41-5674c078f32b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:42.622333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1d1a2827-0984-46bf-ac41-5674c078f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:42.711039 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:42.799851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9ddc-0361-4cc3-b43f-231384d48f69 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.800898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9ddc-0361-4cc3-b43f-231384d48f69 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.801069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9ddc-0361-4cc3-b43f-231384d48f69 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.802443 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:42.808101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf27b00-db9e-484b-a7f9-07ee2478a235 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.808646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf27b00-db9e-484b-a7f9-07ee2478a235 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.816699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf27b00-db9e-484b-a7f9-07ee2478a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.832603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fcf27b00-db9e-484b-a7f9-07ee2478a235 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:42.834302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fcf27b00-db9e-484b-a7f9-07ee2478a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:42.918648 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:42.925799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab4939-4bfd-41c5-9662-50ef811a7604 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.926088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab4939-4bfd-41c5-9662-50ef811a7604 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.926415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab4939-4bfd-41c5-9662-50ef811a7604 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.927959 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 13/25] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:49:42.928069 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 13/26] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:42.940214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306e706-6080-406d-a1a0-bb0cf1bed441 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.940513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306e706-6080-406d-a1a0-bb0cf1bed441 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.940786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306e706-6080-406d-a1a0-bb0cf1bed441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.961209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cb02-69d0-4c06-bc86-f170ddd825f7 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.961491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cb02-69d0-4c06-bc86-f170ddd825f7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.961758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cb02-69d0-4c06-bc86-f170ddd825f7 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.966635 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:42.973507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4306e706-6080-406d-a1a0-bb0cf1bed441 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:42.974994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4306e706-6080-406d-a1a0-bb0cf1bed441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:42.975262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587244ba-1118-49ad-ab35-11b6feb09840 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.975582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587244ba-1118-49ad-ab35-11b6feb09840 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.975857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587244ba-1118-49ad-ab35-11b6feb09840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:43.005021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-587244ba-1118-49ad-ab35-11b6feb09840 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:43.007347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-587244ba-1118-49ad-ab35-11b6feb09840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:43.109901 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:43.110466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306e706-6080-406d-a1a0-bb0cf1bed441 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:43.134301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:43.144954 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:43.269730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306e706-6080-406d-a1a0-bb0cf1bed441 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:43.319352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:43.320337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:43.320809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:43.321295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:43.322190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:43.323776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:43.365215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587244ba-1118-49ad-ab35-11b6feb09840 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:43.475148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587244ba-1118-49ad-ab35-11b6feb09840 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:43.508793 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:43.526649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:43.527308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:43.527594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:43.527873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:43.545614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:49:43.551209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:43.552030 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:49:43.552767 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 16/30] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:49:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:49:43.559350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:43.579696 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 15/31] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 23 00:49:43 2022] POST /identity/v3/roles => generated 219 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:49:43.580798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:43.732942 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:43.771862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e48ee7-4a46-46db-8c13-c0eb453b0c7c None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:43.775535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dce14-951a-4f36-a33a-795627e8f310 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:43.825041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:43.825822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:43.826137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:43.826410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:43.827090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:43.828876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:43.842910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:43.843589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:43.843959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:43.844243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:43.844927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:43.845234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:43.846879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:43.856378 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 17/32] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:49:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:49:43.857114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:43.919272 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:43.952691 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 16/33] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 23 00:49:43 2022] POST /identity/v3/roles => generated 225 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:49:43.953846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:43.986261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefefc8f-4e7d-41bd-b2e6-b1865e816aa6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.066893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da5cb6-f92a-46c8-994b-eac24ea5aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.067621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da5cb6-f92a-46c8-994b-eac24ea5aa26 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.067923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da5cb6-f92a-46c8-994b-eac24ea5aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.068390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da5cb6-f92a-46c8-994b-eac24ea5aa26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.086958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820edd5-7540-4a15-ae8a-aae3e21ff242 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.093025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da5cb6-f92a-46c8-994b-eac24ea5aa26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.094660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da5cb6-f92a-46c8-994b-eac24ea5aa26 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-25da5cb6-f92a-46c8-994b-eac24ea5aa26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:49:44.121832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:44.122855 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:49:44.123655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:49:44.123655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:49:44.123655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:49:44.123655 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 18/34] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:49:44.124335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a58ca3-8762-4b3b-84a7-23d9ae809246 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.124497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a58ca3-8762-4b3b-84a7-23d9ae809246 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.124752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a58ca3-8762-4b3b-84a7-23d9ae809246 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.125096 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:44.126140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 19/35] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:44.131180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a58ca3-8762-4b3b-84a7-23d9ae809246 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:44.132906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf72dd7-bfa0-4a8c-a40a-ff8a641f629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.136660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72dd7-bfa0-4a8c-a40a-ff8a641f629e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.136660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72dd7-bfa0-4a8c-a40a-ff8a641f629e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.136660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72dd7-bfa0-4a8c-a40a-ff8a641f629e None admin] PATH_INFO: `/v3/users/aff16e16e402486ab43ace4b1e3cc4c1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.137793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf72dd7-bfa0-4a8c-a40a-ff8a641f629e None admin] RBAC: Authorizing `identity:get_user(user_id=aff16e16e402486ab43ace4b1e3cc4c1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.139372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf72dd7-bfa0-4a8c-a40a-ff8a641f629e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.145904 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 17/36] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:49:43 2022] GET /identity/v3/users/aff16e16e402486ab43ace4b1e3cc4c1 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:44.145904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9087a4-81d7-49e8-b9f4-95194670e805 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.145904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9087a4-81d7-49e8-b9f4-95194670e805 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.145904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9087a4-81d7-49e8-b9f4-95194670e805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.169159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6a9087a4-81d7-49e8-b9f4-95194670e805 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:44.171266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6a9087a4-81d7-49e8-b9f4-95194670e805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:44.268058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 18/37] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:44.268806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9087a4-81d7-49e8-b9f4-95194670e805 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:44.278790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a58ca3-8762-4b3b-84a7-23d9ae809246 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.282388 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:44.327696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929c18e-21ac-47ad-869c-a619b3d1bfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.327696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929c18e-21ac-47ad-869c-a619b3d1bfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.327696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929c18e-21ac-47ad-869c-a619b3d1bfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.327696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929c18e-21ac-47ad-869c-a619b3d1bfb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.328076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929c18e-21ac-47ad-869c-a619b3d1bfb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:44.328076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929c18e-21ac-47ad-869c-a619b3d1bfb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.329564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929c18e-21ac-47ad-869c-a619b3d1bfb3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.390735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9087a4-81d7-49e8-b9f4-95194670e805 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.421470 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:44.430920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94a00b-97a1-41c3-a859-15fb9bee3141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.431576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94a00b-97a1-41c3-a859-15fb9bee3141 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.431857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94a00b-97a1-41c3-a859-15fb9bee3141 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.432131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94a00b-97a1-41c3-a859-15fb9bee3141 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.439374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94a00b-97a1-41c3-a859-15fb9bee3141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.439374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94a00b-97a1-41c3-a859-15fb9bee3141 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.439374 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:44.439374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba84da-7435-454b-9a97-8fc05fe427c5 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.439374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba84da-7435-454b-9a97-8fc05fe427c5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.439374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba84da-7435-454b-9a97-8fc05fe427c5 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.439374 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 20/39] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:44.442264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba84da-7435-454b-9a97-8fc05fe427c5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:44.455673 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 20/40] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:44.458041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb844-e2be-4d1a-ae5e-1d293664c4d0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.458400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb844-e2be-4d1a-ae5e-1d293664c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.458795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb844-e2be-4d1a-ae5e-1d293664c4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.476977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c4feb844-e2be-4d1a-ae5e-1d293664c4d0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:44.478291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c4feb844-e2be-4d1a-ae5e-1d293664c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:44.555078 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:44.556126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feb844-e2be-4d1a-ae5e-1d293664c4d0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:44.562543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba84da-7435-454b-9a97-8fc05fe427c5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.598283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.598889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.599167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.599444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.600155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.domain.id=default, user.id=aff16e16e402486ab43ace4b1e3cc4c1) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:44.600463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.601899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.618021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 21/42] 10.222.0.42 () {56 vars in 1322 bytes} [Sun Oct 23 00:49:44 2022] GET /identity/v3/role_assignments?user.id=aff16e16e402486ab43ace4b1e3cc4c1&scope.domain.id=default&role.id=084c71d449aa4c209afa646584a16293 => generated 530 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:49:44.618021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:44.671693 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:44.682197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feb844-e2be-4d1a-ae5e-1d293664c4d0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.688460 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:44.723408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.724101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.724381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.724653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.725365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.727008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.736700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242e690-8e27-475c-9ad4-21609cbd31ff None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.775377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.776276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.776425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.776691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.777859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.779410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.781390 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:44.787240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:44.854063 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:49:44 2022] POST /identity/v3/projects => generated 301 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:49:44.854838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:44.905661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5abb9-6da5-4327-a0a7-7c689d5ebeed None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:44.937510 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:44.946820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d1e4-269f-4dc2-8c78-25737af828e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:44.947479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d1e4-269f-4dc2-8c78-25737af828e1 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.948178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d1e4-269f-4dc2-8c78-25737af828e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.948509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d1e4-269f-4dc2-8c78-25737af828e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.949121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d1e4-269f-4dc2-8c78-25737af828e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:44.950799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00d1e4-269f-4dc2-8c78-25737af828e1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:44.989992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cccd5-31ec-4826-8aee-b1c8e5713e3e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:45.026795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad5b6-3c0d-45ba-964d-0dcd2e6d4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:45.027422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad5b6-3c0d-45ba-964d-0dcd2e6d4470 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:45.027704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad5b6-3c0d-45ba-964d-0dcd2e6d4470 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:45.027979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad5b6-3c0d-45ba-964d-0dcd2e6d4470 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:45.028661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad5b6-3c0d-45ba-964d-0dcd2e6d4470 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:45.030075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad5b6-3c0d-45ba-964d-0dcd2e6d4470 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:45.078551 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:49:44 2022] POST /identity/v3/projects => generated 312 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:49:45.130107 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 23 00:49:44 2022] POST /identity/v3/roles => generated 223 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:49:47.204671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc9a8-01bb-4fce-8bd4-0d24b4616aa8 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:47.205218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc9a8-01bb-4fce-8bd4-0d24b4616aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:47.205218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc9a8-01bb-4fce-8bd4-0d24b4616aa8 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:47.206597 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:47.211780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdebea-3366-4925-9251-3a81902d27a0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:47.212155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdebea-3366-4925-9251-3a81902d27a0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:47.212321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdebea-3366-4925-9251-3a81902d27a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:47.225462 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:47.230800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d0cdebea-3366-4925-9251-3a81902d27a0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:47.231952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d0cdebea-3366-4925-9251-3a81902d27a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:47.294886 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:47.561378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc9a8-01bb-4fce-8bd4-0d24b4616aa8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:47.657296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc9a8-01bb-4fce-8bd4-0d24b4616aa8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:47.689515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcc90f-cac9-4665-8cce-47add513ecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:47.690163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcc90f-cac9-4665-8cce-47add513ecce None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:47.690993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcc90f-cac9-4665-8cce-47add513ecce None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:47.691266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcc90f-cac9-4665-8cce-47add513ecce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:47.692374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcc90f-cac9-4665-8cce-47add513ecce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:47.693815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcc90f-cac9-4665-8cce-47add513ecce None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:47.695372 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:47.700672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdebea-3366-4925-9251-3a81902d27a0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:47.793379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdebea-3366-4925-9251-3a81902d27a0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:47.826188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269af63-efea-43ea-993a-8493b5010a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:47.826788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269af63-efea-43ea-993a-8493b5010a54 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:47.827066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269af63-efea-43ea-993a-8493b5010a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:47.827339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269af63-efea-43ea-993a-8493b5010a54 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:47.827980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269af63-efea-43ea-993a-8493b5010a54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:47.829404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269af63-efea-43ea-993a-8493b5010a54 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:47.834559 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:47.929629 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1140 bytes} [Sun Oct 23 00:49:47 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:49:50.046139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cd23-cb95-420b-b77d-24331c6c46bc None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:50.046931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cd23-cb95-420b-b77d-24331c6c46bc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:50.046931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cd23-cb95-420b-b77d-24331c6c46bc None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:50.048644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 26/51] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:50.055410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd211-aa9d-4d35-a413-7ab829123a65 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:50.055832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd211-aa9d-4d35-a413-7ab829123a65 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:50.055964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd211-aa9d-4d35-a413-7ab829123a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:50.075854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-756cd211-aa9d-4d35-a413-7ab829123a65 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:50.077027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-756cd211-aa9d-4d35-a413-7ab829123a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:50.140706 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 26/52] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:50.408065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507cd23-cb95-420b-b77d-24331c6c46bc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:50.457489 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:50.507695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507cd23-cb95-420b-b77d-24331c6c46bc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:50.540170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f4e7c-95d9-4f79-ab03-579d128b9271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:50.540824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4e7c-95d9-4f79-ab03-579d128b9271 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:50.541104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4e7c-95d9-4f79-ab03-579d128b9271 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:50.541376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f4e7c-95d9-4f79-ab03-579d128b9271 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:50.542508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4e7c-95d9-4f79-ab03-579d128b9271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:50.543947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f4e7c-95d9-4f79-ab03-579d128b9271 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:50.545486 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:50.551418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cd211-aa9d-4d35-a413-7ab829123a65 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:50.645554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cd211-aa9d-4d35-a413-7ab829123a65 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:50.662506 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:50.678535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b070d-d252-4d21-8f5e-74c54cd0b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:50.679138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b070d-d252-4d21-8f5e-74c54cd0b16a None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:50.679420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b070d-d252-4d21-8f5e-74c54cd0b16a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:50.679694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b070d-d252-4d21-8f5e-74c54cd0b16a None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:50.680334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b070d-d252-4d21-8f5e-74c54cd0b16a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:50.681761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b070d-d252-4d21-8f5e-74c54cd0b16a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:50.779122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 27/54] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:49:50 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:49:54.270134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c76715-8499-47cd-85e7-f5f9300f5f96 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.270134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c76715-8499-47cd-85e7-f5f9300f5f96 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.270134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c76715-8499-47cd-85e7-f5f9300f5f96 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.271231 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 28/55] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:54.279082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca19950-8dc6-4f0b-a58e-0beb2ce6b123 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.279932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca19950-8dc6-4f0b-a58e-0beb2ce6b123 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.280372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca19950-8dc6-4f0b-a58e-0beb2ce6b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.290166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac130e-f1e6-4723-b480-2c0de1dd63af None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.290702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac130e-f1e6-4723-b480-2c0de1dd63af None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.291179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac130e-f1e6-4723-b480-2c0de1dd63af None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.292691 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 29/56] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:54.311442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1ca19950-8dc6-4f0b-a58e-0beb2ce6b123 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:54.314004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed0522-7576-4120-a3fd-7f330631a135 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.314004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed0522-7576-4120-a3fd-7f330631a135 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.314004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed0522-7576-4120-a3fd-7f330631a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.314295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ca19950-8dc6-4f0b-a58e-0beb2ce6b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:54.340634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-22ed0522-7576-4120-a3fd-7f330631a135 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:54.341830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-22ed0522-7576-4120-a3fd-7f330631a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:54.428053 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 28/57] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:54.430119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8887-f5e4-4ed1-a065-4b926ebbd73c None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.430636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8887-f5e4-4ed1-a065-4b926ebbd73c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.431129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8887-f5e4-4ed1-a065-4b926ebbd73c None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.432909 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:54.438907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8914ed-140e-4018-a40c-468c6faa0899 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.440532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8914ed-140e-4018-a40c-468c6faa0899 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.441198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8914ed-140e-4018-a40c-468c6faa0899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.447762 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:49:54.479404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3d8914ed-140e-4018-a40c-468c6faa0899 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:54.480940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d8914ed-140e-4018-a40c-468c6faa0899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:54.584287 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 30/60] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:54.705642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed0522-7576-4120-a3fd-7f330631a135 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:54.714332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8914ed-140e-4018-a40c-468c6faa0899 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:54.762465 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:54.770961 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:54.819011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed0522-7576-4120-a3fd-7f330631a135 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:54.841849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8914ed-140e-4018-a40c-468c6faa0899 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:54.854193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81020e-8910-4db0-be01-25fd8a6beaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:54.855142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81020e-8910-4db0-be01-25fd8a6beaed None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.855661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81020e-8910-4db0-be01-25fd8a6beaed None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.855840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81020e-8910-4db0-be01-25fd8a6beaed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.868123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81020e-8910-4db0-be01-25fd8a6beaed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6a81020e-8910-4db0-be01-25fd8a6beaed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:49:54.874075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:54.875063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:54.875825 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:49:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:49:54.876530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0451709-6e22-422d-81f5-b39fa5bc6418 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.876530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0451709-6e22-422d-81f5-b39fa5bc6418 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.876794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0451709-6e22-422d-81f5-b39fa5bc6418 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.878980 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 32/62] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:54.880461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9b254-d24f-484e-bac8-cabf110a2ccf None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.880870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9b254-d24f-484e-bac8-cabf110a2ccf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.881259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9b254-d24f-484e-bac8-cabf110a2ccf None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.886540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 33/63] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:54.887006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0380d73-473b-4334-afa3-995ddcc372c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:54.887618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9b254-d24f-484e-bac8-cabf110a2ccf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:54.887728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380d73-473b-4334-afa3-995ddcc372c8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.887920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380d73-473b-4334-afa3-995ddcc372c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.888215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380d73-473b-4334-afa3-995ddcc372c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.899627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0380d73-473b-4334-afa3-995ddcc372c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-c0380d73-473b-4334-afa3-995ddcc372c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:49:54.904863 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:54.905757 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:49:54.907246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 31/64] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:49:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:49:54.908204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259a0d-1765-4d06-a013-0f2296158901 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:54.908705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259a0d-1765-4d06-a013-0f2296158901 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:54.909154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d259a0d-1765-4d06-a013-0f2296158901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:54.928118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3d259a0d-1765-4d06-a013-0f2296158901 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:54.929350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d259a0d-1765-4d06-a013-0f2296158901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:55.001565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:55.003531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf666a-0ea6-4259-92a6-c2d13aed8aeb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.003822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf666a-0ea6-4259-92a6-c2d13aed8aeb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.004099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf666a-0ea6-4259-92a6-c2d13aed8aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.022715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3fdf666a-0ea6-4259-92a6-c2d13aed8aeb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:55.023883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3fdf666a-0ea6-4259-92a6-c2d13aed8aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:55.045209 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.097264 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 33/66] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:55.098052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf666a-0ea6-4259-92a6-c2d13aed8aeb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.113998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9b254-d24f-484e-bac8-cabf110a2ccf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.120145 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.148866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.149535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.149837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.150139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.150974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:55.151286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.152677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.166414 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 34/67] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.167243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.223498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf666a-0ea6-4259-92a6-c2d13aed8aeb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.269250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.270346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.271165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.271598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.272662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:55.273382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.275273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.279937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2be22d-7f9a-414e-8e63-b1d93aa650c2 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.287764 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 34/68] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.288572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.307806 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.323714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.324617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.324970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.325256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.336687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:49:55.341575 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:55.342479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:55.343244 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:49:55.344390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.373635 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.397769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c028-9f00-4305-b1fd-9e325243316f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.431403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.432027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.432305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.432577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] PATH_INFO: `/v3/users/25d7e17ecc654a77b0a9059dfca46873` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.444354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb43e69-147b-407b-863a-b7de546eae92 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.445166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] RBAC: Authorizing `identity:get_user(user_id=25d7e17ecc654a77b0a9059dfca46873)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.446635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.448220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 35/70] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/users/25d7e17ecc654a77b0a9059dfca46873 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.448974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.478760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.479402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.479689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.479965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.491397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:49:55.496265 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:55.497115 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:55.497892 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:49:55.498538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.531376 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.556316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac756a-bc90-47a4-b7b8-cf056444a21b None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.587561 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.589574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.590237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.590513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.590781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] PATH_INFO: `/v3/users/aff16e16e402486ab43ace4b1e3cc4c1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.591876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=aff16e16e402486ab43ace4b1e3cc4c1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.593307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.594934 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 36/72] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/users/aff16e16e402486ab43ace4b1e3cc4c1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.595670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.599778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc5b0-1a5c-4f55-ae75-a3659f6057b1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.634512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.635057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.635338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.635614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.636270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:55.636575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.637955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.646217 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.647137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.696679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53733bb7-928c-41a4-9c71-65154619e8e8 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.729178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.729819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.730165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.730467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.731583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.733043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.734643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 37/74] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.735398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.747580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495a122-d0c7-49b3-83f3-12ed1bfc8838 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.749184 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.780567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.781222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.781505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.781781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.782946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.784387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.786033 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.786786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.805720 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.836577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe897c-7348-4c9e-8aa6-0f7babaeae3e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.869175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.869781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.870091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.870367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.871022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:55.871326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.872707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.881019 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 38/76] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.885728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.888703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c1fe1-4d2e-4100-8c0d-229636e0de51 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:55.921569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:55.922233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:55.922517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:55.922793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:55.923937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:55.926208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:55.927828 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 39/77] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:55.928564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:55.954209 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.982378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4d77-f61b-4e9d-a97d-f37bc34f1e4f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.009765 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:56.015774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.016433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.016717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.016991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] PATH_INFO: `/v3/users/25d7e17ecc654a77b0a9059dfca46873` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.018170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] RBAC: Authorizing `identity:get_user(user_id=25d7e17ecc654a77b0a9059dfca46873)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.019607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.021699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 39/78] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:49:55 2022] GET /identity/v3/users/25d7e17ecc654a77b0a9059dfca46873 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:56.021880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:56.028618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1de8bc-830b-4092-976a-adb70476bcbf None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.063129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.063818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.064105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.064378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.065589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.067379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.118273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0629b-690b-4cf9-8ce4-f80950d330e7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.149721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.150336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.150617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.150891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/25d7e17ecc654a77b0a9059dfca46873/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.152777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] RBAC: Authorizing `identity:create_grant(project_id=270fb656c5914e96aa8f5710fe891b8e, user_id=25d7e17ecc654a77b0a9059dfca46873, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.154231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.160222 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 40/79] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:49:55 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:49:56.161155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:56.233918 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:56.250011 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 40/80] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:49:56 2022] PUT /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/25d7e17ecc654a77b0a9059dfca46873/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:49:56.250011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:56.277272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e852-09aa-471a-843b-71093b59317b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.319390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.320155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.320338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.320607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] PATH_INFO: `/v3/users/25d7e17ecc654a77b0a9059dfca46873` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.321936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] RBAC: Authorizing `identity:get_user(user_id=25d7e17ecc654a77b0a9059dfca46873)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.323471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.325208 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 41/81] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:49:56 2022] GET /identity/v3/users/25d7e17ecc654a77b0a9059dfca46873 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:56.330941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:56.345610 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:56.379153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15461da-e534-424a-b211-4d0492a2094e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.438092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.438712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.438992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.439266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/aff16e16e402486ab43ace4b1e3cc4c1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.441196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] RBAC: Authorizing `identity:create_grant(project_id=270fb656c5914e96aa8f5710fe891b8e, user_id=aff16e16e402486ab43ace4b1e3cc4c1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.442685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.470509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68730d51-5aaf-4ad9-871c-152998fc9c36 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.506050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.506761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.506982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.507255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.508417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.509864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.511727 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 41/82] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:49:56 2022] PUT /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/aff16e16e402486ab43ace4b1e3cc4c1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:49:56.511846 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 42/83] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:49:56 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:56.512382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:56.519319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:56.609599 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:56.643792 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:56.680889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c1e55-f164-4d6b-86f6-6b024ead0819 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.685593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73dc8d-a52a-4eb2-a302-ffd6e7365ccf None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.734744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.735959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.736533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.738742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] PATH_INFO: `/v3/projects/9a42f189262249b08fdb2ccbb9c9807c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.740880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] RBAC: Authorizing `identity:get_project(project_id=9a42f189262249b08fdb2ccbb9c9807c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.743143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.744975 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 42/84] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:49:56 2022] GET /identity/v3/projects/9a42f189262249b08fdb2ccbb9c9807c => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:56.751650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:56.754348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca02d-2be2-4cb9-b0ac-50cf8e115bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.755022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca02d-2be2-4cb9-b0ac-50cf8e115bd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.755299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca02d-2be2-4cb9-b0ac-50cf8e115bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.755568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca02d-2be2-4cb9-b0ac-50cf8e115bd5 None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/25d7e17ecc654a77b0a9059dfca46873/roles/0fd4959143bd4b9e9db4ff088a6875fb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.758879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca02d-2be2-4cb9-b0ac-50cf8e115bd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=270fb656c5914e96aa8f5710fe891b8e, user_id=25d7e17ecc654a77b0a9059dfca46873, role_id=0fd4959143bd4b9e9db4ff088a6875fb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.760324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca02d-2be2-4cb9-b0ac-50cf8e115bd5 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:56.830579 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 43/85] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:49:56 2022] PUT /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/25d7e17ecc654a77b0a9059dfca46873/roles/0fd4959143bd4b9e9db4ff088a6875fb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:49:56.882123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bc087-9016-4177-aeae-061230b6b701 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:56.913139 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:56.926985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2a225-27e0-4afb-beef-ff7304cb9f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:56.927684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a225-27e0-4afb-beef-ff7304cb9f8b None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:56.928009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a225-27e0-4afb-beef-ff7304cb9f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:56.928287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2a225-27e0-4afb-beef-ff7304cb9f8b None admin] PATH_INFO: `/v3/projects/9a42f189262249b08fdb2ccbb9c9807c/users/25d7e17ecc654a77b0a9059dfca46873/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:56.935646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2a225-27e0-4afb-beef-ff7304cb9f8b None admin] RBAC: Authorizing `identity:create_grant(project_id=9a42f189262249b08fdb2ccbb9c9807c, user_id=25d7e17ecc654a77b0a9059dfca46873, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:56.937165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2a225-27e0-4afb-beef-ff7304cb9f8b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:57.020474 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 43/86] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:49:56 2022] PUT /identity/v3/projects/9a42f189262249b08fdb2ccbb9c9807c/users/25d7e17ecc654a77b0a9059dfca46873/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:49:58.971458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898ca9-499f-462a-a4b7-376711589e71 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:58.972448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898ca9-499f-462a-a4b7-376711589e71 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:58.972943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf898ca9-499f-462a-a4b7-376711589e71 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:58.974539 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 44/87] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:58.980124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ecff-85b4-4566-80e8-d788232e85ff None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:58.980975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ecff-85b4-4566-80e8-d788232e85ff None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:58.981450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619ecff-85b4-4566-80e8-d788232e85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:59.008326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e619ecff-85b4-4566-80e8-d788232e85ff None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:59.009911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e619ecff-85b4-4566-80e8-d788232e85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:59.106895 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 44/88] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:59.143743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7bc5-ccec-41c4-8327-b662b671784e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:59.144353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7bc5-ccec-41c4-8327-b662b671784e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:59.144825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7bc5-ccec-41c4-8327-b662b671784e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:59.146482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 45/89] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:59.151495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf2bd-39f7-48dc-aa36-3a0b6d2512d2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:59.151999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf2bd-39f7-48dc-aa36-3a0b6d2512d2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:59.152499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf2bd-39f7-48dc-aa36-3a0b6d2512d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:59.176421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-67abf2bd-39f7-48dc-aa36-3a0b6d2512d2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:59.177900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-67abf2bd-39f7-48dc-aa36-3a0b6d2512d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:59.255015 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 45/90] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:49:59.491195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7bc5-ccec-41c4-8327-b662b671784e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:59.612724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7bc5-ccec-41c4-8327-b662b671784e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:59.661350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:59.662009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:59.662298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:59.662570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:59.673001 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:59.678815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:49:59.683690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:49:59.684539 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:49:59.685267 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 46/91] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:49:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:49:59.693429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf2bd-39f7-48dc-aa36-3a0b6d2512d2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:59.791090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:59.801598 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:59.880931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf2bd-39f7-48dc-aa36-3a0b6d2512d2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:59.931612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538e37a-797b-4256-8a91-c7864b42345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:59.932246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538e37a-797b-4256-8a91-c7864b42345c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:59.932527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538e37a-797b-4256-8a91-c7864b42345c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:59.932798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538e37a-797b-4256-8a91-c7864b42345c None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:59.933474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538e37a-797b-4256-8a91-c7864b42345c None admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:49:59.933776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538e37a-797b-4256-8a91-c7864b42345c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:59.937171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538e37a-797b-4256-8a91-c7864b42345c None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:59.955918 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 46/92] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:49:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:49:59.957194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdb682-ca47-47d6-a1f8-97d25d4ec2b6 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:59.957482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdb682-ca47-47d6-a1f8-97d25d4ec2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:59.957756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdb682-ca47-47d6-a1f8-97d25d4ec2b6 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:59.968666 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 47/93] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:49:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:59.969594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdb682-ca47-47d6-a1f8-97d25d4ec2b6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:59.989271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e84d-1d62-4051-bac3-d2eb00170598 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:00.046641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a69038-bdf4-4a40-be2e-091eb80730e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:00.047453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69038-bdf4-4a40-be2e-091eb80730e4 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.047733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69038-bdf4-4a40-be2e-091eb80730e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.048003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69038-bdf4-4a40-be2e-091eb80730e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.060021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a69038-bdf4-4a40-be2e-091eb80730e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-70a69038-bdf4-4a40-be2e-091eb80730e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:00.065674 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:00.066518 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:00.067293 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 47/94] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:49:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:00.068395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b715-59c0-4762-867c-9ea5f259262d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.069594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b715-59c0-4762-867c-9ea5f259262d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.069594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b715-59c0-4762-867c-9ea5f259262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.088665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e003b715-59c0-4762-867c-9ea5f259262d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:00.089864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e003b715-59c0-4762-867c-9ea5f259262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:00.148842 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:00.163836 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 48/95] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:00.164523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003b715-59c0-4762-867c-9ea5f259262d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:00.182814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdb682-ca47-47d6-a1f8-97d25d4ec2b6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:00.202224 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:00.270592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3da5a8-3b3e-4d02-8736-4679555fd992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:00.271264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3da5a8-3b3e-4d02-8736-4679555fd992 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.271546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3da5a8-3b3e-4d02-8736-4679555fd992 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.271822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3da5a8-3b3e-4d02-8736-4679555fd992 None admin] PATH_INFO: `/v3/users/25d7e17ecc654a77b0a9059dfca46873` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.274670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3da5a8-3b3e-4d02-8736-4679555fd992 None admin] RBAC: Authorizing `identity:get_user(user_id=25d7e17ecc654a77b0a9059dfca46873)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:00.276129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3da5a8-3b3e-4d02-8736-4679555fd992 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:00.277737 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:49:59 2022] GET /identity/v3/users/25d7e17ecc654a77b0a9059dfca46873 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:00.278936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378479-5507-4ced-b63d-9135919d0fa5 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.279217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378479-5507-4ced-b63d-9135919d0fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.279495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378479-5507-4ced-b63d-9135919d0fa5 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.286491 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 49/97] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:00.287325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378479-5507-4ced-b63d-9135919d0fa5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:00.311908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003b715-59c0-4762-867c-9ea5f259262d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:00.349826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6222-6fe6-4df7-8a87-d3c96a0da318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:00.350518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6222-6fe6-4df7-8a87-d3c96a0da318 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.350801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6222-6fe6-4df7-8a87-d3c96a0da318 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.351175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6222-6fe6-4df7-8a87-d3c96a0da318 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.351902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa6222-6fe6-4df7-8a87-d3c96a0da318 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:00.352209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa6222-6fe6-4df7-8a87-d3c96a0da318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:00.353771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa6222-6fe6-4df7-8a87-d3c96a0da318 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:00.366293 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 49/98] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:00.367872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce7780-d424-45ee-806d-c67387e749a3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.368430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce7780-d424-45ee-806d-c67387e749a3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.368734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce7780-d424-45ee-806d-c67387e749a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.386042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fdce7780-d424-45ee-806d-c67387e749a3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:00.387221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fdce7780-d424-45ee-806d-c67387e749a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:00.401651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62378479-5507-4ced-b63d-9135919d0fa5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:00.437212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e293b-95a0-437f-a4c0-39f5df4cee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:00.437758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e293b-95a0-437f-a4c0-39f5df4cee97 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.438064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e293b-95a0-437f-a4c0-39f5df4cee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.438366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e293b-95a0-437f-a4c0-39f5df4cee97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.439204 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:00.459800 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 50/99] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:00.461040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20079613-1cbb-447c-adb2-636276b86f1b None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.461333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20079613-1cbb-447c-adb2-636276b86f1b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.461606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20079613-1cbb-447c-adb2-636276b86f1b None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.474295 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 51/100] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:00.474295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c28da-fa1a-403a-a011-e53ef2b3cf96 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.474295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c28da-fa1a-403a-a011-e53ef2b3cf96 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.474295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c28da-fa1a-403a-a011-e53ef2b3cf96 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.474295 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 52/101] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:00.474295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c28da-fa1a-403a-a011-e53ef2b3cf96 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:00.506476 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:00.533212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e293b-95a0-437f-a4c0-39f5df4cee97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:00.535555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e293b-95a0-437f-a4c0-39f5df4cee97 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:00.589515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c28da-fa1a-403a-a011-e53ef2b3cf96 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:00.626400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9b7b-9350-4b02-8823-58820cfa3f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:00.627062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9b7b-9350-4b02-8823-58820cfa3f84 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.627350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9b7b-9350-4b02-8823-58820cfa3f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.627628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9b7b-9350-4b02-8823-58820cfa3f84 None admin] PATH_INFO: `/v3/users/2f4a56b5eb67443b97a30d5fe6c7e3d9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.639629 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 50/102] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:00.641123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b82e-959a-4c9d-8fcb-506e79cbc02c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.641595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b82e-959a-4c9d-8fcb-506e79cbc02c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.642068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b82e-959a-4c9d-8fcb-506e79cbc02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.647246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9b7b-9350-4b02-8823-58820cfa3f84 None admin] RBAC: Authorizing `identity:get_user(user_id=2f4a56b5eb67443b97a30d5fe6c7e3d9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:00.648732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9b7b-9350-4b02-8823-58820cfa3f84 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:00.650649 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 53/103] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:00 2022] GET /identity/v3/users/2f4a56b5eb67443b97a30d5fe6c7e3d9 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:00.655087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6765f-1fad-46fe-9d18-bb93eb25b0b7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.655087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6765f-1fad-46fe-9d18-bb93eb25b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.655087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6765f-1fad-46fe-9d18-bb93eb25b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.660077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2446b82e-959a-4c9d-8fcb-506e79cbc02c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:00.661251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2446b82e-959a-4c9d-8fcb-506e79cbc02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:00.673620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cbe6765f-1fad-46fe-9d18-bb93eb25b0b7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:00.675953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cbe6765f-1fad-46fe-9d18-bb93eb25b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:00.712603 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:00.737170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 51/104] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:00.737170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b82e-959a-4c9d-8fcb-506e79cbc02c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:00.747444 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:00.758725 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 54/105] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:00.768396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6765f-1fad-46fe-9d18-bb93eb25b0b7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:00.857549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b82e-959a-4c9d-8fcb-506e79cbc02c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:00.894733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6765f-1fad-46fe-9d18-bb93eb25b0b7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:00.905803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:00.906616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.907009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.907341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.921219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:00.927538 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:00.928403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:00.929130 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:00.931681 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 52/106] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:50:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:00.932697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:00.941043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:00.941686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:00.941965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:00.942267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:00.943698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:00.945107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:00.946894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 55/107] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:00 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:00.952548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:00.991725 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.003604 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.037271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5218e9-b83f-4beb-b6c3-473c0567b5cf None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.059717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79504b6d-bc33-490e-93a3-6c1af908a8b1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.071455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.072085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.072369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.072652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.073772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.075256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.076890 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 53/108] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:00 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:01.082900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.094312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.094948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.095233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.095508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.106484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:01.111655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:01.112474 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:01.113223 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 56/109] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:01.113846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.182814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfef017-856e-4882-9336-2c3f78a33939 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.207687 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.213923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f68fb4-20d5-4e58-a36c-96058b09279d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.215382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.216063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.216379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.216661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.217327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:01.217631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.219036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.221612 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.227766 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 54/110] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:01.227766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.254047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.254658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.254942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.255219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.255943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] RBAC: Adding query filter params (role.id=287b5be651514a5785a2f6e2d58fa5bc, scope.project.id=270fb656c5914e96aa8f5710fe891b8e, user.id=25d7e17ecc654a77b0a9059dfca46873) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:01.256249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.257695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.263463 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 57/111] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/role_assignments?user.id=25d7e17ecc654a77b0a9059dfca46873&scope.project.id=270fb656c5914e96aa8f5710fe891b8e&role.id=287b5be651514a5785a2f6e2d58fa5bc => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:01.265155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.331764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406c93-65e0-4d78-b8cc-9b32ced33c04 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.367840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.368486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.368771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.369037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.370204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.371677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.374099 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 55/112] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:01.374099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.384897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815da63-0f28-4b69-ac5c-6d03df2cf47e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.422652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.423305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.423580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.423906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.436792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:01.441863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:01.443302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 58/113] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:01.444058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.454346 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.473072 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.501808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6565-85f4-47e9-a593-abe6b5c9735c None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.536400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.537063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.537343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.537620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/2f4a56b5eb67443b97a30d5fe6c7e3d9/roles/fb1c2990368d407fb560aebe91f46b29` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.539550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] RBAC: Authorizing `identity:create_grant(project_id=270fb656c5914e96aa8f5710fe891b8e, user_id=2f4a56b5eb67443b97a30d5fe6c7e3d9, role_id=fb1c2990368d407fb560aebe91f46b29)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.540999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.558875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad4e3-0385-47d1-b903-44f095e32048 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.591692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.592296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.592574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.592846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.593510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:01.593812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.595194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.603257 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 59/114] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:01.604144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.640125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 56/115] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:01 2022] PUT /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e/users/2f4a56b5eb67443b97a30d5fe6c7e3d9/roles/fb1c2990368d407fb560aebe91f46b29 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:01.640749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.697026 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.721322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed75206-699b-4e14-8c98-2686722929d9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.753877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892543-cb00-488b-9efd-a4c4dbd86718 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.762094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.762748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.763028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.763301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] PATH_INFO: `/v3/users/25d7e17ecc654a77b0a9059dfca46873` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.764505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] RBAC: Authorizing `identity:get_user(user_id=25d7e17ecc654a77b0a9059dfca46873)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.766030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.767940 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 60/116] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/users/25d7e17ecc654a77b0a9059dfca46873 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:01.768573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.787915 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:01.797520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.798182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.798486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.798762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.799956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.801775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.872503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a9e87-027d-4d90-aa78-1f537b7055b6 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:01.878854 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 57/117] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:50:01 2022] POST /identity/v3/projects => generated 302 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:01.879754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.920481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:01.921127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:01.921406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:01.921693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:01.922488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:01.923190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:01.925999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:01.937960 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 61/118] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:01.943151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:01.966465 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.024147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01def6f9-82b4-4147-9faa-0b2ad7a87ec0 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.064291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.066061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.066345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.066619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] PATH_INFO: `/v3/users/25d7e17ecc654a77b0a9059dfca46873` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.068087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] RBAC: Authorizing `identity:get_user(user_id=25d7e17ecc654a77b0a9059dfca46873)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.070207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.072732 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 58/119] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/users/25d7e17ecc654a77b0a9059dfca46873 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:02.073233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:02.073821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade901-bee7-4c32-8b12-a0565fd253ec None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.113929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.114946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.115448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.115920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.132888 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.195973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faca1f-acd1-4f9b-beb7-aeda7980b1fc None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.200104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.201781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.218863 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.230817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.231498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.231778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.232050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] PATH_INFO: `/v3/users/aff16e16e402486ab43ace4b1e3cc4c1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.233323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=aff16e16e402486ab43ace4b1e3cc4c1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.234813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.237196 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 59/120] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/users/aff16e16e402486ab43ace4b1e3cc4c1 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:02.238024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:02.334879 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 62/121] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:02.335829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:02.351055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312868-b5d6-4fb8-8bb0-67f3ed51f5d8 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.367033 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.387973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.388682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.389031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.389374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.458157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fba2b-234c-4571-bac9-5c3afab16e4c None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.476231 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.484204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.486181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.501506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.502997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.503375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.503851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.590807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.593024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.606370 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 60/122] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:02.607266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:02.624406 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.711343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90265-7258-4865-8ea5-d0242fd31a3b None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.730655 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 63/123] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:02.731730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:02.749878 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.751530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.752990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.753461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.753921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.755288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.757018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.759098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 61/124] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:02.762709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:02.857652 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:02.858663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf3f2-cddd-4fac-804d-b2e272785991 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.879160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dc049-aca3-4780-9660-3aecef5d319a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:02.906074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.906718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.906996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.907268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] PATH_INFO: `/v3/projects/9a42f189262249b08fdb2ccbb9c9807c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.909589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] RBAC: Authorizing `identity:get_project(project_id=9a42f189262249b08fdb2ccbb9c9807c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.912068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.914408 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 64/125] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/projects/9a42f189262249b08fdb2ccbb9c9807c => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:02.914983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:02.920546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:02.921456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:02.921940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:02.922432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:02.923774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:02.926364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:02.928336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 62/126] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:02.929337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:03.020797 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:03.038001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2c053-e5b4-4930-bc9f-9c9d3f2a6e4b None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:03.045092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970f32f-6d67-40a7-93da-733dab176530 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:03.081607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:03.082232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:03.082511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:03.082778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:03.083630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] RBAC: Adding query filter params (role.id=287b5be651514a5785a2f6e2d58fa5bc, scope.project.id=9a42f189262249b08fdb2ccbb9c9807c, user.id=25d7e17ecc654a77b0a9059dfca46873) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:03.083801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:03.085204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:03.092503 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 63/127] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/role_assignments?user.id=25d7e17ecc654a77b0a9059dfca46873&scope.project.id=9a42f189262249b08fdb2ccbb9c9807c&role.id=287b5be651514a5785a2f6e2d58fa5bc => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:03.093117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:03.093360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3302b-88ef-4cc8-a7fb-3f7e92d55ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:03.094608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3302b-88ef-4cc8-a7fb-3f7e92d55ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:03.095085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3302b-88ef-4cc8-a7fb-3f7e92d55ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:03.095560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3302b-88ef-4cc8-a7fb-3f7e92d55ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:03.097366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3302b-88ef-4cc8-a7fb-3f7e92d55ca8 None admin] RBAC: Adding query filter params (role.id=0fd4959143bd4b9e9db4ff088a6875fb, scope.project.id=270fb656c5914e96aa8f5710fe891b8e, user.id=25d7e17ecc654a77b0a9059dfca46873) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:03.098528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3302b-88ef-4cc8-a7fb-3f7e92d55ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:03.099896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3302b-88ef-4cc8-a7fb-3f7e92d55ca8 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:03.113306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 65/128] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:02 2022] GET /identity/v3/role_assignments?user.id=25d7e17ecc654a77b0a9059dfca46873&scope.project.id=270fb656c5914e96aa8f5710fe891b8e&role.id=0fd4959143bd4b9e9db4ff088a6875fb => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:03.123171 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:03.224465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e766-0185-4837-9dfc-d5e82e0bc3c7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:03.265061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33b03-d52b-43e2-9412-7ed6988f2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:03.265723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33b03-d52b-43e2-9412-7ed6988f2d24 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:03.267381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33b03-d52b-43e2-9412-7ed6988f2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:03.267381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33b03-d52b-43e2-9412-7ed6988f2d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:03.267381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33b03-d52b-43e2-9412-7ed6988f2d24 None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=270fb656c5914e96aa8f5710fe891b8e, user.id=aff16e16e402486ab43ace4b1e3cc4c1) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:03.267381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33b03-d52b-43e2-9412-7ed6988f2d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:03.268876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33b03-d52b-43e2-9412-7ed6988f2d24 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:03.276279 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 64/129] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:03 2022] GET /identity/v3/role_assignments?user.id=aff16e16e402486ab43ace4b1e3cc4c1&scope.project.id=270fb656c5914e96aa8f5710fe891b8e&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:03.886618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e7c31-d72f-4ca2-ad02-7eaa8d9df4f7 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:03.886908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e7c31-d72f-4ca2-ad02-7eaa8d9df4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:03.887182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e7c31-d72f-4ca2-ad02-7eaa8d9df4f7 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:03.888521 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 66/130] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:03.893574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43c2ef-4adb-4761-9a48-69146d9049e9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:03.893868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43c2ef-4adb-4761-9a48-69146d9049e9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:03.894176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43c2ef-4adb-4761-9a48-69146d9049e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:03.912435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cc43c2ef-4adb-4761-9a48-69146d9049e9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:03.913630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cc43c2ef-4adb-4761-9a48-69146d9049e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:03.978254 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 65/131] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:04.240915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e7c31-d72f-4ca2-ad02-7eaa8d9df4f7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:04.243119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e3069-cdf6-4df9-9dfb-ef8b9fcdc2d0 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.243413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e3069-cdf6-4df9-9dfb-ef8b9fcdc2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.243699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e3069-cdf6-4df9-9dfb-ef8b9fcdc2d0 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.245166 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 66/132] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:04.250141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febab9a-cace-407a-aa19-c1d03396a798 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.250429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febab9a-cace-407a-aa19-c1d03396a798 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.250707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febab9a-cace-407a-aa19-c1d03396a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.269425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2febab9a-cace-407a-aa19-c1d03396a798 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:04.270629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2febab9a-cace-407a-aa19-c1d03396a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:04.272531 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:04.336182 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 67/133] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:04.341244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e7c31-d72f-4ca2-ad02-7eaa8d9df4f7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:04.372926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:04.373553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.373834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.374134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.384243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:04.389415 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:04.390232 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:04.390984 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 67/134] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:04.396952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febab9a-cace-407a-aa19-c1d03396a798 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:04.492186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febab9a-cace-407a-aa19-c1d03396a798 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:04.525773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:04.526406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.526687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.526960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.527621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:04.527926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:04.529290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:04.534218 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:04.537779 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 68/135] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:04.543583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:04.547701 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:04.601070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:04.640529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae940e9-37fb-47a6-a25c-9ed26046c239 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:04.673120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:04.673812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.674128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.674405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] PATH_INFO: `/v3/users/2f4a56b5eb67443b97a30d5fe6c7e3d9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.675809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] RBAC: Authorizing `identity:get_user(user_id=2f4a56b5eb67443b97a30d5fe6c7e3d9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:04.677227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:04.678825 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 68/136] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:04 2022] GET /identity/v3/users/2f4a56b5eb67443b97a30d5fe6c7e3d9 => generated 289 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:04.684531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:04.699252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce493-0355-486b-9e79-858479d19532 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:04.733137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:04.733768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.734072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.734348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.735443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:04.737404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:04.738980 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 69/137] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:04.744314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:04.756702 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:04.785273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802760-7977-4b8a-be78-e4e0e5311150 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:04.807407 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:04.819243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:04.819858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.820135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.820405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.840534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b8ade-8183-4063-a420-2a7c59055961 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:04.872581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:04.873179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:04.873461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:04.873731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:04.874403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:04.875819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:04.886188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:04.887623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:04.952987 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:04.976373 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 70/138] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:04 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:50:04.982239 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 00:50:04.988813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:05.097993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057f7de-8e1c-40c0-a929-1cce60c9b339 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:05.123677 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:05.134266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616240-119a-41c3-b151-0cf52e165ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:05.134908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616240-119a-41c3-b151-0cf52e165ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:05.135190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616240-119a-41c3-b151-0cf52e165ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:05.141171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616240-119a-41c3-b151-0cf52e165ae5 None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:05.141171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c616240-119a-41c3-b151-0cf52e165ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:05.141171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c616240-119a-41c3-b151-0cf52e165ae5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:05.141171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 71/140] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:04 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:05.145751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:05.249630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87976b-60ae-4fef-a40d-3571c9c48a24 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:05.285547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7892b3-54dd-4c8a-b85f-e11af100168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:05.286202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7892b3-54dd-4c8a-b85f-e11af100168b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:05.286485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7892b3-54dd-4c8a-b85f-e11af100168b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:05.286767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7892b3-54dd-4c8a-b85f-e11af100168b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:05.287494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7892b3-54dd-4c8a-b85f-e11af100168b None admin] RBAC: Adding query filter params (role.id=fb1c2990368d407fb560aebe91f46b29, scope.project.id=270fb656c5914e96aa8f5710fe891b8e, user.id=2f4a56b5eb67443b97a30d5fe6c7e3d9) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:05.287805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7892b3-54dd-4c8a-b85f-e11af100168b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:05.289262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7892b3-54dd-4c8a-b85f-e11af100168b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:05.295332 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 70/141] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:05 2022] GET /identity/v3/role_assignments?user.id=2f4a56b5eb67443b97a30d5fe6c7e3d9&scope.project.id=270fb656c5914e96aa8f5710fe891b8e&role.id=fb1c2990368d407fb560aebe91f46b29 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:07.207521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82dff-39b1-4b41-a747-70316c1157e4 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.208061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82dff-39b1-4b41-a747-70316c1157e4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.208061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82dff-39b1-4b41-a747-70316c1157e4 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.209585 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 72/142] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:07.214737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf043-ba8b-4f1b-aad6-0df5f1d8ebf9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.215145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf043-ba8b-4f1b-aad6-0df5f1d8ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.215324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf043-ba8b-4f1b-aad6-0df5f1d8ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.233651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3fdcf043-ba8b-4f1b-aad6-0df5f1d8ebf9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:07.234908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3fdcf043-ba8b-4f1b-aad6-0df5f1d8ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:07.268186 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:07.308876 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:07.364233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a624-f76a-4014-99ce-475cf6e36b77 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.364513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a624-f76a-4014-99ce-475cf6e36b77 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.364880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1a624-f76a-4014-99ce-475cf6e36b77 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.366402 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 73/144] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:07.371301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755a7d-2e2f-4cbc-ab47-4a6877389a5a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.371586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755a7d-2e2f-4cbc-ab47-4a6877389a5a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.371853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7755a7d-2e2f-4cbc-ab47-4a6877389a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.390222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d7755a7d-2e2f-4cbc-ab47-4a6877389a5a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:07.391393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d7755a7d-2e2f-4cbc-ab47-4a6877389a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:07.435751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdef9-4c08-4a7b-8054-b5a963442ac5 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.436060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdef9-4c08-4a7b-8054-b5a963442ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.436303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdef9-4c08-4a7b-8054-b5a963442ac5 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.437790 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 74/145] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:07.443197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61fd6-583a-4729-b063-fdfaed7cd135 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.443481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61fd6-583a-4729-b063-fdfaed7cd135 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.443754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61fd6-583a-4729-b063-fdfaed7cd135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.459070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 72/146] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:07.462064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2bb61fd6-583a-4729-b063-fdfaed7cd135 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:07.463234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2bb61fd6-583a-4729-b063-fdfaed7cd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:07.534715 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 75/147] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:07.576420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7755a7d-2e2f-4cbc-ab47-4a6877389a5a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:07.668951 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:07.675650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7755a7d-2e2f-4cbc-ab47-4a6877389a5a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:07.709322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:07.710054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.710275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.710546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.720253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:07.726106 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:07.727084 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:07.727923 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 73/148] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:50:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:07.731093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61fd6-583a-4729-b063-fdfaed7cd135 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:07.734251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:07.834209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61fd6-583a-4729-b063-fdfaed7cd135 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:07.835457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345d332-f654-407d-915c-b7a09662a530 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:07.856389 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:07.867508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:07.867895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62365622-7a6f-45a0-a371-732526781467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:07.868126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.868399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.868507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365622-7a6f-45a0-a371-732526781467 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:07.868663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.868797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365622-7a6f-45a0-a371-732526781467 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:07.869135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365622-7a6f-45a0-a371-732526781467 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:07.869735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365622-7a6f-45a0-a371-732526781467 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:07.870074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365622-7a6f-45a0-a371-732526781467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:07.871452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365622-7a6f-45a0-a371-732526781467 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:07.879177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:07.879901 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 74/149] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:07.880677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62365622-7a6f-45a0-a371-732526781467 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:07.884310 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:07.885374 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 76/150] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:50:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:07.886169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:07.904611 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:07.982174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62365622-7a6f-45a0-a371-732526781467 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:07.984176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007371-4aa7-4f21-ae57-4886c20f7659 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.015919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.016547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.016775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.016875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.017075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.017422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.017697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.017964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] PATH_INFO: `/v3/users/42bf7b67499643459a050c503b37068d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.018196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.019639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.021182 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 75/151] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:08.021933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.030853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] RBAC: Authorizing `identity:get_user(user_id=42bf7b67499643459a050c503b37068d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.032302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.038182 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 77/152] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:07 2022] GET /identity/v3/users/42bf7b67499643459a050c503b37068d => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:08.038182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.075817 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:08.104557 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:08.119383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f425bb-95d7-4fb4-bf72-2a73c4475587 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.130951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20617cf7-c9db-4c14-b3e3-7af29ce167e9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.152193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.152799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.153077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.153346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.154031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:08.154335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.155691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.163770 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 76/153] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:08.164536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.164651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.165335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.165618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.165889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.166570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.168402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.259596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b59e3-c363-4ccd-97bd-ea2625d206b0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.267485 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 78/154] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:08 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:08.268290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.294132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.294782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.295062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.295333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.296528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.298036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.300804 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 77/155] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:08 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:08.306498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.326451 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:08.390900 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:08.397100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c63c8-4a35-467d-a7cc-4a4227e3e120 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.418768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483dc87-4547-4f43-9d5d-c512b2f15f9e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.434604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.435256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.435531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.435800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] PATH_INFO: `/v3/users/42bf7b67499643459a050c503b37068d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.436946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] RBAC: Authorizing `identity:get_user(user_id=42bf7b67499643459a050c503b37068d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.438484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.440065 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 79/156] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:08 2022] GET /identity/v3/users/42bf7b67499643459a050c503b37068d => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:08.445519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.471261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.472294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.473869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.473869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/42bf7b67499643459a050c503b37068d/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.475688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cf4097faf1480c8aedf8d8fd52df62, user_id=42bf7b67499643459a050c503b37068d, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.477793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.552636 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 78/157] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:08 2022] PUT /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/42bf7b67499643459a050c503b37068d/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:50:08.553211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0427a4-006f-42e2-83e9-96639cdaba69 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.596184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7b848-bb2b-486d-86ad-4f14b46b2f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.597073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b848-bb2b-486d-86ad-4f14b46b2f2a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.597512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b848-bb2b-486d-86ad-4f14b46b2f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.597917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b848-bb2b-486d-86ad-4f14b46b2f2a None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.599240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7b848-bb2b-486d-86ad-4f14b46b2f2a None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.600882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7b848-bb2b-486d-86ad-4f14b46b2f2a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.602755 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 80/158] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:08 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:08.608910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.700548 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:08.731579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c18a31-bf37-438a-9009-063068666cd7 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:08.766647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f496-8270-4121-a812-19c772f9bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:08.767916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f496-8270-4121-a812-19c772f9bddc None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.768415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f496-8270-4121-a812-19c772f9bddc None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.768748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f496-8270-4121-a812-19c772f9bddc None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/42bf7b67499643459a050c503b37068d/roles/0fd4959143bd4b9e9db4ff088a6875fb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.771600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f496-8270-4121-a812-19c772f9bddc None admin] RBAC: Authorizing `identity:create_grant(project_id=53cf4097faf1480c8aedf8d8fd52df62, user_id=42bf7b67499643459a050c503b37068d, role_id=0fd4959143bd4b9e9db4ff088a6875fb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:08.773051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f496-8270-4121-a812-19c772f9bddc None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:08.849486 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 79/159] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:08 2022] PUT /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/42bf7b67499643459a050c503b37068d/roles/0fd4959143bd4b9e9db4ff088a6875fb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:10.642562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480943d-82bd-4c73-8740-6551851737f2 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:10.643190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480943d-82bd-4c73-8740-6551851737f2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:10.643190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480943d-82bd-4c73-8740-6551851737f2 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:10.644326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45ed62-9f16-49ba-924f-4627b165fdbc None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:10.644712 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 81/160] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:10.645211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45ed62-9f16-49ba-924f-4627b165fdbc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:10.645847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45ed62-9f16-49ba-924f-4627b165fdbc None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:10.647479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 80/161] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:10.649678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41d1d-db83-4877-97b1-e12dcec858b0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:10.649957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41d1d-db83-4877-97b1-e12dcec858b0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:10.650245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41d1d-db83-4877-97b1-e12dcec858b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:10.653637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357afcea-96ce-40c8-86a4-5047fba41971 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:10.654182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357afcea-96ce-40c8-86a4-5047fba41971 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:10.654670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357afcea-96ce-40c8-86a4-5047fba41971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:10.669291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f9a41d1d-db83-4877-97b1-e12dcec858b0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:10.670498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f9a41d1d-db83-4877-97b1-e12dcec858b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:10.675587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-357afcea-96ce-40c8-86a4-5047fba41971 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:10.676974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-357afcea-96ce-40c8-86a4-5047fba41971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:10.697915 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:10.754070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 81/162] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:10.755574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c444b13-fb45-47ae-bb21-6086d63d2a56 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:10.755854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c444b13-fb45-47ae-bb21-6086d63d2a56 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:10.756120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c444b13-fb45-47ae-bb21-6086d63d2a56 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:10.757479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 82/163] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:10.759485 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 82/164] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:10.762395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c018-a28a-4774-bbdc-706a62544534 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:10.762682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c018-a28a-4774-bbdc-706a62544534 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:10.762951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c018-a28a-4774-bbdc-706a62544534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:10.788503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4892c018-a28a-4774-bbdc-706a62544534 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:10.789691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4892c018-a28a-4774-bbdc-706a62544534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:10.850784 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:10.858303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 83/165] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:10.995397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401caf7-c7e0-4f1f-a30f-b5c28be952bc None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:10.995759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401caf7-c7e0-4f1f-a30f-b5c28be952bc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:10.995935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401caf7-c7e0-4f1f-a30f-b5c28be952bc None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:10.997440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 83/166] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:11.002663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd54b6-7a9f-4d99-95eb-9036477e0109 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.002949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd54b6-7a9f-4d99-95eb-9036477e0109 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.003222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd54b6-7a9f-4d99-95eb-9036477e0109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.021476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-23dd54b6-7a9f-4d99-95eb-9036477e0109 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:11.022587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-23dd54b6-7a9f-4d99-95eb-9036477e0109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:11.032789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401caf7-c7e0-4f1f-a30f-b5c28be952bc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.099624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 84/167] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:11.100086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd54b6-7a9f-4d99-95eb-9036477e0109 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.153852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401caf7-c7e0-4f1f-a30f-b5c28be952bc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.191244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.191866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.192138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.192400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.202388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:11.205094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd54b6-7a9f-4d99-95eb-9036477e0109 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:11.207197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:11.208184 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:11.208978 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 84/168] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:11.209669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.235918 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.238646 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.245617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.246282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.246559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.246825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.247924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:11.249345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:11.250934 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 85/169] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:11.254628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.316651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253fed3-fc88-47ab-8bbf-25929f6e4b4f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.353134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.353754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.354051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.354323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.355574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9753c16-c8a4-4c90-b111-4575a88d7303 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.364865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:11.369781 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:11.370813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:11.371597 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 85/170] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:11.372260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.394435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.395203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.395791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.396060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.396721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:11.397022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:11.398403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:11.406787 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 86/171] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:11.407544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.453114 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.462362 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.471455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea64ad3-7240-4e1b-be3b-3fa75a55c015 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.504181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89751fe-11b4-4001-bba7-2f83528bf1d7 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.506665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.507274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.507601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.507874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.508516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:11.509937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:11.538142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.538799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.539074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.539343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.549365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:11.555622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:11.556635 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 87/172] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:11.558964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.616745 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 86/173] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:11 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:11.617558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.669634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcffa-a6f2-450d-b270-41a8deee62eb None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.689428 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.709515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.710190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.710465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.710727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.711449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:11.711734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:11.713113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:11.724081 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 88/174] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:11.724081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.736501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceff5c-18bf-4321-9b99-786dfe4a79f6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.775623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.776272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.776802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.776802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] PATH_INFO: `/v3/users/37f6e1e55d744991b235b38f4850a346` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.786620 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.795414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] RBAC: Authorizing `identity:get_user(user_id=37f6e1e55d744991b235b38f4850a346)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:11.796962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:11.798913 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 87/175] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/users/37f6e1e55d744991b235b38f4850a346 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:11.802753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.844185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73577-c524-41f7-9f96-6d3e462ee0dc None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.886449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.887394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.887875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.888376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.889219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:11.889519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:11.890980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:11.901275 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 89/176] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:11.901922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.917827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13ab49-858f-44e3-ae1f-032fc221dacc None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:11.958326 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.960467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:11.961236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.961513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.961782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] PATH_INFO: `/v3/users/42bf7b67499643459a050c503b37068d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.964782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] RBAC: Authorizing `identity:get_user(user_id=42bf7b67499643459a050c503b37068d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:11.966785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:11.968592 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 88/177] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/users/42bf7b67499643459a050c503b37068d => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:11.974725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:12.040276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c08b24-6716-4a47-832e-ae254ecea39b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.047810 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:12.077692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.078478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.078756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.079082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.081377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.083060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.089349 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 90/178] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:12.089349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:12.097205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd569ca-9c49-4958-89e6-9bddcbb97c5d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.140732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.141329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.141605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.141875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] PATH_INFO: `/v3/users/42bf7b67499643459a050c503b37068d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.144271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] RBAC: Authorizing `identity:get_user(user_id=42bf7b67499643459a050c503b37068d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.145920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.150026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 89/179] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/users/42bf7b67499643459a050c503b37068d => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:12.150026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:12.216535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37db58b-92d4-4510-8844-3f558b9e72cf None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.228326 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:12.257304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.258366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.258744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.259298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.269267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0297230-074d-49e0-a91e-9cc3f27f4b63 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.306749 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:12.312940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.313654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.314498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.314805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/37f6e1e55d744991b235b38f4850a346/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.317753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cf4097faf1480c8aedf8d8fd52df62, user_id=37f6e1e55d744991b235b38f4850a346, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.319152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.346886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.348713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.399941 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 90/180] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:12 2022] PUT /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/37f6e1e55d744991b235b38f4850a346/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:12.399941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:12.518834 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 91/181] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:12.525028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:12.537567 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:12.586567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332e19-ddaf-47d5-a5ab-4f74daeffff4 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.659019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3036e5c-979d-45c5-8da1-d01bd42005f6 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.662681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.663299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.663570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.663836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.697881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.698562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.698837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.699109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.700243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.701687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.703718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 92/182] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:12 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:12.709227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:12.731013 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:12.745734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.747907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.815258 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:12.865698 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 91/183] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:12.871334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:12.873637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf8edc-9199-4657-a5eb-ab336c7b0739 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.948351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.948935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.949217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.949490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.954048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=53cf4097faf1480c8aedf8d8fd52df62, user.id=42bf7b67499643459a050c503b37068d) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:12.954048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.954048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.959792 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 93/184] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:12 2022] GET /identity/v3/role_assignments?user.id=42bf7b67499643459a050c503b37068d&scope.project.id=53cf4097faf1480c8aedf8d8fd52df62&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:13.009861 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:13.020780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615c342-f30f-4e01-a00b-654ebdea0ee6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:13.062014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f0c97-7c53-4dda-b904-350f7e6f346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:13.062687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f0c97-7c53-4dda-b904-350f7e6f346c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:13.062964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f0c97-7c53-4dda-b904-350f7e6f346c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:13.063233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f0c97-7c53-4dda-b904-350f7e6f346c None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:13.064550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f0c97-7c53-4dda-b904-350f7e6f346c None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:13.066079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f0c97-7c53-4dda-b904-350f7e6f346c None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:13.067870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 92/185] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:12 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:13.073964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:13.217906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6c3a-3b79-4c92-b2f3-05ba760e11aa None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:13.257887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd0d47-219d-431c-9ab1-2ee767d7226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:13.258533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0d47-219d-431c-9ab1-2ee767d7226f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:13.258815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0d47-219d-431c-9ab1-2ee767d7226f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:13.259088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0d47-219d-431c-9ab1-2ee767d7226f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:13.259816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0d47-219d-431c-9ab1-2ee767d7226f None admin] RBAC: Adding query filter params (role.id=0fd4959143bd4b9e9db4ff088a6875fb, scope.project.id=53cf4097faf1480c8aedf8d8fd52df62, user.id=42bf7b67499643459a050c503b37068d) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:13.260124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0d47-219d-431c-9ab1-2ee767d7226f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:13.261551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0d47-219d-431c-9ab1-2ee767d7226f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:13.267595 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 94/186] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:13 2022] GET /identity/v3/role_assignments?user.id=42bf7b67499643459a050c503b37068d&scope.project.id=53cf4097faf1480c8aedf8d8fd52df62&role.id=0fd4959143bd4b9e9db4ff088a6875fb => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:14.092405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021b16-73e6-4bd3-aef3-8795fe405348 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.092919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021b16-73e6-4bd3-aef3-8795fe405348 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.093022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021b16-73e6-4bd3-aef3-8795fe405348 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.094469 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 93/187] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:14.099928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f098-8cbf-43af-91cc-4551eac93ac6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.100297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f098-8cbf-43af-91cc-4551eac93ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.100480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f098-8cbf-43af-91cc-4551eac93ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.107723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55df3c-28b3-481c-837b-af01a0cbe36c None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.108013 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:14.108219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55df3c-28b3-481c-837b-af01a0cbe36c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.108497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55df3c-28b3-481c-837b-af01a0cbe36c None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.109949 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 94/188] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:14.115237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d36dd-80bf-4ab1-b9c4-036c39f98aaa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.116939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d36dd-80bf-4ab1-b9c4-036c39f98aaa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.116939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d36dd-80bf-4ab1-b9c4-036c39f98aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.119838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d243f098-8cbf-43af-91cc-4551eac93ac6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:14.121024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d243f098-8cbf-43af-91cc-4551eac93ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:14.133847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-436d36dd-80bf-4ab1-b9c4-036c39f98aaa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:14.135042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-436d36dd-80bf-4ab1-b9c4-036c39f98aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:14.194012 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 95/189] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:14.212054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 95/190] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:14.458476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f098-8cbf-43af-91cc-4551eac93ac6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:14.476638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d36dd-80bf-4ab1-b9c4-036c39f98aaa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:14.570526 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:14.571675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f098-8cbf-43af-91cc-4551eac93ac6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:14.579898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d36dd-80bf-4ab1-b9c4-036c39f98aaa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:14.611174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:14.611816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.612095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.612366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.614341 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:14.614443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:14.615015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.615294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.615561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.616777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:14.618242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:14.619972 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 96/191] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:14.624462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:14.626990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:14.631894 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:14.632847 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:14.633623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:14.638532 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 96/192] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:14.639708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:14.728668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd184dea-c75a-4146-b564-6ae1bbdda87d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:14.750203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aaa60-4169-452a-8ce9-db78a292c7a5 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:14.766696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479a17d-1f43-4137-ba76-c33045c62bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:14.767379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479a17d-1f43-4137-ba76-c33045c62bbe None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.767652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479a17d-1f43-4137-ba76-c33045c62bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.767926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479a17d-1f43-4137-ba76-c33045c62bbe None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.768601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479a17d-1f43-4137-ba76-c33045c62bbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:14.770117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479a17d-1f43-4137-ba76-c33045c62bbe None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:14.789191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:14.792785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.792785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.792785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.792785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:14.792785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:14.792785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:14.801633 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 97/193] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:14.807128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:14.863208 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:14.887481 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 97/194] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:14 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:50:14.888822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d35a5-f5ab-40b3-9873-ede02fc73616 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.889100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d35a5-f5ab-40b3-9873-ede02fc73616 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.889373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d35a5-f5ab-40b3-9873-ede02fc73616 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.890685 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 98/195] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:14.904065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35954e4-f576-4614-b709-7a7b27f46982 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.904462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35954e4-f576-4614-b709-7a7b27f46982 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.904882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35954e4-f576-4614-b709-7a7b27f46982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.916158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12542c1d-734d-4453-9776-0ba8301f013a None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:14.925794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d35954e4-f576-4614-b709-7a7b27f46982 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:14.927168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d35954e4-f576-4614-b709-7a7b27f46982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:14.937586 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:14.955287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:14.955946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.956243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.956514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] PATH_INFO: `/v3/users/26b1b95cf9dd46fd886e62189a73c734` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.972730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] RBAC: Authorizing `identity:get_user(user_id=26b1b95cf9dd46fd886e62189a73c734)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:14.974763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:14.977102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 98/196] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:14 2022] GET /identity/v3/users/26b1b95cf9dd46fd886e62189a73c734 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:14.988443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:15.007733 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 99/197] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:15.092363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be990-93d1-40b8-bdf1-cf9c2e350672 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:15.107850 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:15.128127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373695-2986-435d-8632-589042f35e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:15.128757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373695-2986-435d-8632-589042f35e20 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:15.129032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373695-2986-435d-8632-589042f35e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:15.129301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373695-2986-435d-8632-589042f35e20 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:15.130450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373695-2986-435d-8632-589042f35e20 None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:15.131880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373695-2986-435d-8632-589042f35e20 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:15.133661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 99/198] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:14 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:15.139426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35954e4-f576-4614-b709-7a7b27f46982 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:15.249038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35954e4-f576-4614-b709-7a7b27f46982 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:15.279792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373695-2986-435d-8632-589042f35e20 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:15.285171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:15.285840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:15.286145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:15.286413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/26b1b95cf9dd46fd886e62189a73c734/roles/fb1c2990368d407fb560aebe91f46b29` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:15.288315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cf4097faf1480c8aedf8d8fd52df62, user_id=26b1b95cf9dd46fd886e62189a73c734, role_id=fb1c2990368d407fb560aebe91f46b29)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:15.289739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:15.369829 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 100/199] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:15 2022] PUT /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/users/26b1b95cf9dd46fd886e62189a73c734/roles/fb1c2990368d407fb560aebe91f46b29 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:15.393750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373695-2986-435d-8632-589042f35e20 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:15.435191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:15.436243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:15.436783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:15.437253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:15.450008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:15.456001 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:15.456930 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:15.457715 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:15.460568 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 100/200] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:15.466318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:15.490370 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:15.580965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acad7d4-c448-4d7a-870c-9d26d81fb376 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:15.617870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:15.618511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:15.618783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:15.619051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:15.619720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:15.620017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:15.621511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:15.630540 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 101/201] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:15.636350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:15.684860 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:15.742383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d6ce-c520-4594-ac57-47691a820888 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:15.778085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:15.778727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:15.779000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:15.779265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] PATH_INFO: `/v3/users/37f6e1e55d744991b235b38f4850a346` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:15.780400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] RBAC: Authorizing `identity:get_user(user_id=37f6e1e55d744991b235b38f4850a346)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:15.781847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:15.784323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 101/202] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:15 2022] GET /identity/v3/users/37f6e1e55d744991b235b38f4850a346 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:15.789928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:15.864255 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:15.900702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a67bc-0ffc-430c-9029-06d89b97103f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:15.942284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:15.942900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:15.943174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:15.943446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:16.020973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:16.022966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:16.089564 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:16.130015 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 102/203] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:16.132053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:16.238371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea490366-4f02-42c1-b8c9-c302e25e98d4 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:16.248870 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:16.271724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2c34d-7160-490d-8c75-537079a30878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:16.272362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c34d-7160-490d-8c75-537079a30878 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:16.272637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c34d-7160-490d-8c75-537079a30878 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:16.272908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2c34d-7160-490d-8c75-537079a30878 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:16.274083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2c34d-7160-490d-8c75-537079a30878 None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:16.275530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2c34d-7160-490d-8c75-537079a30878 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:16.277501 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 102/204] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:16 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:16.285226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:16.391643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae987-f09e-4160-a334-7ee32b65ddb5 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:16.431363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93324df8-8040-4605-a72d-85b5b4be98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:16.431968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93324df8-8040-4605-a72d-85b5b4be98b4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:16.432242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93324df8-8040-4605-a72d-85b5b4be98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:16.432510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93324df8-8040-4605-a72d-85b5b4be98b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:16.433231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93324df8-8040-4605-a72d-85b5b4be98b4 None admin] RBAC: Adding query filter params (role.id=287b5be651514a5785a2f6e2d58fa5bc, scope.project.id=53cf4097faf1480c8aedf8d8fd52df62, user.id=37f6e1e55d744991b235b38f4850a346) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:16.433532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93324df8-8040-4605-a72d-85b5b4be98b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:16.434976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93324df8-8040-4605-a72d-85b5b4be98b4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:16.441594 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 103/205] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:16 2022] GET /identity/v3/role_assignments?user.id=37f6e1e55d744991b235b38f4850a346&scope.project.id=53cf4097faf1480c8aedf8d8fd52df62&role.id=287b5be651514a5785a2f6e2d58fa5bc => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:17.249428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd40c-b097-476f-a1d4-a3e0afd48124 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.249995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd40c-b097-476f-a1d4-a3e0afd48124 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.249995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd40c-b097-476f-a1d4-a3e0afd48124 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.251407 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 103/206] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:17.256492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113b59-c31a-4df1-b152-26a231f61d0b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.256777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113b59-c31a-4df1-b152-26a231f61d0b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.257046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113b59-c31a-4df1-b152-26a231f61d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.275316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5f113b59-c31a-4df1-b152-26a231f61d0b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:17.276474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f113b59-c31a-4df1-b152-26a231f61d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:17.301163 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:17.334417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bf75a-6891-49c2-81d2-3f31fa246395 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.334707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bf75a-6891-49c2-81d2-3f31fa246395 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.334975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bf75a-6891-49c2-81d2-3f31fa246395 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.336439 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 104/207] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:17.341177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a1bf1-0e5b-40a1-aafe-c0a6d318732f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.341462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a1bf1-0e5b-40a1-aafe-c0a6d318732f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.341734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a1bf1-0e5b-40a1-aafe-c0a6d318732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.345671 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 104/208] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:17.360103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c00a1bf1-0e5b-40a1-aafe-c0a6d318732f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:17.361919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c00a1bf1-0e5b-40a1-aafe-c0a6d318732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:17.431268 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 105/209] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:17.595435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea2ebb-358a-4f5c-814d-ad129e960dde None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.595618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea2ebb-358a-4f5c-814d-ad129e960dde None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.595897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea2ebb-358a-4f5c-814d-ad129e960dde None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.597386 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 105/210] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:17.602335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93207b-2006-4b91-a3bb-c3c64d7e985c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.602626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93207b-2006-4b91-a3bb-c3c64d7e985c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.602897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93207b-2006-4b91-a3bb-c3c64d7e985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.613723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea2ebb-358a-4f5c-814d-ad129e960dde None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:17.621432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9a93207b-2006-4b91-a3bb-c3c64d7e985c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:17.622631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9a93207b-2006-4b91-a3bb-c3c64d7e985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:17.691289 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 106/211] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:17.699428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93207b-2006-4b91-a3bb-c3c64d7e985c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:17.721667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea2ebb-358a-4f5c-814d-ad129e960dde None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:17.741258 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:17.759969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:17.761445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.761871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.762309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.773898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:17.779340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:17.780400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:17.781546 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 106/212] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:17.786003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:17.807539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93207b-2006-4b91-a3bb-c3c64d7e985c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:17.808670 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:17.842684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:17.843382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.843680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.843953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.845633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:17.847095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:17.848838 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 107/213] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:17.854153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:17.890410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d6fd-b524-4714-9d3b-334259e200da None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:17.926740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:17.927349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.927626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.927897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.928560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:17.928863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:17.930380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:17.939350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 107/214] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:17.944929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:17.953619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9226b-aaac-44aa-a576-13a8762fca10 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:17.961879 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:17.989142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:17.989833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.990138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.990408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.991051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:17.992458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:18.024484 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:18.041996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16118e-9e7b-4d5a-988e-170c2bcd8fa7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:18.074020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:18.074648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:18.074931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:18.075202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] PATH_INFO: `/v3/users/929a70d5dd974359a079f6f1279935fe` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:18.087639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] RBAC: Authorizing `identity:get_user(user_id=929a70d5dd974359a079f6f1279935fe)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:18.089076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:18.090743 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 108/215] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:17 2022] GET /identity/v3/users/929a70d5dd974359a079f6f1279935fe => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:18.091500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:18.110090 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 108/216] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:17 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:18.110090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:18.209290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d6cb3-c3cf-41b3-a66c-b22d610a8af9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:18.232526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d9b5-e86d-4653-b8b2-a639ee3b8cc2 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:18.247221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:18.247823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:18.248098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:18.248363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:18.256804 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:18.260136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:18.265035 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:18.266017 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 109/217] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:18.273565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:18.276021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:18.276835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:18.277112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:18.278276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:18.279018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] RBAC: Adding query filter params (role.id=287b5be651514a5785a2f6e2d58fa5bc, user.id=929a70d5dd974359a079f6f1279935fe, scope.system=all) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:18.279328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:18.280759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:18.287819 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 109/218] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 23 00:50:18 2022] GET /identity/v3/role_assignments?user.id=929a70d5dd974359a079f6f1279935fe&scope.system=all&role.id=287b5be651514a5785a2f6e2d58fa5bc => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:18.395496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d577a6-59f5-41d8-bb1a-f1361ca27fca None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:18.435979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:18.436600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:18.436874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:18.437142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:18.437822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:18.438197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:18.439664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:18.448991 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 110/219] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:18.455630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:18.499604 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:18.580415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51874c98-f9b7-49ea-9fa7-641c235a30f6 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:18.616314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:18.616958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:18.617233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:18.617501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] PATH_INFO: `/v3/users/26b1b95cf9dd46fd886e62189a73c734` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:18.618662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] RBAC: Authorizing `identity:get_user(user_id=26b1b95cf9dd46fd886e62189a73c734)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:18.620116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:18.621689 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 110/220] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:18 2022] GET /identity/v3/users/26b1b95cf9dd46fd886e62189a73c734 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:18.627470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:18.692692 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:18.732180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286be84-1adf-4b7f-93da-fa943c18874c None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:18.768257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:18.768864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:18.769138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:18.769404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:18.840536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:18.842002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:18.955262 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:18.997627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 111/221] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:19.003136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:19.101575 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:19.108227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b49cfb-4b8d-44b3-b083-edabeea62462 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:19.143439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71b82e-5b69-4499-8141-5605d1f478a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:19.144158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b82e-5b69-4499-8141-5605d1f478a0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:19.144438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b82e-5b69-4499-8141-5605d1f478a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:19.144705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b82e-5b69-4499-8141-5605d1f478a0 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:19.145934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b82e-5b69-4499-8141-5605d1f478a0 None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:19.147514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b82e-5b69-4499-8141-5605d1f478a0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:19.154140 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 111/222] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:19 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:19.155668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:19.259247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4992c55-52ef-401f-98d3-bc331158c9cc None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:19.295441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d663fa-dbef-41ff-adf2-93426af89d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:19.296044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d663fa-dbef-41ff-adf2-93426af89d43 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:19.296317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d663fa-dbef-41ff-adf2-93426af89d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:19.296588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d663fa-dbef-41ff-adf2-93426af89d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:19.297305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d663fa-dbef-41ff-adf2-93426af89d43 None admin] RBAC: Adding query filter params (role.id=fb1c2990368d407fb560aebe91f46b29, scope.project.id=53cf4097faf1480c8aedf8d8fd52df62, user.id=26b1b95cf9dd46fd886e62189a73c734) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:19.297607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d663fa-dbef-41ff-adf2-93426af89d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:19.299088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d663fa-dbef-41ff-adf2-93426af89d43 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:19.305720 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 112/223] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:19 2022] GET /identity/v3/role_assignments?user.id=26b1b95cf9dd46fd886e62189a73c734&scope.project.id=53cf4097faf1480c8aedf8d8fd52df62&role.id=fb1c2990368d407fb560aebe91f46b29 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:20.414199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9d43-9086-441f-b7c9-4569e26afffb None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.414727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9d43-9086-441f-b7c9-4569e26afffb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.414727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9d43-9086-441f-b7c9-4569e26afffb None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.416121 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 112/224] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:20.421235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee626-ef5d-469a-806b-d57cdc31b6b1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.421606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee626-ef5d-469a-806b-d57cdc31b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.421773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee626-ef5d-469a-806b-d57cdc31b6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.440635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ee1ee626-ef5d-469a-806b-d57cdc31b6b1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:20.441798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee1ee626-ef5d-469a-806b-d57cdc31b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:20.463169 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:20.468373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e6c8-9b99-4e39-95fa-14fc2ca8cce6 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.468907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e6c8-9b99-4e39-95fa-14fc2ca8cce6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.469089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e6c8-9b99-4e39-95fa-14fc2ca8cce6 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.471309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 113/225] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:20.478790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbab983-4334-412b-a806-d37fb6e1aefb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.479155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbab983-4334-412b-a806-d37fb6e1aefb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.479319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbab983-4334-412b-a806-d37fb6e1aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.499639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-efbab983-4334-412b-a806-d37fb6e1aefb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:20.500867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-efbab983-4334-412b-a806-d37fb6e1aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:20.517457 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 113/226] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:20.574130 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 114/227] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:20.598750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc157-390f-47b4-b064-5915ea2de27e None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.599037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc157-390f-47b4-b064-5915ea2de27e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.599311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cc157-390f-47b4-b064-5915ea2de27e None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.600769 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 114/228] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:20.605784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713eed-7b77-4148-8d49-7c9cea7070f8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.606162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713eed-7b77-4148-8d49-7c9cea7070f8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.606504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713eed-7b77-4148-8d49-7c9cea7070f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.624493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-48713eed-7b77-4148-8d49-7c9cea7070f8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:20.625645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-48713eed-7b77-4148-8d49-7c9cea7070f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:20.691454 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 115/229] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:20.787596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc157-390f-47b4-b064-5915ea2de27e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:20.840622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48713eed-7b77-4148-8d49-7c9cea7070f8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:20.866294 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:20.895468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cc157-390f-47b4-b064-5915ea2de27e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:20.934535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:20.935166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.935443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.935716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.946060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:20.947077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48713eed-7b77-4148-8d49-7c9cea7070f8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:20.950833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:20.951697 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:20.952465 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 115/230] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:20.957405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:20.976805 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:20.987281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:20.987921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.988194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.988462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.998164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:21.003012 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:21.003852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 116/231] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:21.004810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:21.057329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca547c2c-6401-4033-9bc1-1f60e29bcda7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.083727 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:21.089078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.089701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.089992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.096816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.096816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.096816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.096816 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 116/232] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:21.096816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:21.101996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0733-e505-4923-9fda-faba469972a5 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.135667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.136286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.136540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.136815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.137465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:21.137757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.139137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.146929 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 117/233] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:21.147691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:21.182789 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:21.198388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4087b-3ca8-41f6-b0b4-73cb1181fa95 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.231786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.232387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.232662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.232929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.233579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:21.233876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.235311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.243295 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 117/234] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:21.243896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:21.251604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d7f06-8f83-4514-bca4-a67db9f09ffa None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.284820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.285419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.285692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.285957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.286590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.287998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.341322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9729-c4f2-485d-aa2f-3f93184bc4b3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.355879 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 118/235] 10.222.0.42 () {60 vars in 1134 bytes} [Sun Oct 23 00:50:21 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:21.356835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:21.360255 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:21.387670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.388327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.388606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.388882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] PATH_INFO: `/v3/users/8024239a06704fd894504937d497b2c8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.404309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] RBAC: Authorizing `identity:get_user(user_id=8024239a06704fd894504937d497b2c8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.405771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.408449 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 118/236] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:21 2022] GET /identity/v3/users/8024239a06704fd894504937d497b2c8 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:21.414266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:21.419894 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:21.475423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f362a8-077c-4845-8cbf-177eb08b3815 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.514224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.514879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.515155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.515422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] PATH_INFO: `/v3/users/929a70d5dd974359a079f6f1279935fe` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.517168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] RBAC: Authorizing `identity:get_user(user_id=929a70d5dd974359a079f6f1279935fe)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.518678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.520319 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 119/237] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:21 2022] GET /identity/v3/users/929a70d5dd974359a079f6f1279935fe => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:21.525822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:21.538312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabdfa1-67c9-4d0e-9caf-a324bcc1568f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.576197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a57e6-5231-4ca6-b958-6b9654fce0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.577227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a57e6-5231-4ca6-b958-6b9654fce0fb None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.577559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a57e6-5231-4ca6-b958-6b9654fce0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.577836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a57e6-5231-4ca6-b958-6b9654fce0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.578902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a57e6-5231-4ca6-b958-6b9654fce0fb None admin] RBAC: Adding query filter params (role.id=fb1c2990368d407fb560aebe91f46b29, user.id=8024239a06704fd894504937d497b2c8, scope.system=all) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:21.579517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a57e6-5231-4ca6-b958-6b9654fce0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.581111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a57e6-5231-4ca6-b958-6b9654fce0fb None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.594009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 119/238] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 23 00:50:21 2022] GET /identity/v3/role_assignments?user.id=8024239a06704fd894504937d497b2c8&scope.system=all&role.id=fb1c2990368d407fb560aebe91f46b29 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:21.608650 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:21.640833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81889b6-80f8-4fcf-9a9a-3e49d5b918a1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.679670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc347c2-505b-4b81-b164-fdec34534b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.680340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc347c2-505b-4b81-b164-fdec34534b9c None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.680617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc347c2-505b-4b81-b164-fdec34534b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.680890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc347c2-505b-4b81-b164-fdec34534b9c None admin] PATH_INFO: `/v3/system/users/929a70d5dd974359a079f6f1279935fe/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.682443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc347c2-505b-4b81-b164-fdec34534b9c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=929a70d5dd974359a079f6f1279935fe, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.683847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc347c2-505b-4b81-b164-fdec34534b9c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.734382 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 120/239] 10.222.0.42 () {58 vars in 1334 bytes} [Sun Oct 23 00:50:21 2022] PUT /identity/v3/system/users/929a70d5dd974359a079f6f1279935fe/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:50:23.539488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d0f5-5cb1-4e87-854e-d12a68137d1d None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.540008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d0f5-5cb1-4e87-854e-d12a68137d1d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.540008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d0f5-5cb1-4e87-854e-d12a68137d1d None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.541380 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 120/240] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:23.546680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952106b1-6250-4026-bacb-afc6dcbd4a22 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.547406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952106b1-6250-4026-bacb-afc6dcbd4a22 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.547883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952106b1-6250-4026-bacb-afc6dcbd4a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.566223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-952106b1-6250-4026-bacb-afc6dcbd4a22 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:23.567401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-952106b1-6250-4026-bacb-afc6dcbd4a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:23.639365 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 121/241] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:23.705620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f227-4ee7-4353-811e-050a7752e406 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.705895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f227-4ee7-4353-811e-050a7752e406 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.706347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f227-4ee7-4353-811e-050a7752e406 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.707826 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 121/242] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:23.713099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b4d9a-39a2-4cc4-bb54-9eee7fe6e4d5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.713386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b4d9a-39a2-4cc4-bb54-9eee7fe6e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.713657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b4d9a-39a2-4cc4-bb54-9eee7fe6e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.732221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-817b4d9a-39a2-4cc4-bb54-9eee7fe6e4d5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:23.733377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-817b4d9a-39a2-4cc4-bb54-9eee7fe6e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:23.797794 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:23.806018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 122/243] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:23.876852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fed6b-feb3-4ce8-a7ad-c6c28b373196 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.877133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fed6b-feb3-4ce8-a7ad-c6c28b373196 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.877577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fed6b-feb3-4ce8-a7ad-c6c28b373196 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.878963 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 122/244] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:23.884230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c712-9c30-491d-b1d1-3cc7ee5895b4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.884526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c712-9c30-491d-b1d1-3cc7ee5895b4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.886497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c712-9c30-491d-b1d1-3cc7ee5895b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.906710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fed6b-feb3-4ce8-a7ad-c6c28b373196 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:23.930144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d531c712-9c30-491d-b1d1-3cc7ee5895b4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:23.931360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d531c712-9c30-491d-b1d1-3cc7ee5895b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:23.978833 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.004954 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 123/245] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:24.013161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fed6b-feb3-4ce8-a7ad-c6c28b373196 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.046917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.047547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.047902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.048122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.049211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.050937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.054024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 123/246] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:24.058087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c712-9c30-491d-b1d1-3cc7ee5895b4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.072352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.165573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c712-9c30-491d-b1d1-3cc7ee5895b4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.173859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f017-8368-4155-98e2-9fb786143b38 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.194714 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.203913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.205174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.207054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.207054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.207054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.208204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.211022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.211654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.211934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.212251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.215164 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.222977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:24.227884 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:24.228881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:24.229668 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 124/247] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:24.234717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.299466 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 124/248] 10.222.0.42 () {60 vars in 1134 bytes} [Sun Oct 23 00:50:24 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:24.300334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.345697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8a775-2052-4a13-8d97-cd52d50161ed None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.384444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.385349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.385772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.386267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.387689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:24.388185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.390226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.402352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 125/249] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:24.407736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.418110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac449cc4-0e51-4669-b755-47995cfaab70 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.457163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.458114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.458540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.458985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.474100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:24.475519 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:24.479451 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:24.481337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:24.482509 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 125/250] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:24.488330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.525490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b84b83-42d9-4e02-83b2-ab1e5b5a64e4 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.551398 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.568301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.568950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.569742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.569742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] PATH_INFO: `/v3/users/8024239a06704fd894504937d497b2c8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.570721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] RBAC: Authorizing `identity:get_user(user_id=8024239a06704fd894504937d497b2c8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.572172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.573760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 126/251] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/users/8024239a06704fd894504937d497b2c8 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:24.579792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.624693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f01e7-cfa0-4eb2-8d4d-1ef0e7c99115 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.676467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.677379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.677868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.678336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.680467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:24.681226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.682834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.696406 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 126/252] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:24.702571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.705089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266387aa-5c84-4563-93d4-f4f76613f57d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.738582 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.754096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.754773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.755056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.755334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] PATH_INFO: `/v3/system/users/8024239a06704fd894504937d497b2c8/roles/fb1c2990368d407fb560aebe91f46b29` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.756998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8024239a06704fd894504937d497b2c8, role_id=fb1c2990368d407fb560aebe91f46b29)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.758621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.818060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcae3e-13fc-41c9-846d-c14b3da7eca2 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.827755 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.830643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 127/253] 10.222.0.42 () {58 vars in 1334 bytes} [Sun Oct 23 00:50:24 2022] PUT /identity/v3/system/users/8024239a06704fd894504937d497b2c8/roles/fb1c2990368d407fb560aebe91f46b29 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:24.856864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3559d2-a1f4-4881-bd2d-9c13092cc2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.857515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3559d2-a1f4-4881-bd2d-9c13092cc2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.857795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3559d2-a1f4-4881-bd2d-9c13092cc2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.858089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3559d2-a1f4-4881-bd2d-9c13092cc2b0 None admin] PATH_INFO: `/v3/users/929a70d5dd974359a079f6f1279935fe` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.859255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3559d2-a1f4-4881-bd2d-9c13092cc2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=929a70d5dd974359a079f6f1279935fe)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.861294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3559d2-a1f4-4881-bd2d-9c13092cc2b0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.863252 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 127/254] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/users/929a70d5dd974359a079f6f1279935fe => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:24.869402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.993707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa3403-1032-46f3-a3db-86b95cc02f32 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:25.037616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f6e3a-e6b0-4250-a306-3a9799b395ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:25.039306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6e3a-e6b0-4250-a306-3a9799b395ca None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:25.039306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6e3a-e6b0-4250-a306-3a9799b395ca None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:25.039306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6e3a-e6b0-4250-a306-3a9799b395ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:25.039551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6e3a-e6b0-4250-a306-3a9799b395ca None admin] RBAC: Adding query filter params (role.id=287b5be651514a5785a2f6e2d58fa5bc, user.id=929a70d5dd974359a079f6f1279935fe, scope.system=all) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:25.039831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6e3a-e6b0-4250-a306-3a9799b395ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:25.041281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6e3a-e6b0-4250-a306-3a9799b395ca None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:25.056231 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 128/255] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/role_assignments?user.id=929a70d5dd974359a079f6f1279935fe&scope.system=all&role.id=287b5be651514a5785a2f6e2d58fa5bc => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:26.643642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c3fe-bcf0-441b-84bc-4181bd530b63 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:26.644137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c3fe-bcf0-441b-84bc-4181bd530b63 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:26.644210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c3fe-bcf0-441b-84bc-4181bd530b63 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:26.645761 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 128/256] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:26.651355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff557b-6255-460c-b6e0-d6aaaa4d6b46 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:26.651785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff557b-6255-460c-b6e0-d6aaaa4d6b46 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:26.651984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff557b-6255-460c-b6e0-d6aaaa4d6b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:26.673326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4fff557b-6255-460c-b6e0-d6aaaa4d6b46 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:26.674526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4fff557b-6255-460c-b6e0-d6aaaa4d6b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:26.735920 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:26.751776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 129/257] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 23 00:50:26.938892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d675-1b9b-4f8a-805a-a7a4af6a5e90 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:26.939221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d675-1b9b-4f8a-805a-a7a4af6a5e90 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:26.939441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d675-1b9b-4f8a-805a-a7a4af6a5e90 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:26.940784 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 129/258] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:26.963979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576cb2b-4ed1-440b-96ca-d7251ed15509 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:26.964274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576cb2b-4ed1-440b-96ca-d7251ed15509 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:26.964535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576cb2b-4ed1-440b-96ca-d7251ed15509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:26.994987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6576cb2b-4ed1-440b-96ca-d7251ed15509 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:26.996198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6576cb2b-4ed1-440b-96ca-d7251ed15509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:27.004489 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 130/259] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:50:27.097716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d675-1b9b-4f8a-805a-a7a4af6a5e90 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.111462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d675-1b9b-4f8a-805a-a7a4af6a5e90 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.115881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.116515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.116797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.117072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.129346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:27.134340 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:27.135220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:27.135992 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 130/260] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:27.141436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576cb2b-4ed1-440b-96ca-d7251ed15509 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.151360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576cb2b-4ed1-440b-96ca-d7251ed15509 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.155943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.156551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.157355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.157627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.158332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:27.158632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.160413 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:50:27.160413 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 00:50:27.160413 n-d-master-1 devstack@keystone.service[81936]: Oct 23 00:50:27.161308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.173621 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 131/261] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:27.177469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.187794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c1a20-b753-4fc5-9caa-e8105ee99cc7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.194254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.194897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.195177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.195450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.202543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.204875 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:50:27.204875 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 00:50:27.204875 n-d-master-1 devstack@keystone.service[81937]: Oct 23 00:50:27.206186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.207908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 131/262] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:27.213427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.224679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d949-7058-4807-be73-cc18e1389de2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.229587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.230366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.230649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.230918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.232072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.234281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.236048 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 132/263] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:27.249922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.262085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05ead-523c-4d79-9cf5-9e6e98c4f673 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.269986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf5e85-3836-4548-886c-232a6a61f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.270722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5e85-3836-4548-886c-232a6a61f24d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.271003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5e85-3836-4548-886c-232a6a61f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.271272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5e85-3836-4548-886c-232a6a61f24d admin admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e/groups/57d7e196675d48f983fa91965db81d20/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.273597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5e85-3836-4548-886c-232a6a61f24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=270fb656c5914e96aa8f5710fe891b8e, group_id=57d7e196675d48f983fa91965db81d20, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.274757 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-abaf5e85-3836-4548-886c-232a6a61f24d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:50:27.274757 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 00:50:27.274757 n-d-master-1 devstack@keystone.service[81937]: Oct 23 00:50:27.276773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5e85-3836-4548-886c-232a6a61f24d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.385537 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 132/264] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 23 00:50:27 2022] PUT /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e/groups/57d7e196675d48f983fa91965db81d20/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:27.450294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.463849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736507f4-e7d7-4adb-b36f-57d1afa7ed79 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.549136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.549714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.550388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.550705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.554775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5a8c-a01f-4501-afe9-7e2c6e4459a9 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.555055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5a8c-a01f-4501-afe9-7e2c6e4459a9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.555617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5a8c-a01f-4501-afe9-7e2c6e4459a9 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.556666 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 133/265] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:27.562247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212c6b0-30b9-4492-8487-cbab723b2931 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.562523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212c6b0-30b9-4492-8487-cbab723b2931 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.562768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212c6b0-30b9-4492-8487-cbab723b2931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.565714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:27.571422 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:27.573939 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:27.575922 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 133/266] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:27.580819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.594043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b43b-16e2-429d-a8dc-d042c7b1addb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.598983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7212c6b0-30b9-4492-8487-cbab723b2931 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:27.599223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.599669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.599990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.600241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7212c6b0-30b9-4492-8487-cbab723b2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:27.600395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.601058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:27.601401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.603521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.618109 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 134/267] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:27.624413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.638198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ff98-956e-469f-856e-24c16926f570 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.647283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.650581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.650907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.651250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.653397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.654484 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:50:27.654484 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 00:50:27.654484 n-d-master-1 devstack@keystone.service[81936]: Oct 23 00:50:27.658624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.671705 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 135/268] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:27.707734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.721788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc9ff2-d917-4fa4-9726-f66c9c3e2375 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.733573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.735508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.735832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.736175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.740532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.745550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.751679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 136/269] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 23 00:50:27 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:27.755614 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 134/270] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:27.758744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:27.771156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e221e-f801-4210-8a4a-772950d5c814 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:27.776229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:27.777333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.777657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.778001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e/groups/57d7e196675d48f983fa91965db81d20/roles/0fd4959143bd4b9e9db4ff088a6875fb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.780458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] RBAC: Authorizing `identity:create_grant(project_id=270fb656c5914e96aa8f5710fe891b8e, group_id=57d7e196675d48f983fa91965db81d20, role_id=0fd4959143bd4b9e9db4ff088a6875fb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:27.781539 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:50:27.781539 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 00:50:27.781539 n-d-master-1 devstack@keystone.service[81936]: Oct 23 00:50:27.783728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:27.849163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d74361-5f9f-4b3b-9a4e-f73743371c4c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.849454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d74361-5f9f-4b3b-9a4e-f73743371c4c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.849863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d74361-5f9f-4b3b-9a4e-f73743371c4c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.851308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 135/271] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:27.856702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8269c-e2dd-4869-bc5e-57c81a2cefe0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:27.856981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8269c-e2dd-4869-bc5e-57c81a2cefe0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:27.857464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8269c-e2dd-4869-bc5e-57c81a2cefe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:27.866831 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 137/272] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 23 00:50:27 2022] PUT /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e/groups/57d7e196675d48f983fa91965db81d20/roles/0fd4959143bd4b9e9db4ff088a6875fb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:27.880781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-aae8269c-e2dd-4869-bc5e-57c81a2cefe0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:27.882385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aae8269c-e2dd-4869-bc5e-57c81a2cefe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:27.960558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 136/273] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:50:28.123485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.225528 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:28.242607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b415f65-c0fd-4389-801b-403c3b74678c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.279110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.279746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.280016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.280281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.295238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:28.300435 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:28.301340 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:50:28.302143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:28.303196 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 138/274] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:28.309046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8269c-e2dd-4869-bc5e-57c81a2cefe0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.347183 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:28.466534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8269c-e2dd-4869-bc5e-57c81a2cefe0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.522726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.523703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.524197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.524696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.525610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:28.526144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:28.527713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:28.541706 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 137/275] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:28.547047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.573038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.585938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3f27f-af17-4e1c-80f7-c63fb7578cfa None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.591386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.592337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.592815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.593329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.616114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:28.627887 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:28.628800 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:28.629609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:28.633226 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 138/276] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:28.647607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.658845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88909f3a-326a-4f61-bf73-3be2b0d3e0d1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.668899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.671695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.672243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.672761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.675441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] RBAC: Adding query filter params (name=member) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:28.676995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:28.678260 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:50:28.678260 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 00:50:28.678260 n-d-master-1 devstack@keystone.service[81937]: Oct 23 00:50:28.680463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:28.702249 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 139/277] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:28.708353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.723367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfd575-d7a8-4854-b4a3-725b721977ea admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.733701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.734724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.737316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.737790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.740257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:28.743504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:28.749409 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 140/278] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:28.754163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e2b40-bb26-4718-9b6e-2a0a145fed12 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.755602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.774326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5bc23-6e4f-43b2-9a76-5a4619dca84d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.783745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.786852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.787342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.787859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.791430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:28.796536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:28.802083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 141/279] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:28.807727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.824259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f8b7f-2599-4619-a48f-d4d4cfcb3a51 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.831734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.832681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.834055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.834852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] PATH_INFO: `/v3/users/8024239a06704fd894504937d497b2c8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.836646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bfc53-de61-47cd-becb-d8b7e3b5a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.837478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] RBAC: Authorizing `identity:get_user(user_id=8024239a06704fd894504937d497b2c8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:28.838448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bfc53-de61-47cd-becb-d8b7e3b5a8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.839478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bfc53-de61-47cd-becb-d8b7e3b5a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.839961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bfc53-de61-47cd-becb-d8b7e3b5a8c7 admin admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/groups/57d7e196675d48f983fa91965db81d20/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.841957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:28.844803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bfc53-de61-47cd-becb-d8b7e3b5a8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cf4097faf1480c8aedf8d8fd52df62, group_id=57d7e196675d48f983fa91965db81d20, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:28.847024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 139/280] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/users/8024239a06704fd894504937d497b2c8 => generated 293 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:28.848799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bfc53-de61-47cd-becb-d8b7e3b5a8c7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:28.852362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:28.870700 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:28.959234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab386fa2-aea6-46a5-8f15-40afa8310387 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:28.995742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aae6bf-2255-48a0-bb5d-a34d75ac2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:28.996723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae6bf-2255-48a0-bb5d-a34d75ac2671 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:28.997200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae6bf-2255-48a0-bb5d-a34d75ac2671 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:28.997706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae6bf-2255-48a0-bb5d-a34d75ac2671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:28.998659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aae6bf-2255-48a0-bb5d-a34d75ac2671 None admin] RBAC: Adding query filter params (role.id=fb1c2990368d407fb560aebe91f46b29, user.id=8024239a06704fd894504937d497b2c8, scope.system=all) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:28.999204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aae6bf-2255-48a0-bb5d-a34d75ac2671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:29.001493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aae6bf-2255-48a0-bb5d-a34d75ac2671 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:29.014662 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 140/281] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 23 00:50:28 2022] GET /identity/v3/role_assignments?user.id=8024239a06704fd894504937d497b2c8&scope.system=all&role.id=fb1c2990368d407fb560aebe91f46b29 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:29.060241 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 142/282] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 23 00:50:28 2022] PUT /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/groups/57d7e196675d48f983fa91965db81d20/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:50:29.470069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede82b3-eb63-4d86-b35b-ab9daf28c38d None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:29.470726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede82b3-eb63-4d86-b35b-ab9daf28c38d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:29.471209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede82b3-eb63-4d86-b35b-ab9daf28c38d None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:29.472776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 141/283] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:29.478313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99783-8d9d-4bf7-a293-18ec00faebc8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:29.478848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99783-8d9d-4bf7-a293-18ec00faebc8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:29.479318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99783-8d9d-4bf7-a293-18ec00faebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:29.502331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-62d99783-8d9d-4bf7-a293-18ec00faebc8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:29.503900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62d99783-8d9d-4bf7-a293-18ec00faebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:29.555252 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:29.581566 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 143/284] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:50:29.818902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1cda8-314e-46c2-9362-76e6ee74e84c None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:29.819407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1cda8-314e-46c2-9362-76e6ee74e84c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:29.819524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1cda8-314e-46c2-9362-76e6ee74e84c None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:29.820997 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 142/285] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:29.826346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bfba9-dbfb-49f4-bfb5-9ea520178387 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:29.826750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bfba9-dbfb-49f4-bfb5-9ea520178387 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:29.826919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bfba9-dbfb-49f4-bfb5-9ea520178387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:29.850259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-004bfba9-dbfb-49f4-bfb5-9ea520178387 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:29.851498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-004bfba9-dbfb-49f4-bfb5-9ea520178387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:29.864280 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 144/286] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:50:29.910994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1cda8-314e-46c2-9362-76e6ee74e84c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:29.923539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1cda8-314e-46c2-9362-76e6ee74e84c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:29.928216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:29.928856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:29.929134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:29.929402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:29.940942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:29.947348 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:29.948205 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:29.948985 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 143/287] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 23 00:50:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:29.954873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bfba9-dbfb-49f4-bfb5-9ea520178387 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:29.964772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bfba9-dbfb-49f4-bfb5-9ea520178387 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:29.969190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:29.969795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:29.970095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:29.970368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:29.971042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:29.971338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:29.973036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:29.982076 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 145/288] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 23 00:50:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:29.987639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:29.997802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b2151-6109-4f98-b35c-ee0b4b6fc811 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.002960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.003637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.003911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.004181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.005329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:30.007337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:30.008935 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 144/289] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 23 00:50:29 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:30.014418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:30.025352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671d594-9367-4b94-b647-43363999aca1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.029947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.030611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.030935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.031209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.032409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:30.034656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:30.036798 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 146/290] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 23 00:50:30 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:30.042579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:30.053248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35738543-a667-4372-8a33-f75bb7eb2425 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.057868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.058598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.058873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.059194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/groups/57d7e196675d48f983fa91965db81d20/roles/0fd4959143bd4b9e9db4ff088a6875fb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.061403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cf4097faf1480c8aedf8d8fd52df62, group_id=57d7e196675d48f983fa91965db81d20, role_id=0fd4959143bd4b9e9db4ff088a6875fb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:30.064761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:30.142726 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 145/291] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 23 00:50:30 2022] PUT /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62/groups/57d7e196675d48f983fa91965db81d20/roles/0fd4959143bd4b9e9db4ff088a6875fb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:30.234479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:30.247200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6335b-4cd0-42c5-8a38-6b9d51629073 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.323361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.324004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.324284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.324558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.340431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:30.345331 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:30.346266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:30.347047 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 147/292] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:30.352378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:30.363315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba028-ecab-410e-9a26-05bff680dc38 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.372238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.372871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.373145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.373413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.374118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:30.374419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:30.376605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:30.385779 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 146/293] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 23 00:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:30.392809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:30.405864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534c8e7-468a-49d1-a729-626e003ea19b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.410389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.411088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.411365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.411633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] PATH_INFO: `/v3/groups/7da45b1bd9ba4e6eb6f9490149c86766` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.422102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] RBAC: Authorizing `identity:get_group(group_id=7da45b1bd9ba4e6eb6f9490149c86766)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:30.424599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:30.426760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 148/294] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 23 00:50:30 2022] GET /identity/v3/groups/7da45b1bd9ba4e6eb6f9490149c86766 => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:30.432356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:30.442968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc575-dd37-4d4f-aa67-b755f39159b8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.451703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4178e7-762d-4346-84a6-a7faf7fb07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.452352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4178e7-762d-4346-84a6-a7faf7fb07e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.452627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4178e7-762d-4346-84a6-a7faf7fb07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.452899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4178e7-762d-4346-84a6-a7faf7fb07e1 admin admin] PATH_INFO: `/v3/projects/598c49694334495883fc0f61f918bb99` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.454103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4178e7-762d-4346-84a6-a7faf7fb07e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=598c49694334495883fc0f61f918bb99)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:30.455880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4178e7-762d-4346-84a6-a7faf7fb07e1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:30.457796 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 147/295] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 23 00:50:30 2022] GET /identity/v3/projects/598c49694334495883fc0f61f918bb99 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:30.463507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:30.474224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c7ea-cf3e-42e9-84d6-63a1f06e3dbf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:30.487725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953954a-7995-42df-991b-d38eb46b4089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:30.488749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953954a-7995-42df-991b-d38eb46b4089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.489276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953954a-7995-42df-991b-d38eb46b4089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.489746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953954a-7995-42df-991b-d38eb46b4089 admin admin] PATH_INFO: `/v3/projects/598c49694334495883fc0f61f918bb99/groups/7da45b1bd9ba4e6eb6f9490149c86766/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.492239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953954a-7995-42df-991b-d38eb46b4089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598c49694334495883fc0f61f918bb99, group_id=7da45b1bd9ba4e6eb6f9490149c86766, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:30.495331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953954a-7995-42df-991b-d38eb46b4089 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:30.580913 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 149/296] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 23 00:50:30 2022] PUT /identity/v3/projects/598c49694334495883fc0f61f918bb99/groups/7da45b1bd9ba4e6eb6f9490149c86766/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:30.681025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebfab-585c-4c18-9f53-50d1006906cb None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.681319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebfab-585c-4c18-9f53-50d1006906cb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.681485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebfab-585c-4c18-9f53-50d1006906cb None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.683266 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 148/297] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:30.689299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253c93c-c80a-40f1-a9df-5d73e304ac5a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:30.690022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253c93c-c80a-40f1-a9df-5d73e304ac5a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:30.690503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253c93c-c80a-40f1-a9df-5d73e304ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:30.713583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3253c93c-c80a-40f1-a9df-5d73e304ac5a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:30.715213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3253c93c-c80a-40f1-a9df-5d73e304ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:30.813174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:31.124485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebfab-585c-4c18-9f53-50d1006906cb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:31.162021 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:31.246734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe35d9-13e4-47d8-92f7-be98f8c9d92e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:31.247681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe35d9-13e4-47d8-92f7-be98f8c9d92e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:31.248155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe35d9-13e4-47d8-92f7-be98f8c9d92e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:31.249736 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 151/299] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:31.255185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc890-2649-42d9-b0c3-ea4ab0749aea None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:31.255471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc890-2649-42d9-b0c3-ea4ab0749aea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:31.255746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc890-2649-42d9-b0c3-ea4ab0749aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:31.271473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebfab-585c-4c18-9f53-50d1006906cb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:31.297011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-138bc890-2649-42d9-b0c3-ea4ab0749aea None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:31.298809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-138bc890-2649-42d9-b0c3-ea4ab0749aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:31.323140 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:31.341555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:31.342324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:31.342607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:31.347149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:31.361823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:31.369156 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:31.370085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:31.370861 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 149/300] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:31.378352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:31.450294 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 152/301] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:31.534109 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:31.551704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27110b9e-f21c-4ea8-a2a9-85f573777f74 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:31.601088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:31.601700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:31.601997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:31.602277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:31.602948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:31.603244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:31.604603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:31.613868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 150/302] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:31.619245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc890-2649-42d9-b0c3-ea4ab0749aea None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:31.760092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc890-2649-42d9-b0c3-ea4ab0749aea None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:31.801372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:31.803715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:31.804351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:31.804624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:31.804904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:31.825795 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:31.878239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:31.879822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:31.982232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da54660-a1ac-4a22-b1e6-158847193d6c None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:31.986244 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 153/303] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:31.991381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:32.053843 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:32.093060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:32.093718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.094524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.094802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.098560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa862e-7604-40d9-9beb-f07253c03b30 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:32.123015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:32.128479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:32.129962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:32.130789 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 151/304] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:50:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:32.138411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:32.139067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.139351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.139626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.140765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:32.142265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:32.148483 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 154/305] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:31 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:32.150904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:32.151014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:32.173114 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:32.261665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96bb42-d7f4-4ac6-bc4a-089fb3cd659f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:32.284412 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:32.297739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:32.298407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.298685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.301047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.301047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:32.301047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:32.301646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:32.311975 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 155/306] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:32.321905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:32.365014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ca2f-517d-484f-a764-46646d37aab5 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:32.404832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a759-7acd-466d-8490-a981968692e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:32.406434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a759-7acd-466d-8490-a981968692e8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.406434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a759-7acd-466d-8490-a981968692e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.406434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a759-7acd-466d-8490-a981968692e8 None admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.408720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a759-7acd-466d-8490-a981968692e8 None admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:32.410320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a759-7acd-466d-8490-a981968692e8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:32.418257 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 152/307] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 23 00:50:32 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:32.419536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb36e3-618a-4a0e-9e69-ff4ba8ca141c None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.419923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb36e3-618a-4a0e-9e69-ff4ba8ca141c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.420298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb36e3-618a-4a0e-9e69-ff4ba8ca141c None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.422003 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 153/308] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:32.423028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb36e3-618a-4a0e-9e69-ff4ba8ca141c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:32.466851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2b35-78f2-4e19-b257-803154ac383d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:32.512966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:32.513718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.514004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.514273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.539279 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:32.566639 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:32.568975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb36e3-618a-4a0e-9e69-ff4ba8ca141c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:32.598805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:32.600253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:32.615925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce2d1-9f4c-40c0-a528-ccce5ec1579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:32.616538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce2d1-9f4c-40c0-a528-ccce5ec1579a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.617073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce2d1-9f4c-40c0-a528-ccce5ec1579a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.617396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce2d1-9f4c-40c0-a528-ccce5ec1579a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.618297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce2d1-9f4c-40c0-a528-ccce5ec1579a None admin] RBAC: Adding query filter params (group.id=57d7e196675d48f983fa91965db81d20, role.id=287b5be651514a5785a2f6e2d58fa5bc, scope.project.id=270fb656c5914e96aa8f5710fe891b8e) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:32.618607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce2d1-9f4c-40c0-a528-ccce5ec1579a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:32.620297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce2d1-9f4c-40c0-a528-ccce5ec1579a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:32.630074 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 154/309] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 23 00:50:32 2022] GET /identity/v3/role_assignments?group.id=57d7e196675d48f983fa91965db81d20&scope.project.id=270fb656c5914e96aa8f5710fe891b8e&role.id=287b5be651514a5785a2f6e2d58fa5bc => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:32.631386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02528487-e6b7-4573-a5a0-e2734088e057 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.631665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02528487-e6b7-4573-a5a0-e2734088e057 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.631933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02528487-e6b7-4573-a5a0-e2734088e057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.659938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-02528487-e6b7-4573-a5a0-e2734088e057 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:32.661282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-02528487-e6b7-4573-a5a0-e2734088e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:32.746133 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 155/310] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:32.793188 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 156/311] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 00:50:32.799527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02528487-e6b7-4573-a5a0-e2734088e057 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:32.904301 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:32.934349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02528487-e6b7-4573-a5a0-e2734088e057 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:32.975854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:32.976498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:32.976770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:32.977032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] PATH_INFO: `/v3/projects/270fb656c5914e96aa8f5710fe891b8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:32.978340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] RBAC: Authorizing `identity:get_project(project_id=270fb656c5914e96aa8f5710fe891b8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:32.979763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:32.981421 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 156/312] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:32 2022] GET /identity/v3/projects/270fb656c5914e96aa8f5710fe891b8e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:32.987076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:33.074448 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:33.103073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5727-0a17-4e43-8072-e393f5fbb8fb None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:33.131958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:33.142943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:33.143594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.143870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.144148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.145277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:33.147352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:33.149170 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 157/313] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 23 00:50:32 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:33.156008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:33.267406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6585ce-4d30-4047-858c-d319a209c66d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:33.282455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3094dbc-d3bc-4db1-b007-b7e156632001 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:33.310907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56b272-b521-4b1b-ac52-bb2530d5de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:33.311548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b272-b521-4b1b-ac52-bb2530d5de04 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.311825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b272-b521-4b1b-ac52-bb2530d5de04 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.312097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b272-b521-4b1b-ac52-bb2530d5de04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.325463 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:33.329477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56b272-b521-4b1b-ac52-bb2530d5de04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ea56b272-b521-4b1b-ac52-bb2530d5de04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:33.334646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:33.335521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:33.336279 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 157/314] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:33.337497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdba5b-958a-4d21-9355-10cc7e438bd8 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.337738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdba5b-958a-4d21-9355-10cc7e438bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.338132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdba5b-958a-4d21-9355-10cc7e438bd8 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.338929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c542bf-aab6-4634-b06b-5ffe3ef5ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:33.339298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 158/315] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:33.345227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c542bf-aab6-4634-b06b-5ffe3ef5ab45 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.345227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c542bf-aab6-4634-b06b-5ffe3ef5ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.345227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c542bf-aab6-4634-b06b-5ffe3ef5ab45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.345227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c542bf-aab6-4634-b06b-5ffe3ef5ab45 None admin] RBAC: Adding query filter params (group.id=57d7e196675d48f983fa91965db81d20, role.id=0fd4959143bd4b9e9db4ff088a6875fb, scope.project.id=270fb656c5914e96aa8f5710fe891b8e) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:33.345227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c542bf-aab6-4634-b06b-5ffe3ef5ab45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:33.345227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c542bf-aab6-4634-b06b-5ffe3ef5ab45 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:33.345626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdba5b-958a-4d21-9355-10cc7e438bd8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:33.354025 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 158/316] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 23 00:50:33 2022] GET /identity/v3/role_assignments?group.id=57d7e196675d48f983fa91965db81d20&scope.project.id=270fb656c5914e96aa8f5710fe891b8e&role.id=0fd4959143bd4b9e9db4ff088a6875fb => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:33.355258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998273b1-2a8d-402e-8e43-7404e8204fb2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.355542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998273b1-2a8d-402e-8e43-7404e8204fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.355811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998273b1-2a8d-402e-8e43-7404e8204fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.375750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-998273b1-2a8d-402e-8e43-7404e8204fb2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:33.376977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-998273b1-2a8d-402e-8e43-7404e8204fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:33.386006 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:33.495769 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 159/317] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:33.508918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdba5b-958a-4d21-9355-10cc7e438bd8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:33.549100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52232f87-0d5d-4fb8-a21e-d260b2967934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:33.550391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52232f87-0d5d-4fb8-a21e-d260b2967934 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.550899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52232f87-0d5d-4fb8-a21e-d260b2967934 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.551389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52232f87-0d5d-4fb8-a21e-d260b2967934 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.552267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52232f87-0d5d-4fb8-a21e-d260b2967934 None admin] RBAC: Adding query filter params (name=member) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:33.552769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52232f87-0d5d-4fb8-a21e-d260b2967934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:33.554407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52232f87-0d5d-4fb8-a21e-d260b2967934 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:33.565026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 159/318] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:50:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:33.570999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998273b1-2a8d-402e-8e43-7404e8204fb2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:33.591675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1a4c-53d2-4816-88e2-dfbcff70be8d None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.592237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1a4c-53d2-4816-88e2-dfbcff70be8d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.592510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1a4c-53d2-4816-88e2-dfbcff70be8d None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.594047 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 160/319] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:33.599037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e390c9a-2e75-468a-811f-2a15e164346e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.599321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e390c9a-2e75-468a-811f-2a15e164346e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.599591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e390c9a-2e75-468a-811f-2a15e164346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.621308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2e390c9a-2e75-468a-811f-2a15e164346e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:33.623344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e390c9a-2e75-468a-811f-2a15e164346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:33.698277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998273b1-2a8d-402e-8e43-7404e8204fb2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:33.711656 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:33.724249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 161/320] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:33.744659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:33.745200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.745469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.745733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.755516 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:33.802802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e390c9a-2e75-468a-811f-2a15e164346e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:33.823517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:33.825456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:33.927427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e390c9a-2e75-468a-811f-2a15e164346e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:33.959116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 160/321] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:33.964728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:33.972613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:33.973253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:33.973531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:33.973800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:33.985291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:33.990274 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:33.991147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:33.991989 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 162/322] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:50:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:33.992647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.019644 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.058438 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.088667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291c182-fce2-4887-8d99-71a8b6b5b803 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.111153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7bb15-4bc3-4382-9e47-2ba2c3b29f3c None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.130410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.131051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.131328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.131599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.133586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.135034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.136812 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 161/323] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:33 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:34.141767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.158588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.159227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.159504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.159774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.173515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:34.178681 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:34.179568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 163/324] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:34.180545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.262863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa6718-1b18-4dae-a81d-78d676df5d72 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.271522 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.293429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442cdbf-8881-4b78-a22a-9e01a994a80d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.306721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.307342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.307623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.307895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.309391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:34.309498 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.309574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.310719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.320646 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 162/325] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:34.321022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.333341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.334002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.334287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.334579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.337378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.339016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.340750 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 164/326] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:34.341443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.448987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6d4f-f51d-4709-b66b-b723490077eb None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.459996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1dc24-5acd-47a5-bb6e-4433bf4c86d6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.490202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.490831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.491111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.491449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.492123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:34.492426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.493808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.502459 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 163/327] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:34.503286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.509275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.510190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.510467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.510737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.541551 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.570208 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.595754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.596243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.622671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981fc38-ed0d-49a2-af70-ec6bd395cab5 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.666712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.667327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.667610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.667884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.668599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] RBAC: Adding query filter params (group.id=57d7e196675d48f983fa91965db81d20, role.id=287b5be651514a5785a2f6e2d58fa5bc, scope.project.id=53cf4097faf1480c8aedf8d8fd52df62) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:34.668913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.670395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.677089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 164/328] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/role_assignments?group.id=57d7e196675d48f983fa91965db81d20&scope.project.id=53cf4097faf1480c8aedf8d8fd52df62&role.id=287b5be651514a5785a2f6e2d58fa5bc => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:34.677911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.714542 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 165/329] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:34.716195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.780456 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.788753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5837b-b02e-4578-9c9b-084913e03ec2 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.805410 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.826714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536f90-1d25-44f7-8f53-493cea6d7d49 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:34.829775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.830441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.830721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.830993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.864390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:34.865023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:34.865474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:34.865763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] PATH_INFO: `/v3/projects/53cf4097faf1480c8aedf8d8fd52df62` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:34.867995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] RBAC: Authorizing `identity:get_project(project_id=53cf4097faf1480c8aedf8d8fd52df62)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.873349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.873349 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 166/330] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/projects/53cf4097faf1480c8aedf8d8fd52df62 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:34.877365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:34.912238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:34.913675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:34.995557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ede4-58ae-47e4-9a5a-c5dc342a787d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:35.021099 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:35.028500 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 165/331] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:35.034787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:35.042841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:35.043489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:35.043764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:35.044037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] PATH_INFO: `/v3/groups/57d7e196675d48f983fa91965db81d20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:35.046398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] RBAC: Authorizing `identity:get_group(group_id=57d7e196675d48f983fa91965db81d20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:35.049301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:35.050305 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 167/332] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 23 00:50:34 2022] GET /identity/v3/groups/57d7e196675d48f983fa91965db81d20 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:35.055788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:35.077658 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:35.144360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcab31-2fc4-4b0d-9b8b-6c14df8b0832 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:35.158835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084f55-f50c-486b-bce7-61c7ca1c2602 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:35.177494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:35.178178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:35.178456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:35.178723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] PATH_INFO: `/v3/projects/598c49694334495883fc0f61f918bb99` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:35.179838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] RBAC: Authorizing `identity:get_project(project_id=598c49694334495883fc0f61f918bb99)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:35.181263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:35.182909 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 166/333] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:50:35 2022] GET /identity/v3/projects/598c49694334495883fc0f61f918bb99 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:35.188776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:35.191897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:35.192505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:35.192785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:35.193053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:35.193775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] RBAC: Adding query filter params (group.id=57d7e196675d48f983fa91965db81d20, role.id=0fd4959143bd4b9e9db4ff088a6875fb, scope.project.id=53cf4097faf1480c8aedf8d8fd52df62) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:35.194111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:35.195521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:35.201134 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 168/334] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 23 00:50:35 2022] GET /identity/v3/role_assignments?group.id=57d7e196675d48f983fa91965db81d20&scope.project.id=53cf4097faf1480c8aedf8d8fd52df62&role.id=0fd4959143bd4b9e9db4ff088a6875fb => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:35.251165 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:35.291576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3da86-c989-4c2a-94a6-0932d7c57a27 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:35.326737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7ca71-3bae-4d2f-8400-5dd1cf89c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:35.327395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ca71-3bae-4d2f-8400-5dd1cf89c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:35.327559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ca71-3bae-4d2f-8400-5dd1cf89c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:35.327828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7ca71-3bae-4d2f-8400-5dd1cf89c0b9 None admin] PATH_INFO: `/v3/groups/7da45b1bd9ba4e6eb6f9490149c86766` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:35.329555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7ca71-3bae-4d2f-8400-5dd1cf89c0b9 None admin] RBAC: Authorizing `identity:get_group(group_id=7da45b1bd9ba4e6eb6f9490149c86766)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:35.331015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7ca71-3bae-4d2f-8400-5dd1cf89c0b9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:35.332608 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 167/335] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 23 00:50:35 2022] GET /identity/v3/groups/7da45b1bd9ba4e6eb6f9490149c86766 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:35.338699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:35.421220 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:35.440624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e5691-caef-4e51-a5b5-5af16b9b4d9e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:35.474781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6665bbf-c2ef-447f-bda2-c556109b84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:35.475391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665bbf-c2ef-447f-bda2-c556109b84d8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:35.475667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665bbf-c2ef-447f-bda2-c556109b84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:35.475933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665bbf-c2ef-447f-bda2-c556109b84d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:35.476654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6665bbf-c2ef-447f-bda2-c556109b84d8 None admin] RBAC: Adding query filter params (group.id=7da45b1bd9ba4e6eb6f9490149c86766, role.id=084c71d449aa4c209afa646584a16293, scope.project.id=598c49694334495883fc0f61f918bb99) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:35.476956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6665bbf-c2ef-447f-bda2-c556109b84d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:35.478446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6665bbf-c2ef-447f-bda2-c556109b84d8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:35.485053 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 169/336] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 23 00:50:35 2022] GET /identity/v3/role_assignments?group.id=7da45b1bd9ba4e6eb6f9490149c86766&scope.project.id=598c49694334495883fc0f61f918bb99&role.id=084c71d449aa4c209afa646584a16293 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:38.003368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0841-4c17-4dee-8cd7-0e4d4bbc33f0 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.004395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0841-4c17-4dee-8cd7-0e4d4bbc33f0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.004881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0841-4c17-4dee-8cd7-0e4d4bbc33f0 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.006458 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 168/337] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:38.012059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98622-ad17-437d-a34f-bbcb859b0341 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.012458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98622-ad17-437d-a34f-bbcb859b0341 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.012589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98622-ad17-437d-a34f-bbcb859b0341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.037155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8da98622-ad17-437d-a34f-bbcb859b0341 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:38.038577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8da98622-ad17-437d-a34f-bbcb859b0341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:38.123574 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 170/338] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:38.238154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3fcbb-1197-4d70-bc92-3a0440ede4d9 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.238831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3fcbb-1197-4d70-bc92-3a0440ede4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.239307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3fcbb-1197-4d70-bc92-3a0440ede4d9 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.241210 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 169/339] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:38.247334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492fd39-095b-4068-a526-07d31c5abd65 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.247893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492fd39-095b-4068-a526-07d31c5abd65 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.248366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492fd39-095b-4068-a526-07d31c5abd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.275789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d492fd39-095b-4068-a526-07d31c5abd65 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:38.277231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d492fd39-095b-4068-a526-07d31c5abd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:38.360396 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 171/340] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:38.456357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3fcbb-1197-4d70-bc92-3a0440ede4d9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:38.606078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3fcbb-1197-4d70-bc92-3a0440ede4d9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:38.644359 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:38.655211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339f311-9d49-48c5-b59c-72d4f7811039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:38.655871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f311-9d49-48c5-b59c-72d4f7811039 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.656208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f311-9d49-48c5-b59c-72d4f7811039 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.666061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f311-9d49-48c5-b59c-72d4f7811039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.667902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339f311-9d49-48c5-b59c-72d4f7811039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:38.669360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339f311-9d49-48c5-b59c-72d4f7811039 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-a339f311-9d49-48c5-b59c-72d4f7811039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:38.685520 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:38.686748 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:38.687820 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:38.687820 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:38.687820 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:38.687820 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 170/341] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:38.693049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492fd39-095b-4068-a526-07d31c5abd65 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:38.710398 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:38.740877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7846b9a-32d7-4ef5-b8e9-1fda45bc4891 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.741155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7846b9a-32d7-4ef5-b8e9-1fda45bc4891 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.741587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7846b9a-32d7-4ef5-b8e9-1fda45bc4891 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.743729 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 171/342] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:38.749831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4c15-b468-4dc6-bab7-cf2fa3bd9b53 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.750981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4c15-b468-4dc6-bab7-cf2fa3bd9b53 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.751552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb4c15-b468-4dc6-bab7-cf2fa3bd9b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.784288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bdcb4c15-b468-4dc6-bab7-cf2fa3bd9b53 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:38.785734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bdcb4c15-b468-4dc6-bab7-cf2fa3bd9b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:38.843701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492fd39-095b-4068-a526-07d31c5abd65 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:38.862737 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 172/343] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:38.869741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb4c15-b468-4dc6-bab7-cf2fa3bd9b53 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:38.907096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:38.907713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:38.907987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:38.908261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:38.908911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:38.909213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:38.910606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:38.944410 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 172/344] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:38.950023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.027377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb4c15-b468-4dc6-bab7-cf2fa3bd9b53 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.040858 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:39.042877 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:39.063102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb1d86-1963-4df6-b37b-cc3701b6d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.063728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb1d86-1963-4df6-b37b-cc3701b6d577 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.064159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb1d86-1963-4df6-b37b-cc3701b6d577 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.064568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb1d86-1963-4df6-b37b-cc3701b6d577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.074577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb1d86-1963-4df6-b37b-cc3701b6d577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.076200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb1d86-1963-4df6-b37b-cc3701b6d577 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.090199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a07bf8-b69b-46f6-a13e-ba246ac53e1e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-cdbb1d86-1963-4df6-b37b-cc3701b6d577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:39.091688 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:39.092580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:39.093441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:39.093441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:39.093441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:39.093441 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 173/345] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:39.094509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dfc48-1729-4a1e-8f4b-6c07e7768761 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.094946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dfc48-1729-4a1e-8f4b-6c07e7768761 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.095214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dfc48-1729-4a1e-8f4b-6c07e7768761 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.096735 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 174/346] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:39.099696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dfc48-1729-4a1e-8f4b-6c07e7768761 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.136029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483735dd-45c4-4c5e-af9b-20d60b4d57fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.136868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483735dd-45c4-4c5e-af9b-20d60b4d57fb None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.137443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483735dd-45c4-4c5e-af9b-20d60b4d57fb None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.137881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483735dd-45c4-4c5e-af9b-20d60b4d57fb None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.139484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483735dd-45c4-4c5e-af9b-20d60b4d57fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.141633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483735dd-45c4-4c5e-af9b-20d60b4d57fb None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.207113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dfc48-1729-4a1e-8f4b-6c07e7768761 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.229647 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 173/347] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:38 2022] POST /identity/v3/users => generated 246 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:50:39.231224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312fb3-7881-4743-9342-d3ed8f2d8015 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.231514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312fb3-7881-4743-9342-d3ed8f2d8015 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.231862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312fb3-7881-4743-9342-d3ed8f2d8015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.252743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.253209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fc312fb3-7881-4743-9342-d3ed8f2d8015 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:39.254070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.254543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.254646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fc312fb3-7881-4743-9342-d3ed8f2d8015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:39.255094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.255959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:39.256523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.259536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.279949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 175/348] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:39.281877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.310594 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:39.343234 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 174/349] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:39.344756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc312fb3-7881-4743-9342-d3ed8f2d8015 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.393750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad511-e069-4549-bfc8-5438811bcde0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.403813 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:39.430178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.431152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.431648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.432108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.442604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.444294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.458539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc312fb3-7881-4743-9342-d3ed8f2d8015 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:39.461567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:39.462441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:39.463260 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:39.463260 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:39.463260 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:39.464964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 176/350] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:39.476843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.503173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.503800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.504075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.504405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.505064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.507234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.587477 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 175/351] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:39 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:39.591681 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:39.620411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7778ce-a7e3-4290-ada2-8af983c5bee9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.658477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.659358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.660194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.660737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.661546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.663467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:39.663993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.665600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.683926 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 177/352] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:39.691017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.768850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3118-546c-4cbf-8de2-3b00b401970d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.776418 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:39.807253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f32318-a5fc-4548-8334-34e37e6478f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.807911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32318-a5fc-4548-8334-34e37e6478f3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.808188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32318-a5fc-4548-8334-34e37e6478f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.808552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32318-a5fc-4548-8334-34e37e6478f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.821444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac17e7-b3ec-4786-9881-e355c7c36052 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.821640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f32318-a5fc-4548-8334-34e37e6478f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.823341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f32318-a5fc-4548-8334-34e37e6478f3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-23f32318-a5fc-4548-8334-34e37e6478f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:39.840466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:39.841407 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:39.842313 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:39.842313 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:39.842313 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:39.847675 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 176/353] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:39.848984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d6b8-92f7-41c9-aa9f-8525ccf86457 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.849264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d6b8-92f7-41c9-aa9f-8525ccf86457 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.849534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d6b8-92f7-41c9-aa9f-8525ccf86457 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.851085 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 177/354] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:39.851800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d6b8-92f7-41c9-aa9f-8525ccf86457 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:39.862583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa893d06-6ffd-42f2-b447-26b9f92b5fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:39.863224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893d06-6ffd-42f2-b447-26b9f92b5fb9 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.867588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893d06-6ffd-42f2-b447-26b9f92b5fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.867588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893d06-6ffd-42f2-b447-26b9f92b5fb9 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:39.867588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa893d06-6ffd-42f2-b447-26b9f92b5fb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:39.867588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa893d06-6ffd-42f2-b447-26b9f92b5fb9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:39.876624 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:39.962939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d6b8-92f7-41c9-aa9f-8525ccf86457 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:39.990044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 178/355] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:39 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:50:39.994184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6fab-246e-4696-a108-f625bbefeb2a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:39.994184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6fab-246e-4696-a108-f625bbefeb2a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:39.994184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6fab-246e-4696-a108-f625bbefeb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:40.016495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:40.017669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:40.018177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:40.018643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:40.019604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:40.020130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:40.021961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:40.037520 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 178/356] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:40.042305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c6cb6fab-246e-4696-a108-f625bbefeb2a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:40.042305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c6cb6fab-246e-4696-a108-f625bbefeb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:40.045007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:40.070685 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:40.170612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e5ad-c70b-4653-b3e0-edd7e8f60d70 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:40.215481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:40.217086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:40.217578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:40.218377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:40.220181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:40.222406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:40.245107 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 179/357] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:40.316997 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 179/358] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:40 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:40.540242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6fab-246e-4696-a108-f625bbefeb2a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:40.647213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6fab-246e-4696-a108-f625bbefeb2a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:40.671298 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:40.683480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:40.688287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:40.688287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:40.688287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:40.688287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:40.688287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:40.738456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.sql.core [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 00:50:40.738456 n-d-master-1 devstack@keystone.service[81937]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 00:50:40.738456 n-d-master-1 devstack@keystone.service[81937]: [parameters: {'id': 'bd2239a4c2d74399b3b386518fa0f35a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 00:50:40.738456 n-d-master-1 devstack@keystone.service[81937]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81937) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:50:40.745317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return ref.to_dict() Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:50:40.750694 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application yield resource Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise self.value Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.commit() Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:50:40.752030 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:50:40.752870 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:50:40.753798 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:50:40.754706 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [parameters: {'id': 'bd2239a4c2d74399b3b386518fa0f35a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:40.755507 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 00:50:40.756307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:40.757119 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 180/359] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 23 00:50:40 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:40.757199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:40.860498 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:40.891964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0b244-6a33-4620-baf8-2962854384f2 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:40.932985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a79d6-2d42-41f7-aa47-e62c0df3edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:40.933629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a79d6-2d42-41f7-aa47-e62c0df3edf1 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:40.933955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a79d6-2d42-41f7-aa47-e62c0df3edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:40.934247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a79d6-2d42-41f7-aa47-e62c0df3edf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:40.946641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a79d6-2d42-41f7-aa47-e62c0df3edf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-2e2a79d6-2d42-41f7-aa47-e62c0df3edf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:40.951938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:40.954157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:40.956109 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 180/360] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:50:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:40.961929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:41.091404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103bbca-bab2-4c31-aa0a-677289a0bcc0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:41.138716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352c64c-3b4c-4b0e-b674-0206d9d9494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:41.139339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c64c-3b4c-4b0e-b674-0206d9d9494c None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:41.139614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c64c-3b4c-4b0e-b674-0206d9d9494c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:41.139881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352c64c-3b4c-4b0e-b674-0206d9d9494c None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:41.141127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352c64c-3b4c-4b0e-b674-0206d9d9494c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:41.141426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352c64c-3b4c-4b0e-b674-0206d9d9494c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:41.142861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352c64c-3b4c-4b0e-b674-0206d9d9494c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:41.156609 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 181/361] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:41.871470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a9d11-8d87-4096-8387-6217e2e27693 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:41.872506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a9d11-8d87-4096-8387-6217e2e27693 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:41.873016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a9d11-8d87-4096-8387-6217e2e27693 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:41.875198 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 181/362] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:41.880113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a264-a19e-434d-a7d2-21768b9ecd8b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:41.880651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a264-a19e-434d-a7d2-21768b9ecd8b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:41.881141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456a264-a19e-434d-a7d2-21768b9ecd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:41.945379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7456a264-a19e-434d-a7d2-21768b9ecd8b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:41.946951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7456a264-a19e-434d-a7d2-21768b9ecd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:42.011492 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:42.040359 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 182/363] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:42.161666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915c70f-834c-4a3e-ba00-ec005d357cf1 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:42.161853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915c70f-834c-4a3e-ba00-ec005d357cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:42.162152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915c70f-834c-4a3e-ba00-ec005d357cf1 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:42.163771 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 182/364] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:42.169203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab8bf2-3605-4421-b12f-e4ebb0bfed76 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:42.169657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab8bf2-3605-4421-b12f-e4ebb0bfed76 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:42.169748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab8bf2-3605-4421-b12f-e4ebb0bfed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:42.190340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a8ab8bf2-3605-4421-b12f-e4ebb0bfed76 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:42.191526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a8ab8bf2-3605-4421-b12f-e4ebb0bfed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:42.269103 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 183/365] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:42.469017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915c70f-834c-4a3e-ba00-ec005d357cf1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:42.602150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915c70f-834c-4a3e-ba00-ec005d357cf1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:42.647756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:42.648397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:42.648675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:42.648946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:42.650862 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:42.664354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:42.669257 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:42.681139 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:42.681965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 183/366] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:42.682692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab8bf2-3605-4421-b12f-e4ebb0bfed76 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:42.706438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:42.833206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab8bf2-3605-4421-b12f-e4ebb0bfed76 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:42.843608 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:42.858975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e76df-241b-4da7-ab56-03cf8607da6c None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:42.868333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f855c-3a7e-4e7e-a29f-0ed8e1296813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:42.869081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f855c-3a7e-4e7e-a29f-0ed8e1296813 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:42.869460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f855c-3a7e-4e7e-a29f-0ed8e1296813 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:42.869817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f855c-3a7e-4e7e-a29f-0ed8e1296813 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:42.870623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f855c-3a7e-4e7e-a29f-0ed8e1296813 None admin] RBAC: Adding query filter params (name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:42.870927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f855c-3a7e-4e7e-a29f-0ed8e1296813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:42.872291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f855c-3a7e-4e7e-a29f-0ed8e1296813 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:42.883104 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 184/367] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:42.884467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de979-c8a8-40d9-90b8-554811c7b6f6 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:42.884756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de979-c8a8-40d9-90b8-554811c7b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:42.885025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de979-c8a8-40d9-90b8-554811c7b6f6 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:42.890920 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 185/368] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:42.890920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de979-c8a8-40d9-90b8-554811c7b6f6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:42.908683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5624c8-df20-4b89-9264-7ad2f6d0f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:42.909348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5624c8-df20-4b89-9264-7ad2f6d0f13a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:42.909599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5624c8-df20-4b89-9264-7ad2f6d0f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:42.909870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5624c8-df20-4b89-9264-7ad2f6d0f13a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:42.920559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5624c8-df20-4b89-9264-7ad2f6d0f13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ed5624c8-df20-4b89-9264-7ad2f6d0f13a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:42.926336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:42.927220 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:42.928336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 184/369] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:42.933459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67183-3604-47a0-91b9-2ca582d5cdbe None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:42.933748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67183-3604-47a0-91b9-2ca582d5cdbe None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:42.934046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67183-3604-47a0-91b9-2ca582d5cdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:42.954454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cbb67183-3604-47a0-91b9-2ca582d5cdbe None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:42.955577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cbb67183-3604-47a0-91b9-2ca582d5cdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:43.014535 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.018338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de979-c8a8-40d9-90b8-554811c7b6f6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.038117 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 185/370] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:43.039258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb67183-3604-47a0-91b9-2ca582d5cdbe None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.063374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.064027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.064305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.064574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.087258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.088639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:43.120364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:43.121359 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:43.122237 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:43.122237 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:43.122237 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:43.123842 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 186/371] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:43.130505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.183039 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.231412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb67183-3604-47a0-91b9-2ca582d5cdbe None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.271627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373df83-9038-4ea8-aaab-12712b2ab3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.272858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373df83-9038-4ea8-aaab-12712b2ab3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.273700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373df83-9038-4ea8-aaab-12712b2ab3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.274231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373df83-9038-4ea8-aaab-12712b2ab3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.275111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373df83-9038-4ea8-aaab-12712b2ab3f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:43.275667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373df83-9038-4ea8-aaab-12712b2ab3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.278047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373df83-9038-4ea8-aaab-12712b2ab3f4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.288322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4883-62ed-4d3e-8681-7facdd763234 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.289828 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 186/372] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:43.291425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33080c10-9c74-453a-9ee0-f6c8b9ecc051 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.291904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33080c10-9c74-453a-9ee0-f6c8b9ecc051 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.292370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33080c10-9c74-453a-9ee0-f6c8b9ecc051 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.293933 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 187/373] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:43.295950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33080c10-9c74-453a-9ee0-f6c8b9ecc051 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.331555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de09fda-d5dd-4a7a-8ac1-4dda2e7b1ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.332215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de09fda-d5dd-4a7a-8ac1-4dda2e7b1ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.332509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de09fda-d5dd-4a7a-8ac1-4dda2e7b1ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.332962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de09fda-d5dd-4a7a-8ac1-4dda2e7b1ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.333425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de09fda-d5dd-4a7a-8ac1-4dda2e7b1ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:43.333725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de09fda-d5dd-4a7a-8ac1-4dda2e7b1ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.335151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de09fda-d5dd-4a7a-8ac1-4dda2e7b1ab9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.348348 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 187/374] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:43.349562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a525-9db5-4073-9f24-be55910b69d4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.349845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a525-9db5-4073-9f24-be55910b69d4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.350140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a525-9db5-4073-9f24-be55910b69d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.368613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d7d2a525-9db5-4073-9f24-be55910b69d4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:43.369780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d7d2a525-9db5-4073-9f24-be55910b69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:43.371583 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.417336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33080c10-9c74-453a-9ee0-f6c8b9ecc051 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.439779 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 188/375] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:43.440407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a525-9db5-4073-9f24-be55910b69d4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.462429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.463565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.464333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.465059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.471224 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.479744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.481444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:43.501492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:43.502445 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:43.503261 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:43.503261 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:43.503261 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:43.503893 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 188/376] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:43.504099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.556931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a525-9db5-4073-9f24-be55910b69d4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.597829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.598615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.598830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.599102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.608182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.610390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:43.626093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:43.627066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:50:43.627955 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:43.631976 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 189/377] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:43.632489 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.633532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.635530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb98f8-9d40-4f95-ae2c-4d9eadd245a8 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.679013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.680163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.680682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.681148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.695325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:43.705525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:43.706492 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:43.707480 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:43.709625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 189/378] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:43.710742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.720726 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.751087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce026b7-693a-4e9c-acf6-7ae7eacbf525 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.790193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.790816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.791094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.791364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.792016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:43.792316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.793716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.811379 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 190/379] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:43.811379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.830253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edd635-281b-4e23-99d5-78a8dd688cbe None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.867436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.867968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.868252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.868521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.869247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:43.869546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.871016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.907699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 190/380] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:43.908524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:43.916273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fb69f-fb1a-4335-8bab-56fca9a16bfb None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:43.925870 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.945707 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:43.950637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:43.951240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:43.951512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:43.951781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:43.952439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:43.952767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:43.954151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:43.961747 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 191/381] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:43.962635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.010498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f17bb-36e0-48eb-a88f-3f5dc12a2c8a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.043283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadbb50-88ab-43f0-ad93-47d6744b6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.043909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadbb50-88ab-43f0-ad93-47d6744b6fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.044188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadbb50-88ab-43f0-ad93-47d6744b6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.044459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadbb50-88ab-43f0-ad93-47d6744b6fb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.055393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadbb50-88ab-43f0-ad93-47d6744b6fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:44.059847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ea0a2-8463-4050-8ca3-482847b23b55 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-7cadbb50-88ab-43f0-ad93-47d6744b6fb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:44.060225 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:44.061197 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:44.062046 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 191/382] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:44.063297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc3c4-d5e1-484b-af62-c8caa6cb05f0 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.063409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc3c4-d5e1-484b-af62-c8caa6cb05f0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.063678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc3c4-d5e1-484b-af62-c8caa6cb05f0 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.065415 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 192/383] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:44.066131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc3c4-d5e1-484b-af62-c8caa6cb05f0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.095970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.096601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.096879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.097207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.104552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.106014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:44.117567 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:44.118479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 192/384] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:44.119411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.144802 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.167890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc3c4-d5e1-484b-af62-c8caa6cb05f0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.176179 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.202512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.203670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.203949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.204220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.213892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.215363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.219573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da0911-763b-4274-8eaa-6dd51dce018c None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:44.229560 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:44.230459 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:44.231273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:44.231273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.231273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:44.231273 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 193/385] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:44.231567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.252845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e223c3-756c-4cf8-b294-5fdce9ae3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.253473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e223c3-756c-4cf8-b294-5fdce9ae3355 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.253747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e223c3-756c-4cf8-b294-5fdce9ae3355 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.254043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e223c3-756c-4cf8-b294-5fdce9ae3355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.264812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e223c3-756c-4cf8-b294-5fdce9ae3355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.266808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e223c3-756c-4cf8-b294-5fdce9ae3355 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-54e223c3-756c-4cf8-b294-5fdce9ae3355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:44.280271 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:44.281219 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:44.282075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:44.282075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.282075 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:44.282075 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 193/386] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:44.282486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889107f-4903-4957-aa31-dda696ac5ed9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.282752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889107f-4903-4957-aa31-dda696ac5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.283002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889107f-4903-4957-aa31-dda696ac5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.299762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1889107f-4903-4957-aa31-dda696ac5ed9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:44.301178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1889107f-4903-4957-aa31-dda696ac5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:44.338818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c40da1-c22d-4c72-b637-f4fadabc9ea5 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.363098 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.367901 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 194/387] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:44.368662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889107f-4903-4957-aa31-dda696ac5ed9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.370451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.371053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.371330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.371600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.372259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:44.372559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.373941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.382504 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 194/388] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:44.387672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.406218 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.473939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889107f-4903-4957-aa31-dda696ac5ed9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.495045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b11f8-9c46-4403-98ed-e644a72655ac None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.510334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.510944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.511273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.511486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.512208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:44.512508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.513925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.533584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.534432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.534871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.535297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.536077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:44.536522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.538042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.550878 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 195/389] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:44.551852 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 195/390] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:44.552902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.554222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.605379 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.655529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edb36b-29e4-438f-b9e9-ab9dc5366502 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.657238 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.664709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784b1b-a0c0-4d24-815d-1d83202f0291 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.689440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.690089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.690363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.690629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.698921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.699520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.699792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.700057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.700245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.700691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:44.700987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.701667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.702351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.713049 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 196/391] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:44.713813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:44.715723 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:44.716618 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:44.718122 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:44.718122 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.718122 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:44.721170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 196/392] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:44.721969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.811013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948280c7-2cc2-4591-9fd8-9ab9df73cf4b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.820213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c545f-0340-41ec-a948-c89cef7bdf44 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.821698 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.844872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.845497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.845802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.846108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.853935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:44.854570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:44.854845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:44.855109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:44.856223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.857662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.862383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:44.864078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:44.871983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:44.872859 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:44.873678 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:44.873678 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:44.873678 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:44.873678 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 197/393] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:44.873897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:44.875540 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:44.876331 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:44.877146 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 197/394] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:44.878665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:44.885265 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:44.973627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1378cb-cc1e-4b55-9abc-07facd34c376 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:44.973855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b4013-bc79-4538-a068-35c18c8e8fd3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.006103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.006449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.006723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.007000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.007091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.007271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.007362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.007579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.015290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.016727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.018312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.019726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:45.028795 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:45.029657 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:50:45.030534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:45.031582 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 198/395] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:45.032123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:45.033691 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:45.034672 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:45.035491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:45.035491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:45.035491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:45.038112 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 198/396] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:45.039077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.058207 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.097119 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.131061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f48260-bc3b-493a-88ef-37ac9d4f496a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.139073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8d78b-efb2-44c7-973f-a4d6e9a663b1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.163606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.164207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.164485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.164751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.165386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:45.165689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.167083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.172643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.173244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.173523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.174275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.175176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:45.175482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.176833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.179040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 199/397] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:45.182825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.189319 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 199/398] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:45.190196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.264970 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.282642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e973d-9ead-4a93-8e91-fefd8afe51eb None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.285467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8da29-6a49-479d-abdb-99139274dd17 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.302872 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.317778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.318414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.318692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.318973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.319736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:45.320004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.320113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.320630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.320943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.321211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.321449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.321920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:45.322253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.323670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.338392 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 200/399] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:45.339186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.344635 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 200/400] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:45.344635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.433787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad4462-fd76-4b5d-99ac-2cc2c8f435ad None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.442153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaf93c-87b8-49c4-a3ef-6b6082939627 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.466360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.466959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.467237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.467958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.468630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:45.468935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.470333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.475513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.476144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.476422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.476689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.486581 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 201/401] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:45.486581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.486784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.486875 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.486946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:45.498927 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:45.500530 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 201/402] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:45.506027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.535216 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.582551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33b2e-fd76-47ba-9557-e7e66ef53522 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.599555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5316a-6509-455d-8700-1db19e9ec953 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.617500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.618144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.618443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.618712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.625098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.626567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.632603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.633249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.633520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.633785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0e79dda089d944818b999e25bb6f8207/roles/c072deb041d34b509dec24befa733f51` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:45.637572 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:45.638683 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 202/403] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:45.639509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.647929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=0e79dda089d944818b999e25bb6f8207, role_id=c072deb041d34b509dec24befa733f51)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.649360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.699048 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.721388 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 202/404] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:45 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0e79dda089d944818b999e25bb6f8207/roles/c072deb041d34b509dec24befa733f51 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:45.734643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.746901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51bb6-651e-41b9-b82e-1cf98311c828 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.783230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.784197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.784675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.785129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.797691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.799122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:45.815341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:45.816641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:45.817917 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:45.817917 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:45.817917 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:45.817917 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 203/405] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:45.817917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.829221 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.847012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9404f-83d6-4f1e-be38-a007e6087d80 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.891128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.891753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.892538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.892538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.892942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.894408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.930180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6446-741c-44f2-8c68-e8a33264ed5e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:45.943398 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:45.963115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:45.963704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:45.963974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:45.964237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:45.964952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:45.965251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:45.966693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:45.970979 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 203/406] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:45 2022] POST /identity/v3/users => generated 247 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:45.979210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:45.987143 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 204/407] 10.222.0.42 () {56 vars in 1139 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:45.988040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.115316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dbcf6-07fc-4e4b-9bbd-463191747128 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.124987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b306d-e511-4564-980f-4220f3e760c9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.155352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.156815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.156953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.157185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.157885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:46.158163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.159542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.172367 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 205/408] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:46.172526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.172920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.173024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.173389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.173508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.174179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:46.174485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.176170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.196062 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 204/409] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:46.196913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.199802 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:46.213815 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:46.288471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a07497-960a-4cae-ad84-ba215b32f53e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.324560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cf509-7ad0-4095-a94a-5e8823989917 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.327099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.328130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.328661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.329128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.340602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.342496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:46.358833 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:46.360238 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:46.361069 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:46.361069 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:46.361069 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:46.362929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.363528 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 206/410] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:46.363722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.363975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.364315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.365083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.373675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.374931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:46.390663 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:46.391584 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:46.392429 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 205/411] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:46.393434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.462889 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:46.476037 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:46.480383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636313a4-610b-476a-950e-763c7ba8205f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.518225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.518994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.519327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.519718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/42c76c07d0cf43d2b230e4afa9709bb0/roles/c072deb041d34b509dec24befa733f51` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.525400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc0b6-fa81-488a-b886-2ba8f8df1fbb None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.534523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=42c76c07d0cf43d2b230e4afa9709bb0, role_id=c072deb041d34b509dec24befa733f51)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.536410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.561776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.563041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.566147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.566147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.566147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:46.566147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.566647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.583435 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 206/412] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:46.583435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.634893 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 207/413] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:46 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/42c76c07d0cf43d2b230e4afa9709bb0/roles/c072deb041d34b509dec24befa733f51 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:46.636214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.763252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0707ed6-a3cb-4e9c-b086-31b24e158e01 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.819233 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:46.846152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b1a0-1f54-4e46-90f3-ae1ba50cfe10 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:46.847057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.847741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.848073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.850112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.850112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:46.850112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.851107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.866307 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 207/414] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:46.875681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:46.893342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:46.893901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:46.894258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:46.894532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:46.896560 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:46.905496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:46.907802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:46.921050 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:46.922227 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:46.923147 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 208/415] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:46.928674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:47.019223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67e34-a5c2-40f7-8cf7-ec11d2a2c5cf None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:47.074246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e326e-7a33-4cd4-806f-2fb66b4f4e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:47.075148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e326e-7a33-4cd4-806f-2fb66b4f4e9b None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:47.075565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e326e-7a33-4cd4-806f-2fb66b4f4e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:47.075972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e326e-7a33-4cd4-806f-2fb66b4f4e9b None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/1a5599baadee4192ae45c1891b7f00f9/roles/c072deb041d34b509dec24befa733f51` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:47.097001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e326e-7a33-4cd4-806f-2fb66b4f4e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=1a5599baadee4192ae45c1891b7f00f9, role_id=c072deb041d34b509dec24befa733f51)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:47.098816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e326e-7a33-4cd4-806f-2fb66b4f4e9b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:47.111323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142cc31-dcb7-46fd-a4fe-57ca569bbf96 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:47.148080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:47.148927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:47.149367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:47.149826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:47.150693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:47.151135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:47.152813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:47.166316 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 209/416] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:47.175196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:47.216565 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 208/417] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:46 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/1a5599baadee4192ae45c1891b7f00f9/roles/c072deb041d34b509dec24befa733f51 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:47.235455 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:47.290683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6996-39cf-43ba-8caf-2bcd61f3b0b9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:47.331304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b7567-959e-4d4a-91d7-d5072e547075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:47.331984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b7567-959e-4d4a-91d7-d5072e547075 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:47.332254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b7567-959e-4d4a-91d7-d5072e547075 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:47.332520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b7567-959e-4d4a-91d7-d5072e547075 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0991c7d338f54d97a489eb19d6378b60/roles/c072deb041d34b509dec24befa733f51` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:47.348413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b7567-959e-4d4a-91d7-d5072e547075 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=0991c7d338f54d97a489eb19d6378b60, role_id=c072deb041d34b509dec24befa733f51)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:47.349865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b7567-959e-4d4a-91d7-d5072e547075 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:47.436550 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 210/418] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:47 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0991c7d338f54d97a489eb19d6378b60/roles/c072deb041d34b509dec24befa733f51 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:47.978814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22f045-1125-4934-8cd1-1998833e9cb0 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:47.979359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22f045-1125-4934-8cd1-1998833e9cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:47.979359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22f045-1125-4934-8cd1-1998833e9cb0 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:47.980956 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 209/419] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:47.987207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d7648-ebe6-483b-a437-a8cd356c5bfa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:47.987490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d7648-ebe6-483b-a437-a8cd356c5bfa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:47.987767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d7648-ebe6-483b-a437-a8cd356c5bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:48.022189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6d8d7648-ebe6-483b-a437-a8cd356c5bfa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:48.023372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6d8d7648-ebe6-483b-a437-a8cd356c5bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:48.110158 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 211/420] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:48.386795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596c29-f306-4bac-909c-1c6b73abaf02 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:48.386795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596c29-f306-4bac-909c-1c6b73abaf02 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:48.386795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596c29-f306-4bac-909c-1c6b73abaf02 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:48.387457 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 210/421] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:48.393365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e302-f64c-47ab-ba26-57d0e7e987d8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:48.394222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e302-f64c-47ab-ba26-57d0e7e987d8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:48.394689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e302-f64c-47ab-ba26-57d0e7e987d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:48.414038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-74a8e302-f64c-47ab-ba26-57d0e7e987d8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:48.415621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-74a8e302-f64c-47ab-ba26-57d0e7e987d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:48.445130 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:48.488010 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 212/422] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:48.519682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596c29-f306-4bac-909c-1c6b73abaf02 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:48.552243 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:48.624812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596c29-f306-4bac-909c-1c6b73abaf02 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:48.660812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:48.661408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:48.661685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:48.661958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:48.672931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:48.678112 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:48.678968 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:48.679741 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 211/423] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:48.687348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8e302-f64c-47ab-ba26-57d0e7e987d8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:48.801271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8e302-f64c-47ab-ba26-57d0e7e987d8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:48.836299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:48.836943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:48.837217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:48.837484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:48.838232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:48.838528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:48.839881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:48.849244 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 213/424] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:48.854930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:48.906204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:48.958419 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:48.960306 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:48.967775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320c03-dad4-45f7-bcad-b80fb7455894 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.006772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.007598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.007878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.008146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.020115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:49.022165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:49.040731 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:49.042886 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:49.044883 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:49.044883 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:49.044883 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:49.044883 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 212/425] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:49.051421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:49.156405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37108f-931d-4fc3-afcb-8622c3ba7b9a None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.168090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92b667-a907-49a7-8e9f-4de1f63745a4 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.193960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.194630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.194902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.195168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.195814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:49.196111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:49.197608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:49.212481 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 213/426] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:49.218933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:49.234325 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:49.262687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.269609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.269609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.269609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.288829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:49.294400 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:49.295247 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:49.296019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:49.298773 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 214/427] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:49.309498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:49.326514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ee806-7e45-4a81-9a35-af6a51520716 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.362690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a8e16-b55a-4f2c-aec2-791b73d31968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.363545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a8e16-b55a-4f2c-aec2-791b73d31968 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.363893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a8e16-b55a-4f2c-aec2-791b73d31968 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.364529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a8e16-b55a-4f2c-aec2-791b73d31968 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.372193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a8e16-b55a-4f2c-aec2-791b73d31968 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:49.375067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a8e16-b55a-4f2c-aec2-791b73d31968 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-ea0a8e16-b55a-4f2c-aec2-791b73d31968 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:49.388291 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:49.389200 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:49.390665 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 214/428] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 23 00:50:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:49.394024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa236-c1ae-4925-bea2-dac16ec6cf1b None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.394024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa236-c1ae-4925-bea2-dac16ec6cf1b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.394024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa236-c1ae-4925-bea2-dac16ec6cf1b None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.394024 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 215/429] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:49.397432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa236-c1ae-4925-bea2-dac16ec6cf1b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:49.442004 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:49.458736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8528b-0adb-4652-8ba9-ce05bf363e6e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.482494 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:49.505602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f6fb7-801e-4be6-8199-d597eebc22f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.506586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f6fb7-801e-4be6-8199-d597eebc22f9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.506865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f6fb7-801e-4be6-8199-d597eebc22f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.507138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f6fb7-801e-4be6-8199-d597eebc22f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.507806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f6fb7-801e-4be6-8199-d597eebc22f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:49.508108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f6fb7-801e-4be6-8199-d597eebc22f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:49.510073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f6fb7-801e-4be6-8199-d597eebc22f9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:49.520982 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 215/430] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:49.522713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2a14f-db0a-4111-9d5e-ef14aaf9093b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.523012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2a14f-db0a-4111-9d5e-ef14aaf9093b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.523283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2a14f-db0a-4111-9d5e-ef14aaf9093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.533769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa236-c1ae-4925-bea2-dac16ec6cf1b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.544772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-eab2a14f-db0a-4111-9d5e-ef14aaf9093b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:49.546552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eab2a14f-db0a-4111-9d5e-ef14aaf9093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:49.574601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.575315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.575518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.575784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.576610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:49.576916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:49.579181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:49.602278 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 216/431] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 23 00:50:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:49.603394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:49.621446 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 216/432] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:49.622682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2a14f-db0a-4111-9d5e-ef14aaf9093b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:49.714483 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:49.746056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2a14f-db0a-4111-9d5e-ef14aaf9093b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.775496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa32d-d4b2-42e6-af68-4a440f38b1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.776274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa32d-d4b2-42e6-af68-4a440f38b1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.776724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa32d-d4b2-42e6-af68-4a440f38b1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.777408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa32d-d4b2-42e6-af68-4a440f38b1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.794580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932562f-934f-4a9b-93bf-6541ef875f93 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:49.840727 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:49.857640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa32d-d4b2-42e6-af68-4a440f38b1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:49.860067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa32d-d4b2-42e6-af68-4a440f38b1e5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:49.867607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65913d6-4ef5-4e85-8389-f4ddabdd7d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:49.868581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65913d6-4ef5-4e85-8389-f4ddabdd7d4c None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.868992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65913d6-4ef5-4e85-8389-f4ddabdd7d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.869432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65913d6-4ef5-4e85-8389-f4ddabdd7d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.891679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65913d6-4ef5-4e85-8389-f4ddabdd7d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:49.893374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65913d6-4ef5-4e85-8389-f4ddabdd7d4c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-d65913d6-4ef5-4e85-8389-f4ddabdd7d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:49.912770 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:49.913753 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:49.914619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:49.914619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:49.914619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:49.918284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 217/433] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:49.919993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e2e2b-25b4-4dd7-bf28-a435f885709d None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.920874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e2e2b-25b4-4dd7-bf28-a435f885709d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.921853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e2e2b-25b4-4dd7-bf28-a435f885709d None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:49.923567 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 218/434] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:49.925288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e2e2b-25b4-4dd7-bf28-a435f885709d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:49.955891 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:49.979502 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 217/435] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:49.980798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d0fb0-589e-4517-a999-3b9659a4eac8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:49.981084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d0fb0-589e-4517-a999-3b9659a4eac8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:49.981379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d0fb0-589e-4517-a999-3b9659a4eac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.004014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fa1d0fb0-589e-4517-a999-3b9659a4eac8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:50.004014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fa1d0fb0-589e-4517-a999-3b9659a4eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:50.057878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e2e2b-25b4-4dd7-bf28-a435f885709d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.078406 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 218/436] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:50.079458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d0fb0-589e-4517-a999-3b9659a4eac8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.102828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.103802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.104144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.104482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.105330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:50.105744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.107334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.131841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 219/437] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:50.133308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.190433 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.194823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d0fb0-589e-4517-a999-3b9659a4eac8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.204917 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.230570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.231554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.232029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.232517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.245282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.246747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.260540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87ba0-8619-4ba4-b25c-fa863fa7f39e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:50.261616 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:50.262494 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:50.263332 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:50.263332 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:50.263332 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:50.263332 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 219/438] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:50.263538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.300211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56019f3c-30d4-4911-948f-a7fd9ec46685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.300843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56019f3c-30d4-4911-948f-a7fd9ec46685 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.301112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56019f3c-30d4-4911-948f-a7fd9ec46685 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.301375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56019f3c-30d4-4911-948f-a7fd9ec46685 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.311460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56019f3c-30d4-4911-948f-a7fd9ec46685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-56019f3c-30d4-4911-948f-a7fd9ec46685 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:50.316690 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:50.317555 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:50.318360 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 220/439] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:50.319348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad580-884c-4267-a6c2-58be6d7cba83 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.319412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad580-884c-4267-a6c2-58be6d7cba83 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.319674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad580-884c-4267-a6c2-58be6d7cba83 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.325042 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 221/440] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:50.325042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ad580-884c-4267-a6c2-58be6d7cba83 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.376753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703929-cadd-44b8-b423-3523fde372d3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.409207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.409822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.410150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.410430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.416201 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.417634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.419098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.424078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ad580-884c-4267-a6c2-58be6d7cba83 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:50.430514 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:50.431381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 220/441] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:50.432479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.455808 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.461228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb29c7f-8473-4852-bc80-a9baccfb3f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.461828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29c7f-8473-4852-bc80-a9baccfb3f5d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.462125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29c7f-8473-4852-bc80-a9baccfb3f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.462393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29c7f-8473-4852-bc80-a9baccfb3f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.463025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb29c7f-8473-4852-bc80-a9baccfb3f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:50.463320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb29c7f-8473-4852-bc80-a9baccfb3f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.464664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb29c7f-8473-4852-bc80-a9baccfb3f5d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.475558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 222/442] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:50.476822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe8f5-8927-4b59-a090-d213008cf544 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.477101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe8f5-8927-4b59-a090-d213008cf544 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.477372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe8f5-8927-4b59-a090-d213008cf544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.495491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b5bfe8f5-8927-4b59-a090-d213008cf544 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:50.496673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b5bfe8f5-8927-4b59-a090-d213008cf544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:50.532059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c1e3-4456-4d6d-afad-0a4fda964b76 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.563105 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 223/443] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:50.563926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfe8f5-8927-4b59-a090-d213008cf544 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.564952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.565560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.565954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.566248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.567019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:50.567319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.568686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.577049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 221/444] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:50.582624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.649303 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.666073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfe8f5-8927-4b59-a090-d213008cf544 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.670484 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.691140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62449-f806-4492-bcdc-10b4412555d9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.702100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.702868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.703145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.703415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.713898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:50.718698 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:50.719537 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:50.720390 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 224/445] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:50.721033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.728676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.729283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.729558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.729827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.730635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:50.730946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.732460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.750734 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 222/446] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:50.751549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.834233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7caf52-dc0c-4e0a-9413-4c177cfb0348 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.859263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fa582-62c6-40e6-9152-e10e156adfc6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:50.868359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.868977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.869247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.869509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.876101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.877525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:50.888389 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:50.889195 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:50.890083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 225/447] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:50.890543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.892357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:50.892983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:50.893260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:50.893524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:50.895470 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.902465 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:50.904520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:50.906604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:50.920692 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:50.922343 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:50.923199 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:50.923199 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:50.923199 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:50.923199 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 223/448] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:50.923199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:50.992391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607303-1efb-4660-aeb0-d3d6c9f19e1a None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.020894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad421167-d0c1-4f77-a83e-1cc7ac9487c5 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.024854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.025457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.025734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.026026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.026680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:51.026977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.028318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.036396 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 226/449] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:51.037162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.054739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.055357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.055627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.055896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.066641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.068062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:51.081549 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:51.082545 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:51.083379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:51.083379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:51.083379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:51.083379 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 224/450] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:51.083379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.105293 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.131654 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.138719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053fbf-44b4-4f30-bd3c-0f835be4fa3f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.171558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.172185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.172461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.172731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.182700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:51.184738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df4d95-15b2-4fe2-8f16-710ba1f691c3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:51.188393 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:51.189364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 227/451] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:51.190363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.219495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.220090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.220358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.220627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.221303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:51.221602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.223032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.235194 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 225/452] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:51.236038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.288694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c939f76-1212-4472-8982-6915b08eb4b5 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.313487 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.321599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.322226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.322498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.322761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.323388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:51.327227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.327227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.334515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bbc71-57ea-499b-9271-5d3068898915 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.340307 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 228/453] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:51.340458 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.340560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.372359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.372910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.373180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.373444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.385448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.386908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:51.400712 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:51.401767 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:51.402846 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:51.402846 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:51.402846 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:51.402846 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 226/454] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:51.402846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.436493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763dcbb-9bc6-4801-be78-c9becf388702 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.468725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.469324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.469603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.469865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.470509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:51.470806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.472159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.484080 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 229/455] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:51.484933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.504648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceaee4-b8c3-483f-8926-0c95b00b77e2 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.534384 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.538448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.539047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.539321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.539589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.540292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:51.540580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.541926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.549480 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 227/456] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:51.550540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.569191 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.586314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46261f-a5a3-4b97-9a0e-084ba4433562 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.619161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.619759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.620035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.620310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.621015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] RBAC: Adding query filter params (role.id=c072deb041d34b509dec24befa733f51, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=0e79dda089d944818b999e25bb6f8207) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:51.621317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.622796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.629119 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 230/457] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/role_assignments?user.id=0e79dda089d944818b999e25bb6f8207&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=c072deb041d34b509dec24befa733f51 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:51.629774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.660672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa07f3-21f2-4d51-ba78-9d5671619f02 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.699921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.700563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.700836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.701104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.710119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.711605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:51.723718 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:51.724700 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:51.725584 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 228/458] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:51.726572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.747589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79410e-4fc1-4b98-9e83-147720ea7d49 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.759245 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.787430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.788050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.788320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.788586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.789233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:51.789533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.790935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.806015 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 231/459] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:51.806015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.817097 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:51.844368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95d5b6-b939-4f27-b7d9-cc487e9e0b3f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:51.877348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:51.877895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:51.878198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:51.878463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:51.884917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:51.886374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:51.897161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:51.898306 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:51.899347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:51.902119 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 229/460] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:51.903362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:51.963496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb863b27-6283-40de-9d56-1d4d24d5d32a None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.000641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.002037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.002495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.003044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.013573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcffcc2-26c5-415f-8f73-f209c6885d50 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.015645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.018108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:52.034857 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:52.035931 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:52.036943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:52.036943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:52.036943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:52.038289 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 232/461] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:52.039177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.054478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.055097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.055390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.055634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.056410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:52.056659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.058101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.065494 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.066496 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.076019 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 230/462] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 23 00:50:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:52.077640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.150621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dcc98-b901-4b28-b963-647a324b9d77 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.179870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7304-f4ff-45d6-b2b2-df9aab124a7e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.185045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.185678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.185952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.186250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.194229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.195673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:52.207015 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:52.207921 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 233/463] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:52.208813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.219459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.220072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.220351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.220622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.221311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:52.221612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.223064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.235081 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 231/464] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:52.235870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.291013 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.300638 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.320551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5517f0-114a-43f6-9ffb-d7a7d87049a5 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.335310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b749f-2335-4c6c-b88f-48679e14c79f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.355634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.356679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.356956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.357379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.358054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:52.358381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.360441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.371419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.376630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 234/465] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:52.376781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.376781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.376781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.377042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.446264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.447713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.479715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc369a-09cf-49ee-9102-6f711c11a980 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.513280 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.514723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.515979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.516254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.516520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.517245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:52.517550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.518989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.534311 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.538951 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 235/466] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:52.539860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.569601 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 232/467] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:52.569601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.646360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5012967-ef65-40ff-bd50-dd6585b7fee4 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.668608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c1b3-6649-4d36-a4a3-29e94b87bcf1 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.682539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.683210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.683493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.683768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/8d2725c03b7e40c39b3db1cd9c45ed71/roles/c072deb041d34b509dec24befa733f51` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.698547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=8d2725c03b7e40c39b3db1cd9c45ed71, role_id=c072deb041d34b509dec24befa733f51)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.699968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.703147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.703771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.704049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.704314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.711298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.712726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:52.724024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:52.725087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:52.725998 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 233/468] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:52.726544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.744967 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.797933 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 236/469] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:52 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/8d2725c03b7e40c39b3db1cd9c45ed71/roles/c072deb041d34b509dec24befa733f51 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:50:52.799050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:52.843938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a87c18-2f3c-4c32-beb6-f3d2424cda4a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.875177 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.887746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.888677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.889132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.890105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.937635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f76b0-42c4-4aad-bb9f-e44812b4f00c None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:52.973233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.974675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:52.978606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:52.979595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:52.980109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:52.980577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:52.992675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:52.993279 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:52.994758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:53.022236 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:53.023199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:53.024243 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:53.024243 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:53.024243 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:53.024243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 237/470] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:53.024243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.115522 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 234/471] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:53.116518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.144081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db429-39ac-4b8e-baf0-de135feb11af None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:53.145729 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:53.180390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:53.181025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:53.181261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:53.181517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:53.182307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:53.182659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:53.184184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.211227 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 238/472] 10.222.0.42 () {56 vars in 1139 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:53.212054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.236492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afcb88-775b-498b-8119-ad9cf04ec954 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:53.253969 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:53.272596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:53.273203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:53.273475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:53.273739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:53.274492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:53.274849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:53.276202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.293182 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 235/473] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:53.294137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.338456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4334a7-cb64-47fc-accc-3e9937c35801 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:53.387923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:53.388560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:53.389093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:53.389364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:53.405001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:53.406503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.408395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010106fc-3b70-43dd-a39d-93480676d2fb None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:53.421926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:53.424049 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:53.426412 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:53.426412 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:53.426412 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:53.434009 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 239/474] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:53.434009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.444903 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:53.451459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:53.452818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:53.453239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:53.453648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:53.527142 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:53.540830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829b9d-c2e7-43c4-acd7-b31a29e34e44 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:53.558869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:53.560393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.589060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:53.590263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:53.590696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:53.591298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:53.600034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:53.602214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:53.618904 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:53.619934 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:53.620967 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:53.623381 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 240/475] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:53.624841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.681075 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 236/476] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:53.682197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.713488 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:53.748366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250a341-62fb-43e0-a357-7e63858ce021 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:53.788481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:53.788871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:53.789243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:53.789610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:53.790398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:53.790793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:53.792253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.797429 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:53.810174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 241/477] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:53.811166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.832678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81133bc-0fb3-479e-8703-6ae3b0afdf90 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:53.882406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:53.883126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:53.883303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:53.883541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:53.884220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:53.884532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:53.886068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:53.904053 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 237/478] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:53.904944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:53.968997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5976d-8a85-4ebb-8fe6-b1724bcd57c5 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.009905 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:54.015551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee3615-cff6-4f3f-8b27-4cc6bd1bdfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.016193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee3615-cff6-4f3f-8b27-4cc6bd1bdfaa None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.016469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee3615-cff6-4f3f-8b27-4cc6bd1bdfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.016737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee3615-cff6-4f3f-8b27-4cc6bd1bdfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.029924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee3615-cff6-4f3f-8b27-4cc6bd1bdfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.031083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933d47-66a6-42f3-9c36-696ff8c4b2b6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.031903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee3615-cff6-4f3f-8b27-4cc6bd1bdfaa None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-7eee3615-cff6-4f3f-8b27-4cc6bd1bdfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:54.050850 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:54.051947 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:54.052974 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:54.052974 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:54.052974 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:54.052974 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 242/479] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:54.052974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2374f5a-6d9d-4ed5-853d-e635415189e2 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.053289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2374f5a-6d9d-4ed5-853d-e635415189e2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.053729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2374f5a-6d9d-4ed5-853d-e635415189e2 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.054996 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 243/480] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:54.058824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2374f5a-6d9d-4ed5-853d-e635415189e2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.076378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.077039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.077316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.077581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.083046 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:54.088007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.089511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:54.101434 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:54.102327 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:54.103136 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:54.105564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 238/481] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:54.106573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.187687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2374f5a-6d9d-4ed5-853d-e635415189e2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.237879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9036-f4ee-4476-adcc-79d1aa167110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.238491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9036-f4ee-4476-adcc-79d1aa167110 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.238769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9036-f4ee-4476-adcc-79d1aa167110 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.239041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9036-f4ee-4476-adcc-79d1aa167110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.239761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9036-f4ee-4476-adcc-79d1aa167110 None admin] RBAC: Adding query filter params (role.id=c072deb041d34b509dec24befa733f51, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=42c76c07d0cf43d2b230e4afa9709bb0) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:54.240068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9036-f4ee-4476-adcc-79d1aa167110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.241491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9036-f4ee-4476-adcc-79d1aa167110 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.245445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75833b7c-09de-4e71-8d4c-49cd2376c447 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.247936 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 244/482] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/role_assignments?user.id=42c76c07d0cf43d2b230e4afa9709bb0&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=c072deb041d34b509dec24befa733f51 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:54.249300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea04b-469e-4752-ae21-05ac69d1d8a5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.249583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea04b-469e-4752-ae21-05ac69d1d8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.249855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea04b-469e-4752-ae21-05ac69d1d8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.269118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7e5ea04b-469e-4752-ae21-05ac69d1d8a5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:54.270382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7e5ea04b-469e-4752-ae21-05ac69d1d8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:54.309959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.310666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.310942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.311296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.312024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:54.312324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.313901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.327734 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 239/483] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:54.328805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.330508 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:54.363378 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 245/484] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:54.364529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea04b-469e-4752-ae21-05ac69d1d8a5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.425933 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:54.488964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea04b-469e-4752-ae21-05ac69d1d8a5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.492431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a184-eae0-466e-8a51-0f88c7f65e52 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.524940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.525701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.526157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.526516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.529396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.531110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.531578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.532018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.532891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:54.533363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.534836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.535192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.537331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.548172 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 240/485] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:54.549025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:54.550107 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:54.550950 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:54.555480 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 246/486] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:54.556065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.560717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.606300 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:54.660461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bce96-cfdb-4221-a8ec-ce8160b9fb33 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.673030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc4436-af2d-4e24-b978-e78b0403673f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.677718 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:54.697849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.698491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.698767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.699035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.699760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] RBAC: Adding query filter params (role.id=c072deb041d34b509dec24befa733f51, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=1a5599baadee4192ae45c1891b7f00f9) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:54.700063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.701486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.709287 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 241/487] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/role_assignments?user.id=1a5599baadee4192ae45c1891b7f00f9&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=c072deb041d34b509dec24befa733f51 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:54.714345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.715321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.715846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.716316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.718580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:54.719173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.720869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.722505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.736021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 247/488] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:54.741884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.865900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7bf9-cac8-4eed-981a-afb44fc9899a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.881230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293784b6-8e61-49db-8896-16a0e6d199c1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:54.898358 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:54.906138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.907070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.908624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.908624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.919744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:54.924216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:54.925151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:54.925373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:54.925615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:54.926369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] RBAC: Adding query filter params (role.id=c072deb041d34b509dec24befa733f51, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=0991c7d338f54d97a489eb19d6378b60) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:54.926674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:54.928094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:54.928706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:54.929580 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:50:54.930398 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:54.933005 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 242/489] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:54.934395 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 248/490] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/role_assignments?user.id=0991c7d338f54d97a489eb19d6378b60&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=c072deb041d34b509dec24befa733f51 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:54.939181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:54.991028 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:55.064896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721fd99-931b-49f2-9a65-09c7ef4cf69c None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:55.105517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc151516-b24d-491b-b5b6-9a4f732edccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:55.106178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151516-b24d-491b-b5b6-9a4f732edccc None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.106509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151516-b24d-491b-b5b6-9a4f732edccc None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.106788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151516-b24d-491b-b5b6-9a4f732edccc None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.107472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151516-b24d-491b-b5b6-9a4f732edccc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:55.107772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151516-b24d-491b-b5b6-9a4f732edccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:55.109228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151516-b24d-491b-b5b6-9a4f732edccc None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:55.119191 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 243/491] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:50:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:55.124876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:55.138481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536533c5-f657-4b8c-a1ba-6d9e8b7c4f9f None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.138769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536533c5-f657-4b8c-a1ba-6d9e8b7c4f9f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.139042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536533c5-f657-4b8c-a1ba-6d9e8b7c4f9f None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.141572 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 244/492] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:55.146574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47214e-38e9-470a-9ebf-c3795680bea2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.146861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47214e-38e9-470a-9ebf-c3795680bea2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.147418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47214e-38e9-470a-9ebf-c3795680bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.169385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9b47214e-38e9-470a-9ebf-c3795680bea2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:55.169385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9b47214e-38e9-470a-9ebf-c3795680bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:55.246439 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 245/493] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:50:55.262118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caccd9-62d4-429c-81dd-eabf1e4a4f3b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:55.315841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:55.316897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.317418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.317864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.333577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:55.335323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:55.353787 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:55.355011 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:55.355880 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:55.355880 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:55.355880 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:55.358393 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 249/494] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:55.363673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47214e-38e9-470a-9ebf-c3795680bea2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:55.397061 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:55.482414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47214e-38e9-470a-9ebf-c3795680bea2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:55.536492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:55.537165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.537425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.537699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.538384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:55.538683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:55.540041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:55.557323 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 246/495] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:55.562977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:55.584907 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:55.682989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:55.698675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9979b9-4c35-48d2-a9cb-7215a1bf431b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:55.741456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:55.742131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.742411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.742682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.753664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:55.755163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:55.777852 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:55.779097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:55.780038 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 250/496] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 23 00:50:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:55.782868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:55.834773 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:55.853051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab7fdd-c1f8-4017-9be1-ba20f7b472fd None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:55.907182 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:55.913411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:55.914335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.914868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.915373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.932906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a17e30-b25f-4928-bc8b-569b541e53f8 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:55.942935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:50:55.948523 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:55.949427 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:50:55.950345 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:55.958101 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 247/497] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:55.964306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:55.976505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:55.977244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:55.977525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:55.977801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:55.978570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:55.978878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:55.980353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:56.012733 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 251/498] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 23 00:50:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:56.023623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:56.121034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203b999-3499-46f5-85af-59325b8e615e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.190115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:56.190745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:56.191019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:56.191285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:56.191964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:56.192263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:56.193705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:56.219073 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 248/499] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:56.221959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:56.224690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b26349-9196-447a-9e01-95a4a1d142ee None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.254320 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:56.285301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:56.298251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:56.298884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:56.299153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:56.299415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:56.318503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:56.319932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:56.346621 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:56.347569 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:56.349465 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:56.349465 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:56.349465 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:56.349465 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 252/500] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:56.355317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:56.423938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f8f3-3190-4009-9df7-3eb5fd1ab44b None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.488521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2730-add3-4c48-8e6b-78df11f6d4ae None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.522927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:56.523570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:56.523845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:56.524118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:56.528148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:56.528727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:56.529002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:56.529269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:56.529910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:56.530786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:56.532141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:56.547935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:56.549380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:56.561398 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 253/501] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:56.562727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:56.579095 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:56.581520 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:56.583806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:56.583806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:56.583806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:56.583806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 249/502] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:56.589741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:56.645203 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:56.687451 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:56.703682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296606f7-9b9e-4a9d-81b9-c8eab156a5c0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.724761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebb382-3d06-4d0f-af73-c88103e90f44 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.751616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:56.752277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:56.752561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:56.752835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:56.759463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:56.760072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:56.760248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:56.760403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:56.760602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:56.761243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:56.761542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:56.761715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:56.762955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:56.775797 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 250/503] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:56.786004 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:56.787062 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:56.790069 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:56.790599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:56.790684 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 254/504] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:50:56.791603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:56.905910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cec3a-f1bf-45ff-91a3-6b37cbe45729 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.923931 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:56.963867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab498d3-e998-4507-88c5-5cd7f5a63d3a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:56.993854 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:57.002266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:57.003107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.003396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.003670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.011467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:57.012972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:57.019584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:57.020303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.020584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.020854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.021549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:57.021853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:57.023307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:50:57.026411 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:57.027336 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:57.028242 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 251/505] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:50:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:57.033051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:57.047316 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 255/506] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:57.053470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:57.155926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c36740-9ae6-424e-b2b7-aa2d95ac4856 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:57.197152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:57.197932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.198341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.198713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.199546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:57.199957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:57.201664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:57.223253 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 252/507] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 23 00:50:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:50:57.231515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:57.257600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92502ef-bb2f-4bef-9ae4-822021f6a10e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:57.292792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9163c-40a1-458d-bc65-109b47052130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:57.293455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9163c-40a1-458d-bc65-109b47052130 None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.293712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9163c-40a1-458d-bc65-109b47052130 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.293997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9163c-40a1-458d-bc65-109b47052130 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0e79dda089d944818b999e25bb6f8207/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.295953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9163c-40a1-458d-bc65-109b47052130 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=0e79dda089d944818b999e25bb6f8207, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:57.297360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9163c-40a1-458d-bc65-109b47052130 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:57.297935 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:57.355984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e0432-7222-4daf-bc76-0e1cbe11c35e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:57.368650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 256/508] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:50:57 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0e79dda089d944818b999e25bb6f8207/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:50:57.372928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04303-2bda-4517-b08b-de346262fb84 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.373579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04303-2bda-4517-b08b-de346262fb84 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.374291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04303-2bda-4517-b08b-de346262fb84 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.377922 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 257/509] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:57.385175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3690f79-cbba-4946-b4b3-671f2c92c84a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.387438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3690f79-cbba-4946-b4b3-671f2c92c84a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.387938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3690f79-cbba-4946-b4b3-671f2c92c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.427482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c3690f79-cbba-4946-b4b3-671f2c92c84a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:57.430584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c3690f79-cbba-4946-b4b3-671f2c92c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:57.432580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:57.434051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.435814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.436375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.477142 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:57.546737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:57.548312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:57.554484 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 258/510] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:57.556114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38669-3126-4c0d-a399-96efb247d0e9 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.556610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38669-3126-4c0d-a399-96efb247d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.557087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38669-3126-4c0d-a399-96efb247d0e9 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.558665 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 259/511] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:57.565883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b287de-6889-4326-82ed-9e18b773cdb5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.566556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b287de-6889-4326-82ed-9e18b773cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.567479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b287de-6889-4326-82ed-9e18b773cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.590569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-11b287de-6889-4326-82ed-9e18b773cdb5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:57.592752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11b287de-6889-4326-82ed-9e18b773cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:57.612357 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:57.672795 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 260/512] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:57.674429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130f66-76aa-4f5e-98c4-756e7061608b None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.674968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130f66-76aa-4f5e-98c4-756e7061608b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.675346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130f66-76aa-4f5e-98c4-756e7061608b None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.676868 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 261/513] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:57.682558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7c83-87dc-4276-aea4-8dbf4773beed None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.682847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7c83-87dc-4276-aea4-8dbf4773beed None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.683123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7c83-87dc-4276-aea4-8dbf4773beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.686902 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 253/514] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:50:57.692645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:57.710337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c90f7c83-87dc-4276-aea4-8dbf4773beed None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:57.712666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c90f7c83-87dc-4276-aea4-8dbf4773beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:57.787867 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 262/515] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:50:57.822197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e068be-a14a-4659-a821-7c3a3c5ba743 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:57.839932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f7c83-87dc-4276-aea4-8dbf4773beed None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:57.860814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:57.861456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:57.861734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:57.862019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:57.874154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:57.875928 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:57.877075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:57.887860 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:57.895569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:57.896488 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:57.897353 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:57.897353 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:57.897353 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:57.897353 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 254/516] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:57.907027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.059727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f7c83-87dc-4276-aea4-8dbf4773beed None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.064487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1ded-1190-4bd6-b661-28a3bb0efe22 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.105036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.105368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.105563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.105832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.106138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.106775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:58.107074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.107274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.107753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.108736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.108965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.121400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.122755 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 255/517] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:58.122867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.123394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:50:58.138838 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:58.140025 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:50:58.141224 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:50:58.141224 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:50:58.141224 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:58.141224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 263/518] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:58.141224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.187897 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:58.207380 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:58.229987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f374-856f-4d66-9472-8714dcb30d94 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.243262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8445-82d6-4352-b1a4-20467719ee94 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.265564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.266221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.266498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.266767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.267343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.268697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.278032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.278676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.278949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:58.279110 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:58.280081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:50:58.280896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:58.281610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] PATH_INFO: `/v3/services/network` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.281610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.281733 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 256/519] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:58.281733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.281851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:58.297809 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:58.302655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:50:58.303509 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 264/520] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:58.304270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.392758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4960f2-2ee2-4021-8b8d-674755747ced None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.411993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c7ce-f1e1-47ad-8f42-f01957e27152 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.413289 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:58.429375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.430056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.430336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.430608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.437075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.438568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.442123 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:58.448043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.448650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.448926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.449194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.454444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:58.454444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:50:58.454637 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:50:58.455415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:50:58.456288 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:50:58.456714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.456782 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 257/521] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:50:58.456782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.468285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 265/522] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:58.469466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.569293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87362fa-4a36-4f4d-b868-484013e30599 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.581188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a2a0-877d-4e76-8404-01beb8706d04 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.602647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.603248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.603523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.603799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.604403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:58.604706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.606092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.610720 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 258/523] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:58.612160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.617283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.617902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.618220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.618491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.619116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] RBAC: Adding query filter params (name=network) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:58.619418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.620767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.626344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 266/524] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:58.627299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.665188 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:58.684695 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:58.719310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb363-316d-45b2-9618-3c841239e642 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.732563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c260bb-f226-416b-9b51-8128ab2b3aab None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.755818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99195448-8337-45f8-a882-635b7085c293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.756693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99195448-8337-45f8-a882-635b7085c293 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.757039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99195448-8337-45f8-a882-635b7085c293 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.757308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99195448-8337-45f8-a882-635b7085c293 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.758014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99195448-8337-45f8-a882-635b7085c293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:58.758317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99195448-8337-45f8-a882-635b7085c293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.759743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99195448-8337-45f8-a882-635b7085c293 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.768218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.768826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.769104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.769376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.770030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.771482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.772551 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 259/525] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:58.773501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99195448-8337-45f8-a882-635b7085c293 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.854654 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 267/526] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:50:58 2022] POST /identity/v3/users => generated 254 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:50:58.859458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.897638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99195448-8337-45f8-a882-635b7085c293 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:58.902245 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:58.954693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:58.955698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:58.956334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:58.957254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:58.958428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:58.958949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:58.961099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:58.969775 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 260/527] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:58.971171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:58.993788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f68fa-9a05-48e4-a144-e03e8ceef684 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:59.019874 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:59.082194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419bca-4d51-485e-86a9-7435ccabc4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:59.082866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419bca-4d51-485e-86a9-7435ccabc4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:59.083139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419bca-4d51-485e-86a9-7435ccabc4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:59.083400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419bca-4d51-485e-86a9-7435ccabc4e5 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:59.084036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419bca-4d51-485e-86a9-7435ccabc4e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:59.084330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419bca-4d51-485e-86a9-7435ccabc4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:59.085719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419bca-4d51-485e-86a9-7435ccabc4e5 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:59.094000 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 268/528] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:59.104144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a41604-92c8-429c-9da3-44b81f092987 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:59.145934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d86d4-de13-4cef-a1da-994a686d2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:59.147017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d86d4-de13-4cef-a1da-994a686d2081 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:59.147515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d86d4-de13-4cef-a1da-994a686d2081 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:59.147983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d86d4-de13-4cef-a1da-994a686d2081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:59.148936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d86d4-de13-4cef-a1da-994a686d2081 None admin] RBAC: Adding query filter params (role.id=c072deb041d34b509dec24befa733f51, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=8d2725c03b7e40c39b3db1cd9c45ed71) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:50:59.149451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d86d4-de13-4cef-a1da-994a686d2081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:59.151201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d86d4-de13-4cef-a1da-994a686d2081 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:59.159413 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 261/529] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:50:58 2022] GET /identity/v3/role_assignments?user.id=8d2725c03b7e40c39b3db1cd9c45ed71&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=c072deb041d34b509dec24befa733f51 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:50:59.792125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d3dd-652a-467b-aa10-8219d8e10b7c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:59.792647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d3dd-652a-467b-aa10-8219d8e10b7c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:59.792647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d3dd-652a-467b-aa10-8219d8e10b7c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:59.794173 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 269/530] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:59.800337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3eaf-94d8-48f6-8135-3949c41becc1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:59.800734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3eaf-94d8-48f6-8135-3949c41becc1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:59.800905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3eaf-94d8-48f6-8135-3949c41becc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:59.822440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e7fe3eaf-94d8-48f6-8135-3949c41becc1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:59.824941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e7fe3eaf-94d8-48f6-8135-3949c41becc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:59.849875 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:59.891794 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 262/531] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:51:00.166272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d3dd-652a-467b-aa10-8219d8e10b7c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:00.292883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d3dd-652a-467b-aa10-8219d8e10b7c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:00.338021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:00.338667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:00.338942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:00.339209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:00.353430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:00.362785 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:00.363697 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:00.364554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 270/532] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:00.372763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe3eaf-94d8-48f6-8135-3949c41becc1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:00.505436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe3eaf-94d8-48f6-8135-3949c41becc1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:00.555975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:00.556945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:00.557446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:00.557908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:00.558803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:00.559297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:00.560862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:00.573545 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 263/533] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:00.579413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:00.630940 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:00.707839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e2320-67b4-462a-84af-b0ef490ab719 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:00.759891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:00.760448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:00.760777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:00.761050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:00.777574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:00.779048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:00.802223 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:00.803661 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:00.804580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:00.804580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:00.804580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:00.804580 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 271/534] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:00.809259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:00.843668 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:00.936102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bc722-8a2b-4869-82ca-7505c6044c7d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:00.976418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:00.977020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:00.977292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:00.977557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:00.978219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:00.978516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:00.979873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:00.999070 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 264/535] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:01.004652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:01.131605 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:01.145846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7294-f0f5-438c-8439-00beaf5db7ed None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:01.197505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:01.198553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.199032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.199497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.213102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:01.214889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:01.236028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:01.237009 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:51:01.237915 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:01.240180 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 272/536] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 23 00:51:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:01.245803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:01.347110 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:01.369960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6e880-be19-4ab8-b8d6-ad0139f273fd None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:01.412354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428d32d-6f86-4859-b7ca-c8c1c4b4b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:01.412886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428d32d-6f86-4859-b7ca-c8c1c4b4b1af None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.413161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428d32d-6f86-4859-b7ca-c8c1c4b4b1af None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.413429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428d32d-6f86-4859-b7ca-c8c1c4b4b1af None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.414173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428d32d-6f86-4859-b7ca-c8c1c4b4b1af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:01.414476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428d32d-6f86-4859-b7ca-c8c1c4b4b1af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:01.415880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428d32d-6f86-4859-b7ca-c8c1c4b4b1af None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:01.442129 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 265/537] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 23 00:51:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:01.443640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:01.617090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0bcf-c3fc-450d-bafc-b32029dd1a40 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.617424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0bcf-c3fc-450d-bafc-b32029dd1a40 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.617635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0bcf-c3fc-450d-bafc-b32029dd1a40 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.619160 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 266/538] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:01.620391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd26b4-5b91-4b57-a57c-010e43d01052 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:01.631927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704321-e748-4421-990b-909968b06c84 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.632221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704321-e748-4421-990b-909968b06c84 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.632460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90704321-e748-4421-990b-909968b06c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.666079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-90704321-e748-4421-990b-909968b06c84 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:01.667197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-90704321-e748-4421-990b-909968b06c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:01.699246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:01.700221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.700698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.701167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.741809 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:01.784777 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 267/539] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:51:01.796940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dcb6e-92df-4732-9250-db48acdccea0 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.797210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dcb6e-92df-4732-9250-db48acdccea0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.797486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dcb6e-92df-4732-9250-db48acdccea0 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.798829 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 268/540] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:01.805651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dcc58-c086-4aa7-b6e1-2284d2a08311 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.806108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dcc58-c086-4aa7-b6e1-2284d2a08311 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.806374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dcc58-c086-4aa7-b6e1-2284d2a08311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.842388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f04dcc58-c086-4aa7-b6e1-2284d2a08311 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:01.843597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f04dcc58-c086-4aa7-b6e1-2284d2a08311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:01.846220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:01.847732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:01.935259 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 269/541] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:51:01.936986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f2f5-2729-48a6-9dff-fb086e4a588b None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.937265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f2f5-2729-48a6-9dff-fb086e4a588b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.937534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f2f5-2729-48a6-9dff-fb086e4a588b None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.943033 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 270/542] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:01.944680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb81ff-d82c-4cfb-a369-75f02d973c88 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:01.944959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb81ff-d82c-4cfb-a369-75f02d973c88 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:01.945230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb81ff-d82c-4cfb-a369-75f02d973c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:01.952303 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:01.966438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6ccb81ff-d82c-4cfb-a369-75f02d973c88 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:01.967989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ccb81ff-d82c-4cfb-a369-75f02d973c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:01.985559 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 273/543] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:51:01.990715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.046563 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 271/544] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:51:02.091167 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:02.091994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb81ff-d82c-4cfb-a369-75f02d973c88 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.179951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65864905-d2eb-4ec6-a8c9-4662a1040c2d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:02.221668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcf7f8-2696-4779-9d14-ffc58a940111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:02.222795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf7f8-2696-4779-9d14-ffc58a940111 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.223273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf7f8-2696-4779-9d14-ffc58a940111 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.223737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf7f8-2696-4779-9d14-ffc58a940111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.241571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcf7f8-2696-4779-9d14-ffc58a940111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:02.243733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcf7f8-2696-4779-9d14-ffc58a940111 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:02.253907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb81ff-d82c-4cfb-a369-75f02d973c88 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e1dcf7f8-2696-4779-9d14-ffc58a940111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:02.259708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:02.260622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:02.261476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:02.261476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:02.261476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:02.261476 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 274/545] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:02.262244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120080-eb78-43f3-ae20-042fef1fca31 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.262523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120080-eb78-43f3-ae20-042fef1fca31 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.262792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120080-eb78-43f3-ae20-042fef1fca31 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.264039 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 275/546] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:02.268997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120080-eb78-43f3-ae20-042fef1fca31 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.291475 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:02.296802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d493e-dcef-4198-a354-88a485253d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:02.297495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d493e-dcef-4198-a354-88a485253d6c None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.297772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d493e-dcef-4198-a354-88a485253d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.298077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d493e-dcef-4198-a354-88a485253d6c None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.298770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d493e-dcef-4198-a354-88a485253d6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:02.300401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d493e-dcef-4198-a354-88a485253d6c None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:02.374240 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:02.378511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120080-eb78-43f3-ae20-042fef1fca31 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:02.397757 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 272/547] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:02 2022] POST /identity/v3/services => generated 240 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:51:02.399072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cf87-6638-4cc2-8da0-b0d6f585169c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.399357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cf87-6638-4cc2-8da0-b0d6f585169c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.399628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cf87-6638-4cc2-8da0-b0d6f585169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.419086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0237cf87-6638-4cc2-8da0-b0d6f585169c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:02.421671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0237cf87-6638-4cc2-8da0-b0d6f585169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:02.426487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:02.427169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.427473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.427742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.428399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:02.428704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:02.430293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:02.444129 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 276/548] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:02.444981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.502383 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 273/549] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:02 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:51:02.503531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cf87-6638-4cc2-8da0-b0d6f585169c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.572000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5ec8-1011-46c6-9431-dc8e9751ecba None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:02.614333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cf87-6638-4cc2-8da0-b0d6f585169c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:02.621663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:02.622844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.623051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.623334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.623999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:02.626070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:02.641327 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:02.652276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:02.652974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.653247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.653517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.664098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:02.668881 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:02.669752 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 274/550] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:51:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:02.676522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.704687 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 277/551] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:02 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:02.705529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.751878 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:02.798938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ba350-9177-472a-8f10-75d72d8265e6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:02.846359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:02.847839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.848320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.848902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.857316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:02.859812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:02.873415 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:02.874391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:02.875282 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:02.877956 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 275/552] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:02.879148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:02.879936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367f520-5e9e-4efc-80a7-4a322e4d853d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:02.918999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:02.919795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:02.921424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:02.921424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:02.921653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:02.921953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:02.923941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:02.926806 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:02.934650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 278/553] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:51:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:02.939768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.021639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5301-2175-4f2b-a04f-ec94f92de1ab None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.030192 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:03.060953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d481833-fc0c-49e8-870f-8951717841ff None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.065644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.066317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.066595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.066864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.083314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:03.088562 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:03.089470 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:03.090346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:03.090967 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 276/554] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:03.096986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.117999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.118602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.118881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.119151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.119839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:03.120156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.121565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.134811 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 279/555] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:03.135740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.203959 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:03.208687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afaf9d-005f-460e-be6b-2863f13ebf99 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.239902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2424378-54fd-4115-ba72-c87f82c7f5a0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.246463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.247352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.247822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.248344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.260216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.261962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.276045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.276647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.276929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.277200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.277866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:03.278190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:03.278969 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:03.279925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:03.280853 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:03.280853 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:03.280853 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:03.281031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.281859 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:03.283734 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 277/556] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:03.284784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.301694 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 280/557] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:03.301694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.422379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03361-aa4a-450c-8414-6e27c009ef78 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.433587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635db3-84d5-4063-a6aa-06bf16269d75 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.457802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.458774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.459245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.459711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.460620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=0e79dda089d944818b999e25bb6f8207) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:03.461117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.462772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.469614 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 278/558] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/role_assignments?user.id=0e79dda089d944818b999e25bb6f8207&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:03.470750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.471107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.471839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.472110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.472389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.473043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:03.473344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.474896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.494539 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:03.494718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 281/559] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:03.497175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.564505 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:03.602697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630961dc-385f-4042-b28a-b398e42e204e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.612481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da29c-7002-45e6-be12-7bdd70f73cc0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.640969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.641996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.642321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.642689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.651941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.652845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.653307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.653721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.655849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.657711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.662461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.664081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:03.673877 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:03.675450 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:03.676558 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:03.676558 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:03.676558 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:03.677506 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 279/560] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:03.682928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:03.683269 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:03.684164 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:03.685098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:03.692074 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 282/561] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:03.693469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.759671 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:03.799413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d77eb7-b94f-410d-83fa-c2d463d7e6a3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.816670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3acc58-12f5-4168-9bef-c0327a56f534 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:03.838955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.839961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.839961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.840347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.841064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:03.841430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.842973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.843309 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:03.858987 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 280/562] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:03.864849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.871340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:03.871957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:03.872229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:03.872494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:03.873217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:03.874116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:03.875959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:03.899845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 283/563] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:03.905672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:03.984898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c744d-52a1-4c7e-8c81-d86d22508809 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.015198 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:04.023523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408787cd-17f5-49e4-a4c7-8e33c9cc4234 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.027660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.028297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.042197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.042197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.043520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.044960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:04.067761 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:04.068695 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:04.069919 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 281/564] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:04.074580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:04.074793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.075485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.075767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.076076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.088344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.088344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:04.103135 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:04.104257 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:04.105346 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:04.105346 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:04.105346 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:04.106326 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 284/565] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:04.113407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:04.171848 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:04.252830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759aa27-65d0-433f-91f3-b2d90a822df2 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.307344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08b7e-6e8a-42c8-b6f8-d38c3638853c None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.331475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.648222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.648222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.648222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.648222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:04.648222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.648222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.649267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.649267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.649267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.649267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.649576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:04.649576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.649576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.649576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 285/566] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:04.649576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:04.649895 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 282/567] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 23 00:51:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:04.649895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:04.650065 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:04.650065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a147ee-70d3-492a-88c2-55a462f3a030 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.650065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.650065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:04.650348 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:04.650876 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:04.651905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:04.652784 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:04.652784 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 286/568] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:04.652784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:04.652990 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:04.656271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348d8b-7335-4f8e-bfaa-edfe600f7350 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.686700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b719-9c41-485d-b63e-7302df0468bd None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.692763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.693716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.694224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.695494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.696417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:04.696932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.698611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.720640 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 287/569] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:04.722276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:04.733028 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:04.757781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.758937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.759430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.759936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.785018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.786950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:04.815143 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:04.822319 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:04.823186 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:04.823186 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:04.823186 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:04.824113 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 283/570] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:04.827542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df7f7e-93f6-47d3-82da-c28fb0d7ae68 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.828373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:04.866293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:04.866955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:04.867231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:04.867503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/dfa33bd9a95046b68371e1107a5507fd/roles/c072deb041d34b509dec24befa733f51` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:04.884284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=dfa33bd9a95046b68371e1107a5507fd, role_id=c072deb041d34b509dec24befa733f51)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:04.885800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:04.965376 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:04.971483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0d988-fc1c-4415-b5e6-592df66971ce None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:04.989728 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 288/571] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:51:04 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/dfa33bd9a95046b68371e1107a5507fd/roles/c072deb041d34b509dec24befa733f51 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:51:05.015908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce26146-8faa-445f-8fc1-68368563e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:05.016582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce26146-8faa-445f-8fc1-68368563e462 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.018146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce26146-8faa-445f-8fc1-68368563e462 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.018146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce26146-8faa-445f-8fc1-68368563e462 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.018146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce26146-8faa-445f-8fc1-68368563e462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:05.018395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce26146-8faa-445f-8fc1-68368563e462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:05.019679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce26146-8faa-445f-8fc1-68368563e462 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:05.034152 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 284/572] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:05.039296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:05.051042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66b27-cea1-43be-8373-4d1d6629b06b None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.051706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66b27-cea1-43be-8373-4d1d6629b06b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.052664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c66b27-cea1-43be-8373-4d1d6629b06b None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.055372 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 285/573] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:05.061630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ff73-0f56-4260-a9af-51930885b072 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.061929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ff73-0f56-4260-a9af-51930885b072 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.062192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ff73-0f56-4260-a9af-51930885b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.086739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e6b4ff73-0f56-4260-a9af-51930885b072 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:05.088306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e6b4ff73-0f56-4260-a9af-51930885b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:05.114792 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:05.163650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ebce3-f03b-4031-b087-6bd9b3543acd None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:05.206128 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 286/574] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:05.223132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83052fc-7509-4a61-86bb-a2b75aae041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:05.223692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83052fc-7509-4a61-86bb-a2b75aae041a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.223964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83052fc-7509-4a61-86bb-a2b75aae041a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.224290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83052fc-7509-4a61-86bb-a2b75aae041a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.237862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83052fc-7509-4a61-86bb-a2b75aae041a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:05.239404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83052fc-7509-4a61-86bb-a2b75aae041a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-d83052fc-7509-4a61-86bb-a2b75aae041a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:05.255189 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:05.256144 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:05.257686 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 289/575] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:05.262176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4ff73-0f56-4260-a9af-51930885b072 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:05.290374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684599-5efc-4698-b559-c7e0a3586772 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.290765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684599-5efc-4698-b559-c7e0a3586772 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.291044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684599-5efc-4698-b559-c7e0a3586772 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.292641 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 290/576] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:05.297882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5ff2-fadc-490e-a700-2515816d51f7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.298178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5ff2-fadc-490e-a700-2515816d51f7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.298452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5ff2-fadc-490e-a700-2515816d51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.318575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5c7f5ff2-fadc-490e-a700-2515816d51f7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:05.319823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c7f5ff2-fadc-490e-a700-2515816d51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:05.401465 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:05.405672 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 291/577] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:05.421541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4ff73-0f56-4260-a9af-51930885b072 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:05.461366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:05.461989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.462268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.462536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.463221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:05.463519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:05.464938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:05.476755 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 287/578] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:05.483132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5ff2-fadc-490e-a700-2515816d51f7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:05.514318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:05.558336 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:05.601894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5ff2-fadc-490e-a700-2515816d51f7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:05.640270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:05.640942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.641218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.641494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/8d2725c03b7e40c39b3db1cd9c45ed71/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.643610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=8d2725c03b7e40c39b3db1cd9c45ed71, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:05.645034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:05.695136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb61880-17f4-44e3-8e91-462f5fea36f9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:05.734844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:05.735483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.735759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.736025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] PATH_INFO: `/v3/services/network` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.736632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:05.738008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:05.746971 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:05.753810 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:05.754819 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 288/579] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:05 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:05.755870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:05.767359 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:05.767727 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 292/580] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:51:05 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/8d2725c03b7e40c39b3db1cd9c45ed71/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:51:05.769525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:05.906222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8784c-da3f-47fd-854a-3e437c269376 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:05.938124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ede8-3ecc-4aad-8271-b881c9a41f12 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:05.952025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:05.952732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.953013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.953331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.953930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:05.956324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:05.957363 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:05.970806 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:05.982361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:05.983796 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 289/581] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Oct 23 00:51:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:05.984593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:05.995552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:05.996139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:05.996353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:05.996641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:05.997340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] RBAC: Adding query filter params (name=network) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:05.997768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:05.999539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.006014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 293/582] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:06.011956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:06.081234 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:06.109898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e8e1a-9e4a-4b45-842e-4494b05f70c4 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.135082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68595-950f-4069-b6de-c3159b57bccf None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.166724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.167353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.167631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.167902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.168537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:06.168834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.170267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.175116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.175998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.176123 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 290/583] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 23 00:51:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:06.176603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.177128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.178037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:06.178595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.180145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.181330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:06.187132 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 294/584] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:06.193744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:06.242222 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:06.303790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210112c-0696-462c-aeca-7993629d63ba None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.322618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e3d0b-2770-4982-9217-de9c2847e3a7 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.342620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79acd90-85f4-4143-accf-ace2bab7ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.343931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79acd90-85f4-4143-accf-ace2bab7ca84 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.344890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79acd90-85f4-4143-accf-ace2bab7ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.345363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79acd90-85f4-4143-accf-ace2bab7ca84 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.346236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79acd90-85f4-4143-accf-ace2bab7ca84 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:06.346763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79acd90-85f4-4143-accf-ace2bab7ca84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.349297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79acd90-85f4-4143-accf-ace2bab7ca84 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.356809 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 291/585] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:06.359762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba257b-73cc-4711-ac90-9b038749260c None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.360366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba257b-73cc-4711-ac90-9b038749260c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.360854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba257b-73cc-4711-ac90-9b038749260c None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.362991 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 292/586] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:06.363613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c527dcf-4b72-482a-a5b4-33b2dbc3d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.364181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba257b-73cc-4711-ac90-9b038749260c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:06.364289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c527dcf-4b72-482a-a5b4-33b2dbc3d01c None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.364539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c527dcf-4b72-482a-a5b4-33b2dbc3d01c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.364752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c527dcf-4b72-482a-a5b4-33b2dbc3d01c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.365547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c527dcf-4b72-482a-a5b4-33b2dbc3d01c None admin] RBAC: Adding query filter params (interface=public, service_id=20087322380a4a5f8de7c1fcd760e469, region_id=RegionOne) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:06.365948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c527dcf-4b72-482a-a5b4-33b2dbc3d01c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.367557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c527dcf-4b72-482a-a5b4-33b2dbc3d01c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.368280 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:06.376242 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 295/587] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/endpoints?service_id=20087322380a4a5f8de7c1fcd760e469&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:06.377607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb332-f35b-4784-bdaf-16e54e7d0cd1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.377888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb332-f35b-4784-bdaf-16e54e7d0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.378313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb332-f35b-4784-bdaf-16e54e7d0cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.398232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cf0fb332-f35b-4784-bdaf-16e54e7d0cd1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:06.399244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf0fb332-f35b-4784-bdaf-16e54e7d0cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:06.494761 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 296/588] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:06.494761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fb332-f35b-4784-bdaf-16e54e7d0cd1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:06.537936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba257b-73cc-4711-ac90-9b038749260c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.544666 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:06.603624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.604156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.604434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.604705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.605406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] RBAC: Adding query filter params (interface=public, service_id=91a3ae4dd35a432fa2bc8d65d54f240f, region_id=RegionOne) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:06.605709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.607115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.616077 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 293/589] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/endpoints?service_id=91a3ae4dd35a432fa2bc8d65d54f240f&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:06.625547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:06.678990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fb332-f35b-4784-bdaf-16e54e7d0cd1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.746459 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:06.752076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.752696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.752974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.753289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.753898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.755503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.771306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 297/590] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/services => generated 772 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:06.780827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d938a-4937-40e9-8c61-1e3bf816ed36 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.789456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:06.855887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.856961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.858058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.858608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.866161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.866161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.912082 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:06.919513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63dd0c-596b-4662-a9a2-f267096d57fe None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:06.959334 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 294/591] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/services => generated 772 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:06.962755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:06.963421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:06.963698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:06.963968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:06.964563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:06.965956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:06.976226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:06.977226 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:06.978122 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 298/592] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:06.987141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:07.111066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f603f0e-371b-4e5f-a10b-05518c0a36db None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:07.143230 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:07.149037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5698996-9f7a-41f8-ba83-b043a8f3e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:07.149649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5698996-9f7a-41f8-ba83-b043a8f3e852 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:07.149922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5698996-9f7a-41f8-ba83-b043a8f3e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:07.150289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5698996-9f7a-41f8-ba83-b043a8f3e852 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:07.150918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5698996-9f7a-41f8-ba83-b043a8f3e852 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:07.151216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5698996-9f7a-41f8-ba83-b043a8f3e852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:07.152580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5698996-9f7a-41f8-ba83-b043a8f3e852 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:07.157373 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 295/593] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:07.162692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:07.272437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc452c-97b8-44ef-aa81-2cdadf6bf31e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:07.307874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14006f88-926d-4fb2-b797-58c53be22f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:07.308490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14006f88-926d-4fb2-b797-58c53be22f36 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:07.308767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14006f88-926d-4fb2-b797-58c53be22f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:07.309079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14006f88-926d-4fb2-b797-58c53be22f36 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:07.309707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14006f88-926d-4fb2-b797-58c53be22f36 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:07.310020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14006f88-926d-4fb2-b797-58c53be22f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:07.312065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14006f88-926d-4fb2-b797-58c53be22f36 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:07.316958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 299/594] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:07.732164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924759e5-510f-4edb-9f60-03e604307ea6 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:07.732973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924759e5-510f-4edb-9f60-03e604307ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:07.733251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924759e5-510f-4edb-9f60-03e604307ea6 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:07.734639 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 296/595] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:07.741223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6e7e-c8ef-4a09-a0eb-b869a57b00c2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:07.741450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6e7e-c8ef-4a09-a0eb-b869a57b00c2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:07.741714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6e7e-c8ef-4a09-a0eb-b869a57b00c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:07.761031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9fcb6e7e-c8ef-4a09-a0eb-b869a57b00c2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:07.762275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9fcb6e7e-c8ef-4a09-a0eb-b869a57b00c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:07.781194 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:07.838095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 300/596] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:08.106684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924759e5-510f-4edb-9f60-03e604307ea6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:08.219851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924759e5-510f-4edb-9f60-03e604307ea6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:08.262574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:08.263668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:08.264655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:08.265128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:08.282187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:08.287287 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:08.288201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:51:08.289018 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:08.291249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 297/597] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:08.297231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb6e7e-c8ef-4a09-a0eb-b869a57b00c2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:08.441765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb6e7e-c8ef-4a09-a0eb-b869a57b00c2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:08.491319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d01e7-0a2b-4eb3-952d-ad75ed7b1f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:08.491946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d01e7-0a2b-4eb3-952d-ad75ed7b1f24 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:08.492218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d01e7-0a2b-4eb3-952d-ad75ed7b1f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:08.492485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d01e7-0a2b-4eb3-952d-ad75ed7b1f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:08.493152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d01e7-0a2b-4eb3-952d-ad75ed7b1f24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:08.493450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d01e7-0a2b-4eb3-952d-ad75ed7b1f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:08.494829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d01e7-0a2b-4eb3-952d-ad75ed7b1f24 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:08.509573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 301/598] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:08.515053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:08.571515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee549-cc65-4397-83f7-066eb8942405 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:08.571840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee549-cc65-4397-83f7-066eb8942405 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:08.572058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee549-cc65-4397-83f7-066eb8942405 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:08.573386 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 302/599] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:08.581946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3c8a-c417-4f9c-8074-d29fcc87452b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:08.582248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3c8a-c417-4f9c-8074-d29fcc87452b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:08.582518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3c8a-c417-4f9c-8074-d29fcc87452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:08.601482 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:08.619018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dceb3c8a-c417-4f9c-8074-d29fcc87452b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:08.620229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dceb3c8a-c417-4f9c-8074-d29fcc87452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:08.640825 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:08.652452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638e0d-ea18-4711-93a8-e8df6d15d239 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:08.692717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:08.693264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:08.693538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:08.693807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:08.706392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:08.707947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:08.724358 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:08.725273 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:08.726189 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:08.726189 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:08.726189 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:08.726189 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 298/600] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:08.747470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:08.762147 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 303/601] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:08.868671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237dd8-a626-48d0-9bc7-38f60f2f2665 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:08.876213 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:08.903551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:08.904168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:08.904616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:08.904892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:08.905576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:08.905914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:08.907348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:08.923849 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 299/602] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:08.929827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb3c8a-c417-4f9c-8074-d29fcc87452b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.061829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb3c8a-c417-4f9c-8074-d29fcc87452b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:09.094786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.098817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:09.099457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.099732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.099998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.114098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:09.115542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:09.134086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:09.135089 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:09.136021 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:09.144119 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 304/603] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:51:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:09.147663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.161840 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:09.248732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfb2c1-ea7d-41e6-a12f-abc5c1ac81cd None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:09.307418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:09.308055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.308328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.308592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.320988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:09.327253 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:09.328137 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:09.328962 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 300/604] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:09.338735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.343454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25239cce-68de-43cc-a7bf-0f44fe3b05e2 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:09.383677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:09.384687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.385162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.386401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.387406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:09.390063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:09.391797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:09.412430 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:09.435062 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 305/605] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 23 00:51:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:09.446792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.534855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cedc0-7f21-4370-98c9-9f218c7d7692 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:09.558310 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:09.575694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b18bc-4ce0-443f-805d-4745086f5a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:09.576844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b18bc-4ce0-443f-805d-4745086f5a58 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.577121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b18bc-4ce0-443f-805d-4745086f5a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.577388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b18bc-4ce0-443f-805d-4745086f5a58 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.578617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b18bc-4ce0-443f-805d-4745086f5a58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:09.578617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b18bc-4ce0-443f-805d-4745086f5a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:09.579928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b18bc-4ce0-443f-805d-4745086f5a58 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:09.596055 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 301/606] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:09.596055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abbee-cb0b-441b-8909-51fce34cd8ae None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.596055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abbee-cb0b-441b-8909-51fce34cd8ae None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.596055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92abbee-cb0b-441b-8909-51fce34cd8ae None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.596055 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 302/607] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:09.596840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abbee-cb0b-441b-8909-51fce34cd8ae None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.627124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e00bb6-797b-40cd-9048-d1bb4bf2e8b9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:09.674205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13fbf1-d408-45ab-88f4-ad3a0a58754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:09.675706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13fbf1-d408-45ab-88f4-ad3a0a58754d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.676192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13fbf1-d408-45ab-88f4-ad3a0a58754d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.677545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13fbf1-d408-45ab-88f4-ad3a0a58754d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.698127 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:09.712398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92abbee-cb0b-441b-8909-51fce34cd8ae None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:09.749563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8164611-9b4b-4787-8d7c-0759032f41a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:09.750326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8164611-9b4b-4787-8d7c-0759032f41a8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.750658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8164611-9b4b-4787-8d7c-0759032f41a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.751164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8164611-9b4b-4787-8d7c-0759032f41a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.757153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13fbf1-d408-45ab-88f4-ad3a0a58754d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:09.758630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13fbf1-d408-45ab-88f4-ad3a0a58754d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:09.761760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8164611-9b4b-4787-8d7c-0759032f41a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:09.763263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8164611-9b4b-4787-8d7c-0759032f41a8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-a8164611-9b4b-4787-8d7c-0759032f41a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:09.779981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:09.780968 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:09.781849 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:09.781849 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:09.781849 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:09.781849 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 303/608] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:09.782539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444314-488f-40b6-9664-1d3a117198ce None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.782796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444314-488f-40b6-9664-1d3a117198ce None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.783277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444314-488f-40b6-9664-1d3a117198ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.804324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-13444314-488f-40b6-9664-1d3a117198ce None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:09.805617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-13444314-488f-40b6-9664-1d3a117198ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:09.826050 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:09.871213 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 306/609] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:51:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:51:09.871213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2a509-8dfd-4110-b0c9-1e4e5ace8a73 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:09.871213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2a509-8dfd-4110-b0c9-1e4e5ace8a73 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:09.871213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2a509-8dfd-4110-b0c9-1e4e5ace8a73 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:09.871213 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 307/610] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:09.871213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2a509-8dfd-4110-b0c9-1e4e5ace8a73 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.893998 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 304/611] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:09.893998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13444314-488f-40b6-9664-1d3a117198ce None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:09.977559 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:09.994101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2a509-8dfd-4110-b0c9-1e4e5ace8a73 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.008471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13444314-488f-40b6-9664-1d3a117198ce None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.031775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf47ff-1093-4572-9ae6-2f0fc2a9fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.032385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf47ff-1093-4572-9ae6-2f0fc2a9fc38 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.032659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf47ff-1093-4572-9ae6-2f0fc2a9fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.032932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf47ff-1093-4572-9ae6-2f0fc2a9fc38 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.033623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf47ff-1093-4572-9ae6-2f0fc2a9fc38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:10.033925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf47ff-1093-4572-9ae6-2f0fc2a9fc38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.035370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf47ff-1093-4572-9ae6-2f0fc2a9fc38 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.048084 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 308/612] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:10.049694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472fb40-da83-4391-885e-b9fb098084eb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.049999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472fb40-da83-4391-885e-b9fb098084eb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.050326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472fb40-da83-4391-885e-b9fb098084eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.053058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.053629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.053916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.054217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.068523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.070035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.071924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3472fb40-da83-4391-885e-b9fb098084eb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:10.073258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3472fb40-da83-4391-885e-b9fb098084eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:10.087104 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:10.088152 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:10.089015 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:10.089015 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:10.089015 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:10.094122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 305/613] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:10.095052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.096576 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.170289 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 309/614] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:10.171226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472fb40-da83-4391-885e-b9fb098084eb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.230511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efc67e-7009-40a8-8fa1-9f0dd1325849 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.260800 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.274808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.275431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.275725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.275993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.283315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.284741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.293203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472fb40-da83-4391-885e-b9fb098084eb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:10.296541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:10.297592 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 306/615] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:10.298957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.334777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73006cc3-1f1a-473b-928e-6a9bcfebbb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.335383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006cc3-1f1a-473b-928e-6a9bcfebbb4e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.335654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006cc3-1f1a-473b-928e-6a9bcfebbb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.335916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006cc3-1f1a-473b-928e-6a9bcfebbb4e None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.336546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73006cc3-1f1a-473b-928e-6a9bcfebbb4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:10.336840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73006cc3-1f1a-473b-928e-6a9bcfebbb4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.338257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73006cc3-1f1a-473b-928e-6a9bcfebbb4e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.349738 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 310/616] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:10.350766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ff741-61ce-41f5-8713-17179514ba32 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.351043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ff741-61ce-41f5-8713-17179514ba32 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.351311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ff741-61ce-41f5-8713-17179514ba32 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.352607 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 311/617] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:10.358112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ff741-61ce-41f5-8713-17179514ba32 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.373376 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.410628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53eff9-54d7-411d-9e75-e4c4cd2f4bca None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.445911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.446564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.446838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.447105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] PATH_INFO: `/v3/services/network` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.447685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.449064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:10.457622 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:10.458651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:10.459468 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 307/618] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:10.460492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.465139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ff741-61ce-41f5-8713-17179514ba32 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.499579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89164bf-d307-4d00-9f4c-e6d6cc26865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.500182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89164bf-d307-4d00-9f4c-e6d6cc26865a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.500456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89164bf-d307-4d00-9f4c-e6d6cc26865a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.500724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89164bf-d307-4d00-9f4c-e6d6cc26865a None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.501430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89164bf-d307-4d00-9f4c-e6d6cc26865a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:10.501729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89164bf-d307-4d00-9f4c-e6d6cc26865a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.503163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89164bf-d307-4d00-9f4c-e6d6cc26865a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.508440 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.519741 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 312/619] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:10.520928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad953d1-df3b-43a5-bd48-de54a1afd06d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.521231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad953d1-df3b-43a5-bd48-de54a1afd06d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.522158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad953d1-df3b-43a5-bd48-de54a1afd06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.539160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cad953d1-df3b-43a5-bd48-de54a1afd06d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:10.540354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cad953d1-df3b-43a5-bd48-de54a1afd06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:10.563379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433f465-5d8a-4d37-b835-26ba96ce8f35 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.596204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.596757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.597031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.597298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.601243 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.603641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.605053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.605810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 313/620] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:10.606673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad953d1-df3b-43a5-bd48-de54a1afd06d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:10.617938 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:10.619403 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:10.620473 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:10.622125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 308/621] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:10.623053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.716319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad953d1-df3b-43a5-bd48-de54a1afd06d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.725440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41481c-232a-41e0-8a5e-ad41dc85d8be None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.732740 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.752689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.753323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.753603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.753874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.754491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.755838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.758570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.759212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.759668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.760083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.761216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] RBAC: Adding query filter params (name=network) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:10.761514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.762882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:10.765411 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:10.766427 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:10.767266 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 314/622] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:10.768052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.777390 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 309/623] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:10.777390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.834795 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.876945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d2301-282f-4d01-8665-1cf055f5ad2d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.877168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055a2c-49df-4808-a872-e5fd69ab767d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:10.910510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.910681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:10.911117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.911215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:10.911389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.911491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:10.911656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.911747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:10.912336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:10.912638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.914073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:10.926104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 310/624] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:10.926701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:10.954937 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:10.983364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:10.984804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.020779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9402364-76f4-4ced-a76f-4a0251bd58b8 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.042954 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:11.053488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.054193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.054474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.054743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.055362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:11.055663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.057004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.061955 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 311/625] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:11.062744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.081044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 315/626] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:51:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:51:11.081859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.154682 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:11.160980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824384-4403-4b50-af1a-0b6b9bbba6b0 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.179887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef618c8-79e3-4e29-b317-82640124872b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.193240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.193834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.194139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.194408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.195022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] RBAC: Adding query filter params (type=network) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:11.195320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.196660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.201738 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 312/627] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:11.202527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.217364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.217984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.218279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.218548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.219194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.220542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.296878 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 316/628] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:11 2022] POST /identity/v3/services => generated 269 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:11.297074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be740e-1338-4bc2-90be-44e271cb1927 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.297681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.331792 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:11.344743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.345372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.345684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.345960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.346721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] RBAC: Adding query filter params (role.id=c072deb041d34b509dec24befa733f51, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=dfa33bd9a95046b68371e1107a5507fd) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:11.347030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.348544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.355474 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 313/629] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:51:11 2022] GET /identity/v3/role_assignments?user.id=dfa33bd9a95046b68371e1107a5507fd&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=c072deb041d34b509dec24befa733f51 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:11.356475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.380804 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:11.444098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051074d6-018e-4702-b5e5-4d960a31f3d4 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.482683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239a7d3-aa20-4065-87a4-d1b1537e73e5 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.495403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.496220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.496421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.496680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.497333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:11.497636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.499810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.507533 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 317/630] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 23 00:51:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:11.508372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.530205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.531146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.531583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.531855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.547654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.550194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:11.567527 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:11.568564 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:11.569553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:11.569553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:11.569553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:11.569553 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 314/631] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:11.569786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.631315 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:11.649518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0558f-d6d0-410e-b8a7-27dfcd1d3e5a None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.657537 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:11.686703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.687607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.687805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.688070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.688960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.690127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.699052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95c83e-a084-432c-bbb8-e3cb42b2bb37 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:11.735571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:11.736180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:11.736458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:11.736728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:11.737393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:11.738757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:11.786360 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 318/632] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:11.786360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:11.842431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 315/633] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:11.935317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169079c-ce3b-42eb-95be-b67dd93394ae None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:12.000943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:12.001623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:12.001926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:12.002215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:12.002878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:12.003244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:12.004643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:12.007996 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:12.019738 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 319/634] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:12.024981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:12.152315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9baa9-712f-4196-ba67-c984c02088db None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:12.185440 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:12.194778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:12.197391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:12.197391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:12.197391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:12.204175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:12.205785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:12.217792 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:12.218996 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:12.220172 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:12.223002 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 316/635] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:12.228434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:12.335307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9da9-9f28-4a01-bec4-f38dc01a8350 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:12.369837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7439c74-38a4-4f2b-8546-d092e72b8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:12.370473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439c74-38a4-4f2b-8546-d092e72b8d04 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:12.370749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439c74-38a4-4f2b-8546-d092e72b8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:12.371018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439c74-38a4-4f2b-8546-d092e72b8d04 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:12.371709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7439c74-38a4-4f2b-8546-d092e72b8d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:12.372015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7439c74-38a4-4f2b-8546-d092e72b8d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:12.374003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7439c74-38a4-4f2b-8546-d092e72b8d04 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:12.385968 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 320/636] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:12.391879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:12.502293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d26ac-e489-4296-a689-6317b9a9e4a9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:12.537766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed378742-047d-42b4-9336-9f81cd5b22c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:12.538461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed378742-047d-42b4-9336-9f81cd5b22c2 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:12.538738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed378742-047d-42b4-9336-9f81cd5b22c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:12.539010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed378742-047d-42b4-9336-9f81cd5b22c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:12.539730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed378742-047d-42b4-9336-9f81cd5b22c2 None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=8d2725c03b7e40c39b3db1cd9c45ed71) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:12.540036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed378742-047d-42b4-9336-9f81cd5b22c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:12.541454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed378742-047d-42b4-9336-9f81cd5b22c2 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:12.547609 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 317/637] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:51:12 2022] GET /identity/v3/role_assignments?user.id=8d2725c03b7e40c39b3db1cd9c45ed71&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:13.605023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1169a37-a4fd-46e3-9271-80e26694c21d None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:13.605560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1169a37-a4fd-46e3-9271-80e26694c21d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:13.605560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1169a37-a4fd-46e3-9271-80e26694c21d None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:13.607273 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 321/638] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:13.612882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7c457-1bd8-4d8e-b6b2-a7012c1c6a3e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:13.613320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7c457-1bd8-4d8e-b6b2-a7012c1c6a3e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:13.613504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7c457-1bd8-4d8e-b6b2-a7012c1c6a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:13.633160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7db7c457-1bd8-4d8e-b6b2-a7012c1c6a3e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:13.634404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7db7c457-1bd8-4d8e-b6b2-a7012c1c6a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:13.686155 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:13.708908 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 318/639] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:13.755543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a378-4731-46f8-9fb3-da99756e9668 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:13.755716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a378-4731-46f8-9fb3-da99756e9668 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:13.755995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a378-4731-46f8-9fb3-da99756e9668 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:13.757325 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 322/640] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:13.762650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e698a8-bd0e-4404-aaca-73c3ede6cfdd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:13.762936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e698a8-bd0e-4404-aaca-73c3ede6cfdd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:13.763237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e698a8-bd0e-4404-aaca-73c3ede6cfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:13.782215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-76e698a8-bd0e-4404-aaca-73c3ede6cfdd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:13.783383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-76e698a8-bd0e-4404-aaca-73c3ede6cfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:13.855213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 319/641] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:13.982938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a378-4731-46f8-9fb3-da99756e9668 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.039789 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:14.089207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a378-4731-46f8-9fb3-da99756e9668 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.126009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.126630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.126904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.127176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.127756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.129113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:14.138066 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:14.139064 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:14.139937 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:14.144141 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 323/642] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 23 00:51:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:14.145498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e698a8-bd0e-4404-aaca-73c3ede6cfdd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.148921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.259052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e698a8-bd0e-4404-aaca-73c3ede6cfdd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.265032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3789d-92ae-4cd7-a6df-13aadcd99063 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.270007 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:14.287672 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:14.294855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7f39e-6bf1-44ac-88e3-c708836e10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.295383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7f39e-6bf1-44ac-88e3-c708836e10fd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.295657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7f39e-6bf1-44ac-88e3-c708836e10fd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.295925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7f39e-6bf1-44ac-88e3-c708836e10fd None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.296551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7f39e-6bf1-44ac-88e3-c708836e10fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:14.297071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7f39e-6bf1-44ac-88e3-c708836e10fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.298227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7f39e-6bf1-44ac-88e3-c708836e10fd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.301920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ff0d9-2e8f-4ba7-ab35-3135ac10f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.308210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ff0d9-2e8f-4ba7-ab35-3135ac10f58b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.308210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ff0d9-2e8f-4ba7-ab35-3135ac10f58b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.308390 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 320/643] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:14.308472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ff0d9-2e8f-4ba7-ab35-3135ac10f58b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.308630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d6cdb-99f3-47d5-8c77-b3325c5b94c6 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.308630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d6cdb-99f3-47d5-8c77-b3325c5b94c6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.308630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d6cdb-99f3-47d5-8c77-b3325c5b94c6 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.308630 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 321/644] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:14.311501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d6cdb-99f3-47d5-8c77-b3325c5b94c6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.320561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ff0d9-2e8f-4ba7-ab35-3135ac10f58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-474ff0d9-2e8f-4ba7-ab35-3135ac10f58b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:14.327159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:14.328250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:14.329447 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 324/645] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:14.330624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e5af-b1d4-4d83-b005-16ac28e7826d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.331269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e5af-b1d4-4d83-b005-16ac28e7826d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.331988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e5af-b1d4-4d83-b005-16ac28e7826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.349373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4a45e5af-b1d4-4d83-b005-16ac28e7826d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:14.350599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a45e5af-b1d4-4d83-b005-16ac28e7826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:14.420429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d6cdb-99f3-47d5-8c77-b3325c5b94c6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.430173 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 325/646] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:14 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:14.430173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e5af-b1d4-4d83-b005-16ac28e7826d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.465361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.466194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.466561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.466893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.467638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:14.470415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.470415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.474602 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 322/647] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:14.480923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.525137 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:14.554987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e5af-b1d4-4d83-b005-16ac28e7826d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.568690 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:14.589649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630fdc-a510-4e40-8067-a05eeb62da29 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.599909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.600791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.601718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.602242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.603645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:14.604284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.606143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.624226 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 326/648] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:14.625221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.635754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.636420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.636698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.636975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.637673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] RBAC: Adding query filter params (interface=public, service_id=3112d497e60244b89f472f2d03311157, region_id=RegionOne) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:14.638010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.639474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.645115 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 323/649] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/endpoints?service_id=3112d497e60244b89f472f2d03311157&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:14.651392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.754913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0713-e8d3-4528-90e9-9d16f03851da None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.762777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dd73a-fc1e-4f2d-bbe5-12a9f1fee4b7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.764629 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:14.789547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce95ca-51d7-490f-865f-ad8db39323fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.790200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce95ca-51d7-490f-865f-ad8db39323fd None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.790473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce95ca-51d7-490f-865f-ad8db39323fd None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.790737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce95ca-51d7-490f-865f-ad8db39323fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.797845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.798478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.798758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.799029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.799879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.801227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.801413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce95ca-51d7-490f-865f-ad8db39323fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.802852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce95ca-51d7-490f-865f-ad8db39323fd None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.806785 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 324/650] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/services => generated 1029 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:51:14.807499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-dcce95ca-51d7-490f-865f-ad8db39323fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:14.820803 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:14.826324 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:14.827220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:14.827220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:14.827220 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:14.827220 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 327/651] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:14.827220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e92d-ccf6-4c4c-ab08-0ef607390a20 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.827220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e92d-ccf6-4c4c-ab08-0ef607390a20 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.827220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e92d-ccf6-4c4c-ab08-0ef607390a20 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.828206 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 328/652] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:14.829208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e92d-ccf6-4c4c-ab08-0ef607390a20 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:14.858437 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:14.929498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68cd76-c7e5-4771-af70-0c4057a68b60 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.944958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e92d-ccf6-4c4c-ab08-0ef607390a20 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:14.966002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541924d-6b62-4256-aae9-597911f883a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.967195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541924d-6b62-4256-aae9-597911f883a1 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.967470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541924d-6b62-4256-aae9-597911f883a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.967734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541924d-6b62-4256-aae9-597911f883a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.968518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541924d-6b62-4256-aae9-597911f883a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.969809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541924d-6b62-4256-aae9-597911f883a1 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3541924d-6b62-4256-aae9-597911f883a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:14.978864 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:14.979919 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:14.980774 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 325/653] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:14.981581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1561c-06b2-42a6-8454-7211834999f6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.981655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1561c-06b2-42a6-8454-7211834999f6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.983029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1561c-06b2-42a6-8454-7211834999f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.985936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:14.986579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:14.986859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:14.987125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:14.987763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:14.988062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:14.989413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.002204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4eb1561c-06b2-42a6-8454-7211834999f6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:15.002636 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 329/654] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:15.002802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4eb1561c-06b2-42a6-8454-7211834999f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:15.003468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.031751 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:15.076352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 326/655] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:14 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:15.077575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1561c-06b2-42a6-8454-7211834999f6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.103110 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:15.120388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef62f7d-0713-4d3d-8334-7b3c30021ac3 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.157406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.158042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.158550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.158896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.159558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:15.160309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.161940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.171841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 330/656] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:15.174002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.208028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1561c-06b2-42a6-8454-7211834999f6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.242735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.243374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.243650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.243920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.251445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.252871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:15.265025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:15.266024 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:15.267533 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 327/657] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:15.278608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.293648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffd74a-2284-4429-930d-45043446c475 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.303219 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:15.334303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.335254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.335746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.336229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.337055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:15.337573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.339949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.353776 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 331/658] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:15.372006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.390963 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:15.391479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda56833-fdda-4d06-b60b-1c78ccf635a6 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.431126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.432158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.432753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.433343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.434365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:15.434887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.436763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.463018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 328/659] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:15.464449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.499181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3f42e-f3e4-4984-adcf-a24431164ab9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.544190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.545170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.545448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.545717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.546797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.548482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:15.561203 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:15.562337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:15.563210 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 332/660] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:15.570336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.571060 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:15.600791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b774-5d90-4d6d-95ac-979ec76408f9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.635912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.636556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.636893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.637167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.648351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.649900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.656182 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:15.665594 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:15.666782 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:15.667885 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:15.667885 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:15.667885 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:15.667885 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 329/661] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:15.672957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.680956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e703a-0ad2-4144-8b11-347b17564689 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.718023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.718673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.718948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.719326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.719971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:15.720269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.721788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.727821 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 333/662] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:15.733631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.785260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860af5f-e2dc-421f-b30a-c3ae4eea6ea7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.818021 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:15.827324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.828493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.829355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.829890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.830776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:15.831295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.833725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.844830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1c1b-6e42-4203-a995-771060259ac3 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:15.852000 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 330/663] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:15.852990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:15.882474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:15.883404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:15.883955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:15.884458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:15.885332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:15.885700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:15.887157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:15.902106 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 334/664] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:15.963330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23856-fc52-4f94-b713-b4708f50646c None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:16.001349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:16.002017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:16.002300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:16.002570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:16.010396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:16.011845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:16.024365 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:16.025394 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:16.026296 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 331/665] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:16.035113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:16.041560 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:16.156532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275e3c-89a6-4f1b-b182-c8ec04cdfb97 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:16.190920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b349c2-de97-492c-b87b-de08c26274f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:16.191954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b349c2-de97-492c-b87b-de08c26274f2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:16.192460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b349c2-de97-492c-b87b-de08c26274f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:16.192932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b349c2-de97-492c-b87b-de08c26274f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:16.193817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b349c2-de97-492c-b87b-de08c26274f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:16.194355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b349c2-de97-492c-b87b-de08c26274f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:16.195964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b349c2-de97-492c-b87b-de08c26274f2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:16.209644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 335/666] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:16.218799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:16.265932 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:16.317335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9b2f-cc24-4f0f-be06-872793b04da9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:16.352423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916ad89-2c93-4dd5-9f74-52ff9ab13c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:16.353183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ad89-2c93-4dd5-9f74-52ff9ab13c82 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:16.353460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ad89-2c93-4dd5-9f74-52ff9ab13c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:16.353727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ad89-2c93-4dd5-9f74-52ff9ab13c82 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/dfa33bd9a95046b68371e1107a5507fd/roles/6250b7a557cf4ada949a18f00b08c581` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:16.356036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916ad89-2c93-4dd5-9f74-52ff9ab13c82 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=dfa33bd9a95046b68371e1107a5507fd, role_id=6250b7a557cf4ada949a18f00b08c581)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:16.358092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916ad89-2c93-4dd5-9f74-52ff9ab13c82 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:16.425094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 332/667] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:51:16 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/dfa33bd9a95046b68371e1107a5507fd/roles/6250b7a557cf4ada949a18f00b08c581 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:51:17.026104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a096a0-d068-4bcd-9a06-8be5ce27a3cd None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:17.026623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a096a0-d068-4bcd-9a06-8be5ce27a3cd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:17.026623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a096a0-d068-4bcd-9a06-8be5ce27a3cd None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:17.028215 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 336/668] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:17.034206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb856-b2f9-46bd-88d5-be957f84ed2d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:17.034600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb856-b2f9-46bd-88d5-be957f84ed2d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:17.034764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb856-b2f9-46bd-88d5-be957f84ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:17.052790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a8abb856-b2f9-46bd-88d5-be957f84ed2d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:17.053949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a8abb856-b2f9-46bd-88d5-be957f84ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:17.129167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 333/669] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:17.395087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a096a0-d068-4bcd-9a06-8be5ce27a3cd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:17.456908 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:17.499991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a096a0-d068-4bcd-9a06-8be5ce27a3cd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:17.534636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c03a7-4a9d-4e1f-aafd-6fe85b7e7ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:17.535296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c03a7-4a9d-4e1f-aafd-6fe85b7e7ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:17.535643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c03a7-4a9d-4e1f-aafd-6fe85b7e7ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:17.535919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c03a7-4a9d-4e1f-aafd-6fe85b7e7ea2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:17.536521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c03a7-4a9d-4e1f-aafd-6fe85b7e7ea2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:17.537931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c03a7-4a9d-4e1f-aafd-6fe85b7e7ea2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-552c03a7-4a9d-4e1f-aafd-6fe85b7e7ea2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:17.548445 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:17.549710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:17.550614 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 337/670] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 23 00:51:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:17.559720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb856-b2f9-46bd-88d5-be957f84ed2d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:17.602302 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:17.662298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb856-b2f9-46bd-88d5-be957f84ed2d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:17.680902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7f002-5832-4be1-98de-949720dcb2da None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:17.681209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7f002-5832-4be1-98de-949720dcb2da None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:17.681454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7f002-5832-4be1-98de-949720dcb2da None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:17.683062 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 338/671] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:17.688816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab22b0-3650-46b1-8241-3d2b4a73cd1f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:17.689089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab22b0-3650-46b1-8241-3d2b4a73cd1f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:17.689354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab22b0-3650-46b1-8241-3d2b4a73cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:17.704461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:17.705430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:17.705913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:17.706426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:17.707366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:17.707782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-91ab22b0-3650-46b1-8241-3d2b4a73cd1f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:17.708148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:17.708971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-91ab22b0-3650-46b1-8241-3d2b4a73cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:17.709921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:17.715642 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 334/672] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:17.722093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:17.784894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 339/673] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:17.830569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf994d20-d6dd-42fb-b87d-c77253d0957a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:17.833209 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:17.869131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:17.870163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:17.870633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:17.871089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:17.871896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:17.872418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:17.874030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:17.880014 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 335/674] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:17.885834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab22b0-3650-46b1-8241-3d2b4a73cd1f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:17.944640 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:17.985860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab22b0-3650-46b1-8241-3d2b4a73cd1f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:18.019082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e77afc-496d-467e-970a-563fa69d9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:18.020089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77afc-496d-467e-970a-563fa69d9a29 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:18.020561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77afc-496d-467e-970a-563fa69d9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:18.021023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77afc-496d-467e-970a-563fa69d9a29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:18.021871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e77afc-496d-467e-970a-563fa69d9a29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:18.023424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e77afc-496d-467e-970a-563fa69d9a29 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:18.062106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:18.100897 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 340/675] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:51:18.188203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10dd1d-564e-4770-9e49-642a5a74dcd7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:18.211027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3ca9d-50b9-4c84-8a2f-8db0516a7c30 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:18.211396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3ca9d-50b9-4c84-8a2f-8db0516a7c30 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:18.211772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3ca9d-50b9-4c84-8a2f-8db0516a7c30 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:18.218304 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 341/676] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:18.220082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c734f90-d3f0-4cff-8f4d-930bb2b5b01e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:18.220359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c734f90-d3f0-4cff-8f4d-930bb2b5b01e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:18.220624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c734f90-d3f0-4cff-8f4d-930bb2b5b01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:18.239496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5c734f90-d3f0-4cff-8f4d-930bb2b5b01e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:18.239841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb7263-500d-4806-bc53-5f3f7b948882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:18.240704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c734f90-d3f0-4cff-8f4d-930bb2b5b01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:18.241029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7263-500d-4806-bc53-5f3f7b948882 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:18.241560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7263-500d-4806-bc53-5f3f7b948882 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:18.242097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7263-500d-4806-bc53-5f3f7b948882 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:18.243025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb7263-500d-4806-bc53-5f3f7b948882 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:18.244679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb7263-500d-4806-bc53-5f3f7b948882 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:18.315061 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 342/677] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:18 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:18.331139 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 336/678] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:18 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:51:18.582959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c734f90-d3f0-4cff-8f4d-930bb2b5b01e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:18.628931 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:18.673721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b8d8-40a4-48d8-97e9-adc302581626 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:18.674058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b8d8-40a4-48d8-97e9-adc302581626 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:18.674545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b8d8-40a4-48d8-97e9-adc302581626 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:18.675910 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 337/679] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:18.682674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0e4e5-fac0-45b8-924e-f3870edc63ca None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:18.683461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0e4e5-fac0-45b8-924e-f3870edc63ca None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:18.683936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0e4e5-fac0-45b8-924e-f3870edc63ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:18.691275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c734f90-d3f0-4cff-8f4d-930bb2b5b01e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:18.707934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-31e0e4e5-fac0-45b8-924e-f3870edc63ca None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:18.710122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-31e0e4e5-fac0-45b8-924e-f3870edc63ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:18.733380 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:18.738414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:18.738960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:18.739226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:18.739493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:18.740138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:18.741486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:18.788100 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 338/680] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:18.833634 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 343/681] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:18 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:19.063924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0e4e5-fac0-45b8-924e-f3870edc63ca None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:19.166298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0e4e5-fac0-45b8-924e-f3870edc63ca None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:19.211030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:19.211671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:19.212002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:19.212279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:19.222910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:19.227706 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:19.228672 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:19.229537 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 339/682] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 23 00:51:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:19.237079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:19.342431 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:19.345639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4db37-b589-4761-a1cf-002869fb56ca None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:19.379576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:19.380194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:19.380472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:19.380743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:19.381404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:19.381710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:19.383096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:19.392611 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 344/683] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 23 00:51:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:19.399261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:19.415133 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:19.504279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bb087-d7dd-4f05-81fe-25a798376ba3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:19.539030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:19.539669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:19.540294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:19.540569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:19.551884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:19.553342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:19.568201 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:19.569157 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:19.570076 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:19.570076 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:19.570076 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:19.570076 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 340/684] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:19.576407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:19.679866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1b917-6c15-4e96-9d6b-bbba3264485b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:19.718149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:19.718770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:19.719046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:19.719315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:19.719963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:19.720265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:19.721645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:19.735666 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 345/685] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:19.741208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:19.816151 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:19.846473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa747e-5b5d-4bff-877c-c7b40e8c835d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:19.881573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:19.882239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:19.882515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:19.882783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:19.890449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:19.891889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:19.902925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:19.903961 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:19.904926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 341/686] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:51:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:19.912017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:19.939532 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:20.017966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7bda7-f13e-4a40-8c9d-5ad0f686a40f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:20.053146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:20.054064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.054506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.054937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.055880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:20.056333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:20.058020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:20.076943 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 346/687] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 23 00:51:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:20.083337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:20.187595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f6807-c280-4b3c-985e-453c6c3d6bde None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:20.210967 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:20.223216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e077937-abeb-4caa-becb-3bebe3420c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:20.223829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e077937-abeb-4caa-becb-3bebe3420c6b None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.224104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e077937-abeb-4caa-becb-3bebe3420c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.224373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e077937-abeb-4caa-becb-3bebe3420c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.292305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e077937-abeb-4caa-becb-3bebe3420c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:20.293742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e077937-abeb-4caa-becb-3bebe3420c6b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:20.398336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 342/688] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:51:20 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:51:20.404185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:20.452397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca80d7-ed4a-4bbd-b60a-94ec2f9be07c None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.452690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca80d7-ed4a-4bbd-b60a-94ec2f9be07c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.452965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca80d7-ed4a-4bbd-b60a-94ec2f9be07c None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.454504 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 343/689] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:20.460499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa11765-f03e-45c0-8395-f54671f36d4d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.461571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa11765-f03e-45c0-8395-f54671f36d4d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.462105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa11765-f03e-45c0-8395-f54671f36d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.485781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-caa11765-f03e-45c0-8395-f54671f36d4d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:20.488098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-caa11765-f03e-45c0-8395-f54671f36d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:20.508297 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:20.518348 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:20.532561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66031642-3390-4bf2-84db-9de452a0e6d1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:20.567496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48083e-4ca5-4033-9eb3-38ed32a8b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:20.568140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48083e-4ca5-4033-9eb3-38ed32a8b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.568416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48083e-4ca5-4033-9eb3-38ed32a8b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.568697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48083e-4ca5-4033-9eb3-38ed32a8b2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.581023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48083e-4ca5-4033-9eb3-38ed32a8b2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:20.586018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48083e-4ca5-4033-9eb3-38ed32a8b2f9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:20.586167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 344/690] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:20.597105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaaa24-0590-4eda-8d8e-67fc6b8f8772 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.597389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaaa24-0590-4eda-8d8e-67fc6b8f8772 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.597665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaaa24-0590-4eda-8d8e-67fc6b8f8772 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-1f48083e-4ca5-4033-9eb3-38ed32a8b2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:20.600565 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:20.601573 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:20.603097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:20.603097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:20.603097 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:20.603097 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 347/691] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:20.603319 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 345/692] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:20.605784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a75a1f-092a-4c83-83af-dfe95c36871a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.605784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a75a1f-092a-4c83-83af-dfe95c36871a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.605784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a75a1f-092a-4c83-83af-dfe95c36871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.607413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaaa24-0590-4eda-8d8e-67fc6b8f8772 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:20.627876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d3a75a1f-092a-4c83-83af-dfe95c36871a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:20.629059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d3a75a1f-092a-4c83-83af-dfe95c36871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:20.711064 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 348/693] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:20.726641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaaa24-0590-4eda-8d8e-67fc6b8f8772 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:20.763372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:20.763977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.764255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.764533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.765169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:20.765466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:20.766852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:20.778630 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 346/694] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:20.794523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a75a1f-092a-4c83-83af-dfe95c36871a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:20.861127 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:20.870233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:20.887416 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:20.909538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a75a1f-092a-4c83-83af-dfe95c36871a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:20.954996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:20.955667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:20.956377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:20.956661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:20.966937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:20.968444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:20.986715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ce21-2a00-48b8-a9be-30c1748324f4 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:20.987233 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:20.988122 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:20.989014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 349/695] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:20.991002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.027634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.029601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.029883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.030241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.030833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.032197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:21.040994 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:21.041959 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:21.042857 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 347/696] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:21.044858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.101559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2cae-06b6-4e81-9e5b-21ecaf804b53 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.121100 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:21.124156 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:21.135061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.135688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.137732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.137732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.137732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.138176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.143626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264eb4b-cbfb-425f-8434-1d07eee8dc72 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:21.146615 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:21.147556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:21.148405 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 350/697] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:21.150043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.178459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b823abe-f339-4a03-868d-d6d3351bd852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.179063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b823abe-f339-4a03-868d-d6d3351bd852 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.179336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b823abe-f339-4a03-868d-d6d3351bd852 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.179598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b823abe-f339-4a03-868d-d6d3351bd852 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.180273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b823abe-f339-4a03-868d-d6d3351bd852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:21.180572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b823abe-f339-4a03-868d-d6d3351bd852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.182003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b823abe-f339-4a03-868d-d6d3351bd852 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.194563 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 348/698] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:21.195720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be68b5-6c04-41cc-bb82-0071ae5ad5ce None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.195996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be68b5-6c04-41cc-bb82-0071ae5ad5ce None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.196266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be68b5-6c04-41cc-bb82-0071ae5ad5ce None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.199842 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 349/699] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:21.199842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be68b5-6c04-41cc-bb82-0071ae5ad5ce None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.249481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a389e3-1699-42d8-9793-2074ad4a0def None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.282692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.283297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.283574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.283840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.284460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:21.284759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.286132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.290651 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 351/700] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:21.291407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.300622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be68b5-6c04-41cc-bb82-0071ae5ad5ce None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.333667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b848ed0-f16b-4ba0-88e2-28954997a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.334296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848ed0-f16b-4ba0-88e2-28954997a3ea None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.334576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848ed0-f16b-4ba0-88e2-28954997a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.334843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b848ed0-f16b-4ba0-88e2-28954997a3ea None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.335460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b848ed0-f16b-4ba0-88e2-28954997a3ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:21.335757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b848ed0-f16b-4ba0-88e2-28954997a3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.337104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b848ed0-f16b-4ba0-88e2-28954997a3ea None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.338817 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:21.339358 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:21.342127 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 350/701] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:21.343248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb18c-d8b1-44bd-bab6-331fe7fc577e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.343526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb18c-d8b1-44bd-bab6-331fe7fc577e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.343799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb18c-d8b1-44bd-bab6-331fe7fc577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.361368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-154cb18c-d8b1-44bd-bab6-331fe7fc577e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:21.362575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-154cb18c-d8b1-44bd-bab6-331fe7fc577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:21.388174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e02c6-314b-48d6-9436-ab05e3b3a652 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.421803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.422418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.422691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.422961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.423674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] RBAC: Adding query filter params (role.id=6250b7a557cf4ada949a18f00b08c581, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=dfa33bd9a95046b68371e1107a5507fd) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:21.423977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.425617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.427422 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 351/702] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:21.428247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cb18c-d8b1-44bd-bab6-331fe7fc577e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.431428 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 352/703] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/role_assignments?user.id=dfa33bd9a95046b68371e1107a5507fd&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=6250b7a557cf4ada949a18f00b08c581 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:21.432363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.554468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0419-6ef8-4d81-9f3c-d05bb0ae3005 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.567296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cb18c-d8b1-44bd-bab6-331fe7fc577e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.571168 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:21.593711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.594613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.595493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.595493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.596363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:21.596851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.598507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.601138 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:21.605163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 353/704] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:21.608448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.609063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.609343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.609615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.610385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:21.610688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.611498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.612065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.617133 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 352/705] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:21.713145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.734513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46ddc-c229-4acf-9b0b-1814573ee1b0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.782421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.783199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.783480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.783750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.784465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] RBAC: Adding query filter params (interface=public, service_id=d839cd6743e749538d594991238abc9f, region_id=RegionOne) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:21.784883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.790009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.792909 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 354/706] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/endpoints?service_id=d839cd6743e749538d594991238abc9f&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:21.798239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.833185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a4dbd-3009-4ae0-a758-93e050edaef1 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.848982 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:21.880132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.880806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.881090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.881369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.882563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.884559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:21.899832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:21.900895 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:21.901728 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:21.902494 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 353/707] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:21.907852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:21.914839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d97df-1b39-4e78-82b0-93c46d7b0303 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:21.954708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:21.955332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:21.955664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:21.955935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:21.956671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:21.958212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:21.966163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 355/708] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:51:21.977956 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:22.027373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072f1d-0109-478d-a220-9dcbd25291a9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:22.066953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:22.067573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:22.067901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:22.068174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:22.068858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:22.069161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:22.070593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:22.076644 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 354/709] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:22.082890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:22.196210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe544367-21cb-4859-add4-4b88f4738e07 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:22.203922 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:22.232748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:22.234176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:22.234925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:22.235395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:22.236281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:22.236781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:22.238386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:22.244075 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 356/710] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:22.250838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:22.357419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad994c-56bc-434a-85be-e450548faee5 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:22.382430 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:22.395237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18110634-a921-4228-a2d9-e2241619c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:22.396162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110634-a921-4228-a2d9-e2241619c101 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:22.396672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110634-a921-4228-a2d9-e2241619c101 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:22.397162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18110634-a921-4228-a2d9-e2241619c101 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:22.398084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110634-a921-4228-a2d9-e2241619c101 None admin] RBAC: Adding query filter params (interface=public, service_id=8efe0fea03f7411b8da5573b7fb34015, region_id=RegionOne) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:22.398592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110634-a921-4228-a2d9-e2241619c101 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:22.400140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18110634-a921-4228-a2d9-e2241619c101 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:22.410331 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 355/711] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:51:22 2022] GET /identity/v3/endpoints?service_id=8efe0fea03f7411b8da5573b7fb34015&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:22.412217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:22.520853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca4ca3-c4e5-4c29-af5e-18d62634ba1d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:22.555512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bcae0-8410-4c47-af76-d663d271d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:22.556126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bcae0-8410-4c47-af76-d663d271d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:22.556406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bcae0-8410-4c47-af76-d663d271d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:22.556678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bcae0-8410-4c47-af76-d663d271d6b4 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:22.557291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bcae0-8410-4c47-af76-d663d271d6b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:22.558674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bcae0-8410-4c47-af76-d663d271d6b4 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:22.565485 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 357/712] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:22 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:51:23.726090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ea36-baa7-4ba1-941b-df42f8d64a57 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:23.726639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ea36-baa7-4ba1-941b-df42f8d64a57 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:23.726639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ea36-baa7-4ba1-941b-df42f8d64a57 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:23.728277 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 356/713] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:23.734906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f2e5-9df0-4f53-b563-a361d2f5f068 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:23.735420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f2e5-9df0-4f53-b563-a361d2f5f068 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:23.735420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f2e5-9df0-4f53-b563-a361d2f5f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:23.755965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9830f2e5-9df0-4f53-b563-a361d2f5f068 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:23.757095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9830f2e5-9df0-4f53-b563-a361d2f5f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:23.786080 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:23.828072 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 358/714] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:23.856955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af83a1-ac76-4850-aafa-d241383c2da1 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:23.857398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af83a1-ac76-4850-aafa-d241383c2da1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:23.857508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af83a1-ac76-4850-aafa-d241383c2da1 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:23.859246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 357/715] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:23.864615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb929-867b-4358-b955-1fd3bee3a8fa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:23.864906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb929-867b-4358-b955-1fd3bee3a8fa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:23.865184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb929-867b-4358-b955-1fd3bee3a8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:23.883419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5d6bb929-867b-4358-b955-1fd3bee3a8fa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:23.884601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d6bb929-867b-4358-b955-1fd3bee3a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:23.951852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 359/716] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:24.097435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af83a1-ac76-4850-aafa-d241383c2da1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:24.210603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af83a1-ac76-4850-aafa-d241383c2da1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:24.227066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bb929-867b-4358-b955-1fd3bee3a8fa None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:24.248330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6569ba6-f50d-49aa-bfd5-a1ab1a356f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:24.248970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569ba6-f50d-49aa-bfd5-a1ab1a356f44 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.249252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569ba6-f50d-49aa-bfd5-a1ab1a356f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.249518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569ba6-f50d-49aa-bfd5-a1ab1a356f44 None admin] PATH_INFO: `/v3/services/image` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.250137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6569ba6-f50d-49aa-bfd5-a1ab1a356f44 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:24.251485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6569ba6-f50d-49aa-bfd5-a1ab1a356f44 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e6569ba6-f50d-49aa-bfd5-a1ab1a356f44 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:24.260551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:24.261543 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:24.267019 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 358/717] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Oct 23 00:51:24 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:24.267822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670548-9bb3-4d4c-8456-34fcb0ebc64f None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.267822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670548-9bb3-4d4c-8456-34fcb0ebc64f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.267822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670548-9bb3-4d4c-8456-34fcb0ebc64f None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.269285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 359/718] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:24.270204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670548-9bb3-4d4c-8456-34fcb0ebc64f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:24.325171 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:24.336950 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:24.343536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bb929-867b-4358-b955-1fd3bee3a8fa None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:24.379429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:24.379968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.380247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.380351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670548-9bb3-4d4c-8456-34fcb0ebc64f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:24.380509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.381166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:24.382731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:24.414393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c7a87-90cb-4b2d-b983-3d2739009c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:24.414997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7a87-90cb-4b2d-b983-3d2739009c97 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.415274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7a87-90cb-4b2d-b983-3d2739009c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.415583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7a87-90cb-4b2d-b983-3d2739009c97 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.416168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c7a87-90cb-4b2d-b983-3d2739009c97 None admin] RBAC: Adding query filter params (name=image) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:24.416468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c7a87-90cb-4b2d-b983-3d2739009c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:24.417812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c7a87-90cb-4b2d-b983-3d2739009c97 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:24.423071 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 360/719] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:24.424650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bcb7f-498f-4534-ab9f-9cf6023a38f4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.424928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bcb7f-498f-4534-ab9f-9cf6023a38f4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.425203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bcb7f-498f-4534-ab9f-9cf6023a38f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.443490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bd8bcb7f-498f-4534-ab9f-9cf6023a38f4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:24.444651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd8bcb7f-498f-4534-ab9f-9cf6023a38f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:24.458665 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 360/720] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:24 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:24.462953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:24.561312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 361/721] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:24.587933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922a5c-3c71-4f26-814a-187dd8f0d81d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:24.627219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4a2f6-fb2b-4edc-aef4-e8a030e06f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:24.628219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a2f6-fb2b-4edc-aef4-e8a030e06f3c None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.628816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a2f6-fb2b-4edc-aef4-e8a030e06f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.629311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a2f6-fb2b-4edc-aef4-e8a030e06f3c None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.630247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4a2f6-fb2b-4edc-aef4-e8a030e06f3c None admin] RBAC: Adding query filter params (type=image) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:24.630779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4a2f6-fb2b-4edc-aef4-e8a030e06f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:24.632372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4a2f6-fb2b-4edc-aef4-e8a030e06f3c None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:24.637864 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 361/722] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:24.811930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23e37-1b95-4806-babc-2eb0fd1b69df None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.812460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23e37-1b95-4806-babc-2eb0fd1b69df None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.812460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23e37-1b95-4806-babc-2eb0fd1b69df None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.814083 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 362/723] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:24.819552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47fbf-9689-449e-bc09-c1b316657efd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.819986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47fbf-9689-449e-bc09-c1b316657efd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.820166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47fbf-9689-449e-bc09-c1b316657efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.837036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23e37-1b95-4806-babc-2eb0fd1b69df None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:24.839349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3bb47fbf-9689-449e-bc09-c1b316657efd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:24.840541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3bb47fbf-9689-449e-bc09-c1b316657efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:24.856324 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:24.887237 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:24.912018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 362/724] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:24.952929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23e37-1b95-4806-babc-2eb0fd1b69df None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:24.992034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:24.992682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:24.992958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:24.993226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:24.993806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:24.995201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:25.004563 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:25.005556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:25.006981 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 363/725] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:25.015077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb47fbf-9689-449e-bc09-c1b316657efd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:25.118338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb47fbf-9689-449e-bc09-c1b316657efd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:25.152728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:25.153340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:25.153615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:25.153881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:25.154531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:25.154828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:25.156177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.161307 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 363/726] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:25.166975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:25.191015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:25.206212 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:25.291950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ad4c-b481-4387-9c50-056633c9f416 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:25.294990 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:25.317631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456614c-f896-459b-bdc9-e890a67122b8 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:25.329313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:25.330148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:25.330435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:25.330709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:25.331339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:25.331674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:25.333036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.338439 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 364/727] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 23 00:51:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:25.344184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:25.357548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:25.358513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:25.359020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:25.359490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:25.360268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:25.361837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:25.372173 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:25.373161 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:25.374665 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:25.377706 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 364/728] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:25.383140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:25.473773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e001e-36b0-4a54-b91d-30e40676a4e3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:25.480778 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:25.507503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dee18-72b5-4198-855a-fd7827c4073e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:25.521468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:25.522347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:25.522624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:25.522891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:25.523587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:25.525685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.545783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:25.546514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:25.546857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:25.547195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:25.547897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:25.548264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:25.549955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.555082 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 365/729] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:25.560439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:25.606009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 365/730] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:25.688974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8067d00-2b65-4ecb-8dcb-d7c813725d61 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:25.732354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8be32-350e-487d-a815-6570e8d3451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:25.733031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8be32-350e-487d-a815-6570e8d3451a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:25.733367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8be32-350e-487d-a815-6570e8d3451a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:25.733635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8be32-350e-487d-a815-6570e8d3451a None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:25.734374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8be32-350e-487d-a815-6570e8d3451a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:25.734671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8be32-350e-487d-a815-6570e8d3451a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:25.736075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8be32-350e-487d-a815-6570e8d3451a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.738442 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:25.742660 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 366/731] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:25.751459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:25.782825 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:25.862452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469776a-4da8-4caf-a553-5709b59bb680 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:25.899717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d0840-63c3-4b05-9ee8-62e2345e33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:25.900330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0840-63c3-4b05-9ee8-62e2345e33a0 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:25.900604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0840-63c3-4b05-9ee8-62e2345e33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:25.900870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0840-63c3-4b05-9ee8-62e2345e33a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:25.901529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d0840-63c3-4b05-9ee8-62e2345e33a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:25.902919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d0840-63c3-4b05-9ee8-62e2345e33a0 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:25.980678 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 366/732] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:26.741042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61175-18c3-4032-8019-d9f9196cd730 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:26.741549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61175-18c3-4032-8019-d9f9196cd730 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:26.741549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61175-18c3-4032-8019-d9f9196cd730 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:26.743084 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 367/733] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:26.748960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab821-71c9-421b-9ac4-bc72c8f11831 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:26.749244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab821-71c9-421b-9ac4-bc72c8f11831 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:26.749513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab821-71c9-421b-9ac4-bc72c8f11831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:26.767604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1c8ab821-71c9-421b-9ac4-bc72c8f11831 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:26.768761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c8ab821-71c9-421b-9ac4-bc72c8f11831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:26.847155 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 367/734] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:26.921149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54830078-cf96-4eed-8004-12aa217f6174 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:26.921493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54830078-cf96-4eed-8004-12aa217f6174 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:26.921697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54830078-cf96-4eed-8004-12aa217f6174 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:26.923345 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 368/735] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:26.928835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e1dd2-4062-42a4-9500-f1c21a698b79 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:26.929275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e1dd2-4062-42a4-9500-f1c21a698b79 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:26.929438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e1dd2-4062-42a4-9500-f1c21a698b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:26.941740 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:26.948405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-685e1dd2-4062-42a4-9500-f1c21a698b79 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:26.949638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-685e1dd2-4062-42a4-9500-f1c21a698b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:27.018231 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 368/736] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:27.118011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54830078-cf96-4eed-8004-12aa217f6174 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:27.224793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54830078-cf96-4eed-8004-12aa217f6174 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:27.258907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:27.259537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.259813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.260081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.260655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:27.262010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:27.271654 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:27.272589 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:27.273413 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 369/737] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:27.282280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e1dd2-4062-42a4-9500-f1c21a698b79 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:27.286312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:27.368911 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:27.399168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e1dd2-4062-42a4-9500-f1c21a698b79 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:27.417601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562dcc-23c1-43ea-b389-d8bdbff23a1b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:27.447019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:27.448569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.449292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.450440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.451296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:27.451795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:27.453544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:27.453652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:27.454263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.454542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.454812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.455561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:27.456567 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:27.456789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:27.466568 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 369/738] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:27.467729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:27.549677 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 370/739] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:27 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:27.583655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a51d-e028-418a-8bc1-6e90b2961381 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:27.631999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:27.632694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.632974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.633285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.633923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:27.634252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:27.635725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:27.642632 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 370/740] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:27.648497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:27.757607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3874f-0358-426b-8968-0e0c1df7f9cc None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:27.782125 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:27.792822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd4022-bad6-400f-b2ef-7c1a66c31128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:27.793489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4022-bad6-400f-b2ef-7c1a66c31128 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.794331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4022-bad6-400f-b2ef-7c1a66c31128 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.794635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4022-bad6-400f-b2ef-7c1a66c31128 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.795343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd4022-bad6-400f-b2ef-7c1a66c31128 None admin] RBAC: Adding query filter params (interface=public, service_id=a4922b98a6b9419e951e1a2630b31709, region_id=RegionOne) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:27.795630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd4022-bad6-400f-b2ef-7c1a66c31128 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:27.797040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd4022-bad6-400f-b2ef-7c1a66c31128 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:27.803028 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 371/741] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:51:27 2022] GET /identity/v3/endpoints?service_id=a4922b98a6b9419e951e1a2630b31709&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:27.808862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:27.878511 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:27.923059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28316f-5996-435d-a9e6-c852d9761041 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:27.951086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f543a-1d26-4387-9163-e4e027aa3946 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.951404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f543a-1d26-4387-9163-e4e027aa3946 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.951630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f543a-1d26-4387-9163-e4e027aa3946 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.953278 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 372/742] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:27.958322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879806b-3c63-42ac-b4fb-7a22f65a7edb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.958596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879806b-3c63-42ac-b4fb-7a22f65a7edb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.958864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879806b-3c63-42ac-b4fb-7a22f65a7edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.961328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade60b4-0a67-4898-8272-a2fa840921f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:27.962529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade60b4-0a67-4898-8272-a2fa840921f3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:27.962984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade60b4-0a67-4898-8272-a2fa840921f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:27.963538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade60b4-0a67-4898-8272-a2fa840921f3 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:27.964319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade60b4-0a67-4898-8272-a2fa840921f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:27.966079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade60b4-0a67-4898-8272-a2fa840921f3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:27.973445 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 371/743] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:27 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:51:27.986013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8879806b-3c63-42ac-b4fb-7a22f65a7edb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:27.986013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8879806b-3c63-42ac-b4fb-7a22f65a7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:28.056366 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 373/744] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:28.271110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cd616-d66a-4a61-a5ba-a50ce6d40d43 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:28.271495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cd616-d66a-4a61-a5ba-a50ce6d40d43 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:28.271690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cd616-d66a-4a61-a5ba-a50ce6d40d43 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:28.273251 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 372/745] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:28.278849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119527-c2de-452f-9581-a9b1e93dfe04 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:28.279134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119527-c2de-452f-9581-a9b1e93dfe04 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:28.279409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119527-c2de-452f-9581-a9b1e93dfe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:28.300345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dd119527-c2de-452f-9581-a9b1e93dfe04 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:28.301520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd119527-c2de-452f-9581-a9b1e93dfe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:28.331155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cd616-d66a-4a61-a5ba-a50ce6d40d43 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:28.370286 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 374/746] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:28 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:28.440061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cd616-d66a-4a61-a5ba-a50ce6d40d43 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:28.464532 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:28.488037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:28.488773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:28.489052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:28.489322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:28.490100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:28.496718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:28.496718 n-d-master-1 devstack@keystone.service[81936]: WARNING keystone.server.flask.common [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 23 00:51:28.543257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.sql.core [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 00:51:28.543257 n-d-master-1 devstack@keystone.service[81936]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:51:28.543257 n-d-master-1 devstack@keystone.service[81936]: [parameters: {'id': '44340fc70aaf4cc08d110763ac9fda77', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 00:51:28.543257 n-d-master-1 devstack@keystone.service[81936]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81936) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44340fc70aaf4cc08d110763ac9fda77.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44340fc70aaf4cc08d110763ac9fda77. Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:51:28.561856 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application result.read() Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 00:51:28.562771 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application yield resource Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise self.value Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application session.commit() Oct 23 00:51:28.563708 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:51:28.564801 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:51:28.566528 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application result.read() Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:51:28.568162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [parameters: {'id': '44340fc70aaf4cc08d110763ac9fda77', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:28.570317 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:28.572296 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 44340fc70aaf4cc08d110763ac9fda77. Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.575617 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 373/747] 10.222.0.42 () {60 vars in 1140 bytes} [Sun Oct 23 00:51:28 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:28.576912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119527-c2de-452f-9581-a9b1e93dfe04 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:28.628925 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:28.659174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:28.681862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119527-c2de-452f-9581-a9b1e93dfe04 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:28.722546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:28.723510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:28.724107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:28.724379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:28.732500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:28.734590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:28.748063 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:28.749010 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:28.750487 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 375/748] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:28.754857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:28.779689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4655c-4727-4f0a-8109-5a385fc5ceeb None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:28.828046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:28.829018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:28.829510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:28.830024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:28.831086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:28.833791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:28.847027 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:28.848074 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:28.848992 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:28.851627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 374/749] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:28.857500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:28.873885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d8a4-b525-414d-945f-2b712d468262 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:28.884703 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:28.912252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:28.912927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:28.913205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:28.913523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:28.914221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] RBAC: Adding query filter params (name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:28.914567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:28.916106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:28.924462 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:28.938230 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 376/750] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:28.995305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc57a-10bf-46d3-9fa5-7bb80e382b47 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:29.041533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:29.042564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:29.043051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:29.043564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:29.044479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:29.045038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:29.046755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:29.056502 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 375/751] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:29.062612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:29.165686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d7c4b-26c9-4e7f-9e4f-48f75a27c453 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:29.203990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:29.204610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:29.204887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:29.205158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:29.205780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:29.206112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:29.207469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:29.212744 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 377/752] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:29.218820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:29.325765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713aac-ee20-4f0f-aaca-8af08c23be58 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:29.334923 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:29.360573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc933e8c-f89e-4ed2-bcf1-ecfd70529b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:29.361180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc933e8c-f89e-4ed2-bcf1-ecfd70529b81 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:29.361452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc933e8c-f89e-4ed2-bcf1-ecfd70529b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:29.361725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc933e8c-f89e-4ed2-bcf1-ecfd70529b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:29.362452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc933e8c-f89e-4ed2-bcf1-ecfd70529b81 None admin] RBAC: Adding query filter params (interface=admin, service_id=8efe0fea03f7411b8da5573b7fb34015, region_id=RegionOne) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:29.362755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc933e8c-f89e-4ed2-bcf1-ecfd70529b81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:29.364162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc933e8c-f89e-4ed2-bcf1-ecfd70529b81 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:29.369688 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 376/753] 10.222.0.42 () {56 vars in 1249 bytes} [Sun Oct 23 00:51:29 2022] GET /identity/v3/endpoints?service_id=8efe0fea03f7411b8da5573b7fb34015&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:29.375966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:29.409352 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:29.486927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dff89-92f8-4212-b7d8-9eed9ee2cb7f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:29.522949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd9d2f-322a-41f6-95a7-ecabc8d6621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:29.523571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9d2f-322a-41f6-95a7-ecabc8d6621b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:29.523850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9d2f-322a-41f6-95a7-ecabc8d6621b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:29.524124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9d2f-322a-41f6-95a7-ecabc8d6621b None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:29.524734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd9d2f-322a-41f6-95a7-ecabc8d6621b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:29.526135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd9d2f-322a-41f6-95a7-ecabc8d6621b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:29.533182 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 378/754] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:29 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:51:29.904788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32491dd3-d34e-4235-a09c-6d18341bf19b None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:29.905218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32491dd3-d34e-4235-a09c-6d18341bf19b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:29.905604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32491dd3-d34e-4235-a09c-6d18341bf19b None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:29.907413 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 377/755] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:29.913051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744e38d-26a4-4087-9d44-a5a2095afe59 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:29.913519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744e38d-26a4-4087-9d44-a5a2095afe59 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:29.913806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744e38d-26a4-4087-9d44-a5a2095afe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:29.934463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b744e38d-26a4-4087-9d44-a5a2095afe59 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:29.935693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b744e38d-26a4-4087-9d44-a5a2095afe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:30.010096 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 379/756] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:30.277547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32491dd3-d34e-4235-a09c-6d18341bf19b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:30.288766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e016-2939-4a8a-804a-d5a629917db7 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:30.289083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e016-2939-4a8a-804a-d5a629917db7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:30.289307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6e016-2939-4a8a-804a-d5a629917db7 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:30.290964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 380/757] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:30.297712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43e91-ba82-49f9-ba6d-c95ba5fe8a25 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:30.298270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43e91-ba82-49f9-ba6d-c95ba5fe8a25 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:30.298769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43e91-ba82-49f9-ba6d-c95ba5fe8a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:30.317353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-36e43e91-ba82-49f9-ba6d-c95ba5fe8a25 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:30.318903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-36e43e91-ba82-49f9-ba6d-c95ba5fe8a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:30.339466 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:30.394198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 381/758] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:30 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:30.402911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32491dd3-d34e-4235-a09c-6d18341bf19b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:30.439992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:30.440647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:30.440924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:30.441250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] PATH_INFO: `/v3/services/image` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:30.441846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:30.443297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:30.453235 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:30.454260 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:30.455070 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:30.459448 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 378/759] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Oct 23 00:51:30 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:30.460786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e43e91-ba82-49f9-ba6d-c95ba5fe8a25 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:30.562083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e43e91-ba82-49f9-ba6d-c95ba5fe8a25 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:30.596466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:30.597072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:30.597350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:30.597623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:30.598274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] RBAC: Adding query filter params (name=image) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:30.598575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:30.599928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:30.610115 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 382/760] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:30.611489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:30.646695 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:30.685641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:30.712170 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:30.719920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a28f-0a83-4176-be83-692e250d690d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:30.765821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:30.766471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:30.766800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:30.767078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:30.767940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] RBAC: Adding query filter params (type=image) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:30.768313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:30.770679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:30.782064 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 379/761] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:30.783463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:30.807767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b85f4-3639-4c12-95d8-391ec4bd7077 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:30.847248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:30.847854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:30.848130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:30.848443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:30.849029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:30.850560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:30.860695 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:30.861922 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:51:30.862951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:30.867068 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 383/762] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:30.868084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:30.913082 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:30.916983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913c6a0-c6c2-4478-86c6-f4d01ac82f97 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:30.961091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:30.962299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:30.962956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:30.963369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:30.964006 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:30.964877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] RBAC: Adding query filter params (interface=public, service_id=3ae4e2c4089b43409d9936e916bce64c, region_id=RegionOne) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:30.966546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:30.968594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:30.976206 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 380/763] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:51:30 2022] GET /identity/v3/endpoints?service_id=3ae4e2c4089b43409d9936e916bce64c&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:30.985923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:30.986104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23209cff-5e93-4722-bc89-6252fed08c40 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:31.022886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:31.023499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.023923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.024199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.024965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:31.025268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:31.026659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:31.037134 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 384/764] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:31.038130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:31.107130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7dcf4-24d5-495c-bb1c-4a88d9028fa4 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:31.145516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63d38-6354-4546-b214-ada5f090a3f1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:31.152390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:31.153143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.153499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.153857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.155256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:31.157288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:31.170092 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 381/765] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:51:30 2022] GET /identity/v3/services => generated 1957 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:51:31.192477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258f01-bd0c-4c95-a9dc-5683830bb7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:31.193188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258f01-bd0c-4c95-a9dc-5683830bb7cb None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.193466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258f01-bd0c-4c95-a9dc-5683830bb7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.193736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258f01-bd0c-4c95-a9dc-5683830bb7cb None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.194482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258f01-bd0c-4c95-a9dc-5683830bb7cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:31.194786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258f01-bd0c-4c95-a9dc-5683830bb7cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:31.196210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258f01-bd0c-4c95-a9dc-5683830bb7cb None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:31.202239 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 385/766] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 23 00:51:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:31.208073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:31.239797 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:31.288037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9ee3d-f851-4605-83f0-d7f34de6b29c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.288444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9ee3d-f851-4605-83f0-d7f34de6b29c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.288724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9ee3d-f851-4605-83f0-d7f34de6b29c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.294007 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 386/767] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:31.296615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eab37-aa38-460a-9f58-c3861078d4f1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.297151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eab37-aa38-460a-9f58-c3861078d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.297602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eab37-aa38-460a-9f58-c3861078d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.322451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-370eab37-aa38-460a-9f58-c3861078d4f1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:31.324148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-370eab37-aa38-460a-9f58-c3861078d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:31.331172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63f2a-dc51-41c7-994b-e2b1ce550efe None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:31.334357 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:31.380837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19923488-018e-419d-be35-93f3a31bd03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:31.381843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19923488-018e-419d-be35-93f3a31bd03f None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.382401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19923488-018e-419d-be35-93f3a31bd03f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.382998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19923488-018e-419d-be35-93f3a31bd03f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.384045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19923488-018e-419d-be35-93f3a31bd03f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:31.385637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19923488-018e-419d-be35-93f3a31bd03f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:31.407313 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 387/768] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:31.477476 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 382/769] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:31.694222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eab37-aa38-460a-9f58-c3861078d4f1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:31.801428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eab37-aa38-460a-9f58-c3861078d4f1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:31.820615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d3528-6c9d-4fdb-a1c3-b61489916792 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.822360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d3528-6c9d-4fdb-a1c3-b61489916792 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.822360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d3528-6c9d-4fdb-a1c3-b61489916792 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.822835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 383/770] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:31.828220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbccca-b39b-4089-8e2f-f740cb5c659a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.828497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbccca-b39b-4089-8e2f-f740cb5c659a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.828767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbccca-b39b-4089-8e2f-f740cb5c659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.846464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:31.847541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:31.847651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-43dbccca-b39b-4089-8e2f-f740cb5c659a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:31.848075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:31.858818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:31.858818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:31.859004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-43dbccca-b39b-4089-8e2f-f740cb5c659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:31.859082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:31.859082 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.server.flask.common [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 23 00:51:31.867108 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:31.910361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.sql.core [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 00:51:31.910361 n-d-master-1 devstack@keystone.service[81937]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 00:51:31.910361 n-d-master-1 devstack@keystone.service[81937]: [parameters: {'user_id': '0823e39e893844f4b3a8ee7bc04ec91e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 00:51:31.910361 n-d-master-1 devstack@keystone.service[81937]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81937) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:51:31.920418 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:51:31.921318 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application yield resource Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise self.value Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.commit() Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:51:31.922310 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:51:31.923158 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:51:31.924273 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:51:31.925176 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [parameters: {'user_id': '0823e39e893844f4b3a8ee7bc04ec91e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:31.926865 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 23 00:51:31.935702 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 23 00:51:31.937793 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 23 00:51:31.937793 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 23 00:51:31.937793 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:51:31.937793 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:51:31.937793 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 00:51:31.937793 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:31.938749 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 384/772] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:31 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:31.938895 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 388/772] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 23 00:51:31 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:31.939033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbccca-b39b-4089-8e2f-f740cb5c659a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:31.945546 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:32.034476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbccca-b39b-4089-8e2f-f740cb5c659a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:32.069057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:32.069741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:32.070037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:32.070309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:32.078215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:32.079929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:32.092148 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:32.094344 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:51:32.096519 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:32.100551 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 385/773] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:51:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:32.100754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:32.203109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165d5dc-7848-4572-8898-c61e912b5e64 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:32.206211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:32.242841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:32.243548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:32.243827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:32.244096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:32.245213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:32.245700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:32.248322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:32.288848 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 389/774] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 23 00:51:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:32.293338 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:32.322217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc31654-a523-40c9-882c-4b11761b4981 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:32.360606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:32.361395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:32.361582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:32.361831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:32.362495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:32.363915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:32.374328 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:32.376651 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:32.378698 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 386/775] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 23 00:51:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:32.382063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:32.449296 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:32.506063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb62674-d5bb-4e3d-93e0-fa5b92e2e6c9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:32.541793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:32.542433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:32.542709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:32.542973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:32.544133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:32.544428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:32.545781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:32.551956 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 390/776] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:32.557920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:32.663781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1628ff-7eed-41ab-97a1-db23c43fa523 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:32.699773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6f5eb-4ba8-48d1-8f5e-5732937a9b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:32.700685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f5eb-4ba8-48d1-8f5e-5732937a9b9a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:32.701230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f5eb-4ba8-48d1-8f5e-5732937a9b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:32.701724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f5eb-4ba8-48d1-8f5e-5732937a9b9a None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:32.702576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f5eb-4ba8-48d1-8f5e-5732937a9b9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:32.703091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f5eb-4ba8-48d1-8f5e-5732937a9b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:32.704754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f5eb-4ba8-48d1-8f5e-5732937a9b9a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:32.710120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 387/777] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 23 00:51:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:32.715885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:32.934393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2f05-47d1-43f6-9a03-d73e210a9096 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:32.956622 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:32.968739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6092-4bb6-45a4-ae06-5778daeadddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:32.969352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6092-4bb6-45a4-ae06-5778daeadddf None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:32.969626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6092-4bb6-45a4-ae06-5778daeadddf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:32.972746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6092-4bb6-45a4-ae06-5778daeadddf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:32.972746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc6092-4bb6-45a4-ae06-5778daeadddf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:32.972746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc6092-4bb6-45a4-ae06-5778daeadddf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:33.086003 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 391/778] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:51:33.404789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17cd3-e6ad-4cd6-ab99-79240fdcdd12 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:33.405340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17cd3-e6ad-4cd6-ab99-79240fdcdd12 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:33.405340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17cd3-e6ad-4cd6-ab99-79240fdcdd12 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:33.406822 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 388/779] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:33.411919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78fc5-2339-4e50-a50a-62ed087cb5b6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:33.412299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78fc5-2339-4e50-a50a-62ed087cb5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:33.412480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78fc5-2339-4e50-a50a-62ed087cb5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:33.431201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-13f78fc5-2339-4e50-a50a-62ed087cb5b6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:33.432701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-13f78fc5-2339-4e50-a50a-62ed087cb5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:33.514079 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 392/780] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:33.780013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17cd3-e6ad-4cd6-ab99-79240fdcdd12 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:33.782998 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:33.800667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f1b25-8ecc-4eac-8af8-0208ff14f575 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:33.800976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f1b25-8ecc-4eac-8af8-0208ff14f575 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:33.801245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f1b25-8ecc-4eac-8af8-0208ff14f575 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:33.807766 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 393/781] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:33.807766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77883a-ef29-43c5-8d57-46c9089cb2c9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:33.808127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77883a-ef29-43c5-8d57-46c9089cb2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:33.808297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77883a-ef29-43c5-8d57-46c9089cb2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:33.827612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1c77883a-ef29-43c5-8d57-46c9089cb2c9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:33.828796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1c77883a-ef29-43c5-8d57-46c9089cb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:33.889616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17cd3-e6ad-4cd6-ab99-79240fdcdd12 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:33.910028 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 394/782] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:33.928772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:33.929435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:33.929716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:33.930007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] PATH_INFO: `/v3/services/image` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:33.930629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:33.932029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:33.940964 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:33.941931 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:51:33.943292 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:33.944437 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 389/783] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Oct 23 00:51:33 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:33.947885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77883a-ef29-43c5-8d57-46c9089cb2c9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:33.992098 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:34.051089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77883a-ef29-43c5-8d57-46c9089cb2c9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:34.084258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:34.084857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:34.085128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:34.085392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:34.086088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] RBAC: Adding query filter params (name=image) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:34.086386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:34.087727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:34.093160 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 395/784] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:34.098699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:34.164863 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:34.174286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:34.201202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430f2c-e808-49c0-8626-a09d299a3093 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:34.236935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:34.237549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:34.237827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:34.238126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:34.238752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:34.239051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:34.240415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:34.245321 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 390/785] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:34.250855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:34.289840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62587809-8926-48bb-a3d9-2de5e0457587 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:34.291392 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:34.325480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:34.326051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:34.326329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:34.326595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:34.336960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:34.341713 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:34.342652 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:34.343502 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 396/786] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 23 00:51:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:34.348541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:34.356694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4042b-9834-44df-9958-1d9948376bc2 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:34.388533 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:34.394240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:34.394853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:34.400072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:34.400072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:34.400072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:34.400072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:34.448892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86987c36-515a-48f3-a3ea-62dbbedbfdc7 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:34.484046 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 391/787] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:51:34.492646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:34.493258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:34.493530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:34.493791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:34.494489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:34.494791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:34.496155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:34.510450 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 397/788] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 23 00:51:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:34.527345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:34.635628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeafe5-fb44-436e-9e2c-27b29a7b4b07 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:34.672948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:34.673732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:34.674379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:34.674737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:34.686668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:34.688337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:34.703396 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:34.704551 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:34.705623 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:34.705623 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:34.705623 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:34.705623 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 392/789] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:34.711648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:34.735382 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:34.811429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796037-acbb-4fe7-b3d7-033bfa8cdd5b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:34.845744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:34.846452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:34.852104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:34.852104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:34.852104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:34.852104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:34.852104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:34.860900 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 398/790] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:34.866909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:34.908235 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:34.968058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079f010-7b0d-4a97-ad26-f595dad7120a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.002290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.002923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.003196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.003459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.011126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.013057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:35.023870 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:35.024813 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:51:35.025741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:35.030159 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 393/791] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 23 00:51:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:35.032420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.112212 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:35.132325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b28f-9abc-4dfb-850d-e47bfc4ec3f8 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.169750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee036af-4ec8-487a-b0aa-0a7bfc146db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.170300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee036af-4ec8-487a-b0aa-0a7bfc146db4 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.170572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee036af-4ec8-487a-b0aa-0a7bfc146db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.170837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee036af-4ec8-487a-b0aa-0a7bfc146db4 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.171557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee036af-4ec8-487a-b0aa-0a7bfc146db4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:35.171854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee036af-4ec8-487a-b0aa-0a7bfc146db4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.173265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee036af-4ec8-487a-b0aa-0a7bfc146db4 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.191103 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 399/792] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 23 00:51:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:35.196607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.255354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f17c7-e9fe-4d99-8d6c-8e3aef5451f5 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.255644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f17c7-e9fe-4d99-8d6c-8e3aef5451f5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.255923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f17c7-e9fe-4d99-8d6c-8e3aef5451f5 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.257410 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 400/793] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:51:35.262913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8a880-1225-46a0-8809-d19e6b236740 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.263228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8a880-1225-46a0-8809-d19e6b236740 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.263461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8a880-1225-46a0-8809-d19e6b236740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.281483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-77a8a880-1225-46a0-8809-d19e6b236740 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:35.282702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-77a8a880-1225-46a0-8809-d19e6b236740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:35.294330 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:35.298172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff7202-ddab-4ba3-8377-d48f2f8f4dca None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.332868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.333509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.333788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.334095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.346886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.348522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.359686 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 401/794] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:35.362337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:35.363254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:35.364140 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:35.364140 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:35.364140 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:35.368086 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 394/795] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:35.369021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8a880-1225-46a0-8809-d19e6b236740 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.439843 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:35.476380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8a880-1225-46a0-8809-d19e6b236740 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.513152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.513760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.514064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.514340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.514978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:35.515277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.516627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.527710 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 402/796] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:35.533235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.631208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.632419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330c3ca-6deb-4110-a041-2f4e2c7f3534 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.667309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.667875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.668667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.668958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.675810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.677231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:35.689124 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:35.690209 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:35.691081 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:35.695020 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 395/797] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:35.696098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.708423 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:35.747704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa5ba-6a4d-4f42-94e9-c43365363ecf None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.777472 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:35.786243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.786877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.787176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.787446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.789402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.790072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.791785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 403/798] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:35.799170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.806382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d021a-3b92-466b-8c4a-ae0ace08e928 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.842639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.843253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.843530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.843799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.844491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:35.844803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.846363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.859390 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 396/799] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:35.865824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:35.906880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a920d-2303-4011-9d85-b1c6124748b0 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:35.940975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c4487-772a-46fa-b76a-1b1cb49a4122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:35.941575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c4487-772a-46fa-b76a-1b1cb49a4122 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:35.941862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c4487-772a-46fa-b76a-1b1cb49a4122 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:35.942153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c4487-772a-46fa-b76a-1b1cb49a4122 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:35.942791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c4487-772a-46fa-b76a-1b1cb49a4122 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:35.944199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c4487-772a-46fa-b76a-1b1cb49a4122 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:35.947944 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:35.978688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ddc3b-7ffa-4bd3-81f3-32841965a387 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:36.013622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84702e72-8baf-4c4c-b3b7-6569be127273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:36.014302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702e72-8baf-4c4c-b3b7-6569be127273 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:36.014580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702e72-8baf-4c4c-b3b7-6569be127273 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:36.014849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702e72-8baf-4c4c-b3b7-6569be127273 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0e79dda089d944818b999e25bb6f8207/roles/6250b7a557cf4ada949a18f00b08c581` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:36.016967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84702e72-8baf-4c4c-b3b7-6569be127273 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=0e79dda089d944818b999e25bb6f8207, role_id=6250b7a557cf4ada949a18f00b08c581)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:36.018405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84702e72-8baf-4c4c-b3b7-6569be127273 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:36.029540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 404/800] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:35 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:36.123235 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 397/801] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:51:35 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/0e79dda089d944818b999e25bb6f8207/roles/6250b7a557cf4ada949a18f00b08c581 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:51:36.686756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1360e6-50c2-446e-bd8e-80384b483924 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:36.687260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1360e6-50c2-446e-bd8e-80384b483924 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:36.687361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1360e6-50c2-446e-bd8e-80384b483924 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:36.688664 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 405/802] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:36.693795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e0326-887c-4f95-aa45-b4a76263f481 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:36.694197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e0326-887c-4f95-aa45-b4a76263f481 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:36.694376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e0326-887c-4f95-aa45-b4a76263f481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:36.713049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aa6e0326-887c-4f95-aa45-b4a76263f481 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:36.714251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa6e0326-887c-4f95-aa45-b4a76263f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:36.782843 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 398/803] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:37.049614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1360e6-50c2-446e-bd8e-80384b483924 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:37.100093 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:37.149333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1360e6-50c2-446e-bd8e-80384b483924 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:37.183316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:37.183948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:37.184224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:37.184490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:37.185161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:37.186542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:37.218312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.sql.core [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:51:37.218312 n-d-master-1 devstack@keystone.service[81937]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:51:37.218312 n-d-master-1 devstack@keystone.service[81937]: [parameters: {'id': '1bd5bb17e2fb4ac5b55336098937f243', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:51:37.218312 n-d-master-1 devstack@keystone.service[81937]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81937) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:51:37.225548 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 00:51:37.226367 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application yield resource Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise self.value Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.commit() Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:51:37.227317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:51:37.228196 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:51:37.229168 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:51:37.229954 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [parameters: {'id': '1bd5bb17e2fb4ac5b55336098937f243', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 00:51:37.232983 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:37.234308 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:37.236202 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 406/804] 10.222.0.42 () {60 vars in 1137 bytes} [Sun Oct 23 00:51:37 2022] POST /identity/v3/domains => generated 190 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:37.237811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e0326-887c-4f95-aa45-b4a76263f481 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:37.295855 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:37.336598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e0326-887c-4f95-aa45-b4a76263f481 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:37.370051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84e130-2e17-4576-b75b-540d90585a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:37.370678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e130-2e17-4576-b75b-540d90585a85 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:37.370947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e130-2e17-4576-b75b-540d90585a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:37.371733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e130-2e17-4576-b75b-540d90585a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:37.381688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84e130-2e17-4576-b75b-540d90585a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:37.383134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84e130-2e17-4576-b75b-540d90585a85 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-0f84e130-2e17-4576-b75b-540d90585a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:37.397859 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:37.398936 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:37.406784 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:37.406784 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:37.406784 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:37.406784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 399/805] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:37.407060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:37.516563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13b5d-3865-4fc4-b614-add1c57588fd None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:37.529120 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:37.549819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc949ef4-ee72-4aa7-8de9-548fd5a831f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:37.550461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949ef4-ee72-4aa7-8de9-548fd5a831f2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:37.550741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949ef4-ee72-4aa7-8de9-548fd5a831f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:37.551016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949ef4-ee72-4aa7-8de9-548fd5a831f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:37.551650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949ef4-ee72-4aa7-8de9-548fd5a831f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:37.551952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949ef4-ee72-4aa7-8de9-548fd5a831f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:37.553312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949ef4-ee72-4aa7-8de9-548fd5a831f2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:37.565554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 407/806] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:38.245132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097d5e-9f31-45ad-b487-f5619b7ce5af None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.245657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097d5e-9f31-45ad-b487-f5619b7ce5af None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.245657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097d5e-9f31-45ad-b487-f5619b7ce5af None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.247050 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 400/807] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:38.252362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a2ef-2967-43c6-805a-9564844c69cc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.252765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a2ef-2967-43c6-805a-9564844c69cc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.253051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a2ef-2967-43c6-805a-9564844c69cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.266378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e233c-dceb-4750-9979-d03ff5002fe6 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.266653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e233c-dceb-4750-9979-d03ff5002fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.266920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e233c-dceb-4750-9979-d03ff5002fe6 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.268215 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 401/808] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:38.270844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-92e2a2ef-2967-43c6-805a-9564844c69cc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:38.272036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92e2a2ef-2967-43c6-805a-9564844c69cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:38.273280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039efbb-b243-4d33-bdfc-6a37fc042670 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.273564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039efbb-b243-4d33-bdfc-6a37fc042670 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.273842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039efbb-b243-4d33-bdfc-6a37fc042670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.292865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c039efbb-b243-4d33-bdfc-6a37fc042670 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:38.294529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c039efbb-b243-4d33-bdfc-6a37fc042670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:38.338607 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 408/809] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:38.359164 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 402/810] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:51:38.617706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2a2ef-2967-43c6-805a-9564844c69cc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:38.626887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039efbb-b243-4d33-bdfc-6a37fc042670 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:38.668958 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:38.715369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2a2ef-2967-43c6-805a-9564844c69cc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:38.716857 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:38.725018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039efbb-b243-4d33-bdfc-6a37fc042670 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:38.747987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:38.748609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.748885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.749153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.750270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:38.751703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:38.753255 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 409/811] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:38.758640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b587a4-465b-4955-be63-e56028facfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:38.758970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:38.759268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b587a4-465b-4955-be63-e56028facfec None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.759544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b587a4-465b-4955-be63-e56028facfec None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.759814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b587a4-465b-4955-be63-e56028facfec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.770779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b587a4-465b-4955-be63-e56028facfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-52b587a4-465b-4955-be63-e56028facfec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:38.775569 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:38.776655 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:38.778550 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 403/812] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 23 00:51:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:38.783060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b587a4-465b-4955-be63-e56028facfec None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:38.859931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc671fd4-01cb-409a-abc9-9cac15cd0946 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:38.879807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b587a4-465b-4955-be63-e56028facfec None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:38.881243 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:38.894360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:38.894974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.895248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.895516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.896163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:38.897618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:38.913532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:38.914164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:38.914439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:38.914707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:38.915365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:38.915665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:38.917003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:38.925063 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 404/813] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 23 00:51:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:38.930779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:39.022007 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 410/814] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:51:38 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:51:39.029345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c280d-2bf3-42a3-9c97-93d374abab22 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:39.066412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:39.067074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:39.067353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:39.067629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:39.079992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:39.081485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:39.097154 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:39.098246 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:39.099167 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:39.099167 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:39.099167 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:39.099167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 405/815] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:51:39.104264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:39.133759 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:39.208302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f83d1-3642-4dc5-988f-c1940b99d25a None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:39.241427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:39.242074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:39.242354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:39.242623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:39.243256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:39.243555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:39.244899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:39.256467 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 411/816] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:39.262354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:39.280478 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:39.360111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d897a-9445-4d4a-9b68-fafe9f32ebd1 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:39.392957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:39.393517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:39.393794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:39.394139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:39.401407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:39.402891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:51:39.413741 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:39.414845 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:51:39.416233 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:39.418345 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 406/817] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 23 00:51:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:39.421036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:39.506420 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:39.521019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92734c-5989-43d7-aed7-ce3f800f196a None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:39.554594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:39.555199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:39.555477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:39.555750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:39.556466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:39.556771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:39.558199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:39.575310 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 412/818] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 23 00:51:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:39.581068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:39.655038 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:39.677035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca27b22-5d7e-4c3b-bfe9-1b315e28764f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:39.709214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:39.709815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:39.710112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:39.710381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:39.774608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:39.776027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:39.914869 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:39.939426 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 407/819] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:51:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:51:39.944913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:40.040889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3946e0-1465-470f-9d1c-ba1d0a5b54a3 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:40.072886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:40.073501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:40.073778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:40.074585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:40.084115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:40.085530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:40.087919 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:51:40.100517 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:40.101590 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:51:40.102487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:51:40.102487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:51:40.102487 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:40.102487 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 413/820] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:40.108155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:40.202415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853d94d-74d1-4738-a832-b0075e8041b3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:40.234986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:40.235587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:40.235861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:40.236130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:40.236763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:40.237059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:40.238438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:40.249463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 408/821] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:40.255323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:40.352843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87500-4f6d-4845-a7f8-62e3c88f5efe None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:40.384917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:40.385540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:40.385813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:40.386114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:40.393070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:40.394534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:51:40.405307 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:40.406174 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:40.407245 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 414/822] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:40.412209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:40.446656 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:40.510101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ccc2-a234-42a6-a95e-28b4fe12e7dd None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:40.542818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff98e8-1263-4a47-ad6f-bea73dfe12c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:40.543415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff98e8-1263-4a47-ad6f-bea73dfe12c5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:40.543689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff98e8-1263-4a47-ad6f-bea73dfe12c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:40.543955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff98e8-1263-4a47-ad6f-bea73dfe12c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:40.544635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff98e8-1263-4a47-ad6f-bea73dfe12c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:40.544936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff98e8-1263-4a47-ad6f-bea73dfe12c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:40.546400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff98e8-1263-4a47-ad6f-bea73dfe12c5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:40.558816 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 409/823] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:40.564660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:40.619279 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:40.666425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c5340-902b-4b22-b264-961d19f8a4f9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:40.698915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536401b-4ffa-4a60-92eb-eac54b4348cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:40.700065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536401b-4ffa-4a60-92eb-eac54b4348cd None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:40.700401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536401b-4ffa-4a60-92eb-eac54b4348cd None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:40.700724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536401b-4ffa-4a60-92eb-eac54b4348cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:40.701499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536401b-4ffa-4a60-92eb-eac54b4348cd None admin] RBAC: Adding query filter params (role.id=6250b7a557cf4ada949a18f00b08c581, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=0e79dda089d944818b999e25bb6f8207) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:40.701804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536401b-4ffa-4a60-92eb-eac54b4348cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:40.703336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536401b-4ffa-4a60-92eb-eac54b4348cd None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:40.709722 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 415/824] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:51:40 2022] GET /identity/v3/role_assignments?user.id=0e79dda089d944818b999e25bb6f8207&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=6250b7a557cf4ada949a18f00b08c581 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:51:41.186344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3e45-81e1-4b8b-b87b-c2a2954e10ee None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:41.186623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3e45-81e1-4b8b-b87b-c2a2954e10ee None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:41.186895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3e45-81e1-4b8b-b87b-c2a2954e10ee None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:41.188243 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 410/825] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:41.193846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803053d3-bcf9-47a5-890a-8b86a974ee31 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:41.194155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803053d3-bcf9-47a5-890a-8b86a974ee31 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:41.194425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803053d3-bcf9-47a5-890a-8b86a974ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:41.212367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-803053d3-bcf9-47a5-890a-8b86a974ee31 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:41.213546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-803053d3-bcf9-47a5-890a-8b86a974ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:41.280387 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 416/826] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:41.545460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3e45-81e1-4b8b-b87b-c2a2954e10ee None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:41.635298 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:41.642235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3e45-81e1-4b8b-b87b-c2a2954e10ee None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:41.674869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:41.675478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:41.675755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:41.676024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:41.685643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:41.690341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:41.691347 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:51:41.692169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 411/827] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:41.697491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803053d3-bcf9-47a5-890a-8b86a974ee31 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:41.744994 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:41.791694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803053d3-bcf9-47a5-890a-8b86a974ee31 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:41.823569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:41.824764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:41.825034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:41.825296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:41.825938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:41.826257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:41.827591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:41.835461 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 417/828] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:41.841242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:41.936399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d6c5-d885-4004-9469-5d7ac3334cc9 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:41.967758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:41.968360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:41.968631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:41.968903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] PATH_INFO: `/v3/users/dae053f214b5483d84c3e9f3e7d4bd6d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:41.981296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] RBAC: Authorizing `identity:get_user(user_id=dae053f214b5483d84c3e9f3e7d4bd6d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:41.982725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:41.984269 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 412/829] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:51:41 2022] GET /identity/v3/users/dae053f214b5483d84c3e9f3e7d4bd6d => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:41.989940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:42.086888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc5700-a7b4-45a7-a82f-f26c58100d0b None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:42.098688 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:42.117878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c3f6f-07f5-4308-9247-86b010fe2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:42.118515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c3f6f-07f5-4308-9247-86b010fe2975 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:42.118785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c3f6f-07f5-4308-9247-86b010fe2975 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:42.119047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c3f6f-07f5-4308-9247-86b010fe2975 None admin] PATH_INFO: `/v3/projects/0667bb5840854d5f8e76027df1589969` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:42.120129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c3f6f-07f5-4308-9247-86b010fe2975 None admin] RBAC: Authorizing `identity:get_project(project_id=0667bb5840854d5f8e76027df1589969)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:42.122069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c3f6f-07f5-4308-9247-86b010fe2975 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:42.123887 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 418/830] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:51:41 2022] GET /identity/v3/projects/0667bb5840854d5f8e76027df1589969 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:42.129375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:42.145259 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:42.225911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c520aa-a503-48a1-b24d-f814fe9c5a4e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:42.258768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018c954-130f-41aa-be87-4c3bd4d251df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:42.259401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018c954-130f-41aa-be87-4c3bd4d251df None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:42.259673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018c954-130f-41aa-be87-4c3bd4d251df None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:42.259939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018c954-130f-41aa-be87-4c3bd4d251df None admin] PATH_INFO: `/v3/projects/0667bb5840854d5f8e76027df1589969/users/dae053f214b5483d84c3e9f3e7d4bd6d/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:42.261777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018c954-130f-41aa-be87-4c3bd4d251df None admin] RBAC: Authorizing `identity:create_grant(project_id=0667bb5840854d5f8e76027df1589969, user_id=dae053f214b5483d84c3e9f3e7d4bd6d, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:42.263206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018c954-130f-41aa-be87-4c3bd4d251df None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:42.323597 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 413/831] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:51:42 2022] PUT /identity/v3/projects/0667bb5840854d5f8e76027df1589969/users/dae053f214b5483d84c3e9f3e7d4bd6d/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:51:44.425416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7408-ac6d-4c73-a024-6697457b848a None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.426019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7408-ac6d-4c73-a024-6697457b848a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.426019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f7408-ac6d-4c73-a024-6697457b848a None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.427326 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 419/832] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:44.432613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254b193-f0c7-4569-9c74-a80267955753 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.433535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254b193-f0c7-4569-9c74-a80267955753 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.433636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254b193-f0c7-4569-9c74-a80267955753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.451866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2254b193-f0c7-4569-9c74-a80267955753 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:44.453022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2254b193-f0c7-4569-9c74-a80267955753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:44.516583 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 414/833] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:44.785818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7408-ac6d-4c73-a024-6697457b848a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:44.883500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f7408-ac6d-4c73-a024-6697457b848a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:44.915438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:44.916142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.916418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.916683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.927206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:51:44.931917 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:51:44.933141 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:51:44.934093 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 420/834] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:51:44.938935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254b193-f0c7-4569-9c74-a80267955753 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:44.941948 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.033761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254b193-f0c7-4569-9c74-a80267955753 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.066238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.066832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.067106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.067373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.068019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:45.068313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.069652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.077344 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 415/835] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:45.083404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:45.124024 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.178989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012d8c-09a7-41e3-9da0-c1bd69c5195e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.212153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.212766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.213038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.213303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] PATH_INFO: `/v3/users/dae053f214b5483d84c3e9f3e7d4bd6d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.215029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] RBAC: Authorizing `identity:get_user(user_id=dae053f214b5483d84c3e9f3e7d4bd6d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.216480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.218035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 421/836] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:51:45 2022] GET /identity/v3/users/dae053f214b5483d84c3e9f3e7d4bd6d => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:45.223766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:45.285901 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.318617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6549e-b1e5-447c-954c-4032a56af56b None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.351005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.351595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.351870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.352140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.415644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.417054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.477214 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.510584 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 416/837] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:51:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:51:45.516869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:45.610766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18b38-3189-4480-ba0d-325e66876416 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.619304 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.643282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a65c78-490d-4871-968e-d393dd6a41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.643962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65c78-490d-4871-968e-d393dd6a41d5 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.644238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65c78-490d-4871-968e-d393dd6a41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.644503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65c78-490d-4871-968e-d393dd6a41d5 None admin] PATH_INFO: `/v3/projects/0667bb5840854d5f8e76027df1589969` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.645631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65c78-490d-4871-968e-d393dd6a41d5 None admin] RBAC: Authorizing `identity:get_project(project_id=0667bb5840854d5f8e76027df1589969)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.647063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65c78-490d-4871-968e-d393dd6a41d5 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.648636 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 422/838] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:51:45 2022] GET /identity/v3/projects/0667bb5840854d5f8e76027df1589969 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:45.654840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:45.748095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253a58c-2050-4df3-8c2b-0763c0de1de0 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.779688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf197b-27fe-4f1e-abd7-64b9ac2437f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.780271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf197b-27fe-4f1e-abd7-64b9ac2437f3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.780545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf197b-27fe-4f1e-abd7-64b9ac2437f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.780811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf197b-27fe-4f1e-abd7-64b9ac2437f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.781516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf197b-27fe-4f1e-abd7-64b9ac2437f3 None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=0667bb5840854d5f8e76027df1589969, user.id=dae053f214b5483d84c3e9f3e7d4bd6d) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:45.781816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf197b-27fe-4f1e-abd7-64b9ac2437f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.783229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf197b-27fe-4f1e-abd7-64b9ac2437f3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.788607 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 417/839] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:51:45 2022] GET /identity/v3/role_assignments?user.id=dae053f214b5483d84c3e9f3e7d4bd6d&scope.project.id=0667bb5840854d5f8e76027df1589969&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:47.923104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1d98-48d0-464d-b58f-e99f7ce98e4f None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:47.923872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1d98-48d0-464d-b58f-e99f7ce98e4f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:47.923872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1d98-48d0-464d-b58f-e99f7ce98e4f None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:47.925250 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 423/840] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:47.930554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c070d6-45f0-40e2-a598-11f458db4f4e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:47.930969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c070d6-45f0-40e2-a598-11f458db4f4e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:47.931101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c070d6-45f0-40e2-a598-11f458db4f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:47.949938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-27c070d6-45f0-40e2-a598-11f458db4f4e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:47.951132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-27c070d6-45f0-40e2-a598-11f458db4f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:47.973559 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:48.015257 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 418/841] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:48.290795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d1d98-48d0-464d-b58f-e99f7ce98e4f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:48.386940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d1d98-48d0-464d-b58f-e99f7ce98e4f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:48.418632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddef166-b3ee-42d8-ace0-a6807599f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:48.419241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef166-b3ee-42d8-ace0-a6807599f49e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:48.419515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef166-b3ee-42d8-ace0-a6807599f49e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:48.419781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef166-b3ee-42d8-ace0-a6807599f49e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:48.421005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddef166-b3ee-42d8-ace0-a6807599f49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:48.422447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddef166-b3ee-42d8-ace0-a6807599f49e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:48.424227 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 424/842] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:48.429815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c070d6-45f0-40e2-a598-11f458db4f4e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:48.524085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c070d6-45f0-40e2-a598-11f458db4f4e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:48.557146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca06715-2d95-4f4e-9077-f4ed2b73e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:48.557683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca06715-2d95-4f4e-9077-f4ed2b73e823 None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:48.558523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca06715-2d95-4f4e-9077-f4ed2b73e823 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:48.558791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca06715-2d95-4f4e-9077-f4ed2b73e823 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:48.559433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca06715-2d95-4f4e-9077-f4ed2b73e823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:48.560844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca06715-2d95-4f4e-9077-f4ed2b73e823 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:48.660960 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 419/843] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:51:48 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:50.802538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d093d-2d4e-41f8-9521-25a7d3624333 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:50.803061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d093d-2d4e-41f8-9521-25a7d3624333 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:50.803061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d093d-2d4e-41f8-9521-25a7d3624333 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:50.804309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 425/844] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:50.810111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce34b-4702-4a04-af7b-8461a372bb62 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:50.810511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce34b-4702-4a04-af7b-8461a372bb62 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:50.810653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ce34b-4702-4a04-af7b-8461a372bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:50.828671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d13ce34b-4702-4a04-af7b-8461a372bb62 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:50.829863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d13ce34b-4702-4a04-af7b-8461a372bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:50.840881 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:50.894502 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 420/845] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:51.160634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d093d-2d4e-41f8-9521-25a7d3624333 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:51.206350 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:51.257008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d093d-2d4e-41f8-9521-25a7d3624333 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:51.289619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:51.290260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:51.290533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:51.290798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] PATH_INFO: `/v3/roles/0fd4959143bd4b9e9db4ff088a6875fb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:51.292164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] RBAC: Authorizing `identity:get_role(role_id=0fd4959143bd4b9e9db4ff088a6875fb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:51.293500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:51.294806 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 426/846] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:51:51 2022] GET /identity/v3/roles/0fd4959143bd4b9e9db4ff088a6875fb => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:51.300924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ce34b-4702-4a04-af7b-8461a372bb62 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:51.393956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ce34b-4702-4a04-af7b-8461a372bb62 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:51.426333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:51.426892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:51.427167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:51.427437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] PATH_INFO: `/v3/users/8e9043f9dbb041f9b44d354a28812106` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:51.439706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] RBAC: Authorizing `identity:get_user(user_id=8e9043f9dbb041f9b44d354a28812106)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:51.441179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:51.442744 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 421/847] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:51:51 2022] GET /identity/v3/users/8e9043f9dbb041f9b44d354a28812106 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:51.448704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:51.544371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79523-5723-4dd0-8f6b-870380f72c92 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:51.557062 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:51.578185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70faa79-d3f3-418a-93ec-eb95b1b973fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:51.578805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70faa79-d3f3-418a-93ec-eb95b1b973fc None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:51.579083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70faa79-d3f3-418a-93ec-eb95b1b973fc None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:51.579350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70faa79-d3f3-418a-93ec-eb95b1b973fc None admin] PATH_INFO: `/v3/projects/0667bb5840854d5f8e76027df1589969` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:51.580466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70faa79-d3f3-418a-93ec-eb95b1b973fc None admin] RBAC: Authorizing `identity:get_project(project_id=0667bb5840854d5f8e76027df1589969)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:51.581865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70faa79-d3f3-418a-93ec-eb95b1b973fc None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:51.583712 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 427/848] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:51:51 2022] GET /identity/v3/projects/0667bb5840854d5f8e76027df1589969 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:51.589352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:51.592999 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:51.684202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48e060-3997-4c39-9f69-34d9cc59765a None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:51.716278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc16def-3f6a-43cd-995b-7f93de8f5db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:51.716915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16def-3f6a-43cd-995b-7f93de8f5db1 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:51.717189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16def-3f6a-43cd-995b-7f93de8f5db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:51.717457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc16def-3f6a-43cd-995b-7f93de8f5db1 None admin] PATH_INFO: `/v3/projects/0667bb5840854d5f8e76027df1589969/users/8e9043f9dbb041f9b44d354a28812106/roles/0fd4959143bd4b9e9db4ff088a6875fb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:51.719566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc16def-3f6a-43cd-995b-7f93de8f5db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0667bb5840854d5f8e76027df1589969, user_id=8e9043f9dbb041f9b44d354a28812106, role_id=0fd4959143bd4b9e9db4ff088a6875fb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:51.720975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc16def-3f6a-43cd-995b-7f93de8f5db1 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:51.843746 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 422/849] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:51:51 2022] PUT /identity/v3/projects/0667bb5840854d5f8e76027df1589969/users/8e9043f9dbb041f9b44d354a28812106/roles/0fd4959143bd4b9e9db4ff088a6875fb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:51:53.957603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aac88-c4de-4248-b2f2-6fb5ed612c1e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:53.958120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aac88-c4de-4248-b2f2-6fb5ed612c1e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:53.958120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aac88-c4de-4248-b2f2-6fb5ed612c1e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:53.959432 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 428/850] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:53.965240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1dcca-9175-4307-9caa-601c85623d0d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:53.965671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1dcca-9175-4307-9caa-601c85623d0d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:53.965764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1dcca-9175-4307-9caa-601c85623d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:53.984178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-42a1dcca-9175-4307-9caa-601c85623d0d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:53.985341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-42a1dcca-9175-4307-9caa-601c85623d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:54.040337 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:54.049012 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 423/851] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:54.315683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aac88-c4de-4248-b2f2-6fb5ed612c1e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:54.417632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aac88-c4de-4248-b2f2-6fb5ed612c1e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:54.451086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:54.451725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:54.452002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:54.452273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] PATH_INFO: `/v3/roles/0fd4959143bd4b9e9db4ff088a6875fb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:54.453660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] RBAC: Authorizing `identity:get_role(role_id=0fd4959143bd4b9e9db4ff088a6875fb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:54.455118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:54.456716 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 429/852] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:51:54 2022] GET /identity/v3/roles/0fd4959143bd4b9e9db4ff088a6875fb => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:54.462498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1dcca-9175-4307-9caa-601c85623d0d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:54.558243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1dcca-9175-4307-9caa-601c85623d0d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:54.590536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:54.591112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:54.591391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:54.591665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] PATH_INFO: `/v3/users/8e9043f9dbb041f9b44d354a28812106` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:54.592770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9043f9dbb041f9b44d354a28812106)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:54.594221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:54.595779 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 424/853] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:51:54 2022] GET /identity/v3/users/8e9043f9dbb041f9b44d354a28812106 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:54.601555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:54.648132 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:54.695734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e89a-d687-4730-8f37-c89fc23aef94 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:54.728407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:54.729001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:54.729869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:54.730172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:54.793182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:54.794663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:54.840425 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:54.888723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 430/854] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:51:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:51:54.894520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:54.953798 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:54.990592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2381f-f96d-4a65-87eb-e27b32152a44 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:55.022496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4a309-3894-46c7-b577-d00f4a3bdceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:55.023105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4a309-3894-46c7-b577-d00f4a3bdceb None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:55.023386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4a309-3894-46c7-b577-d00f4a3bdceb None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:55.023654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4a309-3894-46c7-b577-d00f4a3bdceb None admin] PATH_INFO: `/v3/projects/0667bb5840854d5f8e76027df1589969` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:55.024739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4a309-3894-46c7-b577-d00f4a3bdceb None admin] RBAC: Authorizing `identity:get_project(project_id=0667bb5840854d5f8e76027df1589969)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:55.026175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4a309-3894-46c7-b577-d00f4a3bdceb None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:55.028359 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 425/855] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:51:54 2022] GET /identity/v3/projects/0667bb5840854d5f8e76027df1589969 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:55.034713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:55.126754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c055821-45b1-4919-abac-f0435bdb97ad None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:55.159675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28a984-0a39-43c9-a826-04930e627975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:55.160199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28a984-0a39-43c9-a826-04930e627975 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:55.160472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28a984-0a39-43c9-a826-04930e627975 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:55.160738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28a984-0a39-43c9-a826-04930e627975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:55.161436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28a984-0a39-43c9-a826-04930e627975 None admin] RBAC: Adding query filter params (role.id=0fd4959143bd4b9e9db4ff088a6875fb, scope.project.id=0667bb5840854d5f8e76027df1589969, user.id=8e9043f9dbb041f9b44d354a28812106) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:55.161735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28a984-0a39-43c9-a826-04930e627975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:55.163163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28a984-0a39-43c9-a826-04930e627975 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:55.169077 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 431/856] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:51:55 2022] GET /identity/v3/role_assignments?user.id=8e9043f9dbb041f9b44d354a28812106&scope.project.id=0667bb5840854d5f8e76027df1589969&role.id=0fd4959143bd4b9e9db4ff088a6875fb => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:57.265362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768d7c-87f7-4648-b77d-934405b5e648 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:57.265910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768d7c-87f7-4648-b77d-934405b5e648 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:57.265910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768d7c-87f7-4648-b77d-934405b5e648 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:57.267257 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 426/857] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:57.272560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625da789-217f-4f5c-8164-d0bd75f4a6c2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:57.272927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625da789-217f-4f5c-8164-d0bd75f4a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:57.273094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625da789-217f-4f5c-8164-d0bd75f4a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:57.291204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-625da789-217f-4f5c-8164-d0bd75f4a6c2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:57.292376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-625da789-217f-4f5c-8164-d0bd75f4a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:57.299648 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:57.356320 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 432/858] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:51:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:51:57.622761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9768d7c-87f7-4648-b77d-934405b5e648 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:57.720198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9768d7c-87f7-4648-b77d-934405b5e648 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:57.747853 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:57.753315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1f6b7-a342-44c2-aabd-faf3606e54e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:57.754883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1f6b7-a342-44c2-aabd-faf3606e54e6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:57.754883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1f6b7-a342-44c2-aabd-faf3606e54e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:57.754883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1f6b7-a342-44c2-aabd-faf3606e54e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:57.755815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1f6b7-a342-44c2-aabd-faf3606e54e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:57.757239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1f6b7-a342-44c2-aabd-faf3606e54e6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:57.758838 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 427/859] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:57.764657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625da789-217f-4f5c-8164-d0bd75f4a6c2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:57.859356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625da789-217f-4f5c-8164-d0bd75f4a6c2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:57.891007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d851c97-5c13-4677-ade8-abc1bf0e9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:57.891547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d851c97-5c13-4677-ade8-abc1bf0e9852 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:57.891823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d851c97-5c13-4677-ade8-abc1bf0e9852 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:57.892094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d851c97-5c13-4677-ade8-abc1bf0e9852 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:57.892727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d851c97-5c13-4677-ade8-abc1bf0e9852 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:57.894158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d851c97-5c13-4677-ade8-abc1bf0e9852 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:57.908136 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:57.950044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 433/860] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:51:57 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:52:00.093791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d78a2-6199-4f8d-8c71-f05bc45d6f80 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:00.094377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d78a2-6199-4f8d-8c71-f05bc45d6f80 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:00.094377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d78a2-6199-4f8d-8c71-f05bc45d6f80 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:00.095717 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 428/861] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:00.100838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aece0-a2ad-4c92-8bdb-03bea36ed52a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:00.101249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aece0-a2ad-4c92-8bdb-03bea36ed52a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:00.101356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aece0-a2ad-4c92-8bdb-03bea36ed52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:00.118893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-170aece0-a2ad-4c92-8bdb-03bea36ed52a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:00.120074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-170aece0-a2ad-4c92-8bdb-03bea36ed52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:00.184305 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 434/862] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:00.452551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d78a2-6199-4f8d-8c71-f05bc45d6f80 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:00.550888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d78a2-6199-4f8d-8c71-f05bc45d6f80 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:00.582458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23019e-d89a-4632-86a7-6bc6420ce0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:00.583071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23019e-d89a-4632-86a7-6bc6420ce0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:00.583347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23019e-d89a-4632-86a7-6bc6420ce0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:00.583618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23019e-d89a-4632-86a7-6bc6420ce0d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:00.584712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23019e-d89a-4632-86a7-6bc6420ce0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:00.586148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23019e-d89a-4632-86a7-6bc6420ce0d5 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:00.587678 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 429/863] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:00.593805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170aece0-a2ad-4c92-8bdb-03bea36ed52a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:00.687723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170aece0-a2ad-4c92-8bdb-03bea36ed52a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:00.709365 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:00.719835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3586ed-46d0-438d-b70f-aef1e499d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:00.724217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3586ed-46d0-438d-b70f-aef1e499d8cd None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:00.724217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3586ed-46d0-438d-b70f-aef1e499d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:00.724217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3586ed-46d0-438d-b70f-aef1e499d8cd None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:00.724217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3586ed-46d0-438d-b70f-aef1e499d8cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:00.724217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3586ed-46d0-438d-b70f-aef1e499d8cd None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:00.840556 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 435/864] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:52:00 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:52:03.006764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dce1c-82d1-40c5-aab3-2756d5651b4e None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:03.007308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dce1c-82d1-40c5-aab3-2756d5651b4e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:03.007308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dce1c-82d1-40c5-aab3-2756d5651b4e None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:03.008628 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 430/865] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:03.014415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d204-d952-4c3f-abab-7e394be06cc6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:03.014851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d204-d952-4c3f-abab-7e394be06cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:03.014958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d204-d952-4c3f-abab-7e394be06cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:03.032490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e464d204-d952-4c3f-abab-7e394be06cc6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:03.033658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e464d204-d952-4c3f-abab-7e394be06cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:03.096608 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 436/866] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:03.359540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dce1c-82d1-40c5-aab3-2756d5651b4e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:03.422231 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:03.455460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dce1c-82d1-40c5-aab3-2756d5651b4e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:03.489181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:03.489803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:03.490107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:03.490377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:03.500709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:52:03.505391 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:52:03.506505 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:52:03.507687 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 431/867] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:52:03.512442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464d204-d952-4c3f-abab-7e394be06cc6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:03.606831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464d204-d952-4c3f-abab-7e394be06cc6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:03.617535 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:03.639478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:03.640063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:03.640338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:03.640606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:03.641256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:52:03.641554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:03.642930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:03.650586 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 437/868] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:03.656880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:03.751096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0876e-073f-411a-8936-00d85300e97e None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:03.774771 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:03.783283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:03.787513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:03.787513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:03.787513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] PATH_INFO: `/v3/users/486848c89c30433185b222ebeb5b2b00` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:03.797291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] RBAC: Authorizing `identity:get_user(user_id=486848c89c30433185b222ebeb5b2b00)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:03.799048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:03.800514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 432/869] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:52:03 2022] GET /identity/v3/users/486848c89c30433185b222ebeb5b2b00 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:03.806303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:03.899995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca2463-1672-4c4f-8350-64f80ef5337e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:03.932518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2379b-3a92-47df-a3b6-83ac7dfa4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:03.933162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2379b-3a92-47df-a3b6-83ac7dfa4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:03.933442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2379b-3a92-47df-a3b6-83ac7dfa4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:03.933713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2379b-3a92-47df-a3b6-83ac7dfa4cc1 None admin] PATH_INFO: `/v3/projects/b757271aaee64208baaacff7c0328d48` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:03.934906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2379b-3a92-47df-a3b6-83ac7dfa4cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=b757271aaee64208baaacff7c0328d48)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:03.936311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2379b-3a92-47df-a3b6-83ac7dfa4cc1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:03.937894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 438/870] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:52:03 2022] GET /identity/v3/projects/b757271aaee64208baaacff7c0328d48 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:03.943608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:04.038806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f45a1-3b70-4674-a334-1430a40299dd None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:04.186017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121d678-cba6-4a39-9e49-c931c4c4fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:04.186686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121d678-cba6-4a39-9e49-c931c4c4fe27 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:04.186965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121d678-cba6-4a39-9e49-c931c4c4fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:04.187236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121d678-cba6-4a39-9e49-c931c4c4fe27 None admin] PATH_INFO: `/v3/projects/b757271aaee64208baaacff7c0328d48/users/486848c89c30433185b222ebeb5b2b00/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:04.189081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121d678-cba6-4a39-9e49-c931c4c4fe27 None admin] RBAC: Authorizing `identity:create_grant(project_id=b757271aaee64208baaacff7c0328d48, user_id=486848c89c30433185b222ebeb5b2b00, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:04.190571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121d678-cba6-4a39-9e49-c931c4c4fe27 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:04.291231 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 433/871] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:52:03 2022] PUT /identity/v3/projects/b757271aaee64208baaacff7c0328d48/users/486848c89c30433185b222ebeb5b2b00/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:52:06.387257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b282e-b3cc-40ef-b3b6-9a1c640c4b13 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:06.387782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b282e-b3cc-40ef-b3b6-9a1c640c4b13 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:06.387782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b282e-b3cc-40ef-b3b6-9a1c640c4b13 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:06.389172 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 439/872] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:06.394246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275daa7d-3d9d-466a-81a0-a2d0a25a1c66 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:06.394655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275daa7d-3d9d-466a-81a0-a2d0a25a1c66 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:06.394778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275daa7d-3d9d-466a-81a0-a2d0a25a1c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:06.412184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-275daa7d-3d9d-466a-81a0-a2d0a25a1c66 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:06.413335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-275daa7d-3d9d-466a-81a0-a2d0a25a1c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:06.452133 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:06.476671 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 434/873] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:06.748476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b282e-b3cc-40ef-b3b6-9a1c640c4b13 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:06.789268 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:06.845724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b282e-b3cc-40ef-b3b6-9a1c640c4b13 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:06.877848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:06.878492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:06.878765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:06.879034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:06.888641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:52:06.893349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:52:06.894388 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:52:06.895199 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 440/874] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:52:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:52:06.900351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275daa7d-3d9d-466a-81a0-a2d0a25a1c66 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:06.994647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275daa7d-3d9d-466a-81a0-a2d0a25a1c66 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:07.027326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:07.027863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:07.028134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:07.028399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:07.029043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:52:07.029337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:07.030697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:07.038306 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 435/875] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:52:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:07.044145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:07.136371 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:07.139185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0184a2-a763-46dd-8600-b5e33db6d296 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:07.171087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:07.171696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:07.171971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:07.172235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] PATH_INFO: `/v3/users/486848c89c30433185b222ebeb5b2b00` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:07.173585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] RBAC: Authorizing `identity:get_user(user_id=486848c89c30433185b222ebeb5b2b00)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:07.175027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:07.176550 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 441/876] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:52:07 2022] GET /identity/v3/users/486848c89c30433185b222ebeb5b2b00 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:07.182175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:07.215796 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:07.275456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47bd3-d10c-46a6-878d-8432112df8ac None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:07.308044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:07.308614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:07.308889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:07.309158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:07.371448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:07.372855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:07.403924 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:07.463712 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 436/877] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:52:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:52:07.469442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:07.564724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797c9f1-beb6-470d-af43-e33a0de86620 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:07.596588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc52613-cd58-45b6-8af6-bff2e1fd00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:07.597207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52613-cd58-45b6-8af6-bff2e1fd00fd None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:07.597482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52613-cd58-45b6-8af6-bff2e1fd00fd None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:07.597751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52613-cd58-45b6-8af6-bff2e1fd00fd None admin] PATH_INFO: `/v3/projects/b757271aaee64208baaacff7c0328d48` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:07.598862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc52613-cd58-45b6-8af6-bff2e1fd00fd None admin] RBAC: Authorizing `identity:get_project(project_id=b757271aaee64208baaacff7c0328d48)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:07.600272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc52613-cd58-45b6-8af6-bff2e1fd00fd None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:07.601868 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 442/878] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:52:07 2022] GET /identity/v3/projects/b757271aaee64208baaacff7c0328d48 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:07.608143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:07.703585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457f6bd-2178-4de0-8064-dd1100eb83ed None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:07.735335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebfdb6-c7c1-4d91-a6c5-db7ffcc88770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:07.735919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebfdb6-c7c1-4d91-a6c5-db7ffcc88770 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:07.736192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebfdb6-c7c1-4d91-a6c5-db7ffcc88770 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:07.736457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebfdb6-c7c1-4d91-a6c5-db7ffcc88770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:07.737172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebfdb6-c7c1-4d91-a6c5-db7ffcc88770 None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=b757271aaee64208baaacff7c0328d48, user.id=486848c89c30433185b222ebeb5b2b00) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:52:07.737475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebfdb6-c7c1-4d91-a6c5-db7ffcc88770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:07.738896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebfdb6-c7c1-4d91-a6c5-db7ffcc88770 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:07.741539 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:07.744611 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 437/879] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:52:07 2022] GET /identity/v3/role_assignments?user.id=486848c89c30433185b222ebeb5b2b00&scope.project.id=b757271aaee64208baaacff7c0328d48&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:09.868379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd399-5a0c-49e2-92a2-212c5edae5f1 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:09.868889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd399-5a0c-49e2-92a2-212c5edae5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:09.868889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd399-5a0c-49e2-92a2-212c5edae5f1 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:09.870240 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 443/880] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:09.875442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34588d-7739-42b7-8a51-1723b70bff5b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:09.875846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34588d-7739-42b7-8a51-1723b70bff5b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:09.876022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34588d-7739-42b7-8a51-1723b70bff5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:09.893412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aa34588d-7739-42b7-8a51-1723b70bff5b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:09.894586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa34588d-7739-42b7-8a51-1723b70bff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:09.957333 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 438/881] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:10.222774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd399-5a0c-49e2-92a2-212c5edae5f1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:10.256765 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:10.319092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd399-5a0c-49e2-92a2-212c5edae5f1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:10.351738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69479710-3de8-41c9-a2ab-fe0fb2bdaad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:10.352327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479710-3de8-41c9-a2ab-fe0fb2bdaad1 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:10.352601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479710-3de8-41c9-a2ab-fe0fb2bdaad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:10.352868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479710-3de8-41c9-a2ab-fe0fb2bdaad1 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:10.353524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69479710-3de8-41c9-a2ab-fe0fb2bdaad1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:10.354916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69479710-3de8-41c9-a2ab-fe0fb2bdaad1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:10.417533 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 444/882] 10.222.0.42 () {60 vars in 1138 bytes} [Sun Oct 23 00:52:10 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:52:12.559957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2de77-bed0-450a-8695-b1ce2c87bc7e None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:12.560403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2de77-bed0-450a-8695-b1ce2c87bc7e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:12.560487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2de77-bed0-450a-8695-b1ce2c87bc7e None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:12.561835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 439/883] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:12.567061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b1349-992a-4c61-a55a-3735592ae7ff None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:12.567427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b1349-992a-4c61-a55a-3735592ae7ff None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:12.567613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b1349-992a-4c61-a55a-3735592ae7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:12.585026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-306b1349-992a-4c61-a55a-3735592ae7ff None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:12.586224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-306b1349-992a-4c61-a55a-3735592ae7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:12.649818 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 445/884] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:12.920380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2de77-bed0-450a-8695-b1ce2c87bc7e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:13.017204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2de77-bed0-450a-8695-b1ce2c87bc7e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:13.044444 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:13.050226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967648fb-b555-4b82-8eb8-b3811eb33d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:13.050847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967648fb-b555-4b82-8eb8-b3811eb33d1d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:13.051123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967648fb-b555-4b82-8eb8-b3811eb33d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:13.051395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967648fb-b555-4b82-8eb8-b3811eb33d1d None admin] PATH_INFO: `/v3/domains/9aadd75a16a34a62bebac948d9b40bce` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:13.061482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967648fb-b555-4b82-8eb8-b3811eb33d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=9aadd75a16a34a62bebac948d9b40bce)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:13.062935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967648fb-b555-4b82-8eb8-b3811eb33d1d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:13.066024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 440/885] 10.222.0.42 () {56 vars in 1183 bytes} [Sun Oct 23 00:52:12 2022] GET /identity/v3/domains/9aadd75a16a34a62bebac948d9b40bce => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:13.070097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b1349-992a-4c61-a55a-3735592ae7ff None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:13.096145 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:13.163659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b1349-992a-4c61-a55a-3735592ae7ff None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:13.195673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aa9ba-a5b9-4bf2-aa46-ff15843a6340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:13.196216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa9ba-a5b9-4bf2-aa46-ff15843a6340 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:13.196490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa9ba-a5b9-4bf2-aa46-ff15843a6340 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:13.196757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa9ba-a5b9-4bf2-aa46-ff15843a6340 None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:13.197391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aa9ba-a5b9-4bf2-aa46-ff15843a6340 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:13.199327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aa9ba-a5b9-4bf2-aa46-ff15843a6340 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:13.291935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 446/886] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:52:13 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:52:15.420359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3afcc-4b36-40a0-8bf0-059fed06d454 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:15.420934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3afcc-4b36-40a0-8bf0-059fed06d454 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:15.420934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3afcc-4b36-40a0-8bf0-059fed06d454 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:15.422424 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 441/887] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:15.427956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066399ac-497a-4a6a-b39f-867d58ec58f4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:15.428372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066399ac-497a-4a6a-b39f-867d58ec58f4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:15.428525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066399ac-497a-4a6a-b39f-867d58ec58f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:15.446049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-066399ac-497a-4a6a-b39f-867d58ec58f4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:15.447209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-066399ac-497a-4a6a-b39f-867d58ec58f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:15.510938 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 447/888] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:15.775341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3afcc-4b36-40a0-8bf0-059fed06d454 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:15.872020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3afcc-4b36-40a0-8bf0-059fed06d454 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:15.903825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0e50-42c4-40ea-8170-1cb39b77e7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:15.904431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0e50-42c4-40ea-8170-1cb39b77e7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:15.904708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0e50-42c4-40ea-8170-1cb39b77e7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:15.904982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0e50-42c4-40ea-8170-1cb39b77e7b3 None admin] PATH_INFO: `/v3/domains/9aadd75a16a34a62bebac948d9b40bce` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:15.906089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0e50-42c4-40ea-8170-1cb39b77e7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9aadd75a16a34a62bebac948d9b40bce)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:15.907496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0e50-42c4-40ea-8170-1cb39b77e7b3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:15.909040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 442/889] 10.222.0.42 () {56 vars in 1183 bytes} [Sun Oct 23 00:52:15 2022] GET /identity/v3/domains/9aadd75a16a34a62bebac948d9b40bce => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:15.914859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066399ac-497a-4a6a-b39f-867d58ec58f4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:15.925487 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:16.011132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066399ac-497a-4a6a-b39f-867d58ec58f4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:16.043409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b109937-2df3-4788-8efc-bbcfaa943796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:16.043947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b109937-2df3-4788-8efc-bbcfaa943796 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:16.044221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b109937-2df3-4788-8efc-bbcfaa943796 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:16.044487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b109937-2df3-4788-8efc-bbcfaa943796 None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:16.045158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b109937-2df3-4788-8efc-bbcfaa943796 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:16.046600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b109937-2df3-4788-8efc-bbcfaa943796 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:16.147795 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 448/890] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:52:15 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:52:18.273002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f16d6-751c-4a65-9d57-89d884361e19 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:18.273554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f16d6-751c-4a65-9d57-89d884361e19 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:18.273554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f16d6-751c-4a65-9d57-89d884361e19 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:18.274877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 443/891] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:18.280706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6473069-ea74-472a-aef5-b86a7aada58d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:18.281120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6473069-ea74-472a-aef5-b86a7aada58d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:18.281247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6473069-ea74-472a-aef5-b86a7aada58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:18.299110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c6473069-ea74-472a-aef5-b86a7aada58d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:18.300281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c6473069-ea74-472a-aef5-b86a7aada58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:18.355793 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:18.363317 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 449/892] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:18.630344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f16d6-751c-4a65-9d57-89d884361e19 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:18.686760 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:18.727663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f16d6-751c-4a65-9d57-89d884361e19 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:18.759091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:18.759697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:18.760509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:18.760772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:18.770694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:52:18.775346 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:52:18.776525 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:52:18.777620 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 444/893] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:52:18.782424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6473069-ea74-472a-aef5-b86a7aada58d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:18.926818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6473069-ea74-472a-aef5-b86a7aada58d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:18.959942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:18.960538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:18.960816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:18.961085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:18.961734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:52:18.962054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:18.963431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:18.971024 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 450/894] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:18.976775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:19.070954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c9a0a-a792-437f-9a64-c7b4477e0591 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:19.086762 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:19.102364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:19.103107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:19.103212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:19.103478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] PATH_INFO: `/v3/users/851cb4e44fcc47709d375938bd610422` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:19.116925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] RBAC: Authorizing `identity:get_user(user_id=851cb4e44fcc47709d375938bd610422)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:19.118355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:19.120505 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 445/895] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:52:18 2022] GET /identity/v3/users/851cb4e44fcc47709d375938bd610422 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:19.126248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:19.179496 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:19.220952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580cae9-6f52-4b59-b75d-98ea4b22f255 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:19.253487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ecd0c-c27c-43f6-a99f-2795ee3a1f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:19.254159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ecd0c-c27c-43f6-a99f-2795ee3a1f73 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:19.254436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ecd0c-c27c-43f6-a99f-2795ee3a1f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:19.254704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ecd0c-c27c-43f6-a99f-2795ee3a1f73 None admin] PATH_INFO: `/v3/projects/0d9d053fcbe34604bfd631f1b21ad413` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:19.255813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ecd0c-c27c-43f6-a99f-2795ee3a1f73 None admin] RBAC: Authorizing `identity:get_project(project_id=0d9d053fcbe34604bfd631f1b21ad413)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:19.257219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ecd0c-c27c-43f6-a99f-2795ee3a1f73 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:19.258949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 451/896] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:52:19 2022] GET /identity/v3/projects/0d9d053fcbe34604bfd631f1b21ad413 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:19.264734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:19.358867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c139e7-31ff-4c23-bbcf-64ba99a36a3d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:19.390198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1c141-da30-400f-bd05-7ebd4657c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:19.390830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c141-da30-400f-bd05-7ebd4657c1e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:19.391099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c141-da30-400f-bd05-7ebd4657c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:19.391366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c141-da30-400f-bd05-7ebd4657c1e1 None admin] PATH_INFO: `/v3/projects/0d9d053fcbe34604bfd631f1b21ad413/users/851cb4e44fcc47709d375938bd610422/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:19.393192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1c141-da30-400f-bd05-7ebd4657c1e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d9d053fcbe34604bfd631f1b21ad413, user_id=851cb4e44fcc47709d375938bd610422, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:19.394610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1c141-da30-400f-bd05-7ebd4657c1e1 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:19.470640 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 446/897] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:52:19 2022] PUT /identity/v3/projects/0d9d053fcbe34604bfd631f1b21ad413/users/851cb4e44fcc47709d375938bd610422/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:52:21.549478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95b72-d269-4161-b8f0-21296444e9bd None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:21.549910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95b72-d269-4161-b8f0-21296444e9bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:21.550028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95b72-d269-4161-b8f0-21296444e9bd None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:21.551375 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 452/898] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:21.556491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47555-3121-4859-9604-a2f2baf2cad2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:21.556874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47555-3121-4859-9604-a2f2baf2cad2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:21.557033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47555-3121-4859-9604-a2f2baf2cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:21.574549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bad47555-3121-4859-9604-a2f2baf2cad2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:21.575712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bad47555-3121-4859-9604-a2f2baf2cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:21.603159 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:21.639576 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 447/899] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:52:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:52:21.908366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e95b72-d269-4161-b8f0-21296444e9bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:22.004499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e95b72-d269-4161-b8f0-21296444e9bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:22.026017 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:22.035686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:22.036781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:22.036781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:22.036983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:22.046920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:52:22.052216 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:52:22.053309 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:52:22.054179 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 453/900] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:52:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:52:22.059720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad47555-3121-4859-9604-a2f2baf2cad2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:22.152135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad47555-3121-4859-9604-a2f2baf2cad2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:22.184969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:22.185502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:22.185779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:22.186074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:22.186724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:52:22.187023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:22.188365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:22.195994 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 448/901] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:22.201607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:22.294334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc98d5c-93e7-4901-85c9-9aaff02c952d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:22.325611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:22.326234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:22.326506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:22.326769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] PATH_INFO: `/v3/users/851cb4e44fcc47709d375938bd610422` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:22.327848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] RBAC: Authorizing `identity:get_user(user_id=851cb4e44fcc47709d375938bd610422)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:22.329240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:22.330771 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 454/902] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 23 00:52:22 2022] GET /identity/v3/users/851cb4e44fcc47709d375938bd610422 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:22.336252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:22.364050 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:22.431824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ff58-416e-4993-824f-f85d32a3f250 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:22.463310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:22.463839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:22.464109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:22.464372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:22.527833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:22.529244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:22.554650 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:22.621009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 449/903] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:52:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:52:22.627073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:22.677415 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:22.723415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90eb6b-c614-434a-bd05-d398588508c2 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:22.754416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0e122-7a94-4605-a7b9-d21685840db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:22.755029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e122-7a94-4605-a7b9-d21685840db6 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:22.755299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e122-7a94-4605-a7b9-d21685840db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:22.755562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0e122-7a94-4605-a7b9-d21685840db6 None admin] PATH_INFO: `/v3/projects/0d9d053fcbe34604bfd631f1b21ad413` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:22.756639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0e122-7a94-4605-a7b9-d21685840db6 None admin] RBAC: Authorizing `identity:get_project(project_id=0d9d053fcbe34604bfd631f1b21ad413)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:22.758059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0e122-7a94-4605-a7b9-d21685840db6 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:22.760207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 455/904] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 23 00:52:22 2022] GET /identity/v3/projects/0d9d053fcbe34604bfd631f1b21ad413 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:22.766337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:22.861211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ca17e-1fb5-4322-80aa-d1f80d382e77 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:22.886370 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:22.893729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f49c-6726-470e-9cc6-eefcbd63e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:22.894347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f49c-6726-470e-9cc6-eefcbd63e1bf None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:22.894627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f49c-6726-470e-9cc6-eefcbd63e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:22.894898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f49c-6726-470e-9cc6-eefcbd63e1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:22.895611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f49c-6726-470e-9cc6-eefcbd63e1bf None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=0d9d053fcbe34604bfd631f1b21ad413, user.id=851cb4e44fcc47709d375938bd610422) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:52:22.895933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f49c-6726-470e-9cc6-eefcbd63e1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:22.897314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f49c-6726-470e-9cc6-eefcbd63e1bf None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:22.903443 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 450/905] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:52:22 2022] GET /identity/v3/role_assignments?user.id=851cb4e44fcc47709d375938bd610422&scope.project.id=0d9d053fcbe34604bfd631f1b21ad413&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:52:32.750574 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=40 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:32.923117 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:35.535402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d3da-24ac-43bd-9781-a97725de6d67 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:35.535917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d3da-24ac-43bd-9781-a97725de6d67 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:35.535917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d3da-24ac-43bd-9781-a97725de6d67 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:35.537261 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 456/906] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:35.543055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90620-c764-49bf-81d6-03a4e1a0abb1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:35.543451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90620-c764-49bf-81d6-03a4e1a0abb1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:35.543594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90620-c764-49bf-81d6-03a4e1a0abb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:35.561670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9dd90620-c764-49bf-81d6-03a4e1a0abb1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:35.566132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9dd90620-c764-49bf-81d6-03a4e1a0abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:35.625329 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 451/907] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:53:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:53:35.905290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01d3da-24ac-43bd-9781-a97725de6d67 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:36.002103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01d3da-24ac-43bd-9781-a97725de6d67 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:36.034739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:36.035355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:36.035629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:36.035896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:36.046552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:36.047975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:36.061549 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:36.062668 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:36.064153 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:36.064153 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:36.064153 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:36.064153 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 457/908] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:36.068748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90620-c764-49bf-81d6-03a4e1a0abb1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:36.165600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90620-c764-49bf-81d6-03a4e1a0abb1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:36.193211 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:36.199242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a93ff-7c9e-4d52-aa23-689a59c360ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:36.199839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a93ff-7c9e-4d52-aa23-689a59c360ed None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:36.200109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a93ff-7c9e-4d52-aa23-689a59c360ed None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:36.200382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a93ff-7c9e-4d52-aa23-689a59c360ed None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:36.201010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a93ff-7c9e-4d52-aa23-689a59c360ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:36.201303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a93ff-7c9e-4d52-aa23-689a59c360ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:36.202673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a93ff-7c9e-4d52-aa23-689a59c360ed None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:36.213249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 452/909] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:36.219020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:36.270546 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:36.314912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d684f0-9ce8-4b78-b2f8-34d5cdca53b9 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:36.348235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810abe-69fe-44c6-b2a8-547ef1818c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:36.348835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810abe-69fe-44c6-b2a8-547ef1818c7e None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:36.349108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810abe-69fe-44c6-b2a8-547ef1818c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:36.349375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810abe-69fe-44c6-b2a8-547ef1818c7e None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:36.350030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed810abe-69fe-44c6-b2a8-547ef1818c7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:36.351432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed810abe-69fe-44c6-b2a8-547ef1818c7e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:36.519118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 458/910] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 23 00:53:36 2022] POST /identity/v3/users => generated 251 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:53:38.662617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8277172-a947-4027-b9bb-21bbde8c1262 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:38.663159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8277172-a947-4027-b9bb-21bbde8c1262 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:38.663159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8277172-a947-4027-b9bb-21bbde8c1262 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:38.664523 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 453/911] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:38.669678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ace6-10c5-4afa-88a6-38cda83ab9d5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:38.670138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ace6-10c5-4afa-88a6-38cda83ab9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:38.670252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ace6-10c5-4afa-88a6-38cda83ab9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:38.689016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-96b2ace6-10c5-4afa-88a6-38cda83ab9d5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:38.690222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96b2ace6-10c5-4afa-88a6-38cda83ab9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:38.754992 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 459/912] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:53:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:53:39.027171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8277172-a947-4027-b9bb-21bbde8c1262 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:39.124756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8277172-a947-4027-b9bb-21bbde8c1262 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:39.156608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:39.157216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:39.157486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:39.157747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:39.168590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:53:39.173507 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:39.174646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:39.175679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 454/913] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:53:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:53:39.180563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2ace6-10c5-4afa-88a6-38cda83ab9d5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:39.218989 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:39.276442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2ace6-10c5-4afa-88a6-38cda83ab9d5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:39.310144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:39.310699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:39.310975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:39.311243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:39.311897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] RBAC: Adding query filter params (name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:39.312197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:39.313585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:39.321695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 460/914] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:53:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:39.327637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:39.377342 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:39.425194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e5e3-252b-47d5-945b-a13022e5d557 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:39.457467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:39.464920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:39.464920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:39.464920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:39.469196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:39.470662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:39.484504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:39.485662 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:39.487308 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:39.487308 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:39.487308 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:39.487308 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 455/915] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:39.493526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:39.588121 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:39.590969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60e87-5531-46ec-89ab-5b5ccbbd934d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:39.622635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:39.623224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:39.623498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:39.623764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:39.624391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:39.624686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:39.626112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:39.637404 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 461/916] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:53:39.643182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:39.739672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aea26e-5270-4d22-a265-ba7c396f15f7 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:39.741141 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:39.771919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:39.772544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:39.772822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:39.773686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:39.780845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:39.782284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:53:39.793101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:39.794421 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:39.795894 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 456/917] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:39.800543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:39.896908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ee6d-b317-4ed7-a86f-9e979d613145 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:39.929038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:39.930207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:39.930478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:39.930737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:39.931452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:39.931746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:39.933146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:39.950541 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 462/918] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 23 00:53:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:39.956459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:40.053545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310b6c-013f-4a3a-93f4-f53ef7908bcd None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:40.086817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:40.087432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:40.087706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:40.087972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:40.098167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:40.099600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:40.113359 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:40.114502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:40.115440 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:40.115440 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:40.115440 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:40.115440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 457/919] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:40.120964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:40.139942 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:40.217718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be660bc-4647-4f4e-9782-9f87bb5c6fda None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:40.251279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:40.251875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:40.252148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:40.252410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:40.253030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:40.253323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:40.254704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:40.265806 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 463/920] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:40.271555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:40.287324 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:40.366624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a754396-9450-42c4-939d-52edbc4ce4e3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:40.399202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:40.399821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:40.400092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:40.400357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:40.406621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:40.408037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:53:40.419222 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:40.423477 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:40.424568 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 458/921] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:40.426457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:40.503049 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:40.523008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0acb9-c7bd-4d25-83a1-9d19927c7063 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:40.555214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b4089-b100-45c8-8a46-0fa6f2b72b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:40.555875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4089-b100-45c8-8a46-0fa6f2b72b9d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:40.556153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4089-b100-45c8-8a46-0fa6f2b72b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:40.556419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4089-b100-45c8-8a46-0fa6f2b72b9d None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:40.557095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b4089-b100-45c8-8a46-0fa6f2b72b9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:40.557394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b4089-b100-45c8-8a46-0fa6f2b72b9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:40.558821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b4089-b100-45c8-8a46-0fa6f2b72b9d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:40.570043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 464/922] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:40.576104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:40.647842 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:40.672233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b006e-6d51-4edf-84d8-73f72528939d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:40.703868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6246bb-c1db-427b-a6bf-53e3c73d5822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:40.704514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6246bb-c1db-427b-a6bf-53e3c73d5822 None admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:40.704800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6246bb-c1db-427b-a6bf-53e3c73d5822 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:40.705065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6246bb-c1db-427b-a6bf-53e3c73d5822 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/9e0b68b23114466a8c7fd4eaf4cfd593/roles/c072deb041d34b509dec24befa733f51` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:40.719875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6246bb-c1db-427b-a6bf-53e3c73d5822 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=9e0b68b23114466a8c7fd4eaf4cfd593, role_id=c072deb041d34b509dec24befa733f51)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:40.721291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6246bb-c1db-427b-a6bf-53e3c73d5822 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:40.846360 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 459/923] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:53:40 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/9e0b68b23114466a8c7fd4eaf4cfd593/roles/c072deb041d34b509dec24befa733f51 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:53:42.974696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4896-6732-45f6-897f-7f63f6665f02 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:42.975208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4896-6732-45f6-897f-7f63f6665f02 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:42.975208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4896-6732-45f6-897f-7f63f6665f02 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:42.977119 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 465/924] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:42.982534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfb3f6-4cc3-4746-bf75-378738ba5382 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:42.982988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfb3f6-4cc3-4746-bf75-378738ba5382 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:42.983112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfb3f6-4cc3-4746-bf75-378738ba5382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:43.002324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5ebfb3f6-4cc3-4746-bf75-378738ba5382 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:43.003497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5ebfb3f6-4cc3-4746-bf75-378738ba5382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:43.067941 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 460/925] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:53:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:53:43.332094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4896-6732-45f6-897f-7f63f6665f02 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:43.430457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4896-6732-45f6-897f-7f63f6665f02 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:43.462484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:43.463097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:43.463373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:43.463640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:43.471920 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:43.477434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:53:43.482533 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:43.483720 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:53:43.484710 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:43.486418 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 466/926] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 23 00:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:43.489379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfb3f6-4cc3-4746-bf75-378738ba5382 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:43.542609 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:43.584584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfb3f6-4cc3-4746-bf75-378738ba5382 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:43.616783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:43.617375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:43.617644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:43.617908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:43.618772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] RBAC: Adding query filter params (name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:43.619069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:43.620402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:43.628619 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 461/927] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 23 00:53:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:43.633954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:43.729385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72f0eb-9157-449f-a819-cc4896ef4430 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:43.760985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:43.761600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:43.761872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:43.762177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:43.771640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:43.773566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:43.788167 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:43.789851 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:43.790951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:43.790951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:43.790951 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:43.790951 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 467/928] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:43.796037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:43.890918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c141-1670-4532-8d98-d9b2fdc6f490 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:43.906781 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:43.924589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:43.925183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:43.925458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:43.925729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:43.926391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:43.926693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:43.928042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:43.939190 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 462/929] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:43.945377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:43.994115 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:44.042370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b72a-5940-42f4-9861-247cf6ded949 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:44.075049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:44.075669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:44.075938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:44.076200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:44.083474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:44.088682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:53:44.096323 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:44.097303 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:44.098623 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 468/930] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:44.103410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:44.199967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c3451-8152-4e49-b72c-8aeae25f875f None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:44.232794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:44.233393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:44.233671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:44.233941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:44.234686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:44.234989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:44.236399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:44.252810 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 463/931] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 23 00:53:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:44.259479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:44.356260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d43c28-a1c3-4a38-8b58-1ea0b33f7efd None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:44.366035 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:44.389492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:44.390123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:44.390402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:44.390670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:44.457705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:44.459105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:44.557029 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 469/932] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:53:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:53:44.562857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:44.596001 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:44.658322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66e804-53ad-4268-9a7a-627519a4fb61 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:44.691781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:44.692397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:44.692668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:44.692934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:44.703086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:44.704487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:44.719243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:44.720243 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:44.721101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:44.721101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:44.721101 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:44.721101 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 464/933] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:44.726547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:44.737936 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:44.822358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3a61-8cc1-46d3-9aef-6cd2b657fd1f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:44.854574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:44.855172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:44.855448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:44.855716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:44.856344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:44.856646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:44.858012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:44.869207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 470/934] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:44.875019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:44.957368 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:44.971760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103ae4b-5fc7-411a-96c6-25cb148b5133 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:45.004789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:45.005445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:45.005716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:45.006011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:45.013466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:45.013902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:53:45.026212 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:45.030379 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:45.031481 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 465/935] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:45.033529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:45.102301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:45.132389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f492-68d1-43ad-9f43-d811d63f60bf None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:45.164804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46e1e-c85b-4cf4-b073-46c45e1755da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:45.165389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46e1e-c85b-4cf4-b073-46c45e1755da None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:45.165661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46e1e-c85b-4cf4-b073-46c45e1755da None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:45.165925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46e1e-c85b-4cf4-b073-46c45e1755da None admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:45.166627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46e1e-c85b-4cf4-b073-46c45e1755da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:45.166924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46e1e-c85b-4cf4-b073-46c45e1755da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:45.168324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46e1e-c85b-4cf4-b073-46c45e1755da None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:45.179944 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 471/936] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:45.186041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:45.281481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8c48d-4591-4f13-b03e-d8924e8f315d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:45.314289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d035b-48af-4d12-998e-2a861b8174ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:45.314874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d035b-48af-4d12-998e-2a861b8174ee None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:45.315148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d035b-48af-4d12-998e-2a861b8174ee None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:45.315413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d035b-48af-4d12-998e-2a861b8174ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:45.316115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d035b-48af-4d12-998e-2a861b8174ee None admin] RBAC: Adding query filter params (role.id=c072deb041d34b509dec24befa733f51, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=9e0b68b23114466a8c7fd4eaf4cfd593) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:45.316418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d035b-48af-4d12-998e-2a861b8174ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:45.317813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d035b-48af-4d12-998e-2a861b8174ee None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:45.323412 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 466/937] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:53:45 2022] GET /identity/v3/role_assignments?user.id=9e0b68b23114466a8c7fd4eaf4cfd593&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=c072deb041d34b509dec24befa733f51 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:47.469544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e410-1e59-451c-b22a-a349774ed5be None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:47.470197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e410-1e59-451c-b22a-a349774ed5be None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:47.470197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e410-1e59-451c-b22a-a349774ed5be None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:47.471604 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 472/938] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:47.477369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6dce-52b9-4547-8898-3d96c819d2a5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:47.477793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6dce-52b9-4547-8898-3d96c819d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:47.477915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f6dce-52b9-4547-8898-3d96c819d2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:47.496930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f13f6dce-52b9-4547-8898-3d96c819d2a5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:47.500058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f13f6dce-52b9-4547-8898-3d96c819d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:47.500944 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:47.562123 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 467/939] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:53:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:53:47.828358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884e410-1e59-451c-b22a-a349774ed5be None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:47.926000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884e410-1e59-451c-b22a-a349774ed5be None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:47.953095 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:47.958675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:47.959320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:47.959592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:47.959858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:47.970044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:53:47.974779 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:47.976008 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:47.976926 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 473/940] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:47.981920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6dce-52b9-4547-8898-3d96c819d2a5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:48.075290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f6dce-52b9-4547-8898-3d96c819d2a5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:48.107984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:48.108514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:48.108786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:48.109053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:48.109700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:48.110019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:48.111364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:48.119544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 468/941] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:48.125482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:48.221768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fe66-3cbe-4b8b-9a76-9a622e6a684f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:48.254186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:48.254853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:48.255129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:48.255396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:48.265543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:48.270074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:48.280952 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:48.282101 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:48.283175 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:48.283175 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:48.283175 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:48.283175 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 474/942] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:48.287903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:48.290752 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:48.386005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33ca57-02bb-4353-b155-39712773027b None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:48.417594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:48.418217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:48.418490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:48.418755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:48.419385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:48.419714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:48.421481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:48.434340 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 469/943] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:48.440086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:48.482671 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:48.536180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81a0ff-b479-4088-ac3c-43e270360dc1 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:48.568987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:48.569632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:48.569906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:48.570210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:48.577344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:48.578810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:53:48.589619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:48.590837 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:48.592018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 475/944] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:48.596729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:48.655849 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:48.693153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49b774-cb76-4455-b670-0750efa18de3 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:48.725980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:48.726604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:48.726867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:48.727130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:48.727836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:48.728132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:48.729539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:48.746440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 470/945] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 23 00:53:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:48.752226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:48.851096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc01a-c640-429c-a7d7-3e99fd7dc13f None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:48.852546 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:48.882849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:48.883467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:48.883742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:48.884006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:48.894268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:48.895702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:48.909867 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:48.916100 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:48.918982 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:48.918982 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:48.918982 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:48.918982 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 476/946] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:48.919248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:49.012130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1603cd-f5cd-43c2-81a7-bee2f0e3154d None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:49.031723 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:49.045802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:49.046422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:49.046693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:49.046956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:49.047579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:49.047872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:49.049208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:49.060031 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 471/947] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:53:49.065721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:49.163033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b749f-3a15-45f4-8070-528dbc363924 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:49.196163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:49.196823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:49.197094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:49.197359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:49.203680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:49.205085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:53:49.216483 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:49.220293 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:49.221364 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 477/948] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:49.223538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:49.321280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62810-97a9-4fc8-8eeb-4c68889afc69 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:49.353988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a331ef-6fc0-45be-8d86-e12a0a291d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:49.354603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a331ef-6fc0-45be-8d86-e12a0a291d23 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:49.354874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a331ef-6fc0-45be-8d86-e12a0a291d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:49.355137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a331ef-6fc0-45be-8d86-e12a0a291d23 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:49.355821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a331ef-6fc0-45be-8d86-e12a0a291d23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:49.356119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a331ef-6fc0-45be-8d86-e12a0a291d23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:49.357521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a331ef-6fc0-45be-8d86-e12a0a291d23 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:49.368953 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 472/949] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:53:49.375065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:49.391419 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:49.471451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233b97f-baf4-4814-964c-9e8320acaacb None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:49.505547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327b2cc-b457-42c1-ace8-adfa941b9512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:49.506237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327b2cc-b457-42c1-ace8-adfa941b9512 None admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:49.506514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327b2cc-b457-42c1-ace8-adfa941b9512 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:49.507352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327b2cc-b457-42c1-ace8-adfa941b9512 None admin] PATH_INFO: `/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/9e0b68b23114466a8c7fd4eaf4cfd593/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:49.509241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327b2cc-b457-42c1-ace8-adfa941b9512 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccfe2faaaeaa488eb31b979b891fa58e, user_id=9e0b68b23114466a8c7fd4eaf4cfd593, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:49.510698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327b2cc-b457-42c1-ace8-adfa941b9512 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:49.582896 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 478/950] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 23 00:53:49 2022] PUT /identity/v3/projects/ccfe2faaaeaa488eb31b979b891fa58e/users/9e0b68b23114466a8c7fd4eaf4cfd593/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:53:51.685596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bcf2e-d509-48ab-b52a-66de214e3cca None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:51.686265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bcf2e-d509-48ab-b52a-66de214e3cca None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:51.686265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bcf2e-d509-48ab-b52a-66de214e3cca None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:51.687486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 473/951] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:51.692832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467472c0-16f4-465d-8eea-e6e6b3e45bf7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:51.693265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467472c0-16f4-465d-8eea-e6e6b3e45bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:51.693363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467472c0-16f4-465d-8eea-e6e6b3e45bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:51.712231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-467472c0-16f4-465d-8eea-e6e6b3e45bf7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:51.713390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-467472c0-16f4-465d-8eea-e6e6b3e45bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:51.778129 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 479/952] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:53:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:53:52.045549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bcf2e-d509-48ab-b52a-66de214e3cca None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:52.087795 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:52.143806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bcf2e-d509-48ab-b52a-66de214e3cca None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:52.176594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:52.177212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:52.177490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:52.177758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:52.187954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:53:52.192646 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:52.193764 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:52.195276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 474/953] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 23 00:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:52.200556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467472c0-16f4-465d-8eea-e6e6b3e45bf7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:52.203625 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:52.294820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467472c0-16f4-465d-8eea-e6e6b3e45bf7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:52.328562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:52.329109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:52.329388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:52.329662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:52.330374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:52.330677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:52.332035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:52.339953 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 480/954] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 23 00:53:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:52.345812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:52.442213 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:52.445034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66158092-a0d8-4c4d-a926-457ce4012ae1 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:52.477687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:52.478340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:52.478612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:52.478876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:52.491558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:52.491558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:52.504821 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:52.505949 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:52.507631 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:52.507631 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:52.507631 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:52.507631 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 475/955] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:52.512150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:52.577478 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:52.611490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee8f4-6a35-49cc-b484-26ed8d080539 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:52.644461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:52.645054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:52.645328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:52.645592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:52.646242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:52.646534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:52.647898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:52.658980 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 481/956] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:52.664783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:52.761612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936ee5-e4b9-473a-9451-0fb557a81b56 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:52.792846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:52.793460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:52.793732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:52.794019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:52.801252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:52.802689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:53:52.813958 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:52.822541 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:52.823745 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 476/957] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:52.824488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:52.915600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442d84a-57af-4b22-b7c3-105d9cc486db None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:52.940946 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:52.949888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:52.950518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:52.950794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:52.951064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:52.951778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:52.952080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:52.953483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:52.969638 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 482/958] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 23 00:53:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:52.975895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:52.990772 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:53.072170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f929-0cb9-4a37-88ab-832cd037b3b4 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:53.105728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:53.108975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:53.108975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:53.108975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:53.173253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:53.174677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:53.188480 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:53.270261 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 477/959] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 23 00:53:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:53:53.276170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:53.373998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7fe9f-769b-47f9-9b6b-b1f1277b1e9e None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:53.407100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:53.407721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:53.407995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:53.408262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:53.418472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:53.419896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:53:53.440938 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:53.442136 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:53:53.443250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:53:53.443250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:53:53.443250 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:53.443250 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 483/960] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 00:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:53.443551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:53.539277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38254-0804-4505-862a-c11303dad1a8 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:53.552650 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:53.572696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:53.573298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:53.573570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:53.573832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:53.574493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:53.574786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:53.576124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:53.587229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 478/961] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 23 00:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:53.592940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:53.627561 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:53.688804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89246c09-d634-4453-97de-bcea20e5417d None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:53.722595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:53.723158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:53.723436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:53.723714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:53.730249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:53.731698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:53:53.743531 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:53.744561 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 00:53:53.745508 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 484/962] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 23 00:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:53:53.750382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:53.848645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47201f-b83e-4ba6-bd7d-adf00ecf2065 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:53.880906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62c91d-a840-470e-815f-e2d22e50b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:53.882029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c91d-a840-470e-815f-e2d22e50b586 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:53.882308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c91d-a840-470e-815f-e2d22e50b586 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:53.882574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c91d-a840-470e-815f-e2d22e50b586 None admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:53.883256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62c91d-a840-470e-815f-e2d22e50b586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:53.883561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62c91d-a840-470e-815f-e2d22e50b586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:53.885068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62c91d-a840-470e-815f-e2d22e50b586 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:53.896807 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 479/963] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 23 00:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:53.903443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:53.994373 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:53.999849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661cb4-5082-4361-8b11-93a55b085fe6 None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:54.033808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932ef64-bff1-4b97-9448-3cb505af5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:54.034434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ef64-bff1-4b97-9448-3cb505af5297 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:54.034704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ef64-bff1-4b97-9448-3cb505af5297 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:54.034969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932ef64-bff1-4b97-9448-3cb505af5297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:54.035678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932ef64-bff1-4b97-9448-3cb505af5297 None admin] RBAC: Adding query filter params (role.id=084c71d449aa4c209afa646584a16293, scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e, user.id=9e0b68b23114466a8c7fd4eaf4cfd593) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:54.035979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932ef64-bff1-4b97-9448-3cb505af5297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:54.037385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932ef64-bff1-4b97-9448-3cb505af5297 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:54.042942 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 485/964] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 23 00:53:53 2022] GET /identity/v3/role_assignments?user.id=9e0b68b23114466a8c7fd4eaf4cfd593&scope.project.id=ccfe2faaaeaa488eb31b979b891fa58e&role.id=084c71d449aa4c209afa646584a16293 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:56.196844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdc998-43b6-4c61-bb58-a8bfc3d8f557 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:56.197378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdc998-43b6-4c61-bb58-a8bfc3d8f557 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:56.197378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdc998-43b6-4c61-bb58-a8bfc3d8f557 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:56.198742 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 480/965] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:56.204065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e767d1-b003-4924-b149-3235b56f78b9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:56.204482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e767d1-b003-4924-b149-3235b56f78b9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:56.204647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e767d1-b003-4924-b149-3235b56f78b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:56.223232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-46e767d1-b003-4924-b149-3235b56f78b9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:56.224434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-46e767d1-b003-4924-b149-3235b56f78b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:56.290232 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 486/966] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:53:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:53:56.558493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdc998-43b6-4c61-bb58-a8bfc3d8f557 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:56.589303 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:56.659315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdc998-43b6-4c61-bb58-a8bfc3d8f557 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:56.692661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:56.693282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:56.693603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:56.694441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:56.695013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:56.696359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:53:56.705085 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:53:56.708865 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:53:56.709925 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 481/967] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:53:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:53:56.712373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e767d1-b003-4924-b149-3235b56f78b9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:56.799301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:56.809801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e767d1-b003-4924-b149-3235b56f78b9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:56.842417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5e0d8-24fd-4217-adee-5ca0332167ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:56.843032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5e0d8-24fd-4217-adee-5ca0332167ca None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:56.843301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5e0d8-24fd-4217-adee-5ca0332167ca None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:56.843566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5e0d8-24fd-4217-adee-5ca0332167ca None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:56.844182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5e0d8-24fd-4217-adee-5ca0332167ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:56.844476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5e0d8-24fd-4217-adee-5ca0332167ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:56.845849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5e0d8-24fd-4217-adee-5ca0332167ca None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:56.850984 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 487/968] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 23 00:53:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:56.856754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:56.949134 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:56.954797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55639124-39a2-4bd4-aaa5-afddab265837 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:56.987440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c718272-673b-471a-bea3-5271be3fefe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:56.988036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718272-673b-471a-bea3-5271be3fefe3 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:56.988334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718272-673b-471a-bea3-5271be3fefe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:56.988587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718272-673b-471a-bea3-5271be3fefe3 None admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:56.989206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c718272-673b-471a-bea3-5271be3fefe3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:53:56.989505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c718272-673b-471a-bea3-5271be3fefe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:56.991511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c718272-673b-471a-bea3-5271be3fefe3 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:56.995824 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 482/969] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 23 00:53:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:59.119592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc858-f13d-4cc1-89f7-24b6527e9301 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:59.120149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc858-f13d-4cc1-89f7-24b6527e9301 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:59.120149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc858-f13d-4cc1-89f7-24b6527e9301 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:59.121510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 488/970] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:59.127038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3641c9-5d13-45d3-b8be-6cde4a698fd6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:59.127457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3641c9-5d13-45d3-b8be-6cde4a698fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:59.127588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3641c9-5d13-45d3-b8be-6cde4a698fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:59.145792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0f3641c9-5d13-45d3-b8be-6cde4a698fd6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:59.147617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0f3641c9-5d13-45d3-b8be-6cde4a698fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:59.211369 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 483/971] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:53:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:53:59.479167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cc858-f13d-4cc1-89f7-24b6527e9301 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:59.578371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cc858-f13d-4cc1-89f7-24b6527e9301 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:59.610132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54376f3-61e3-49c6-b991-9c668edbdd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:59.610727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54376f3-61e3-49c6-b991-9c668edbdd42 None admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:59.611000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54376f3-61e3-49c6-b991-9c668edbdd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:59.611267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54376f3-61e3-49c6-b991-9c668edbdd42 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:59.611896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54376f3-61e3-49c6-b991-9c668edbdd42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:59.613242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54376f3-61e3-49c6-b991-9c668edbdd42 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:59.689030 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 489/972] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 23 00:53:59 2022] POST /identity/v3/services => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:54:01.844588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9416dae-a496-4c9a-94e6-2daf027313ef None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:01.845090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9416dae-a496-4c9a-94e6-2daf027313ef None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:01.845090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9416dae-a496-4c9a-94e6-2daf027313ef None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:01.846437 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 484/973] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:54:01.851833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269a29-adfb-48d2-97b6-133859110f34 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:01.852266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269a29-adfb-48d2-97b6-133859110f34 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:01.852358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269a29-adfb-48d2-97b6-133859110f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:01.871066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f0269a29-adfb-48d2-97b6-133859110f34 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:01.872260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f0269a29-adfb-48d2-97b6-133859110f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:01.882965 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:01.946397 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 490/974] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:54:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:54:02.218066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9416dae-a496-4c9a-94e6-2daf027313ef None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:02.307970 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:02.318235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9416dae-a496-4c9a-94e6-2daf027313ef None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:02.351706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:02.352355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:02.352633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:02.352903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:02.353478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:02.354877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:54:02.363464 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:54:02.364609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:54:02.365800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 485/975] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:54:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:54:02.370751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269a29-adfb-48d2-97b6-133859110f34 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:02.467239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269a29-adfb-48d2-97b6-133859110f34 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:02.509546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:02.510186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:02.510464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:02.510733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:02.511356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] RBAC: Adding query filter params (name=placement) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:54:02.511654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:02.513003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:02.519955 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 491/976] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 23 00:54:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:54:02.525380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:02.645998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4506e0e-6b73-4e43-ac7e-f5b2d4de05b0 None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:02.679291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bdc0a-4707-423b-b148-85adeb6dbfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:02.679876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bdc0a-4707-423b-b148-85adeb6dbfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:02.680149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bdc0a-4707-423b-b148-85adeb6dbfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:02.680411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bdc0a-4707-423b-b148-85adeb6dbfb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:02.681092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bdc0a-4707-423b-b148-85adeb6dbfb6 None admin] RBAC: Adding query filter params (interface=public, service_id=64ba21c6e7694c9f9113560bfae9f3ff, region_id=RegionOne) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:54:02.681391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bdc0a-4707-423b-b148-85adeb6dbfb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:02.682758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bdc0a-4707-423b-b148-85adeb6dbfb6 None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:02.687628 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 486/977] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 23 00:54:02 2022] GET /identity/v3/endpoints?service_id=64ba21c6e7694c9f9113560bfae9f3ff&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:54:02.693879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:02.697661 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:02.790327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39529-147c-4ed3-97f3-ea09a03346df None admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:02.830772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318df84-ccee-46cc-a8d4-7db9cc21e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:02.831446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318df84-ccee-46cc-a8d4-7db9cc21e350 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:02.831723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318df84-ccee-46cc-a8d4-7db9cc21e350 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:02.831987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318df84-ccee-46cc-a8d4-7db9cc21e350 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:02.832615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318df84-ccee-46cc-a8d4-7db9cc21e350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:02.834545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318df84-ccee-46cc-a8d4-7db9cc21e350 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:02.841257 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 492/978] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 23 00:54:02 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:54:04.986196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edc15-c790-4090-bfb8-80aa96d75100 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:04.986717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edc15-c790-4090-bfb8-80aa96d75100 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:04.986717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edc15-c790-4090-bfb8-80aa96d75100 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:04.988234 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 487/979] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 00:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:54:04.994028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3337f9-2575-4b92-b38c-e0536839e488 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:04.994453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3337f9-2575-4b92-b38c-e0536839e488 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:04.994566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3337f9-2575-4b92-b38c-e0536839e488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:05.012256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fe3337f9-2575-4b92-b38c-e0536839e488 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:05.013467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe3337f9-2575-4b92-b38c-e0536839e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:05.071924 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:05.077180 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 493/980] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 00:54:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:54:05.348910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47edc15-c790-4090-bfb8-80aa96d75100 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:05.367966 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:05.445982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47edc15-c790-4090-bfb8-80aa96d75100 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:05.479556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:05.480177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:05.480447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:05.480711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:05.481279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:05.482657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:54:05.491392 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:54:05.492576 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 00:54:05.493783 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 488/981] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 23 00:54:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:54:05.498428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3337f9-2575-4b92-b38c-e0536839e488 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:05.593339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3337f9-2575-4b92-b38c-e0536839e488 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:05.625710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee50e87-2909-4248-ab28-e04bc21f0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:05.626285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee50e87-2909-4248-ab28-e04bc21f0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:05.626552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee50e87-2909-4248-ab28-e04bc21f0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:05.626815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee50e87-2909-4248-ab28-e04bc21f0ad6 None admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:05.627424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee50e87-2909-4248-ab28-e04bc21f0ad6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:54:05.627720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee50e87-2909-4248-ab28-e04bc21f0ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:05.629053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee50e87-2909-4248-ab28-e04bc21f0ad6 None admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:05.633948 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 494/982] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 23 00:54:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:54:05.639880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:05.719906 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:05.736904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf2e5a-a0dd-4785-829a-12ab52e9cdeb None admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:05.769241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8966a-f82e-49bf-a0ba-e0d69fd0698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:05.769877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8966a-f82e-49bf-a0ba-e0d69fd0698f None admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:05.770389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8966a-f82e-49bf-a0ba-e0d69fd0698f None admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:05.770834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8966a-f82e-49bf-a0ba-e0d69fd0698f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:05.772478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8966a-f82e-49bf-a0ba-e0d69fd0698f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:05.773853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8966a-f82e-49bf-a0ba-e0d69fd0698f None admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:05.885578 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 489/983] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 00:54:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:54:15.631035 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=69 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:15.880367 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:10.650769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e5b35-5a73-4f9f-9f07-fda644bcb02c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:10.651149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e5b35-5a73-4f9f-9f07-fda644bcb02c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:10.651149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e5b35-5a73-4f9f-9f07-fda644bcb02c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:10.658479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4325-94f2-4a53-a945-de0b37ced6ab None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:10.658479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4325-94f2-4a53-a945-de0b37ced6ab None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:10.658908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4325-94f2-4a53-a945-de0b37ced6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:10.662288 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 495/984] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:10.737739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5b5c4325-94f2-4a53-a945-de0b37ced6ab None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:10.738877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5b5c4325-94f2-4a53-a945-de0b37ced6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:10.871254 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 490/985] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:11.167723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9d92-13ce-410d-8a4c-3eccb18d77b9 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:11.168003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9d92-13ce-410d-8a4c-3eccb18d77b9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:11.168446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9d92-13ce-410d-8a4c-3eccb18d77b9 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:11.170732 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 496/986] 10.222.0.42 () {54 vars in 964 bytes} [Sun Oct 23 01:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:11.177499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32598cd0-9b1a-422d-969f-244c8f786568 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:11.177796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32598cd0-9b1a-422d-969f-244c8f786568 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:11.178240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32598cd0-9b1a-422d-969f-244c8f786568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:11.261297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-32598cd0-9b1a-422d-969f-244c8f786568 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:11.262508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-32598cd0-9b1a-422d-969f-244c8f786568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:11.284071 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:11.341137 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 491/987] 10.222.0.42 () {58 vars in 1061 bytes} [Sun Oct 23 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:11.350799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9d92-13ce-410d-8a4c-3eccb18d77b9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:11.352547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-736c9d92-13ce-410d-8a4c-3eccb18d77b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:11.475274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9d92-13ce-410d-8a4c-3eccb18d77b9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:11.560555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101cbdf-b079-4a2e-b691-ac38c7683ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:11.561176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101cbdf-b079-4a2e-b691-ac38c7683ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:11.561450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101cbdf-b079-4a2e-b691-ac38c7683ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:11.561714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101cbdf-b079-4a2e-b691-ac38c7683ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:11.563444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a101cbdf-b079-4a2e-b691-ac38c7683ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:11.625938 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:11.690021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101cbdf-b079-4a2e-b691-ac38c7683ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:11.691688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101cbdf-b079-4a2e-b691-ac38c7683ed6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:11.714105 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 497/988] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:14.160087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b67218-627b-4e94-ba58-193d42f2775e None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:14.160668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b67218-627b-4e94-ba58-193d42f2775e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:14.160668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b67218-627b-4e94-ba58-193d42f2775e None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:14.162001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 492/989] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:14.167432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c197d-c620-4d64-b44c-f825f404af4d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:14.167834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c197d-c620-4d64-b44c-f825f404af4d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:14.167921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c197d-c620-4d64-b44c-f825f404af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:14.248629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e99c197d-c620-4d64-b44c-f825f404af4d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:14.249826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e99c197d-c620-4d64-b44c-f825f404af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:14.343353 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 498/990] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:14.626521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b67218-627b-4e94-ba58-193d42f2775e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:14.628174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66b67218-627b-4e94-ba58-193d42f2775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:14.731547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b67218-627b-4e94-ba58-193d42f2775e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:14.800192 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:14.802619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a95ea-8837-43f8-b058-a8cdfb44b599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:14.803223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a95ea-8837-43f8-b058-a8cdfb44b599 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:14.803494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a95ea-8837-43f8-b058-a8cdfb44b599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:14.803761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a95ea-8837-43f8-b058-a8cdfb44b599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:14.805326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-104a95ea-8837-43f8-b058-a8cdfb44b599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:14.913556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a95ea-8837-43f8-b058-a8cdfb44b599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:14.915066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a95ea-8837-43f8-b058-a8cdfb44b599 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:14.932953 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 493/991] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:17.608030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd97d93-5810-4c66-b82f-22072856649e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:17.608544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd97d93-5810-4c66-b82f-22072856649e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:17.608544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd97d93-5810-4c66-b82f-22072856649e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:17.609899 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 499/992] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:17.615243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24af6-ca30-49a9-9ffe-e2f586b1390b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:17.615639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24af6-ca30-49a9-9ffe-e2f586b1390b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:17.615789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24af6-ca30-49a9-9ffe-e2f586b1390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:17.679797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4dd24af6-ca30-49a9-9ffe-e2f586b1390b None None] MFA Rules not processed for user `25d7e17ecc654a77b0a9059dfca46873`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:17.680987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4dd24af6-ca30-49a9-9ffe-e2f586b1390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:17.731942 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:17.775289 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 494/993] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:18.057245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd97d93-5810-4c66-b82f-22072856649e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:18.058826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7fd97d93-5810-4c66-b82f-22072856649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:18.068971 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:18.161459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd97d93-5810-4c66-b82f-22072856649e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:18.234089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244f5ee-60d9-4d98-bdcb-15c0f6d7ace0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:18.234694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f5ee-60d9-4d98-bdcb-15c0f6d7ace0 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:18.234966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f5ee-60d9-4d98-bdcb-15c0f6d7ace0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:18.235234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f5ee-60d9-4d98-bdcb-15c0f6d7ace0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:18.236799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5244f5ee-60d9-4d98-bdcb-15c0f6d7ace0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:18.296621 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:18.341540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244f5ee-60d9-4d98-bdcb-15c0f6d7ace0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:18.342915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244f5ee-60d9-4d98-bdcb-15c0f6d7ace0 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:18.360984 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 500/994] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:21.224283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b906d-d926-49f1-8bda-4d22aba9648d None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:21.224810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b906d-d926-49f1-8bda-4d22aba9648d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:21.225087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b906d-d926-49f1-8bda-4d22aba9648d None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:21.226470 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 495/995] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:21.231759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc15e-6055-4ab0-a832-685a94c127e5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:21.232124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc15e-6055-4ab0-a832-685a94c127e5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:21.232308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc15e-6055-4ab0-a832-685a94c127e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:21.295897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c28dc15e-6055-4ab0-a832-685a94c127e5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:21.297083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c28dc15e-6055-4ab0-a832-685a94c127e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:21.389553 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 501/996] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:21.687637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d79c-5392-48c4-a366-62c18dad3ab4 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:21.687910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d79c-5392-48c4-a366-62c18dad3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:21.688175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d79c-5392-48c4-a366-62c18dad3ab4 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:21.689531 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 496/997] 10.222.0.42 () {54 vars in 964 bytes} [Sun Oct 23 01:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:21.695313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7fcd5-78c0-4d52-83af-aec75d5dafbf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:21.695596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7fcd5-78c0-4d52-83af-aec75d5dafbf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:21.695867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7fcd5-78c0-4d52-83af-aec75d5dafbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:21.717994 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:21.771160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f1e7fcd5-78c0-4d52-83af-aec75d5dafbf None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:21.772273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f1e7fcd5-78c0-4d52-83af-aec75d5dafbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:21.845940 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 502/998] 10.222.0.42 () {58 vars in 1061 bytes} [Sun Oct 23 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:21.854974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86d79c-5392-48c4-a366-62c18dad3ab4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:21.856484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d86d79c-5392-48c4-a366-62c18dad3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:21.956058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86d79c-5392-48c4-a366-62c18dad3ab4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:22.025614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb192247-e3d8-4e5d-bfe3-fae718b8be49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:22.026180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192247-e3d8-4e5d-bfe3-fae718b8be49 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:22.026454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192247-e3d8-4e5d-bfe3-fae718b8be49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:22.026717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192247-e3d8-4e5d-bfe3-fae718b8be49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:22.028271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bb192247-e3d8-4e5d-bfe3-fae718b8be49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:22.034872 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:22.134078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb192247-e3d8-4e5d-bfe3-fae718b8be49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:22.135512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb192247-e3d8-4e5d-bfe3-fae718b8be49 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:22.152824 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 497/999] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:25.694989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc8e3-7e63-468a-a576-9f7c0e7957c2 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:25.695561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc8e3-7e63-468a-a576-9f7c0e7957c2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:25.695561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc8e3-7e63-468a-a576-9f7c0e7957c2 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:25.696866 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 503/1000] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:25.702753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb58987-f406-485e-ab5c-981f530528c2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:25.703166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb58987-f406-485e-ab5c-981f530528c2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:25.703294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb58987-f406-485e-ab5c-981f530528c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:25.767599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4bb58987-f406-485e-ab5c-981f530528c2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:25.768702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4bb58987-f406-485e-ab5c-981f530528c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:25.830443 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:25.872433 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 498/1001] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:26.155594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc8e3-7e63-468a-a576-9f7c0e7957c2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:26.157118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-731dc8e3-7e63-468a-a576-9f7c0e7957c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:26.260228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc8e3-7e63-468a-a576-9f7c0e7957c2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:26.273282 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:26.334053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02032-88e5-4a0d-b1a5-5b0ebda928ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:26.334658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02032-88e5-4a0d-b1a5-5b0ebda928ba service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:26.334932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02032-88e5-4a0d-b1a5-5b0ebda928ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:26.335198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02032-88e5-4a0d-b1a5-5b0ebda928ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:26.336844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-52d02032-88e5-4a0d-b1a5-5b0ebda928ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:26.447732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02032-88e5-4a0d-b1a5-5b0ebda928ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:26.449084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02032-88e5-4a0d-b1a5-5b0ebda928ba service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:26.470688 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 504/1002] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:28.673499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18643f-0b1b-4a81-9f8e-e4676e215a20 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:28.674069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18643f-0b1b-4a81-9f8e-e4676e215a20 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:28.674069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18643f-0b1b-4a81-9f8e-e4676e215a20 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:28.675440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 499/1003] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:28.681084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9037c1-1782-4760-86eb-7ac882c43666 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:28.681515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9037c1-1782-4760-86eb-7ac882c43666 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:28.681639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9037c1-1782-4760-86eb-7ac882c43666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:28.729377 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:28.748153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bc9037c1-1782-4760-86eb-7ac882c43666 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:28.748648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bc9037c1-1782-4760-86eb-7ac882c43666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:28.853520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 505/1004] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:00:29.131066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18643f-0b1b-4a81-9f8e-e4676e215a20 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:29.132585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-af18643f-0b1b-4a81-9f8e-e4676e215a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:29.234552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18643f-0b1b-4a81-9f8e-e4676e215a20 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:29.306080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988020d-9d21-44c0-9c1c-cb0201a527bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:29.306600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988020d-9d21-44c0-9c1c-cb0201a527bf service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:29.306902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988020d-9d21-44c0-9c1c-cb0201a527bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:29.307171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988020d-9d21-44c0-9c1c-cb0201a527bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:29.308755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b988020d-9d21-44c0-9c1c-cb0201a527bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:29.325473 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:29.416521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988020d-9d21-44c0-9c1c-cb0201a527bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:29.418032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988020d-9d21-44c0-9c1c-cb0201a527bf service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:29.436928 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 500/1005] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:31.636248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d185a6c-15c4-4c9c-b82a-54dae3d0a3c7 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:31.636784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d185a6c-15c4-4c9c-b82a-54dae3d0a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:31.636784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d185a6c-15c4-4c9c-b82a-54dae3d0a3c7 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:31.638843 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 506/1006] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:31.644160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eafb7a-9819-46cc-8eaf-d3380c5c52c5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:31.644553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eafb7a-9819-46cc-8eaf-d3380c5c52c5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:31.644707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eafb7a-9819-46cc-8eaf-d3380c5c52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:31.710569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-76eafb7a-9819-46cc-8eaf-d3380c5c52c5 None None] MFA Rules not processed for user `25d7e17ecc654a77b0a9059dfca46873`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:31.711679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-76eafb7a-9819-46cc-8eaf-d3380c5c52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:31.774587 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:31.807260 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 501/1007] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:32.094250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d185a6c-15c4-4c9c-b82a-54dae3d0a3c7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:32.095801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8d185a6c-15c4-4c9c-b82a-54dae3d0a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:32.210820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d185a6c-15c4-4c9c-b82a-54dae3d0a3c7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:32.236048 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:32.294827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e5cc8-bc08-4470-b79c-44afa88397dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:32.295369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e5cc8-bc08-4470-b79c-44afa88397dc service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:32.295647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e5cc8-bc08-4470-b79c-44afa88397dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:32.295914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e5cc8-bc08-4470-b79c-44afa88397dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:32.297533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9e5e5cc8-bc08-4470-b79c-44afa88397dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:32.410507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e5cc8-bc08-4470-b79c-44afa88397dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:32.411907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e5cc8-bc08-4470-b79c-44afa88397dc service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:32.430738 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 507/1008] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:34.959000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9fabf-ab9d-404e-8a9d-f8f5586ef1a5 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:34.959510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9fabf-ab9d-404e-8a9d-f8f5586ef1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:34.959510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9fabf-ab9d-404e-8a9d-f8f5586ef1a5 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:34.960803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 502/1009] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:34.966003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be12dc-e476-4d27-bc52-af9a73b5f633 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:34.966412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be12dc-e476-4d27-bc52-af9a73b5f633 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:34.966560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be12dc-e476-4d27-bc52-af9a73b5f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:35.028687 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:35.031291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-96be12dc-e476-4d27-bc52-af9a73b5f633 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:35.032495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96be12dc-e476-4d27-bc52-af9a73b5f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:35.126801 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 508/1010] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:35.406290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9fabf-ab9d-404e-8a9d-f8f5586ef1a5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:35.407852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e3e9fabf-ab9d-404e-8a9d-f8f5586ef1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:35.509455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9fabf-ab9d-404e-8a9d-f8f5586ef1a5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:35.581024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e3414-96c3-483c-8d78-7feeeb479968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:35.581626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e3414-96c3-483c-8d78-7feeeb479968 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:35.581900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e3414-96c3-483c-8d78-7feeeb479968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:35.582193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e3414-96c3-483c-8d78-7feeeb479968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:35.583768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-113e3414-96c3-483c-8d78-7feeeb479968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:35.609785 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:35.689890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e3414-96c3-483c-8d78-7feeeb479968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:35.691280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e3414-96c3-483c-8d78-7feeeb479968 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:35.709167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 503/1011] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:37.905779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951dcef-7111-4ed4-91f6-e002d89c3f01 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:37.906428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951dcef-7111-4ed4-91f6-e002d89c3f01 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:37.906428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951dcef-7111-4ed4-91f6-e002d89c3f01 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:37.907710 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 509/1012] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:37.912977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef1a0-8dc9-411e-8c83-a046307eb15b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:37.913387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef1a0-8dc9-411e-8c83-a046307eb15b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:37.913558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef1a0-8dc9-411e-8c83-a046307eb15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:37.978195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-123ef1a0-8dc9-411e-8c83-a046307eb15b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:37.979384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-123ef1a0-8dc9-411e-8c83-a046307eb15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:38.052488 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:38.074171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 504/1013] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:38.359485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951dcef-7111-4ed4-91f6-e002d89c3f01 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:38.361652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5951dcef-7111-4ed4-91f6-e002d89c3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:38.462239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951dcef-7111-4ed4-91f6-e002d89c3f01 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:38.491395 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:38.536405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ac527-bf36-49b3-88f1-1b15e04f8988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:38.537011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ac527-bf36-49b3-88f1-1b15e04f8988 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:38.537287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ac527-bf36-49b3-88f1-1b15e04f8988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:38.537555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ac527-bf36-49b3-88f1-1b15e04f8988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:38.539210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-115ac527-bf36-49b3-88f1-1b15e04f8988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:38.643549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ac527-bf36-49b3-88f1-1b15e04f8988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:38.644888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ac527-bf36-49b3-88f1-1b15e04f8988 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:38.662885 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 510/1014] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:41.454341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361840e6-9f4a-4417-8620-d3e0d67d2f4a None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:41.454890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361840e6-9f4a-4417-8620-d3e0d67d2f4a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:41.454890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361840e6-9f4a-4417-8620-d3e0d67d2f4a None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:41.456235 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 505/1015] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:41.461345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa883-016f-48f2-a007-91e41b5cd58f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:41.461791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa883-016f-48f2-a007-91e41b5cd58f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:41.461888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fa883-016f-48f2-a007-91e41b5cd58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:41.525642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0c6fa883-016f-48f2-a007-91e41b5cd58f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:41.526852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0c6fa883-016f-48f2-a007-91e41b5cd58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:41.535582 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:41.620574 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 511/1016] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:41.899627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361840e6-9f4a-4417-8620-d3e0d67d2f4a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:41.901158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-361840e6-9f4a-4417-8620-d3e0d67d2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:42.001656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361840e6-9f4a-4417-8620-d3e0d67d2f4a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:42.072787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcdef6-47aa-406d-85ee-b660b97446e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:42.073379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcdef6-47aa-406d-85ee-b660b97446e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:42.073651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcdef6-47aa-406d-85ee-b660b97446e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:42.073916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcdef6-47aa-406d-85ee-b660b97446e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:42.076152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c2fcdef6-47aa-406d-85ee-b660b97446e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:42.109712 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:42.181388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcdef6-47aa-406d-85ee-b660b97446e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:42.182846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcdef6-47aa-406d-85ee-b660b97446e5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:42.201343 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 506/1017] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:46.445497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9ef0-5939-44fb-a251-02cede086c2d None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:46.446077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9ef0-5939-44fb-a251-02cede086c2d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:46.446077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f9ef0-5939-44fb-a251-02cede086c2d None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:46.447409 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 512/1018] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:46.453011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2368f-5dbf-48be-80cd-0fcb6297c950 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:46.453440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2368f-5dbf-48be-80cd-0fcb6297c950 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:46.453719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2368f-5dbf-48be-80cd-0fcb6297c950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:46.524848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c7a2368f-5dbf-48be-80cd-0fcb6297c950 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:46.526083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c7a2368f-5dbf-48be-80cd-0fcb6297c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:46.610875 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:46.621760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 507/1019] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:46.908493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f9ef0-5939-44fb-a251-02cede086c2d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:46.910149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd7f9ef0-5939-44fb-a251-02cede086c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:47.010540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f9ef0-5939-44fb-a251-02cede086c2d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:47.047775 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:47.085086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d327790-1940-43b8-92e5-64b7d7b4995e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:47.085690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d327790-1940-43b8-92e5-64b7d7b4995e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:47.085966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d327790-1940-43b8-92e5-64b7d7b4995e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:47.086260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d327790-1940-43b8-92e5-64b7d7b4995e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:47.087839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8d327790-1940-43b8-92e5-64b7d7b4995e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:47.193333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d327790-1940-43b8-92e5-64b7d7b4995e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:47.194676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d327790-1940-43b8-92e5-64b7d7b4995e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:47.212867 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 513/1020] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:50.308678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d6000-8292-487c-9f72-f3d97c8162ad None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:50.309212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d6000-8292-487c-9f72-f3d97c8162ad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:50.309212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d6000-8292-487c-9f72-f3d97c8162ad None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:50.310600 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 508/1021] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:50.316499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1faa4-e596-43f4-a81f-e50c1e2dd8c9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:50.317052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1faa4-e596-43f4-a81f-e50c1e2dd8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:50.317052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1faa4-e596-43f4-a81f-e50c1e2dd8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:50.385323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3de1faa4-e596-43f4-a81f-e50c1e2dd8c9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:50.387181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3de1faa4-e596-43f4-a81f-e50c1e2dd8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:50.407801 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:50.488554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 514/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:50.769951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d6000-8292-487c-9f72-f3d97c8162ad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:50.771560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-607d6000-8292-487c-9f72-f3d97c8162ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:50.877460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d6000-8292-487c-9f72-f3d97c8162ad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:50.954931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2905e6d-270b-466f-a57c-8ea5bf1eff86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:50.955530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905e6d-270b-466f-a57c-8ea5bf1eff86 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:50.955800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905e6d-270b-466f-a57c-8ea5bf1eff86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:50.956064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905e6d-270b-466f-a57c-8ea5bf1eff86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:50.957638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d2905e6d-270b-466f-a57c-8ea5bf1eff86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:51.001584 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:51.085072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2905e6d-270b-466f-a57c-8ea5bf1eff86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:51.086544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2905e6d-270b-466f-a57c-8ea5bf1eff86 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:51.106094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 509/1023] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:55.591925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8d6c-ac3b-466c-973f-5fba2a315695 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:55.592467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8d6c-ac3b-466c-973f-5fba2a315695 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:55.592562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8d6c-ac3b-466c-973f-5fba2a315695 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:55.593887 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 515/1024] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:00:55.599278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7030a70-6dde-451b-9d46-2b570739c9e6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:55.599763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7030a70-6dde-451b-9d46-2b570739c9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:55.599866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7030a70-6dde-451b-9d46-2b570739c9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:55.671241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a7030a70-6dde-451b-9d46-2b570739c9e6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:55.672436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a7030a70-6dde-451b-9d46-2b570739c9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:55.768798 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:55.771450 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 510/1025] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:56.054043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e8d6c-ac3b-466c-973f-5fba2a315695 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:56.055652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-356e8d6c-ac3b-466c-973f-5fba2a315695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:56.157519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e8d6c-ac3b-466c-973f-5fba2a315695 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:56.216045 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:56.241022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebcf13-e0a0-4cf3-a93d-ffa0ce5cc12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:56.241624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebcf13-e0a0-4cf3-a93d-ffa0ce5cc12b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:56.241894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebcf13-e0a0-4cf3-a93d-ffa0ce5cc12b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:56.242188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebcf13-e0a0-4cf3-a93d-ffa0ce5cc12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:56.243762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-50ebcf13-e0a0-4cf3-a93d-ffa0ce5cc12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:56.355052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebcf13-e0a0-4cf3-a93d-ffa0ce5cc12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:56.356504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebcf13-e0a0-4cf3-a93d-ffa0ce5cc12b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:56.375966 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 516/1026] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:01.282566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75e6f-1351-42c3-8dc8-baf7bc5d8b7f None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:01.283040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75e6f-1351-42c3-8dc8-baf7bc5d8b7f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:01.283128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75e6f-1351-42c3-8dc8-baf7bc5d8b7f None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:01.284723 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 511/1027] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:01.290480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9ecf6-79f1-4fd8-b99c-f31c4d175914 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:01.291271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9ecf6-79f1-4fd8-b99c-f31c4d175914 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:01.291723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9ecf6-79f1-4fd8-b99c-f31c4d175914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:01.436732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a4e9ecf6-79f1-4fd8-b99c-f31c4d175914 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:01.438439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4e9ecf6-79f1-4fd8-b99c-f31c4d175914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:01.459117 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:01.580340 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 517/1028] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:05.625027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930240-c9a7-40c7-91a1-7321c188535a None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:05.625597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930240-c9a7-40c7-91a1-7321c188535a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:05.625597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930240-c9a7-40c7-91a1-7321c188535a None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:05.627135 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 512/1029] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:05.632009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f28d7-c12a-49d3-bbf0-6d5b48e7db62 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:05.632475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f28d7-c12a-49d3-bbf0-6d5b48e7db62 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:05.632568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f28d7-c12a-49d3-bbf0-6d5b48e7db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:05.713060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7e6f28d7-c12a-49d3-bbf0-6d5b48e7db62 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:05.714454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7e6f28d7-c12a-49d3-bbf0-6d5b48e7db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:05.789115 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:05.827293 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 518/1030] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:01:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:07.292922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034ec73-1e1c-4524-a624-c4e24b342f40 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:07.293449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034ec73-1e1c-4524-a624-c4e24b342f40 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:07.293543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034ec73-1e1c-4524-a624-c4e24b342f40 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:07.295048 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 513/1031] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:07.300345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780003-b4c1-473d-9ba5-98c5403142a5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:07.300781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780003-b4c1-473d-9ba5-98c5403142a5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:07.301259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780003-b4c1-473d-9ba5-98c5403142a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:07.379565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-27780003-b4c1-473d-9ba5-98c5403142a5 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:07.380826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-27780003-b4c1-473d-9ba5-98c5403142a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:07.494328 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 519/1032] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:11.043030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd239e3-5b99-4b9b-abac-cd423b4d4b7f None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:11.044022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd239e3-5b99-4b9b-abac-cd423b4d4b7f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:11.044624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd239e3-5b99-4b9b-abac-cd423b4d4b7f None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:11.050090 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 514/1033] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:11.053244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853a3e-9d87-4270-9bd3-aeaa0371ac43 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:11.053700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853a3e-9d87-4270-9bd3-aeaa0371ac43 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:11.053779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853a3e-9d87-4270-9bd3-aeaa0371ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:11.092607 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:11.124325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ef853a3e-9d87-4270-9bd3-aeaa0371ac43 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:11.126022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ef853a3e-9d87-4270-9bd3-aeaa0371ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:11.231184 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 520/1034] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:01:11.533323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddb8ca-1799-4a7a-aa36-40caae19ff04 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:11.534058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddb8ca-1799-4a7a-aa36-40caae19ff04 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:11.534587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddb8ca-1799-4a7a-aa36-40caae19ff04 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:11.537780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 515/1035] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 23 01:01:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:11.550305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191265db-5eb7-4b8a-88a6-35888c97956b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:11.550595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191265db-5eb7-4b8a-88a6-35888c97956b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:11.550869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191265db-5eb7-4b8a-88a6-35888c97956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:11.632073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-191265db-5eb7-4b8a-88a6-35888c97956b None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:11.633262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-191265db-5eb7-4b8a-88a6-35888c97956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:11.684709 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:11.754028 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 521/1036] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:11.761497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddb8ca-1799-4a7a-aa36-40caae19ff04 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:11.763133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-38ddb8ca-1799-4a7a-aa36-40caae19ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:11.930628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddb8ca-1799-4a7a-aa36-40caae19ff04 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:12.006547 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:12.048589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01139844-275e-4aa6-ab72-8c0acf2805e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:12.049354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139844-275e-4aa6-ab72-8c0acf2805e4 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:12.049554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139844-275e-4aa6-ab72-8c0acf2805e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:12.049810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139844-275e-4aa6-ab72-8c0acf2805e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:12.051809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-01139844-275e-4aa6-ab72-8c0acf2805e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:12.149142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01139844-275e-4aa6-ab72-8c0acf2805e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:12.150590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01139844-275e-4aa6-ab72-8c0acf2805e4 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:12.173697 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 516/1037] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:14.569100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd3b89-8b3c-4e9a-9492-4fdd10818fd6 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:14.569602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd3b89-8b3c-4e9a-9492-4fdd10818fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:14.569602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd3b89-8b3c-4e9a-9492-4fdd10818fd6 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:14.571076 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 522/1038] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:14.576258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3838d4-825b-4294-800f-ad2051e20a43 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:14.576798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3838d4-825b-4294-800f-ad2051e20a43 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:14.576798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3838d4-825b-4294-800f-ad2051e20a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:14.679965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2b3838d4-825b-4294-800f-ad2051e20a43 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:14.681537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2b3838d4-825b-4294-800f-ad2051e20a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:14.724599 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:14.789713 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 517/1039] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:15.084245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd3b89-8b3c-4e9a-9492-4fdd10818fd6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:15.085872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0bbd3b89-8b3c-4e9a-9492-4fdd10818fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:15.243942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd3b89-8b3c-4e9a-9492-4fdd10818fd6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:15.255686 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:15.376276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad610-fa5f-4883-8b69-e25e82527d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:15.376911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad610-fa5f-4883-8b69-e25e82527d2c service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:15.379181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad610-fa5f-4883-8b69-e25e82527d2c service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:15.379181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad610-fa5f-4883-8b69-e25e82527d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:15.379181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c6ad610-fa5f-4883-8b69-e25e82527d2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:15.479368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ad610-fa5f-4883-8b69-e25e82527d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:15.480961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ad610-fa5f-4883-8b69-e25e82527d2c service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:15.500731 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 523/1040] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:18.105945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea46c3-46d6-4621-90ba-d65a56cc0325 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:18.106431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea46c3-46d6-4621-90ba-d65a56cc0325 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:18.106525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea46c3-46d6-4621-90ba-d65a56cc0325 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:18.108205 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 518/1041] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:18.113105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea40c-430b-4af1-9f19-99a47e000765 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:18.113532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea40c-430b-4af1-9f19-99a47e000765 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:18.113636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea40c-430b-4af1-9f19-99a47e000765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:18.130702 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:18.198502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c59ea40c-430b-4af1-9f19-99a47e000765 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:18.199779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c59ea40c-430b-4af1-9f19-99a47e000765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:18.337799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 524/1042] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:18.639436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d510968-5ea6-4767-8040-15476acb4e8e None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:18.639723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d510968-5ea6-4767-8040-15476acb4e8e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:18.640178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d510968-5ea6-4767-8040-15476acb4e8e None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:18.641516 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 519/1043] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 23 01:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:18.647439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950dce-39f7-470c-b507-726afb8121e2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:18.647775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950dce-39f7-470c-b507-726afb8121e2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:18.648957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950dce-39f7-470c-b507-726afb8121e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:18.747974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2b950dce-39f7-470c-b507-726afb8121e2 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:18.749516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2b950dce-39f7-470c-b507-726afb8121e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:18.792278 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:18.893963 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 525/1044] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:18.895300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d510968-5ea6-4767-8040-15476acb4e8e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:18.897005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8d510968-5ea6-4767-8040-15476acb4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:19.093216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d510968-5ea6-4767-8040-15476acb4e8e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:19.121181 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:19.241577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcb493-351e-4884-bbee-f75848952d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:19.242730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb493-351e-4884-bbee-f75848952d38 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:19.243212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb493-351e-4884-bbee-f75848952d38 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:19.243809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb493-351e-4884-bbee-f75848952d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:19.246164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-27bcb493-351e-4884-bbee-f75848952d38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:19.362934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcb493-351e-4884-bbee-f75848952d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:19.364733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcb493-351e-4884-bbee-f75848952d38 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:19.391169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 520/1045] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:22.075577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2edb3-b806-4343-a154-4703fdb39b7a None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:22.076096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2edb3-b806-4343-a154-4703fdb39b7a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:22.076096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2edb3-b806-4343-a154-4703fdb39b7a None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:22.081394 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 526/1046] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:22.083144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f5e0-9692-4199-8e92-aec9412aa89e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:22.083543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f5e0-9692-4199-8e92-aec9412aa89e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:22.083732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1f5e0-9692-4199-8e92-aec9412aa89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:22.117325 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:22.156227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-18e1f5e0-9692-4199-8e92-aec9412aa89e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:22.157567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-18e1f5e0-9692-4199-8e92-aec9412aa89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:22.294989 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 521/1047] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:22.619301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2edb3-b806-4343-a154-4703fdb39b7a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:22.623450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1ed2edb3-b806-4343-a154-4703fdb39b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:22.879003 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:22.884055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2edb3-b806-4343-a154-4703fdb39b7a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:23.010761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188912d-83a6-42dd-9fa0-55fcd36c1e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:23.011308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188912d-83a6-42dd-9fa0-55fcd36c1e21 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:23.011587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188912d-83a6-42dd-9fa0-55fcd36c1e21 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:23.011853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188912d-83a6-42dd-9fa0-55fcd36c1e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:23.013500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f188912d-83a6-42dd-9fa0-55fcd36c1e21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:23.115202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188912d-83a6-42dd-9fa0-55fcd36c1e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:23.116786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188912d-83a6-42dd-9fa0-55fcd36c1e21 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:23.133080 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:23.136718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 527/1048] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:23.156834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52f47-5de2-45fa-9115-cb6efc90d3b4 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:23.157385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52f47-5de2-45fa-9115-cb6efc90d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:23.157385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52f47-5de2-45fa-9115-cb6efc90d3b4 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:23.158771 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 522/1049] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:23.164023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8012528-7e25-493f-8a89-410a408a73f5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:23.164311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8012528-7e25-493f-8a89-410a408a73f5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:23.164630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8012528-7e25-493f-8a89-410a408a73f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:23.235534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c8012528-7e25-493f-8a89-410a408a73f5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:23.236777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c8012528-7e25-493f-8a89-410a408a73f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:23.349632 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 528/1050] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:23.681332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e05fb-32bc-44a7-b08c-03cf0e81c0a9 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:23.681332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e05fb-32bc-44a7-b08c-03cf0e81c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:23.681332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e05fb-32bc-44a7-b08c-03cf0e81c0a9 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:23.683322 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 523/1051] 10.222.0.42 () {54 vars in 963 bytes} [Sun Oct 23 01:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:23.687571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea80a0-3f62-4f51-894c-a93af3a346c3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:23.687863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea80a0-3f62-4f51-894c-a93af3a346c3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:23.688136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea80a0-3f62-4f51-894c-a93af3a346c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:23.767465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ddea80a0-3f62-4f51-894c-a93af3a346c3 None None] MFA Rules not processed for user `1a5599baadee4192ae45c1891b7f00f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:23.768674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ddea80a0-3f62-4f51-894c-a93af3a346c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:23.791197 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:23.850021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 529/1052] 10.222.0.42 () {58 vars in 1060 bytes} [Sun Oct 23 01:01:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:23.857538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e05fb-32bc-44a7-b08c-03cf0e81c0a9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:23.859100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fe9e05fb-32bc-44a7-b08c-03cf0e81c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:23.974987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e05fb-32bc-44a7-b08c-03cf0e81c0a9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:23.979293 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:24.054866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab757-002c-4bc7-bf97-035863798c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:24.055472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab757-002c-4bc7-bf97-035863798c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:24.055743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab757-002c-4bc7-bf97-035863798c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:24.056008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab757-002c-4bc7-bf97-035863798c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:24.058111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a9dab757-002c-4bc7-bf97-035863798c0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:24.183659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab757-002c-4bc7-bf97-035863798c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:24.185234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab757-002c-4bc7-bf97-035863798c0c service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:24.204181 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 524/1053] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:25.450505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78f60-7b01-4c49-a6f5-af6029cf38d2 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:25.451054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78f60-7b01-4c49-a6f5-af6029cf38d2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:25.451054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78f60-7b01-4c49-a6f5-af6029cf38d2 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:25.452377 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 530/1054] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:25.457696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0823-b939-4763-b9ee-904bde7a3080 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:25.458130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0823-b939-4763-b9ee-904bde7a3080 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:25.458264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0823-b939-4763-b9ee-904bde7a3080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:25.507792 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:25.531535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ed7b0823-b939-4763-b9ee-904bde7a3080 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:25.532894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ed7b0823-b939-4763-b9ee-904bde7a3080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:25.638361 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 525/1055] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:25.932409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f78f60-7b01-4c49-a6f5-af6029cf38d2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:25.934430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-64f78f60-7b01-4c49-a6f5-af6029cf38d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:26.109482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f78f60-7b01-4c49-a6f5-af6029cf38d2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:26.138870 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:26.234586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfd27b-0a7d-4ea7-b5a2-c90921ad1eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:26.234963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd27b-0a7d-4ea7-b5a2-c90921ad1eee service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:26.235235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd27b-0a7d-4ea7-b5a2-c90921ad1eee service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:26.235502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd27b-0a7d-4ea7-b5a2-c90921ad1eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:26.237081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d9dfd27b-0a7d-4ea7-b5a2-c90921ad1eee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:26.340139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfd27b-0a7d-4ea7-b5a2-c90921ad1eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:26.342054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfd27b-0a7d-4ea7-b5a2-c90921ad1eee service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:26.362164 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 531/1056] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:01:28.833157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f941ca-e039-46aa-b121-cdf023b3bcda None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:28.834091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f941ca-e039-46aa-b121-cdf023b3bcda None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:28.834527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f941ca-e039-46aa-b121-cdf023b3bcda None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:28.841844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8c705-1a3c-4a5c-942b-afaea1f65f3c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:28.842798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8c705-1a3c-4a5c-942b-afaea1f65f3c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:28.843224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8c705-1a3c-4a5c-942b-afaea1f65f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:28.848190 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 526/1057] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:28 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:28.889964 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:28.919961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-90c8c705-1a3c-4a5c-942b-afaea1f65f3c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:28.921519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90c8c705-1a3c-4a5c-942b-afaea1f65f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:29.030630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 532/1058] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:29.320166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f941ca-e039-46aa-b121-cdf023b3bcda None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:29.321855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44f941ca-e039-46aa-b121-cdf023b3bcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:29.460866 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:29.521749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f941ca-e039-46aa-b121-cdf023b3bcda None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:29.674953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6444728-252e-48e4-914f-7add87230fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:29.675482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444728-252e-48e4-914f-7add87230fdd service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:29.675756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444728-252e-48e4-914f-7add87230fdd service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:29.676024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6444728-252e-48e4-914f-7add87230fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:29.678068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6444728-252e-48e4-914f-7add87230fdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:29.765778 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:29.784483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6444728-252e-48e4-914f-7add87230fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:29.786510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6444728-252e-48e4-914f-7add87230fdd service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:29.809028 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 527/1059] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:32.196161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85face2-ee4c-42ae-9327-a0d763cfe4b2 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:32.196161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85face2-ee4c-42ae-9327-a0d763cfe4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:32.196793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85face2-ee4c-42ae-9327-a0d763cfe4b2 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:32.198589 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 533/1060] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:32.206561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df145915-6e27-498e-ac73-300b1662c7fd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:32.206561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df145915-6e27-498e-ac73-300b1662c7fd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:32.206561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df145915-6e27-498e-ac73-300b1662c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:32.284982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-df145915-6e27-498e-ac73-300b1662c7fd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:32.286238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df145915-6e27-498e-ac73-300b1662c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:32.387782 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 528/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:32.671698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85face2-ee4c-42ae-9327-a0d763cfe4b2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:32.673852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f85face2-ee4c-42ae-9327-a0d763cfe4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:32.794963 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:32.838082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85face2-ee4c-42ae-9327-a0d763cfe4b2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:32.957200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620562b0-57e6-4cd7-8e19-f421739fdc75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:32.957768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620562b0-57e6-4cd7-8e19-f421739fdc75 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:32.958075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620562b0-57e6-4cd7-8e19-f421739fdc75 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:32.958426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620562b0-57e6-4cd7-8e19-f421739fdc75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:32.960018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-620562b0-57e6-4cd7-8e19-f421739fdc75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:33.035807 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:33.053107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620562b0-57e6-4cd7-8e19-f421739fdc75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:33.054745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620562b0-57e6-4cd7-8e19-f421739fdc75 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:33.076845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 534/1062] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:35.822727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de635e8-7b90-499e-a0b1-debd649184bf None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:35.823258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de635e8-7b90-499e-a0b1-debd649184bf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:35.823258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de635e8-7b90-499e-a0b1-debd649184bf None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:35.824654 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 529/1063] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:35.830110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e2a2-14ed-426e-a3d1-63d52d1ee099 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:35.830523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e2a2-14ed-426e-a3d1-63d52d1ee099 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:35.830640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e2a2-14ed-426e-a3d1-63d52d1ee099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:35.899549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a1f3e2a2-14ed-426e-a3d1-63d52d1ee099 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:35.901204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a1f3e2a2-14ed-426e-a3d1-63d52d1ee099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:36.013030 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 535/1064] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:36.301716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de635e8-7b90-499e-a0b1-debd649184bf None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:36.303981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4de635e8-7b90-499e-a0b1-debd649184bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:36.366209 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:36.464197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de635e8-7b90-499e-a0b1-debd649184bf None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:36.586962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61eb3-ec6d-477d-aaf9-2fa1decf5c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:36.588605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61eb3-ec6d-477d-aaf9-2fa1decf5c7c service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:36.589236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61eb3-ec6d-477d-aaf9-2fa1decf5c7c service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:36.589650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61eb3-ec6d-477d-aaf9-2fa1decf5c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:36.591760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b8e61eb3-ec6d-477d-aaf9-2fa1decf5c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:36.609078 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:36.700924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61eb3-ec6d-477d-aaf9-2fa1decf5c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:36.702574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61eb3-ec6d-477d-aaf9-2fa1decf5c7c service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:36.720505 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 530/1065] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:39.172340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391f98a-453a-4164-9f07-058a5a2eab91 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:39.172955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391f98a-453a-4164-9f07-058a5a2eab91 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:39.172955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391f98a-453a-4164-9f07-058a5a2eab91 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:39.174263 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 536/1066] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:39.179763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4578-cd1f-419a-bdfc-2eef2fa9db8b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:39.180221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4578-cd1f-419a-bdfc-2eef2fa9db8b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:39.180340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4578-cd1f-419a-bdfc-2eef2fa9db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:39.244196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ea3d4578-cd1f-419a-bdfc-2eef2fa9db8b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:39.245446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea3d4578-cd1f-419a-bdfc-2eef2fa9db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:39.329854 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:39.341633 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 531/1067] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:01:39.638277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391f98a-453a-4164-9f07-058a5a2eab91 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:39.639806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7391f98a-453a-4164-9f07-058a5a2eab91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:39.697768 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:39.792564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391f98a-453a-4164-9f07-058a5a2eab91 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:39.907844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002e72f-616f-4ed2-b5c8-323dc89a4e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:39.908453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e72f-616f-4ed2-b5c8-323dc89a4e90 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:39.908729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e72f-616f-4ed2-b5c8-323dc89a4e90 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:39.908995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e72f-616f-4ed2-b5c8-323dc89a4e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:39.910620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4002e72f-616f-4ed2-b5c8-323dc89a4e90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:39.923494 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:39.948046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f528-dd80-4a30-9e59-91babc1997d4 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:39.948331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f528-dd80-4a30-9e59-91babc1997d4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:39.948601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9f528-dd80-4a30-9e59-91babc1997d4 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:39.950220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 532/1068] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:39.955055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1405e1-ab01-4f97-a9c2-c647bef56ee5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:39.955338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1405e1-ab01-4f97-a9c2-c647bef56ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:39.955614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1405e1-ab01-4f97-a9c2-c647bef56ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:40.003313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002e72f-616f-4ed2-b5c8-323dc89a4e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:40.004891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002e72f-616f-4ed2-b5c8-323dc89a4e90 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:40.022761 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 537/1069] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:40.023518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dc1405e1-ab01-4f97-a9c2-c647bef56ee5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:40.024800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc1405e1-ab01-4f97-a9c2-c647bef56ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:40.122945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 533/1070] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:01:40.433000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9025c-6601-4bfa-8cd2-8e9fd4126704 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:40.433516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9025c-6601-4bfa-8cd2-8e9fd4126704 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:40.433630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9025c-6601-4bfa-8cd2-8e9fd4126704 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:40.434971 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 538/1071] 10.222.0.42 () {54 vars in 962 bytes} [Sun Oct 23 01:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:40.440365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852102c-05af-43b2-8f24-44f8917b8932 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:40.440831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852102c-05af-43b2-8f24-44f8917b8932 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:40.440941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852102c-05af-43b2-8f24-44f8917b8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:40.519886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e852102c-05af-43b2-8f24-44f8917b8932 None None] MFA Rules not processed for user `42c76c07d0cf43d2b230e4afa9709bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:40.521075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e852102c-05af-43b2-8f24-44f8917b8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:40.534420 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:40.599499 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 534/1072] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Oct 23 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:40.607864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9025c-6601-4bfa-8cd2-8e9fd4126704 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:40.609418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-49f9025c-6601-4bfa-8cd2-8e9fd4126704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:40.714274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9025c-6601-4bfa-8cd2-8e9fd4126704 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:40.750690 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:40.788876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3bb4e-ca2a-4cb7-af5c-75d74cbb5d49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:40.789487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3bb4e-ca2a-4cb7-af5c-75d74cbb5d49 service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:40.789764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3bb4e-ca2a-4cb7-af5c-75d74cbb5d49 service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:40.790061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3bb4e-ca2a-4cb7-af5c-75d74cbb5d49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:40.791689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0fe3bb4e-ca2a-4cb7-af5c-75d74cbb5d49 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:40.906464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3bb4e-ca2a-4cb7-af5c-75d74cbb5d49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:40.907907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3bb4e-ca2a-4cb7-af5c-75d74cbb5d49 service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:40.926714 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 539/1073] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:41.825899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7322a5-495d-4cc6-855e-cfb16f6a2b38 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:41.826424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7322a5-495d-4cc6-855e-cfb16f6a2b38 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:41.826574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7322a5-495d-4cc6-855e-cfb16f6a2b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:41.893850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1f7322a5-495d-4cc6-855e-cfb16f6a2b38 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:41.895061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f7322a5-495d-4cc6-855e-cfb16f6a2b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:41.979851 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 535/1074] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:42.025241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c5d8-f103-4fa7-b0ed-c3c771908a47 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:42.025726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c5d8-f103-4fa7-b0ed-c3c771908a47 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:42.025827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c5d8-f103-4fa7-b0ed-c3c771908a47 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:42.027138 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 540/1075] 10.222.0.42 () {54 vars in 943 bytes} [Sun Oct 23 01:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:42.033341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f2e8-1964-4ceb-bafc-6309d49e613d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:42.033715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f2e8-1964-4ceb-bafc-6309d49e613d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:42.034014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f2e8-1964-4ceb-bafc-6309d49e613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:42.065783 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:42.110172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c504f2e8-1964-4ceb-bafc-6309d49e613d None None] MFA Rules not processed for user `8d2725c03b7e40c39b3db1cd9c45ed71`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:42.111370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c504f2e8-1964-4ceb-bafc-6309d49e613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:42.230187 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 536/1076] 10.222.0.42 () {58 vars in 1040 bytes} [Sun Oct 23 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:42.242760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59c5d8-f103-4fa7-b0ed-c3c771908a47 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:42.242760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ad59c5d8-f103-4fa7-b0ed-c3c771908a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:42.304054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6021c4-b836-4988-8b68-2ec3e46f69d4 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:42.304344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6021c4-b836-4988-8b68-2ec3e46f69d4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:42.304613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6021c4-b836-4988-8b68-2ec3e46f69d4 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:42.306001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 537/1077] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:42.310920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:42.311199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:42.311468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:42.317528 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:42.381514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:42.382792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:42.383865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59c5d8-f103-4fa7-b0ed-c3c771908a47 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:42.421885 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:42.483956 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 538/1078] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:01:42.491480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6fd91-82df-4353-8a57-fb28ee097fce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:42.492088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6fd91-82df-4353-8a57-fb28ee097fce service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:42.492357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6fd91-82df-4353-8a57-fb28ee097fce service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:42.492626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6fd91-82df-4353-8a57-fb28ee097fce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:42.494705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62a6fd91-82df-4353-8a57-fb28ee097fce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:42.546109 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:42.577753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6fd91-82df-4353-8a57-fb28ee097fce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:42.579344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6fd91-82df-4353-8a57-fb28ee097fce service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:42.587242 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 541/1079] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:01:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:01:42.773152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:42.774404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:42.889773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77747e-6a6e-4a27-8e4e-62a081a1eca4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:42.950488 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:43.038860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4cc40-82e1-4f28-94f4-038d73c07ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:43.039523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4cc40-82e1-4f28-94f4-038d73c07ee8 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:43.039866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4cc40-82e1-4f28-94f4-038d73c07ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:43.040733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4cc40-82e1-4f28-94f4-038d73c07ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:43.042449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f7e4cc40-82e1-4f28-94f4-038d73c07ee8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:43.151893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4cc40-82e1-4f28-94f4-038d73c07ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:43.153474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4cc40-82e1-4f28-94f4-038d73c07ee8 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:43.175203 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 539/1080] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:46.154232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048859f2-3d4e-479d-bb84-89b8cf981ac3 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:46.154762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048859f2-3d4e-479d-bb84-89b8cf981ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:46.154762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048859f2-3d4e-479d-bb84-89b8cf981ac3 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:46.156237 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 542/1081] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:46.161402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db306a-c4c7-4a06-b037-69c1310777d2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:46.161817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db306a-c4c7-4a06-b037-69c1310777d2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:46.162011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db306a-c4c7-4a06-b037-69c1310777d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:46.237047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-75db306a-c4c7-4a06-b037-69c1310777d2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:46.238393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-75db306a-c4c7-4a06-b037-69c1310777d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:46.247753 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:46.350013 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 540/1082] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:46.649003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048859f2-3d4e-479d-bb84-89b8cf981ac3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:46.651144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-048859f2-3d4e-479d-bb84-89b8cf981ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:46.826832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048859f2-3d4e-479d-bb84-89b8cf981ac3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:46.877456 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:46.953164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3d33-3a58-4b22-a130-944260373b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:46.955743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3d33-3a58-4b22-a130-944260373b88 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:46.955743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3d33-3a58-4b22-a130-944260373b88 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:46.955743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3d33-3a58-4b22-a130-944260373b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:46.956573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-536c3d33-3a58-4b22-a130-944260373b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:47.061023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3d33-3a58-4b22-a130-944260373b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:47.062620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3d33-3a58-4b22-a130-944260373b88 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:47.082232 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 543/1083] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:49.416741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b888e-a25e-4f48-90bd-290368826605 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:49.417295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b888e-a25e-4f48-90bd-290368826605 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:49.417295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b888e-a25e-4f48-90bd-290368826605 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:49.418701 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 541/1084] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:01:49.427434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0d669-92ee-4b78-8693-f228fe90a9b2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:49.428224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0d669-92ee-4b78-8693-f228fe90a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:49.428494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0d669-92ee-4b78-8693-f228fe90a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:49.532368 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:49.535723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-36f0d669-92ee-4b78-8693-f228fe90a9b2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:01:49.536941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-36f0d669-92ee-4b78-8693-f228fe90a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:49.648947 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 544/1085] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:01:49.941726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b888e-a25e-4f48-90bd-290368826605 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:49.943391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-175b888e-a25e-4f48-90bd-290368826605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:50.096030 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:50.103610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b888e-a25e-4f48-90bd-290368826605 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:50.225109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a49b4a-2340-4b3b-9b4d-ba14be1145de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:50.225626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49b4a-2340-4b3b-9b4d-ba14be1145de service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:50.225904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49b4a-2340-4b3b-9b4d-ba14be1145de service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:50.226224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49b4a-2340-4b3b-9b4d-ba14be1145de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:50.228451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-87a49b4a-2340-4b3b-9b4d-ba14be1145de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:01:50.324918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a49b4a-2340-4b3b-9b4d-ba14be1145de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:50.326800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a49b4a-2340-4b3b-9b4d-ba14be1145de service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:50.346884 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:50.351681 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 542/1086] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:59.647509 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=43 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:00.376611 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:06.523098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0e7e-7268-4c01-8733-1ef1d0fca67e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:06.523662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0e7e-7268-4c01-8733-1ef1d0fca67e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:06.523662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0e7e-7268-4c01-8733-1ef1d0fca67e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:06.525027 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 545/1087] 10.222.0.42 () {54 vars in 918 bytes} [Sun Oct 23 01:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:06.530274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93aa50-e016-42c9-a2d6-ea1c3e28975a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:06.530709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93aa50-e016-42c9-a2d6-ea1c3e28975a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:06.530824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93aa50-e016-42c9-a2d6-ea1c3e28975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:06.605444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ef93aa50-e016-42c9-a2d6-ea1c3e28975a None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:06.606663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef93aa50-e016-42c9-a2d6-ea1c3e28975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:06.708017 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 543/1088] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Oct 23 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:02:06.722581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6998dd-23d0-4de7-8d5f-388f401d642e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:06.722863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6998dd-23d0-4de7-8d5f-388f401d642e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:06.723140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6998dd-23d0-4de7-8d5f-388f401d642e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:06.724496 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 546/1089] 10.222.0.42 () {54 vars in 918 bytes} [Sun Oct 23 01:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:06.729543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a5a8-de17-4b0d-815e-07b8390e297b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:06.729825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a5a8-de17-4b0d-815e-07b8390e297b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:06.730259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a5a8-de17-4b0d-815e-07b8390e297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:06.801282 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:06.804238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8880a5a8-de17-4b0d-815e-07b8390e297b None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:06.805451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8880a5a8-de17-4b0d-815e-07b8390e297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:06.916517 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 544/1090] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Oct 23 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:09.473813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3043d-b56e-4c06-95c9-b9e2059dcaf7 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:09.474354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3043d-b56e-4c06-95c9-b9e2059dcaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:09.474354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3043d-b56e-4c06-95c9-b9e2059dcaf7 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:09.475634 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 547/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:09.481060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfde9a-f5a3-4fbf-ae1d-2d28b287563c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:09.481465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfde9a-f5a3-4fbf-ae1d-2d28b287563c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:09.481640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfde9a-f5a3-4fbf-ae1d-2d28b287563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:09.547842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1acfde9a-f5a3-4fbf-ae1d-2d28b287563c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:09.549027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1acfde9a-f5a3-4fbf-ae1d-2d28b287563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:09.602351 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:09.643616 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 545/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:09.930997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3043d-b56e-4c06-95c9-b9e2059dcaf7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:09.932519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ccb3043d-b56e-4c06-95c9-b9e2059dcaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:10.076920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3043d-b56e-4c06-95c9-b9e2059dcaf7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:10.147505 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:10.187692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8d24-e8f4-4eb3-98e4-d506f88c583f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:10.188223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8d24-e8f4-4eb3-98e4-d506f88c583f service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:10.188496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8d24-e8f4-4eb3-98e4-d506f88c583f service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:10.188760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8d24-e8f4-4eb3-98e4-d506f88c583f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:10.190404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5f0a8d24-e8f4-4eb3-98e4-d506f88c583f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:10.276624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8d24-e8f4-4eb3-98e4-d506f88c583f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:10.278212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8d24-e8f4-4eb3-98e4-d506f88c583f service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:10.296168 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 548/1093] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:11.427451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf0e0-8f8a-4afd-89b5-253de9310944 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:11.428026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf0e0-8f8a-4afd-89b5-253de9310944 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:11.428026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf0e0-8f8a-4afd-89b5-253de9310944 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:11.430027 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 546/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:11.435182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0dc97-e776-4827-b113-acf096522915 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:11.435635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0dc97-e776-4827-b113-acf096522915 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:11.435738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0dc97-e776-4827-b113-acf096522915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:11.511082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8af0dc97-e776-4827-b113-acf096522915 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:11.512280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8af0dc97-e776-4827-b113-acf096522915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:11.538127 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:11.606657 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 549/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:11.762500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcf0e0-8f8a-4afd-89b5-253de9310944 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:11.764009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fcdcf0e0-8f8a-4afd-89b5-253de9310944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:11.906103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcf0e0-8f8a-4afd-89b5-253de9310944 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:11.946385 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:12.016893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5e03-68bd-440c-b1e9-bbaa6fc5d229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:12.017493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5e03-68bd-440c-b1e9-bbaa6fc5d229 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:12.017765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5e03-68bd-440c-b1e9-bbaa6fc5d229 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:12.018062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5e03-68bd-440c-b1e9-bbaa6fc5d229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:12.019648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e32b5e03-68bd-440c-b1e9-bbaa6fc5d229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:12.107524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b5e03-68bd-440c-b1e9-bbaa6fc5d229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:12.109081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b5e03-68bd-440c-b1e9-bbaa6fc5d229 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:12.126596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 547/1096] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:13.236585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41850e-a8fa-400a-9d24-bf8341a97bea None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:13.237147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41850e-a8fa-400a-9d24-bf8341a97bea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:13.237147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41850e-a8fa-400a-9d24-bf8341a97bea None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:13.238545 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 550/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:13.243781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb752db-ef1f-42fc-99e7-7dfb9ded8318 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:13.244195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb752db-ef1f-42fc-99e7-7dfb9ded8318 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:13.244298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb752db-ef1f-42fc-99e7-7dfb9ded8318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:13.297353 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:13.318781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7fb752db-ef1f-42fc-99e7-7dfb9ded8318 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:13.319991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7fb752db-ef1f-42fc-99e7-7dfb9ded8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:13.412590 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 548/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:13.565204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41850e-a8fa-400a-9d24-bf8341a97bea None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:13.566797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0a41850e-a8fa-400a-9d24-bf8341a97bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:13.709920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41850e-a8fa-400a-9d24-bf8341a97bea None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:13.722194 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:13.820833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92673a9-a1d3-4db8-8e1a-79f054910438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:13.821349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92673a9-a1d3-4db8-8e1a-79f054910438 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:13.821623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92673a9-a1d3-4db8-8e1a-79f054910438 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:13.821890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92673a9-a1d3-4db8-8e1a-79f054910438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:13.823510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b92673a9-a1d3-4db8-8e1a-79f054910438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:13.910043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92673a9-a1d3-4db8-8e1a-79f054910438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:13.911618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92673a9-a1d3-4db8-8e1a-79f054910438 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:13.929407 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 551/1099] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:15.016820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba97e99-cdcf-43d2-aec1-b08acc7b6933 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:15.017344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba97e99-cdcf-43d2-aec1-b08acc7b6933 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:15.017344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba97e99-cdcf-43d2-aec1-b08acc7b6933 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:15.018765 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 549/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:15.024093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e7da-99bb-4947-9c3d-dfa08ee0714a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:15.024490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e7da-99bb-4947-9c3d-dfa08ee0714a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:15.024633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e7da-99bb-4947-9c3d-dfa08ee0714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:15.044618 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:15.102156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7f54e7da-99bb-4947-9c3d-dfa08ee0714a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:15.103350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7f54e7da-99bb-4947-9c3d-dfa08ee0714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:15.197239 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 552/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:15.346509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba97e99-cdcf-43d2-aec1-b08acc7b6933 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:15.347982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0ba97e99-cdcf-43d2-aec1-b08acc7b6933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:15.456077 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:15.491892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba97e99-cdcf-43d2-aec1-b08acc7b6933 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:15.601395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a2946-93e7-493a-bc33-04217997560f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:15.601917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2946-93e7-493a-bc33-04217997560f service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:15.602217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2946-93e7-493a-bc33-04217997560f service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:15.602484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2946-93e7-493a-bc33-04217997560f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:15.604066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e0a2946-93e7-493a-bc33-04217997560f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:15.679061 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:15.692056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a2946-93e7-493a-bc33-04217997560f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:15.693632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a2946-93e7-493a-bc33-04217997560f service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:15.711842 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 550/1102] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:16.798524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4804-7a31-4dcb-b14b-cd3deb50cf4c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:16.799062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4804-7a31-4dcb-b14b-cd3deb50cf4c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:16.799062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4804-7a31-4dcb-b14b-cd3deb50cf4c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:16.800392 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 553/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:16.805460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e21a-fe54-4708-a2b4-d0c2f51f306d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:16.805883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e21a-fe54-4708-a2b4-d0c2f51f306d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:16.806015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e21a-fe54-4708-a2b4-d0c2f51f306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:16.881427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a497e21a-fe54-4708-a2b4-d0c2f51f306d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:16.883141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a497e21a-fe54-4708-a2b4-d0c2f51f306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:16.976663 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 551/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:17.126494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4804-7a31-4dcb-b14b-cd3deb50cf4c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:17.127982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c17b4804-7a31-4dcb-b14b-cd3deb50cf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:17.213464 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:17.272718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4804-7a31-4dcb-b14b-cd3deb50cf4c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:17.383637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f8c73-f0cc-417b-bc01-1e65e43b706d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:17.384263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8c73-f0cc-417b-bc01-1e65e43b706d service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:17.384538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8c73-f0cc-417b-bc01-1e65e43b706d service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:17.384804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f8c73-f0cc-417b-bc01-1e65e43b706d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:17.386420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-322f8c73-f0cc-417b-bc01-1e65e43b706d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:17.434215 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:17.473710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f8c73-f0cc-417b-bc01-1e65e43b706d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:17.475317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f8c73-f0cc-417b-bc01-1e65e43b706d service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:17.494264 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 554/1105] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:18.584339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc14d-c942-4d79-80db-8a43cdfbcf42 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:18.584902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc14d-c942-4d79-80db-8a43cdfbcf42 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:18.584902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc14d-c942-4d79-80db-8a43cdfbcf42 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:18.586311 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 552/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:18.591222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2674bb4-bb2b-45c3-966f-7ce9a3412b72 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:18.591617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2674bb4-bb2b-45c3-966f-7ce9a3412b72 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:18.591798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2674bb4-bb2b-45c3-966f-7ce9a3412b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:18.665772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c2674bb4-bb2b-45c3-966f-7ce9a3412b72 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:18.667009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c2674bb4-bb2b-45c3-966f-7ce9a3412b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:18.761792 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 555/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:18.910280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc14d-c942-4d79-80db-8a43cdfbcf42 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:18.911815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b94cc14d-c942-4d79-80db-8a43cdfbcf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:18.959178 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:19.052475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc14d-c942-4d79-80db-8a43cdfbcf42 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:19.161385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99686b-c11a-47cf-87b4-42b0f8d56c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:19.162018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99686b-c11a-47cf-87b4-42b0f8d56c08 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:19.162281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99686b-c11a-47cf-87b4-42b0f8d56c08 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:19.162545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99686b-c11a-47cf-87b4-42b0f8d56c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:19.164632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd99686b-c11a-47cf-87b4-42b0f8d56c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:19.171296 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:19.252135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99686b-c11a-47cf-87b4-42b0f8d56c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:19.253683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99686b-c11a-47cf-87b4-42b0f8d56c08 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:19.270787 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 553/1108] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:20.365521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0db3c-b63b-41e5-b439-96c8f27554b6 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:20.366096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0db3c-b63b-41e5-b439-96c8f27554b6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:20.366096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0db3c-b63b-41e5-b439-96c8f27554b6 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:20.367951 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 556/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:20.372786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34a50-e1bb-4462-aa7a-617d463fd21c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:20.373228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34a50-e1bb-4462-aa7a-617d463fd21c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:20.373337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b34a50-e1bb-4462-aa7a-617d463fd21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:20.448093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-45b34a50-e1bb-4462-aa7a-617d463fd21c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:20.449266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-45b34a50-e1bb-4462-aa7a-617d463fd21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:20.515198 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:20.543621 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 554/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:20.693050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0db3c-b63b-41e5-b439-96c8f27554b6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:20.694592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-29c0db3c-b63b-41e5-b439-96c8f27554b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:20.711824 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:20.837629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0db3c-b63b-41e5-b439-96c8f27554b6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:20.921639 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:20.946700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ce50d-914c-45da-8e44-12f187e38ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:20.947234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ce50d-914c-45da-8e44-12f187e38ee6 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:20.947505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ce50d-914c-45da-8e44-12f187e38ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:20.947770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ce50d-914c-45da-8e44-12f187e38ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:20.949352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-027ce50d-914c-45da-8e44-12f187e38ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:21.035014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ce50d-914c-45da-8e44-12f187e38ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:21.036584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ce50d-914c-45da-8e44-12f187e38ee6 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:21.054724 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 557/1111] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:22.130101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ba43-c0b4-44a7-a54d-a1dbab4446ff None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:22.130659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ba43-c0b4-44a7-a54d-a1dbab4446ff None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:22.130659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ba43-c0b4-44a7-a54d-a1dbab4446ff None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:22.131976 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 555/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:22.136841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb753-a074-450e-976e-f2821f1d7628 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:22.137268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb753-a074-450e-976e-f2821f1d7628 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:22.137363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb753-a074-450e-976e-f2821f1d7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:22.211536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9d9fb753-a074-450e-976e-f2821f1d7628 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:22.212736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9d9fb753-a074-450e-976e-f2821f1d7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:22.253772 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:22.309108 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 558/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:22.459604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ba43-c0b4-44a7-a54d-a1dbab4446ff None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:22.461648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6cf8ba43-c0b4-44a7-a54d-a1dbab4446ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:22.604324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ba43-c0b4-44a7-a54d-a1dbab4446ff None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:22.656094 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:22.713685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8042a0-b219-49a4-a2d5-8b0aab1a7902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:22.714320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8042a0-b219-49a4-a2d5-8b0aab1a7902 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:22.714597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8042a0-b219-49a4-a2d5-8b0aab1a7902 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:22.714864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8042a0-b219-49a4-a2d5-8b0aab1a7902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:22.716496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c8042a0-b219-49a4-a2d5-8b0aab1a7902 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:22.803622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8042a0-b219-49a4-a2d5-8b0aab1a7902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:22.805191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8042a0-b219-49a4-a2d5-8b0aab1a7902 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:22.822914 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 556/1114] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:23.916706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d691-dcfc-4840-a1a6-68083f6cfe38 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:23.917219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d691-dcfc-4840-a1a6-68083f6cfe38 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:23.917219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d691-dcfc-4840-a1a6-68083f6cfe38 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:23.918557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 559/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:23.923415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f57352-f884-47c8-8993-d54ce4f6bdb2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:23.923805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f57352-f884-47c8-8993-d54ce4f6bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:23.923951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f57352-f884-47c8-8993-d54ce4f6bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:23.997654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-74f57352-f884-47c8-8993-d54ce4f6bdb2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:23.998870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-74f57352-f884-47c8-8993-d54ce4f6bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:24.000821 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:24.092964 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 557/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:24.240976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d691-dcfc-4840-a1a6-68083f6cfe38 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:24.242542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1719d691-dcfc-4840-a1a6-68083f6cfe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:24.386123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d691-dcfc-4840-a1a6-68083f6cfe38 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:24.412806 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:24.497623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669696f9-7f73-49e2-ab8e-86f14d56d737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:24.498212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669696f9-7f73-49e2-ab8e-86f14d56d737 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:24.498486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669696f9-7f73-49e2-ab8e-86f14d56d737 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:24.498750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669696f9-7f73-49e2-ab8e-86f14d56d737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:24.500323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-669696f9-7f73-49e2-ab8e-86f14d56d737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:24.587859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669696f9-7f73-49e2-ab8e-86f14d56d737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:24.589424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669696f9-7f73-49e2-ab8e-86f14d56d737 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:24.606823 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 560/1117] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:26.656055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cf80-18f5-47b2-854b-7976a1e0a067 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:26.656645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cf80-18f5-47b2-854b-7976a1e0a067 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:26.656645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cf80-18f5-47b2-854b-7976a1e0a067 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:26.657944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 558/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:26.664203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4bff-3e64-4ac8-a884-28732c487b89 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:26.664623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4bff-3e64-4ac8-a884-28732c487b89 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:26.664726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4bff-3e64-4ac8-a884-28732c487b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:26.705252 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:26.730125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-076f4bff-3e64-4ac8-a884-28732c487b89 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:26.731596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-076f4bff-3e64-4ac8-a884-28732c487b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:26.826171 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 561/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:02:27.112617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947cf80-18f5-47b2-854b-7976a1e0a067 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:27.114171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f947cf80-18f5-47b2-854b-7976a1e0a067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:27.216599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947cf80-18f5-47b2-854b-7976a1e0a067 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:27.248448 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:27.289552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979694fe-ba65-4088-9669-0e9eb8369a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:27.290200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979694fe-ba65-4088-9669-0e9eb8369a80 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:27.290478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979694fe-ba65-4088-9669-0e9eb8369a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:27.290745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979694fe-ba65-4088-9669-0e9eb8369a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:27.292326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-979694fe-ba65-4088-9669-0e9eb8369a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:27.398922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979694fe-ba65-4088-9669-0e9eb8369a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:27.400276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979694fe-ba65-4088-9669-0e9eb8369a80 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:27.417963 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 559/1120] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:29.741594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a1b05-47d8-4bee-9358-42c6a6d35c0e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:29.742172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a1b05-47d8-4bee-9358-42c6a6d35c0e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:29.742172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a1b05-47d8-4bee-9358-42c6a6d35c0e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:29.743504 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 562/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:29.748902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66f8fa-bc86-4a7e-8a55-e0f96cfee6df None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:29.749315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66f8fa-bc86-4a7e-8a55-e0f96cfee6df None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:29.749454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66f8fa-bc86-4a7e-8a55-e0f96cfee6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:29.815478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fd66f8fa-bc86-4a7e-8a55-e0f96cfee6df None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:29.816673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd66f8fa-bc86-4a7e-8a55-e0f96cfee6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:29.829629 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:29.911096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 560/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:30.192824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a1b05-47d8-4bee-9358-42c6a6d35c0e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:30.194422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-404a1b05-47d8-4bee-9358-42c6a6d35c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:30.294193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a1b05-47d8-4bee-9358-42c6a6d35c0e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:30.307296 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:30.367729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e9bc-cdf7-4681-b2d2-4931ef9a3507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:30.368266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e9bc-cdf7-4681-b2d2-4931ef9a3507 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:30.368542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e9bc-cdf7-4681-b2d2-4931ef9a3507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:30.368807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e9bc-cdf7-4681-b2d2-4931ef9a3507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:30.370463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8234e9bc-cdf7-4681-b2d2-4931ef9a3507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:30.476775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e9bc-cdf7-4681-b2d2-4931ef9a3507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:30.478218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e9bc-cdf7-4681-b2d2-4931ef9a3507 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:30.496393 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 563/1123] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:32.993000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520e54-1e17-4a50-bb83-6e99cabe3863 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:32.993530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520e54-1e17-4a50-bb83-6e99cabe3863 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:32.993530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520e54-1e17-4a50-bb83-6e99cabe3863 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:32.994950 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 561/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:33.000416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2e4da-617e-4061-94e3-74f99f632912 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:33.000871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2e4da-617e-4061-94e3-74f99f632912 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:33.000969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2e4da-617e-4061-94e3-74f99f632912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:33.047690 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:33.065916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-59a2e4da-617e-4061-94e3-74f99f632912 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:33.067148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-59a2e4da-617e-4061-94e3-74f99f632912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:33.162376 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 564/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:33.445149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0520e54-1e17-4a50-bb83-6e99cabe3863 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:33.446719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0520e54-1e17-4a50-bb83-6e99cabe3863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:33.548474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0520e54-1e17-4a50-bb83-6e99cabe3863 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:33.588906 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:33.621872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc9da0-c5ac-42b8-a0a7-bedd88f91041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:33.622501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc9da0-c5ac-42b8-a0a7-bedd88f91041 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:33.622776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc9da0-c5ac-42b8-a0a7-bedd88f91041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:33.623044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc9da0-c5ac-42b8-a0a7-bedd88f91041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:33.624632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-63bc9da0-c5ac-42b8-a0a7-bedd88f91041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:33.730144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc9da0-c5ac-42b8-a0a7-bedd88f91041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:33.731574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc9da0-c5ac-42b8-a0a7-bedd88f91041 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:33.750425 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 562/1126] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:35.988690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9fd2-de4b-4e94-a73d-b792bd06412c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:35.989209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9fd2-de4b-4e94-a73d-b792bd06412c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:35.989209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9fd2-de4b-4e94-a73d-b792bd06412c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:35.991098 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 565/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:35.996397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a555d-8941-444a-a82a-96ae0a634e08 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:35.996811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a555d-8941-444a-a82a-96ae0a634e08 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:35.996925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a555d-8941-444a-a82a-96ae0a634e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:36.061512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2d0a555d-8941-444a-a82a-96ae0a634e08 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:36.062739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2d0a555d-8941-444a-a82a-96ae0a634e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:36.082997 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:36.156573 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 563/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:36.442967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9fd2-de4b-4e94-a73d-b792bd06412c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:36.444500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c37f9fd2-de4b-4e94-a73d-b792bd06412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:36.545636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9fd2-de4b-4e94-a73d-b792bd06412c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:36.566806 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:36.618819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685a0d-b13b-4e0e-98d9-ca66922e5723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:36.619415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685a0d-b13b-4e0e-98d9-ca66922e5723 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:36.619684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685a0d-b13b-4e0e-98d9-ca66922e5723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:36.619947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685a0d-b13b-4e0e-98d9-ca66922e5723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:36.621528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c9685a0d-b13b-4e0e-98d9-ca66922e5723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:36.727010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685a0d-b13b-4e0e-98d9-ca66922e5723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:36.728438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685a0d-b13b-4e0e-98d9-ca66922e5723 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:36.745641 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 566/1129] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:38.929758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd2e4e-128f-4482-b3fb-72f35c86a539 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:38.930313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd2e4e-128f-4482-b3fb-72f35c86a539 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:38.930313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd2e4e-128f-4482-b3fb-72f35c86a539 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:38.931596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 564/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:38.936804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07742-ba73-4064-82dd-b2dc3f29d89a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:38.937243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07742-ba73-4064-82dd-b2dc3f29d89a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:38.937422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07742-ba73-4064-82dd-b2dc3f29d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:38.999263 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:39.001843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8db07742-ba73-4064-82dd-b2dc3f29d89a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:39.003051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8db07742-ba73-4064-82dd-b2dc3f29d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:39.097462 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 567/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:39.378939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd2e4e-128f-4482-b3fb-72f35c86a539 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:39.380580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8fbd2e4e-128f-4482-b3fb-72f35c86a539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:39.481182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd2e4e-128f-4482-b3fb-72f35c86a539 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:39.530144 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:39.555337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce27fa2-6bd4-4940-8e60-2923acee5818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:39.555940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce27fa2-6bd4-4940-8e60-2923acee5818 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:39.556215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce27fa2-6bd4-4940-8e60-2923acee5818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:39.556484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce27fa2-6bd4-4940-8e60-2923acee5818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:39.558109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ce27fa2-6bd4-4940-8e60-2923acee5818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:39.664256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce27fa2-6bd4-4940-8e60-2923acee5818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:39.665614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce27fa2-6bd4-4940-8e60-2923acee5818 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:39.684216 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 565/1132] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:02:41.879733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9790-a54a-40b9-a624-a35cfeb3bf65 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:41.880258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9790-a54a-40b9-a624-a35cfeb3bf65 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:41.880258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9790-a54a-40b9-a624-a35cfeb3bf65 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:41.882211 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 568/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:41.887571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d9c2-8df1-4473-ab72-230a0e91d76b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:41.887998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d9c2-8df1-4473-ab72-230a0e91d76b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:41.888148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d9c2-8df1-4473-ab72-230a0e91d76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:41.953394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c7b1d9c2-8df1-4473-ab72-230a0e91d76b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:41.954642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c7b1d9c2-8df1-4473-ab72-230a0e91d76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:41.982240 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:42.046952 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 566/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:42.336310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f9790-a54a-40b9-a624-a35cfeb3bf65 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:42.337954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c21f9790-a54a-40b9-a624-a35cfeb3bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:42.440752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f9790-a54a-40b9-a624-a35cfeb3bf65 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:42.469565 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:42.515104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8f9fe-a56a-4e0c-93e7-d26d957a9562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:42.515740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f9fe-a56a-4e0c-93e7-d26d957a9562 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:42.516013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f9fe-a56a-4e0c-93e7-d26d957a9562 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:42.516280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f9fe-a56a-4e0c-93e7-d26d957a9562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:42.517879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3be8f9fe-a56a-4e0c-93e7-d26d957a9562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:42.624048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f9fe-a56a-4e0c-93e7-d26d957a9562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:42.625467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f9fe-a56a-4e0c-93e7-d26d957a9562 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:42.642760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 569/1135] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:44.817319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763910-bad3-40fa-8bbe-05de9937c6a6 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:44.817828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763910-bad3-40fa-8bbe-05de9937c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:44.817828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763910-bad3-40fa-8bbe-05de9937c6a6 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:44.819776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:44.825040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc3af-0837-423e-b138-67aecb32c570 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:44.825465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc3af-0837-423e-b138-67aecb32c570 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:44.825572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc3af-0837-423e-b138-67aecb32c570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:44.889925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c93fc3af-0837-423e-b138-67aecb32c570 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:44.891134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c93fc3af-0837-423e-b138-67aecb32c570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:44.899189 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:44.985277 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:45.267350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97763910-bad3-40fa-8bbe-05de9937c6a6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:45.268885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-97763910-bad3-40fa-8bbe-05de9937c6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:45.372404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97763910-bad3-40fa-8bbe-05de9937c6a6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:45.426658 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:45.444901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d611fc-9c67-4365-b1ff-e741170aedc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:45.445505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d611fc-9c67-4365-b1ff-e741170aedc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:45.445779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d611fc-9c67-4365-b1ff-e741170aedc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:45.446079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d611fc-9c67-4365-b1ff-e741170aedc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:45.447667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05d611fc-9c67-4365-b1ff-e741170aedc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:45.556779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d611fc-9c67-4365-b1ff-e741170aedc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:45.558173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d611fc-9c67-4365-b1ff-e741170aedc4 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:45.576301 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 568/1138] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:47.757508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358318-b0cf-49ae-b541-7784719d8700 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:47.758053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358318-b0cf-49ae-b541-7784719d8700 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:47.758053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358318-b0cf-49ae-b541-7784719d8700 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:47.759363 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:47.764598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e62d6-6ef0-47f6-8fb8-b807e8ddd57a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:47.764980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e62d6-6ef0-47f6-8fb8-b807e8ddd57a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:47.765154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e62d6-6ef0-47f6-8fb8-b807e8ddd57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:47.831794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-054e62d6-6ef0-47f6-8fb8-b807e8ddd57a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:47.832989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-054e62d6-6ef0-47f6-8fb8-b807e8ddd57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:47.870753 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:47.926851 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:48.213899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358318-b0cf-49ae-b541-7784719d8700 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:48.215457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3358318-b0cf-49ae-b541-7784719d8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:48.315759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358318-b0cf-49ae-b541-7784719d8700 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:48.353526 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:48.389780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99e3fc-3f46-4caf-8807-ebd7b67095dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:48.390425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99e3fc-3f46-4caf-8807-ebd7b67095dd service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:48.390692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99e3fc-3f46-4caf-8807-ebd7b67095dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:48.390952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99e3fc-3f46-4caf-8807-ebd7b67095dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:48.392530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4f99e3fc-3f46-4caf-8807-ebd7b67095dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:48.497918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99e3fc-3f46-4caf-8807-ebd7b67095dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:48.499370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99e3fc-3f46-4caf-8807-ebd7b67095dd service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:48.517557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 572/1141] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:50.673114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6b82d-a997-468b-ab53-c3fe30ec09b5 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:50.673639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6b82d-a997-468b-ab53-c3fe30ec09b5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:50.673639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6b82d-a997-468b-ab53-c3fe30ec09b5 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:50.674954 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:50.680582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295a81-1f03-4b1d-a853-31d50473290f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:50.681034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295a81-1f03-4b1d-a853-31d50473290f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:50.681146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295a81-1f03-4b1d-a853-31d50473290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:50.745512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2f295a81-1f03-4b1d-a853-31d50473290f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:50.746734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f295a81-1f03-4b1d-a853-31d50473290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:50.764722 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:50.841058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:51.119338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6b82d-a997-468b-ab53-c3fe30ec09b5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:51.120901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dfe6b82d-a997-468b-ab53-c3fe30ec09b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:51.223395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6b82d-a997-468b-ab53-c3fe30ec09b5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:51.288644 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:51.295003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d5167-12b2-41fc-b578-bf8f7459e57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:51.295613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5167-12b2-41fc-b578-bf8f7459e57b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:51.295886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5167-12b2-41fc-b578-bf8f7459e57b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:51.296155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5167-12b2-41fc-b578-bf8f7459e57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:51.297805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8c3d5167-12b2-41fc-b578-bf8f7459e57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:51.407883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d5167-12b2-41fc-b578-bf8f7459e57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:51.409315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d5167-12b2-41fc-b578-bf8f7459e57b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:51.428250 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 571/1144] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:02:53.558393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30950267-68fa-4ef6-92ba-9dcedbad4e12 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:53.558928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30950267-68fa-4ef6-92ba-9dcedbad4e12 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:53.558928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30950267-68fa-4ef6-92ba-9dcedbad4e12 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:53.560298 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:02:53.565687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87b8a-c026-413e-a1c6-5cde8c2ecb80 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:53.566103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87b8a-c026-413e-a1c6-5cde8c2ecb80 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:53.566268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87b8a-c026-413e-a1c6-5cde8c2ecb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:53.632331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c3f87b8a-c026-413e-a1c6-5cde8c2ecb80 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:02:53.633532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c3f87b8a-c026-413e-a1c6-5cde8c2ecb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:53.680323 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:53.728265 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:02:54.011289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30950267-68fa-4ef6-92ba-9dcedbad4e12 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:02:54.012823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-30950267-68fa-4ef6-92ba-9dcedbad4e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:54.113474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30950267-68fa-4ef6-92ba-9dcedbad4e12 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:02:54.160202 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:02:54.185943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ac804-8970-4d80-9aec-7017da69f2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:02:54.186577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac804-8970-4d80-9aec-7017da69f2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:02:54.186851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac804-8970-4d80-9aec-7017da69f2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:02:54.187117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac804-8970-4d80-9aec-7017da69f2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:02:54.188703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a4ac804-8970-4d80-9aec-7017da69f2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:02:54.295034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ac804-8970-4d80-9aec-7017da69f2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:02:54.296372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ac804-8970-4d80-9aec-7017da69f2f6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:02:54.315048 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 575/1147] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:03.726748 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=22 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:04.312839 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=66 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:14.161967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e05c3-a091-420c-9a1d-81c1c2d6ef58 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:14.162530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e05c3-a091-420c-9a1d-81c1c2d6ef58 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:14.162530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e05c3-a091-420c-9a1d-81c1c2d6ef58 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:14.163860 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 573/1148] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:14.168942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0af3b-e915-4549-a282-a59392293de9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:14.169350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0af3b-e915-4549-a282-a59392293de9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:14.169497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0af3b-e915-4549-a282-a59392293de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:14.233873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1ea0af3b-e915-4549-a282-a59392293de9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:14.235092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1ea0af3b-e915-4549-a282-a59392293de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:14.329393 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 576/1149] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:03:14.632007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3460b-6d98-489c-a822-88f3f4cdedd2 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:14.632290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3460b-6d98-489c-a822-88f3f4cdedd2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:14.632562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3460b-6d98-489c-a822-88f3f4cdedd2 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:14.633894 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 574/1150] 10.222.0.42 () {54 vars in 962 bytes} [Sun Oct 23 01:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:14.638898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a958c84-0c7f-4afa-9eb9-81afe8c8e6e9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:14.639186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a958c84-0c7f-4afa-9eb9-81afe8c8e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:14.639467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a958c84-0c7f-4afa-9eb9-81afe8c8e6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:14.715863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2a958c84-0c7f-4afa-9eb9-81afe8c8e6e9 None None] MFA Rules not processed for user `42c76c07d0cf43d2b230e4afa9709bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:14.717419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2a958c84-0c7f-4afa-9eb9-81afe8c8e6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:14.738054 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:14.792442 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 577/1151] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Oct 23 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:03:14.800169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3460b-6d98-489c-a822-88f3f4cdedd2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:14.801904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1fd3460b-6d98-489c-a822-88f3f4cdedd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:14.902616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3460b-6d98-489c-a822-88f3f4cdedd2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:14.973588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676b055-f511-48d6-9148-bbb914a997ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:14.974825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b055-f511-48d6-9148-bbb914a997ea service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:14.975093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b055-f511-48d6-9148-bbb914a997ea service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:14.975357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b055-f511-48d6-9148-bbb914a997ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:14.976927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5676b055-f511-48d6-9148-bbb914a997ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:15.028744 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:15.082611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676b055-f511-48d6-9148-bbb914a997ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:15.084544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676b055-f511-48d6-9148-bbb914a997ea service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:15.102966 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 575/1152] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:03:17.343060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25c23e-64c4-40e9-a3ba-89f9136096bf None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:17.343629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25c23e-64c4-40e9-a3ba-89f9136096bf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:17.343629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25c23e-64c4-40e9-a3ba-89f9136096bf None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:17.344958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 578/1153] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:17.351024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06071955-1545-47ba-9a82-86b0d2fdae5b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:17.351469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06071955-1545-47ba-9a82-86b0d2fdae5b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:17.351578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06071955-1545-47ba-9a82-86b0d2fdae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:17.416445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-06071955-1545-47ba-9a82-86b0d2fdae5b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:17.417669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-06071955-1545-47ba-9a82-86b0d2fdae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:17.512298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 576/1154] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:03:17.784267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25c23e-64c4-40e9-a3ba-89f9136096bf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:17.785789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-da25c23e-64c4-40e9-a3ba-89f9136096bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:17.907209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25c23e-64c4-40e9-a3ba-89f9136096bf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:17.954782 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:17.995829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ebad4-6002-41b6-bbe2-c35f999009de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:17.996425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebad4-6002-41b6-bbe2-c35f999009de admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:17.996696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebad4-6002-41b6-bbe2-c35f999009de admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:17.996959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ebad4-6002-41b6-bbe2-c35f999009de admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:17.997583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ebad4-6002-41b6-bbe2-c35f999009de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:17.998695 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-bf3ebad4-6002-41b6-bbe2-c35f999009de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:03:17.998695 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:03:17.998695 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:03:17.999815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ebad4-6002-41b6-bbe2-c35f999009de admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:18.018674 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 579/1155] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 23 01:03:17 2022] GET /identity/v3/projects => generated 2553 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:03:20.165429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3c228-8f76-474b-9c3e-809553a3d0f7 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:20.166011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3c228-8f76-474b-9c3e-809553a3d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:20.166011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3c228-8f76-474b-9c3e-809553a3d0f7 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:20.167341 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 577/1156] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:20.172518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512a3a4-70bf-4dc2-b1cd-4d54e3a4367f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:20.172901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512a3a4-70bf-4dc2-b1cd-4d54e3a4367f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:20.173067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512a3a4-70bf-4dc2-b1cd-4d54e3a4367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:20.237777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a512a3a4-70bf-4dc2-b1cd-4d54e3a4367f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:20.238995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a512a3a4-70bf-4dc2-b1cd-4d54e3a4367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:20.341440 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 580/1157] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:03:20.625158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3c228-8f76-474b-9c3e-809553a3d0f7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:20.626712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3ec3c228-8f76-474b-9c3e-809553a3d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:20.636794 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:20.768911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3c228-8f76-474b-9c3e-809553a3d0f7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:20.847614 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:20.879552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ce22-4904-496a-aab5-3f28b3df512f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:20.880672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ce22-4904-496a-aab5-3f28b3df512f service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:20.880946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ce22-4904-496a-aab5-3f28b3df512f service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:20.881211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ce22-4904-496a-aab5-3f28b3df512f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:20.882831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f115ce22-4904-496a-aab5-3f28b3df512f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:20.968924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ce22-4904-496a-aab5-3f28b3df512f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:20.970539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ce22-4904-496a-aab5-3f28b3df512f service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:20.987853 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 578/1158] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:23.293911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3dca5-d2fc-4a81-81e3-2b86a3fc4d36 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:23.294507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3dca5-d2fc-4a81-81e3-2b86a3fc4d36 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:23.294507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3dca5-d2fc-4a81-81e3-2b86a3fc4d36 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:23.295826 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 581/1159] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:23.301195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ae5e-bd80-4123-b90d-799ee9b08619 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:23.301685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ae5e-bd80-4123-b90d-799ee9b08619 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:23.301789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ae5e-bd80-4123-b90d-799ee9b08619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:23.367862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4d42ae5e-bd80-4123-b90d-799ee9b08619 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:23.369063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4d42ae5e-bd80-4123-b90d-799ee9b08619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:23.414584 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:23.463912 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 579/1160] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:03:23.748794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3dca5-d2fc-4a81-81e3-2b86a3fc4d36 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:23.750386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9fc3dca5-d2fc-4a81-81e3-2b86a3fc4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:23.774250 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:23.850729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3dca5-d2fc-4a81-81e3-2b86a3fc4d36 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:23.923962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7a9ce-564d-41eb-b1e8-713e8be97280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:23.924558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a9ce-564d-41eb-b1e8-713e8be97280 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:23.924865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a9ce-564d-41eb-b1e8-713e8be97280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:23.925132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a9ce-564d-41eb-b1e8-713e8be97280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:23.927482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7de7a9ce-564d-41eb-b1e8-713e8be97280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:23.998233 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:24.031946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7a9ce-564d-41eb-b1e8-713e8be97280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:24.033355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7a9ce-564d-41eb-b1e8-713e8be97280 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:24.052108 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 582/1161] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:26.240749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1a4e9-1c68-4639-b0b4-414e4eb7ac59 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:26.241299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1a4e9-1c68-4639-b0b4-414e4eb7ac59 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:26.241299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1a4e9-1c68-4639-b0b4-414e4eb7ac59 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:26.242776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 580/1162] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:26.248028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb0b2c-d1df-468d-b0a7-89fbf19f9a6c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:26.248468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb0b2c-d1df-468d-b0a7-89fbf19f9a6c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:26.248576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb0b2c-d1df-468d-b0a7-89fbf19f9a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:26.313486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-feeb0b2c-d1df-468d-b0a7-89fbf19f9a6c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:26.314623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-feeb0b2c-d1df-468d-b0a7-89fbf19f9a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:26.408582 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 583/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:03:26.706852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1a4e9-1c68-4639-b0b4-414e4eb7ac59 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:26.709023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-36f1a4e9-1c68-4639-b0b4-414e4eb7ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:26.809824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1a4e9-1c68-4639-b0b4-414e4eb7ac59 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:26.880409 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:26.881844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bde091-889b-46d5-b98a-fe21a58cf488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:26.882505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde091-889b-46d5-b98a-fe21a58cf488 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:26.882784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde091-889b-46d5-b98a-fe21a58cf488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:26.883053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde091-889b-46d5-b98a-fe21a58cf488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:26.884634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b3bde091-889b-46d5-b98a-fe21a58cf488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:26.990516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bde091-889b-46d5-b98a-fe21a58cf488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:26.991940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bde091-889b-46d5-b98a-fe21a58cf488 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:27.009704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 581/1164] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:29.236710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304cf2-27a0-48d4-b43b-afb9246dd50b None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:29.237288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304cf2-27a0-48d4-b43b-afb9246dd50b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:29.237288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304cf2-27a0-48d4-b43b-afb9246dd50b None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:29.238791 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 584/1165] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:29.243941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d5b69-1b9c-49c5-8bb9-57ea5ef9c5d2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:29.244420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d5b69-1b9c-49c5-8bb9-57ea5ef9c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:29.244531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d5b69-1b9c-49c5-8bb9-57ea5ef9c5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:29.308437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-256d5b69-1b9c-49c5-8bb9-57ea5ef9c5d2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:29.309615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-256d5b69-1b9c-49c5-8bb9-57ea5ef9c5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:29.360981 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:29.403879 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 582/1166] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:03:29.699391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304cf2-27a0-48d4-b43b-afb9246dd50b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:29.700948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-86304cf2-27a0-48d4-b43b-afb9246dd50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:29.736293 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:29.801810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304cf2-27a0-48d4-b43b-afb9246dd50b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:29.872698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dfc38-c0de-4696-a930-a5626141c654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:29.873292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfc38-c0de-4696-a930-a5626141c654 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:29.873564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfc38-c0de-4696-a930-a5626141c654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:29.873829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfc38-c0de-4696-a930-a5626141c654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:29.875428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-966dfc38-c0de-4696-a930-a5626141c654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:29.955196 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:29.982848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dfc38-c0de-4696-a930-a5626141c654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:29.984317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dfc38-c0de-4696-a930-a5626141c654 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:30.002948 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 585/1167] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:32.562872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fddc9-b091-41af-8575-9dc1aa2ded56 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:32.563419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fddc9-b091-41af-8575-9dc1aa2ded56 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:32.563419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fddc9-b091-41af-8575-9dc1aa2ded56 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:32.564760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 583/1168] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 23 01:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:32.570592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e5aff-93da-4aa1-a48c-fc8e8ebe1cd8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:32.571061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e5aff-93da-4aa1-a48c-fc8e8ebe1cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:32.571169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e5aff-93da-4aa1-a48c-fc8e8ebe1cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:32.636267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2e7e5aff-93da-4aa1-a48c-fc8e8ebe1cd8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:32.637462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e7e5aff-93da-4aa1-a48c-fc8e8ebe1cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:32.731497 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 586/1169] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 23 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:03:33.022836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fddc9-b091-41af-8575-9dc1aa2ded56 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:33.024357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-272fddc9-b091-41af-8575-9dc1aa2ded56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:33.125817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fddc9-b091-41af-8575-9dc1aa2ded56 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:33.197632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de8b3d-0d1c-4725-a70a-0d358319c6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:33.198253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8b3d-0d1c-4725-a70a-0d358319c6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:33.198527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8b3d-0d1c-4725-a70a-0d358319c6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:33.198793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8b3d-0d1c-4725-a70a-0d358319c6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:33.200368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a2de8b3d-0d1c-4725-a70a-0d358319c6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:33.208786 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:33.306947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8b3d-0d1c-4725-a70a-0d358319c6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:33.308373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8b3d-0d1c-4725-a70a-0d358319c6c0 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:33.325725 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 584/1170] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:42.729988 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=82 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:43.323551 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=50 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:55.199378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:55.199985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:55.199985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:55.275128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:04:55.276327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:55.369110 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 587/1171] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:04:55.377103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b3d6-4496-4bb1-b7d9-a4fbeeb25148 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:55.377605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b3d6-4496-4bb1-b7d9-a4fbeeb25148 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:55.377703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b3d6-4496-4bb1-b7d9-a4fbeeb25148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:55.451705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4a92b3d6-4496-4bb1-b7d9-a4fbeeb25148 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:04:55.452819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a92b3d6-4496-4bb1-b7d9-a4fbeeb25148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:55.549189 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 585/1172] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:04:55.554142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:55.555357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:55.567089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c7eea-b110-4b14-8608-58f01a515964 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:55.637116 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:55.675150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:55.675765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:55.676038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:55.676304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:55.676957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:04:55.677260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:55.678298 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:04:55.678298 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:04:55.678298 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:04:55.679182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:55.692207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 588/1173] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:04:55.701472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b3d6-4496-4bb1-b7d9-a4fbeeb25148 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:55.711337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b3d6-4496-4bb1-b7d9-a4fbeeb25148 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:55.770992 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:55.802598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:55.803201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:55.803468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:55.803733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:55.804361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:55.805743 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:04:55.805743 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:04:55.805743 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:04:55.807287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:55.914579 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 586/1174] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:04:55 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:04:55.918773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:55.923957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:55.953063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3d261-4fde-4b52-9ff2-9ba107ed8e51 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:56.044582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:56.045179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:56.045451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:56.045718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:56.046364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:56.047870 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:04:56.047870 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:04:56.047870 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:04:56.049058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:56.148319 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 589/1175] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:04:55 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:04:56.152646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:56.154221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:56.215510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca0aad-bdf9-418a-9746-a98b69e0ab60 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:56.301001 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:56.310801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:56.311402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:56.311672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:56.311939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:56.312621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:56.314767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:56.328595 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 587/1176] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:04:56.332525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:56.334090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:56.345382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0685c-5649-4cde-bc6e-13912dc5519e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:56.370675 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:56.439018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40464b-9002-43c5-abea-b5385f4450d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:56.439622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40464b-9002-43c5-abea-b5385f4450d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:56.439898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40464b-9002-43c5-abea-b5385f4450d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:56.440166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40464b-9002-43c5-abea-b5385f4450d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:56.440798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40464b-9002-43c5-abea-b5385f4450d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:56.442408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40464b-9002-43c5-abea-b5385f4450d8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:56.454401 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 590/1177] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:04:56.458693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:56.460360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:56.493515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbcd14-10bc-4dc8-9d4c-ca0036041409 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:56.585963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30eff0-6047-438a-a8d1-d9b4aa0f8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:56.586570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30eff0-6047-438a-a8d1-d9b4aa0f8c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:56.586850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30eff0-6047-438a-a8d1-d9b4aa0f8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:56.587140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30eff0-6047-438a-a8d1-d9b4aa0f8c9c admin admin] PATH_INFO: `/v3/projects/7b58e4cc89f54b94a030a2eac00925bd/users/6d4cf332220b4d548d10cb148dc331da/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:56.610387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30eff0-6047-438a-a8d1-d9b4aa0f8c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b58e4cc89f54b94a030a2eac00925bd, user_id=6d4cf332220b4d548d10cb148dc331da, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:56.612990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30eff0-6047-438a-a8d1-d9b4aa0f8c9c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:56.685026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 588/1178] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:04:56 2022] PUT /identity/v3/projects/7b58e4cc89f54b94a030a2eac00925bd/users/6d4cf332220b4d548d10cb148dc331da/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:04:56.696024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041d71-6b51-4319-aa9a-3b28af0c1b9b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:56.696307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041d71-6b51-4319-aa9a-3b28af0c1b9b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:56.696575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041d71-6b51-4319-aa9a-3b28af0c1b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:56.752393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2d041d71-6b51-4319-aa9a-3b28af0c1b9b None None] MFA Rules not processed for user `6d4cf332220b4d548d10cb148dc331da`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:04:56.753587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d041d71-6b51-4319-aa9a-3b28af0c1b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:56.827725 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 591/1179] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:04:56.841082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a258e-6399-44ac-90f6-364d40f62ab8 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:56.841308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a258e-6399-44ac-90f6-364d40f62ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:56.841580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a258e-6399-44ac-90f6-364d40f62ab8 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:56.842946 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 589/1180] 10.222.0.42 () {54 vars in 963 bytes} [Sun Oct 23 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:04:56.848083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092641-5a8c-4460-a9bb-9cae59ffcfd7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:56.848367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092641-5a8c-4460-a9bb-9cae59ffcfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:56.848638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd092641-5a8c-4460-a9bb-9cae59ffcfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:56.879790 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:56.923702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fd092641-5a8c-4460-a9bb-9cae59ffcfd7 None None] MFA Rules not processed for user `1a5599baadee4192ae45c1891b7f00f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:04:56.925153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fd092641-5a8c-4460-a9bb-9cae59ffcfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:56.998345 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 592/1181] 10.222.0.42 () {58 vars in 1060 bytes} [Sun Oct 23 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:04:57.005902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a258e-6399-44ac-90f6-364d40f62ab8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:57.007439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de8a258e-6399-44ac-90f6-364d40f62ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:57.056729 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:57.108937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a258e-6399-44ac-90f6-364d40f62ab8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:57.180698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:57.181301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:57.181573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:57.181839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:57.183449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:57.281237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:57.283829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:57.287455 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:57.301743 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 590/1182] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:04:57.346894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b392f03-15ac-48bb-83a8-47fa8a33e633 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:57.350451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b392f03-15ac-48bb-83a8-47fa8a33e633 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:57.350451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b392f03-15ac-48bb-83a8-47fa8a33e633 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:57.350451 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 593/1183] 10.222.0.42 () {52 vars in 830 bytes} [Sun Oct 23 01:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:04:57.352100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:57.353322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:57.452917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3e4e0-85d0-4e01-97a9-f31fcd1f5be6 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:57.555073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:57.555783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:57.555964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:57.556225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] PATH_INFO: `/v3/users/6d4cf332220b4d548d10cb148dc331da` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:57.569319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4cf332220b4d548d10cb148dc331da)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:57.570487 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:04:57.570487 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:04:57.570487 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:04:57.571764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:57.583249 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:57.795987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4cf332220b4d548d10cb148dc331da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:57.810581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4cf332220b4d548d10cb148dc331da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:57.811129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4cf332220b4d548d10cb148dc331da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:57.879106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4cf332220b4d548d10cb148dc331da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:57.879530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4cf332220b4d548d10cb148dc331da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:57.908007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 591/1184] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:04:57 2022] DELETE /identity/v3/users/6d4cf332220b4d548d10cb148dc331da => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:04:57.912388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:57.912666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:57.912934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:57.969308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:04:57.970520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:58.042891 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:58.055473 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 594/1185] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:04:58.065241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:58.066479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:58.163179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbb132-01c3-4ae5-9198-f9962767cf35 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:58.215243 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:58.233702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4d04e-d4b1-4e5b-ac54-0e588a5290dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:58.240877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4d04e-d4b1-4e5b-ac54-0e588a5290dd service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:58.240877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4d04e-d4b1-4e5b-ac54-0e588a5290dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:58.240877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4d04e-d4b1-4e5b-ac54-0e588a5290dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:58.240877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d5a4d04e-d4b1-4e5b-ac54-0e588a5290dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:58.344686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4d04e-d4b1-4e5b-ac54-0e588a5290dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:58.346048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4d04e-d4b1-4e5b-ac54-0e588a5290dd service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:58.363828 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 592/1186] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:04:58.864239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:04:58.865447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:04:58.877208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec658-99cb-46f4-85d7-2acbd9346e68 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:04:58.975729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:04:58.976365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:04:58.976639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:04:58.976908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] PATH_INFO: `/v3/projects/7b58e4cc89f54b94a030a2eac00925bd` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:04:58.987049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b58e4cc89f54b94a030a2eac00925bd)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:04:58.988070 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:04:58.988070 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:04:58.988070 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:04:58.989261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:04:59.099658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b58e4cc89f54b94a030a2eac00925bd', 'request_id': 'req-b896faaf-7d84-49df-8e59-2b8d83e0865d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:59.107410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b58e4cc89f54b94a030a2eac00925bd', 'request_id': 'req-b896faaf-7d84-49df-8e59-2b8d83e0865d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:59.199119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b58e4cc89f54b94a030a2eac00925bd', 'request_id': 'req-b896faaf-7d84-49df-8e59-2b8d83e0865d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:59.228256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] The token cache is being invalidate because project 7b58e4cc89f54b94a030a2eac00925bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:04:59.228545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:59.229067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b896faaf-7d84-49df-8e59-2b8d83e0865d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:04:59.230398 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 595/1187] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:04:58 2022] DELETE /identity/v3/projects/7b58e4cc89f54b94a030a2eac00925bd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:05:08.361606 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=62 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:05:09.226244 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:08:21.025624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ec094-98b3-4436-8e18-ef0d2db3bd6a None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:21.026222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ec094-98b3-4436-8e18-ef0d2db3bd6a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:21.026222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ec094-98b3-4436-8e18-ef0d2db3bd6a None None] PATH_INFO: `/v3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:21.027539 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 593/1188] 10.222.0.46 () {54 vars in 925 bytes} [Sun Oct 23 01:08:21 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:08:21.041025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe87e-dae7-4abc-9b69-5f07b1fea68c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:21.041434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe87e-dae7-4abc-9b69-5f07b1fea68c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:21.041562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe87e-dae7-4abc-9b69-5f07b1fea68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:21.120768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4bebe87e-dae7-4abc-9b69-5f07b1fea68c None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:08:21.121966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4bebe87e-dae7-4abc-9b69-5f07b1fea68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:21.234332 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 596/1189] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 23 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:08:25.593584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d3c7-e792-4602-bbcc-88341daf79a4 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:25.594075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d3c7-e792-4602-bbcc-88341daf79a4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:25.594186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d3c7-e792-4602-bbcc-88341daf79a4 None None] PATH_INFO: `/v3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:25.595466 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 594/1190] 10.222.0.45 () {54 vars in 925 bytes} [Sun Oct 23 01:08:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:08:25.613304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32607837-4ed2-4b8a-b43a-e71976329408 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:25.613726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32607837-4ed2-4b8a-b43a-e71976329408 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:25.613856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32607837-4ed2-4b8a-b43a-e71976329408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:25.633207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-32607837-4ed2-4b8a-b43a-e71976329408 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:08:25.634445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-32607837-4ed2-4b8a-b43a-e71976329408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:25.642841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 597/1191] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 23 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:08:30.469713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff478-9e93-4565-b7fe-10d64f77221f None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:30.470340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff478-9e93-4565-b7fe-10d64f77221f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:30.470340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff478-9e93-4565-b7fe-10d64f77221f None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:30.471615 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 595/1192] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 23 01:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:08:30.480647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a0cc3-7b1a-4a3f-8ddb-450363e08107 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:30.480647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a0cc3-7b1a-4a3f-8ddb-450363e08107 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:30.480647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a0cc3-7b1a-4a3f-8ddb-450363e08107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:30.497718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5c5a0cc3-7b1a-4a3f-8ddb-450363e08107 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:08:30.498992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c5a0cc3-7b1a-4a3f-8ddb-450363e08107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:30.507508 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 598/1193] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:08:30.515190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff478-9e93-4565-b7fe-10d64f77221f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:08:30.529001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff478-9e93-4565-b7fe-10d64f77221f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:08:30.533774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970845e-328c-446c-b40a-07768b4d6899 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:08:30.538039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970845e-328c-446c-b40a-07768b4d6899 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:30.538039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970845e-328c-446c-b40a-07768b4d6899 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:30.538039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970845e-328c-446c-b40a-07768b4d6899 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:30.543275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970845e-328c-446c-b40a-07768b4d6899 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:08:30.544886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970845e-328c-446c-b40a-07768b4d6899 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:08:30.554377 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 596/1194] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:08:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:08:35.182696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a0cc3-7b1a-4a3f-8ddb-450363e08107 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:08:35.192502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a0cc3-7b1a-4a3f-8ddb-450363e08107 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:08:35.197421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b516c08-4f92-48c4-a17d-ba996594b0f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:08:35.198053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b516c08-4f92-48c4-a17d-ba996594b0f0 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:35.198377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b516c08-4f92-48c4-a17d-ba996594b0f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:35.198607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b516c08-4f92-48c4-a17d-ba996594b0f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:35.206916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b516c08-4f92-48c4-a17d-ba996594b0f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:08:35.208523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b516c08-4f92-48c4-a17d-ba996594b0f0 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:08:35.218329 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 599/1195] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:08:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:08:40.550500 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:08:42.984128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52768a83-ab29-4cee-9007-ba7647e5a187 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:42.987541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52768a83-ab29-4cee-9007-ba7647e5a187 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:42.987541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52768a83-ab29-4cee-9007-ba7647e5a187 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:42.987541 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 597/1196] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:08:42.990960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd410-4af0-4b67-adad-e14554a5347a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:42.991708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd410-4af0-4b67-adad-e14554a5347a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:42.991970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd410-4af0-4b67-adad-e14554a5347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:43.033327 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:08:43.051995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-27bfd410-4af0-4b67-adad-e14554a5347a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:08:43.053198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-27bfd410-4af0-4b67-adad-e14554a5347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:43.129365 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 600/1197] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:08:43.283234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52768a83-ab29-4cee-9007-ba7647e5a187 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:08:43.284963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-52768a83-ab29-4cee-9007-ba7647e5a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:43.385256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52768a83-ab29-4cee-9007-ba7647e5a187 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:08:43.390871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe8256-eb6a-4d97-ac69-d8b3bced96a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:08:43.391470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8256-eb6a-4d97-ac69-d8b3bced96a3 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:43.391773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8256-eb6a-4d97-ac69-d8b3bced96a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:43.392045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8256-eb6a-4d97-ac69-d8b3bced96a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:43.399960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe8256-eb6a-4d97-ac69-d8b3bced96a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:08:43.401534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe8256-eb6a-4d97-ac69-d8b3bced96a3 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:08:43.410680 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 598/1198] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:08:44.490703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3bb5-9305-4bf9-9b80-79ebd0286351 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:44.491175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3bb5-9305-4bf9-9b80-79ebd0286351 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:44.491272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3bb5-9305-4bf9-9b80-79ebd0286351 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:44.493135 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 601/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 01:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:08:44.497928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2f07a-be35-4475-a6db-e98405975c85 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:44.498334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2f07a-be35-4475-a6db-e98405975c85 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:44.498509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2f07a-be35-4475-a6db-e98405975c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:44.517991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-83a2f07a-be35-4475-a6db-e98405975c85 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:08:44.519183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-83a2f07a-be35-4475-a6db-e98405975c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:44.526825 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 599/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:08:44.676493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3bb5-9305-4bf9-9b80-79ebd0286351 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:08:44.691255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3bb5-9305-4bf9-9b80-79ebd0286351 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:08:44.696787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb551c43-d150-404e-828a-6300951d0368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:08:44.697389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb551c43-d150-404e-828a-6300951d0368 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:44.697667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb551c43-d150-404e-828a-6300951d0368 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:44.697940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb551c43-d150-404e-828a-6300951d0368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:44.705924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb551c43-d150-404e-828a-6300951d0368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:08:44.707528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb551c43-d150-404e-828a-6300951d0368 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:08:44.716690 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 602/1201] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:08:48.567753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ba81-7265-44fb-b4f3-07a62ae063fa None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:48.568280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ba81-7265-44fb-b4f3-07a62ae063fa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:48.568280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ba81-7265-44fb-b4f3-07a62ae063fa None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:48.569613 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 600/1202] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:08:48.574848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a6c5-5b84-48b9-b679-97d5b814d4be None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:48.575275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a6c5-5b84-48b9-b679-97d5b814d4be None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:48.575399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a6c5-5b84-48b9-b679-97d5b814d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:48.595562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bf15a6c5-5b84-48b9-b679-97d5b814d4be None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:08:48.596768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bf15a6c5-5b84-48b9-b679-97d5b814d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:48.605049 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 603/1203] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:08:48.889142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ba81-7265-44fb-b4f3-07a62ae063fa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:08:48.890853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-31a3ba81-7265-44fb-b4f3-07a62ae063fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:48.966803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ba81-7265-44fb-b4f3-07a62ae063fa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:08:48.970301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9f845-1233-4c5d-ba57-2c12e2c0e68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:08:48.970887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9f845-1233-4c5d-ba57-2c12e2c0e68b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:48.971158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9f845-1233-4c5d-ba57-2c12e2c0e68b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:48.971424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9f845-1233-4c5d-ba57-2c12e2c0e68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:48.980522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9f845-1233-4c5d-ba57-2c12e2c0e68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:08:48.981948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9f845-1233-4c5d-ba57-2c12e2c0e68b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:08:48.991178 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 601/1204] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:08:51.114592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282575c5-b48a-4492-92e2-366355a968fb None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:51.115125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282575c5-b48a-4492-92e2-366355a968fb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:51.115125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282575c5-b48a-4492-92e2-366355a968fb None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:51.116475 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 604/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 01:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:08:51.121907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34596a5-c95c-43ce-938e-84517332ec7a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:51.122356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34596a5-c95c-43ce-938e-84517332ec7a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:51.122465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34596a5-c95c-43ce-938e-84517332ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:51.141700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d34596a5-c95c-43ce-938e-84517332ec7a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:08:51.143128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d34596a5-c95c-43ce-938e-84517332ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:08:51.151680 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 602/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:08:51.440203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282575c5-b48a-4492-92e2-366355a968fb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:08:51.451453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282575c5-b48a-4492-92e2-366355a968fb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:08:51.455062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d032b-97fa-4acd-9ccc-8fa3ae2af6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:08:51.464381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d032b-97fa-4acd-9ccc-8fa3ae2af6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:08:51.464381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d032b-97fa-4acd-9ccc-8fa3ae2af6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:08:51.464381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d032b-97fa-4acd-9ccc-8fa3ae2af6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:08:51.465518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d032b-97fa-4acd-9ccc-8fa3ae2af6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:08:51.466947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d032b-97fa-4acd-9ccc-8fa3ae2af6c7 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:08:51.476394 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 605/1207] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:09:01.136765 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:09:01.475309 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=51 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:09:40.070140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617775e9-a5ed-49eb-9b5b-3e1a4cad3afd None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:09:40.070140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617775e9-a5ed-49eb-9b5b-3e1a4cad3afd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:09:40.070140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617775e9-a5ed-49eb-9b5b-3e1a4cad3afd None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:09:40.070140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 603/1208] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:09:40.075946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159816-1386-47a4-9668-6330cdbd8d93 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:09:40.076376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159816-1386-47a4-9668-6330cdbd8d93 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:09:40.076624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159816-1386-47a4-9668-6330cdbd8d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:09:40.095878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ca159816-1386-47a4-9668-6330cdbd8d93 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:09:40.097056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ca159816-1386-47a4-9668-6330cdbd8d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:09:40.105969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 606/1209] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:09:50.090997 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:11.944104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791173-13b6-479c-afd9-6840e77c56c2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:11.945286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791173-13b6-479c-afd9-6840e77c56c2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:11.945813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791173-13b6-479c-afd9-6840e77c56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:11.974883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d4791173-13b6-479c-afd9-6840e77c56c2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:11.976093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d4791173-13b6-479c-afd9-6840e77c56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:11.984597 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 604/1210] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:11.995668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072365fb-6492-42cc-81d4-b79bdf2cdb75 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:11.996269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072365fb-6492-42cc-81d4-b79bdf2cdb75 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:11.996269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072365fb-6492-42cc-81d4-b79bdf2cdb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.030775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-072365fb-6492-42cc-81d4-b79bdf2cdb75 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.032341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-072365fb-6492-42cc-81d4-b79bdf2cdb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.044885 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 607/1211] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.049343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791173-13b6-479c-afd9-6840e77c56c2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.063794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791173-13b6-479c-afd9-6840e77c56c2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.069205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.069822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.070147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.070414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.071071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:12.071384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.072384 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:10:12.072384 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:10:12.072384 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:10:12.073255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.091866 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 605/1212] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:12.100245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072365fb-6492-42cc-81d4-b79bdf2cdb75 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.115882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072365fb-6492-42cc-81d4-b79bdf2cdb75 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.125245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db885c-c14a-4f32-9c5a-f072fb12f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.125883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db885c-c14a-4f32-9c5a-f072fb12f6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.126192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db885c-c14a-4f32-9c5a-f072fb12f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.126468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db885c-c14a-4f32-9c5a-f072fb12f6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.127131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db885c-c14a-4f32-9c5a-f072fb12f6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.129057 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-d7db885c-c14a-4f32-9c5a-f072fb12f6c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:10:12.129057 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:10:12.129057 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:10:12.130337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db885c-c14a-4f32-9c5a-f072fb12f6c0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.296710 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 608/1213] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:12.301862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.316030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b230e9c-b774-4925-925d-3f5c503dafea admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.322680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727dae-ce4b-42f8-9031-e6453d1f9013 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.323110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727dae-ce4b-42f8-9031-e6453d1f9013 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.323387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727dae-ce4b-42f8-9031-e6453d1f9013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.369993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6b727dae-ce4b-42f8-9031-e6453d1f9013 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.371621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6b727dae-ce4b-42f8-9031-e6453d1f9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.427936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87985a2-e4fb-4159-81fe-e8a3f3950be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.428571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87985a2-e4fb-4159-81fe-e8a3f3950be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.428853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87985a2-e4fb-4159-81fe-e8a3f3950be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.429119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87985a2-e4fb-4159-81fe-e8a3f3950be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.429774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87985a2-e4fb-4159-81fe-e8a3f3950be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.430918 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-a87985a2-e4fb-4159-81fe-e8a3f3950be9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:10:12.430918 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:10:12.430918 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:10:12.432176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87985a2-e4fb-4159-81fe-e8a3f3950be9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.515727 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 609/1214] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.526335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581073f7-33a9-41a0-8e21-0a48842aec5f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.530018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581073f7-33a9-41a0-8e21-0a48842aec5f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.530018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581073f7-33a9-41a0-8e21-0a48842aec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.561770 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 606/1215] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:12.562839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-581073f7-33a9-41a0-8e21-0a48842aec5f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.563108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61247eab-0d24-4c6c-a42a-2ea4da754844 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.563390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61247eab-0d24-4c6c-a42a-2ea4da754844 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.563659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61247eab-0d24-4c6c-a42a-2ea4da754844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.564117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-581073f7-33a9-41a0-8e21-0a48842aec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.572889 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 610/1216] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:10:12.574209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae415e-579d-47a7-86c7-8abee095356c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.574492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae415e-579d-47a7-86c7-8abee095356c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.574763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae415e-579d-47a7-86c7-8abee095356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.599286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-61247eab-0d24-4c6c-a42a-2ea4da754844 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.600539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-61247eab-0d24-4c6c-a42a-2ea4da754844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.609375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-64ae415e-579d-47a7-86c7-8abee095356c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.610591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-64ae415e-579d-47a7-86c7-8abee095356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.616880 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 607/1217] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.617915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61247eab-0d24-4c6c-a42a-2ea4da754844 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.635740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61247eab-0d24-4c6c-a42a-2ea4da754844 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.641402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0ffd-ad75-4e79-8f30-0dbd395402bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.641899 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 611/1218] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.642285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0ffd-ad75-4e79-8f30-0dbd395402bf admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.642562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0ffd-ad75-4e79-8f30-0dbd395402bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.642827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae415e-579d-47a7-86c7-8abee095356c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.642951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0ffd-ad75-4e79-8f30-0dbd395402bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.643487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea0ffd-ad75-4e79-8f30-0dbd395402bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.645596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea0ffd-ad75-4e79-8f30-0dbd395402bf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.654529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae415e-579d-47a7-86c7-8abee095356c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.663871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e94b6-f41f-4b71-b7af-1ee838bfca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.664496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e94b6-f41f-4b71-b7af-1ee838bfca01 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.664781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e94b6-f41f-4b71-b7af-1ee838bfca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.665050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e94b6-f41f-4b71-b7af-1ee838bfca01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.665701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e94b6-f41f-4b71-b7af-1ee838bfca01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:12.666641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e94b6-f41f-4b71-b7af-1ee838bfca01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.673452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e94b6-f41f-4b71-b7af-1ee838bfca01 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.675282 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 608/1219] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:12.676552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb4d84-8ebf-4f3e-ac21-47b7e631bea0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.676838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb4d84-8ebf-4f3e-ac21-47b7e631bea0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.677114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb4d84-8ebf-4f3e-ac21-47b7e631bea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.692218 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 612/1220] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:12.693801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5afc6-7653-47c4-a1ff-4da01b92c5d7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.694344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5afc6-7653-47c4-a1ff-4da01b92c5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.694840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5afc6-7653-47c4-a1ff-4da01b92c5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.715064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1adb4d84-8ebf-4f3e-ac21-47b7e631bea0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.716640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1adb4d84-8ebf-4f3e-ac21-47b7e631bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.720090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bcb5afc6-7653-47c4-a1ff-4da01b92c5d7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.722686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bcb5afc6-7653-47c4-a1ff-4da01b92c5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.729180 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 609/1221] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.737091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4167f-4050-46ab-8ad4-339f7121c528 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.737091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4167f-4050-46ab-8ad4-339f7121c528 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.737091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4167f-4050-46ab-8ad4-339f7121c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.742946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 613/1222] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.745746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5cfab-33bc-4a45-ae0b-dc36d1630d46 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.746063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5cfab-33bc-4a45-ae0b-dc36d1630d46 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.746342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5cfab-33bc-4a45-ae0b-dc36d1630d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.752230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-daa4167f-4050-46ab-8ad4-339f7121c528 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.753499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-daa4167f-4050-46ab-8ad4-339f7121c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.762273 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 610/1223] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.763138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4167f-4050-46ab-8ad4-339f7121c528 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.769009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bcc5cfab-33bc-4a45-ae0b-dc36d1630d46 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.771800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bcc5cfab-33bc-4a45-ae0b-dc36d1630d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.776324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4167f-4050-46ab-8ad4-339f7121c528 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.779246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 614/1224] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.780426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafaa99-2c73-4d67-9802-a11cd309bbc4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.780753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafaa99-2c73-4d67-9802-a11cd309bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.781033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafaa99-2c73-4d67-9802-a11cd309bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.782395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.783186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.783467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.783969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.785221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.786815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.797990 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 611/1225] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:12.798954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.801360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8dafaa99-2c73-4d67-9802-a11cd309bbc4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.802583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8dafaa99-2c73-4d67-9802-a11cd309bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.808683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41693a2-efd2-4432-a644-ce7587891d04 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.810505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 615/1226] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.811870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62ad82-9c6f-4dc1-95ac-de22a61e5cdb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.812208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62ad82-9c6f-4dc1-95ac-de22a61e5cdb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.812426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62ad82-9c6f-4dc1-95ac-de22a61e5cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.813361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc68fa-a426-4da2-bf56-0820d6183049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.813932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc68fa-a426-4da2-bf56-0820d6183049 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.814236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc68fa-a426-4da2-bf56-0820d6183049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.814502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc68fa-a426-4da2-bf56-0820d6183049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.815105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc68fa-a426-4da2-bf56-0820d6183049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.817007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc68fa-a426-4da2-bf56-0820d6183049 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.833573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3f62ad82-9c6f-4dc1-95ac-de22a61e5cdb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.834806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f62ad82-9c6f-4dc1-95ac-de22a61e5cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.842685 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 616/1227] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.843940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef6b67-1e8d-488a-9439-caeb55076c03 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.846049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef6b67-1e8d-488a-9439-caeb55076c03 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.846049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef6b67-1e8d-488a-9439-caeb55076c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.864853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1eef6b67-1e8d-488a-9439-caeb55076c03 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.866066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1eef6b67-1e8d-488a-9439-caeb55076c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.874059 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 617/1228] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.874665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef6b67-1e8d-488a-9439-caeb55076c03 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.883862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef6b67-1e8d-488a-9439-caeb55076c03 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.888481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.889068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.889343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.889612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.890273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:12.890572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.892220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.900279 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 612/1229] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:12.902100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721dc5-3fdd-4592-b74d-cc566f9859c7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.902218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721dc5-3fdd-4592-b74d-cc566f9859c7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.902471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721dc5-3fdd-4592-b74d-cc566f9859c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.914277 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 618/1230] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:12.914277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.920185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6914-08a5-4c7c-83dc-e0d1a071fe3f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:12.932900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bc721dc5-3fdd-4592-b74d-cc566f9859c7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:12.934126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bc721dc5-3fdd-4592-b74d-cc566f9859c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:12.967242 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:12.978227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:12.978847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:12.983100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:12.983100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:12.983100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:12.983100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:12.983100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:12.993736 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 619/1231] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:12.994444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:12.999403 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 613/1232] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:12.999926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740fd9-f64d-47c4-a7e9-eae880bebec1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.000133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740fd9-f64d-47c4-a7e9-eae880bebec1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.000631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740fd9-f64d-47c4-a7e9-eae880bebec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.005673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6114a1b-ad40-4fff-9160-dcfbb788db50 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.011168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.014709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.014709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.014709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] PATH_INFO: `/v3/projects/14bdf2810cec419483881665e90d785b/users/c6cb75369f08458687ef9be6a9df7806/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.015308 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:13.021755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-06740fd9-f64d-47c4-a7e9-eae880bebec1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:13.022949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-06740fd9-f64d-47c4-a7e9-eae880bebec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:13.027853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bdf2810cec419483881665e90d785b, user_id=c6cb75369f08458687ef9be6a9df7806, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.030884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.031063 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 614/1233] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:13.031473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06740fd9-f64d-47c4-a7e9-eae880bebec1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.040902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06740fd9-f64d-47c4-a7e9-eae880bebec1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.046099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97321f82-52f8-4502-8d4d-3ecc1c8b3d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.046273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321f82-52f8-4502-8d4d-3ecc1c8b3d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.046489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321f82-52f8-4502-8d4d-3ecc1c8b3d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.046786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97321f82-52f8-4502-8d4d-3ecc1c8b3d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.047413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321f82-52f8-4502-8d4d-3ecc1c8b3d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:13.047707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321f82-52f8-4502-8d4d-3ecc1c8b3d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.049269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97321f82-52f8-4502-8d4d-3ecc1c8b3d8b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.060824 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 615/1234] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:13.062180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168d5a-0ba9-4bdb-8d7c-1360f2bdbc0e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.062991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168d5a-0ba9-4bdb-8d7c-1360f2bdbc0e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.063322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168d5a-0ba9-4bdb-8d7c-1360f2bdbc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.083656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-11168d5a-0ba9-4bdb-8d7c-1360f2bdbc0e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:13.084864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11168d5a-0ba9-4bdb-8d7c-1360f2bdbc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:13.092837 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 616/1235] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:13.093581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168d5a-0ba9-4bdb-8d7c-1360f2bdbc0e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.102493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168d5a-0ba9-4bdb-8d7c-1360f2bdbc0e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.106968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.107529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.107804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.108147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.108741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.110671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.115495 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 620/1236] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:12 2022] PUT /identity/v3/projects/14bdf2810cec419483881665e90d785b/users/c6cb75369f08458687ef9be6a9df7806/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:13.125360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.185843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92489f31-a00b-4171-8b3f-6e373fa4441a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.191223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.191833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.192103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.192368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.192993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.195027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.196403 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 617/1237] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.204370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.207383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2561-c28f-4d7a-9336-f3184b2dbe28 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.211937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.212521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.212813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.213062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.213690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:13.213999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.215612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.227586 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 618/1238] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:13.229532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.237412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a7ea7-4e39-4efd-9f27-3d4234d67f6e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.241943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.242522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.242795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.243062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.243649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.245506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.277543 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 621/1239] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/projects => generated 399 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.278420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.338690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f96b-878c-4c09-b325-063771932c10 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.343330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.343935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.344210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.344479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.345115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:13.345419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.347057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.357776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 619/1240] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.358754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.365809 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 622/1241] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:13.365809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.370456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718bea0-2db1-46f1-847c-8b750f46973e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.410962 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:13.425507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9836b-7572-42c7-9e7f-01c52ed6037a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.429624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923772-d0ca-456e-8640-9adb3af40748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.430282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923772-d0ca-456e-8640-9adb3af40748 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.430430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.430552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923772-d0ca-456e-8640-9adb3af40748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.430818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923772-d0ca-456e-8640-9adb3af40748 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.431156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.431457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef923772-d0ca-456e-8640-9adb3af40748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:13.431576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.431758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef923772-d0ca-456e-8640-9adb3af40748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.431950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.432640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.433367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef923772-d0ca-456e-8640-9adb3af40748 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.434753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.446123 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 623/1242] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:13.447352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f9bc-cb5c-4e6a-ac27-79e9d7c22832 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.447659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f9bc-cb5c-4e6a-ac27-79e9d7c22832 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.447914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f9bc-cb5c-4e6a-ac27-79e9d7c22832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.475853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-30d3f9bc-cb5c-4e6a-ac27-79e9d7c22832 None None] MFA Rules not processed for user `c6cb75369f08458687ef9be6a9df7806`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:13.477065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-30d3f9bc-cb5c-4e6a-ac27-79e9d7c22832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:13.526191 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 620/1243] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.527060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.540754 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 624/1244] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:13.541568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f9bc-cb5c-4e6a-ac27-79e9d7c22832 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.552265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f9bc-cb5c-4e6a-ac27-79e9d7c22832 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.589188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafefec-a6d0-4aaf-a6ba-c05b644be5fa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.594361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.595368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.595650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.595924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.596569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.598188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.608173 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 621/1245] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:13.609120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.609899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.610741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.611007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.611521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.612144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.614610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.618978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ec8f3-0433-4623-b3ed-fe7dc2ce36cd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.623521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.624423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.624423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.624640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.625213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.627110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.636490 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:13.731482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 625/1246] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/projects => generated 395 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.732363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.743393 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 622/1247] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.745365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.754516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f778-aa20-48bf-a165-58631bba6433 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.783447 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:13.797204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c295e-1286-471e-ba94-a3e95bcc0e88 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.802547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.803250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.803524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.803793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.804427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.806636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.814789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.815425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.815699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.815970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.816588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.818536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.921543 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 626/1248] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.922515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.932855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d18bf-29ba-4f13-a4a2-7e8b65a615e0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:13.934214 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 623/1249] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:13.934986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:13.991431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:13.992032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:13.992306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:13.992572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:13.993189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:13.995162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:13.998429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4048cc-1e96-40af-933d-6b8937bac414 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.003651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.004238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.004501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.004780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.005445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.007334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.076687 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 627/1250] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:14.077414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.105666 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 624/1251] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:13 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:14.105666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.116859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb511-4401-4830-9469-0802c78dcb8f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.139477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c44a1-fbc9-4e72-9a82-60cbcf8b65e4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.144594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.145257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.145523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.145790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.146463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.148351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.176338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.177170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.177309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.177576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.178234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.179814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.189352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 625/1252] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.190125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.195312 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:14.200155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced895c8-7fcf-4302-a0e4-a831210871ea admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.204634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.205788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.205788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.205788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.206479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.208280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.231086 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 628/1253] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:14 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:14.231962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.280105 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:14.293036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d3d04-7903-4fbd-9dc7-25207d55fec0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.298193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.298791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.301776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.301776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.301776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.302094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.302609 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 626/1254] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:14 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:14.306570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.311899 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 629/1255] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.312925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.317022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fd306-a4dd-4d23-9465-6773ae3841c6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.322607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.323233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.323511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.323727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573ef69-76de-4bac-aa9d-712dbe4d003f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.323838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.324415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.326006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.330371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.330371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.330371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.330371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.330758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.332179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.337504 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 627/1256] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.338153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.347568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96dd60-7b2f-486a-9745-27fc0f3775df admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.352306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.352883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.353154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.353418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.354064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.355984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.447508 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 630/1257] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:14 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:14.447508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.455903 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 628/1258] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:14 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:14.455903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.457098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec683-019b-4710-9afe-9d15731b95ad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.461864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.462504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.462808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.463073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.463677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325fd47-65e5-4da6-94bd-ad5c7218bec2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.463786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.465278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.468299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.473785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.473785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.473785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] PATH_INFO: `/v3/projects/f3a80a158b5c4e3baf87e83a284970c3/users/d61093911783470a94d53354c15df815/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.476644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 631/1259] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.477442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.488268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200febc-f686-4c2b-9060-9c52b8f4b437 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.488377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a80a158b5c4e3baf87e83a284970c3, user_id=d61093911783470a94d53354c15df815, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.490805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.492328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.492922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.493194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.493462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.494108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.495976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.584215 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 629/1260] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:14 2022] PUT /identity/v3/projects/f3a80a158b5c4e3baf87e83a284970c3/users/d61093911783470a94d53354c15df815/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:14.584961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.608467 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 632/1261] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:14 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:14.610295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.620216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9942e8-87d6-4ead-b232-ac1b180ab531 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.649149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90ca6f-2f7a-4214-a7d3-77c9874c9e76 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.654088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.654732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.655006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.655272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.655901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.657470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.667650 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 630/1262] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.668424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.678564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460987-0739-4cfd-a76d-1cc6660f5398 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.679391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.680002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.680287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.680556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.681195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.682806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.683116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.683719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.683997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.684246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.684857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.686416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.695854 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 633/1263] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.695854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.702266 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 631/1264] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.702266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.707655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dad8a-cf7d-417c-999f-c96485b65b28 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.709428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986b98e-c5a8-469a-b0f9-39d55ca76bed admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.712321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.712913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.713189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.713462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.713943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c155540-1f13-4915-8899-4bd5e0f74fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.714245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.714533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c155540-1f13-4915-8899-4bd5e0f74fff admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.714809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c155540-1f13-4915-8899-4bd5e0f74fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.715073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c155540-1f13-4915-8899-4bd5e0f74fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.715687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c155540-1f13-4915-8899-4bd5e0f74fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.715914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.717254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c155540-1f13-4915-8899-4bd5e0f74fff admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.726902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 634/1265] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.730674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.730828 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 632/1266] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.730828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f34185-5b29-4a60-90f0-c0a2db4b22d3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.730828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f34185-5b29-4a60-90f0-c0a2db4b22d3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.730828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f34185-5b29-4a60-90f0-c0a2db4b22d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.739532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d68b7a-d11c-4c48-8e04-f52780e5d9bb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.744081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.744676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.744952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.745220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.745876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.747467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.757172 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 635/1267] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.757394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-78f34185-5b29-4a60-90f0-c0a2db4b22d3 None None] MFA Rules not processed for user `d61093911783470a94d53354c15df815`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:14.757941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.758697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78f34185-5b29-4a60-90f0-c0a2db4b22d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:14.767085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39de79-14b4-4b2a-b1ea-b2c502d10d26 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.771538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.772111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.772387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.772660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.773275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.774842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.784904 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 636/1268] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.785669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.795109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dc5ee-7a28-4fd4-92e2-387cb0c17193 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.800694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.801194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.801325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.801568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.802218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.803789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.814449 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 637/1269] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:14.815200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.817092 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:14.825424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951160-4215-45e0-99e6-98dce53a93bb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.826347 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 633/1270] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:14.826347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f34185-5b29-4a60-90f0-c0a2db4b22d3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.833778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.833778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.833778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.834075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] PATH_INFO: `/v3/projects/f5e8c9aca8184f35a7b6f80eea34b649/users/34675ffa7f9f4e76bad646189402680c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.840473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f34185-5b29-4a60-90f0-c0a2db4b22d3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:14.845096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:14.845744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:14.846045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:14.846350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] PATH_INFO: `/v3/projects/214eb4a11eec4d52a4270b378f9ec933/users/3eb8c143cc1148df9a6628cb5347b442/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:14.848807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e8c9aca8184f35a7b6f80eea34b649, user_id=34675ffa7f9f4e76bad646189402680c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.851626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.861375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=214eb4a11eec4d52a4270b378f9ec933, user_id=3eb8c143cc1148df9a6628cb5347b442, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:14.866803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:14.949227 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 638/1271] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:14 2022] PUT /identity/v3/projects/f5e8c9aca8184f35a7b6f80eea34b649/users/34675ffa7f9f4e76bad646189402680c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:14.950111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.965529 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 634/1272] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:14 2022] PUT /identity/v3/projects/214eb4a11eec4d52a4270b378f9ec933/users/3eb8c143cc1148df9a6628cb5347b442/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:14.966379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:14.980572 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:15.012919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf51b-76d5-4094-9862-c00bb0574943 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.034546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76c79f-13e2-45d4-b503-5f45b978e99c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.039423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.040055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.040335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.040615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.041299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.042926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.053521 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 635/1273] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:15.054537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.064179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf95b-43c2-4f38-bcd2-278eb61e8d6a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.069571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.069735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.070326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.070457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.070623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.070887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] PATH_INFO: `/v3/projects/f56ec537f7f240a3b0ee057dadc6fbff/users/5aeca2b9f4c443a388c4b89b512f7b29/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.070990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.071226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.072487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.074100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.083916 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 639/1274] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:15.084690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.086220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56ec537f7f240a3b0ee057dadc6fbff, user_id=5aeca2b9f4c443a388c4b89b512f7b29, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.088894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.094197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eecc8-ecc4-4735-9fd9-c2c362df2167 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.098692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.099321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.099632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.099905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] PATH_INFO: `/v3/projects/a95bc00077144ab79343443ab76fcc24/users/9f53014630f6452b9393281621f9be06/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.115637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95bc00077144ab79343443ab76fcc24, user_id=9f53014630f6452b9393281621f9be06, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.118291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.190213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 636/1275] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:15 2022] PUT /identity/v3/projects/f56ec537f7f240a3b0ee057dadc6fbff/users/5aeca2b9f4c443a388c4b89b512f7b29/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:15.191844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.201723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 640/1276] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:15 2022] PUT /identity/v3/projects/a95bc00077144ab79343443ab76fcc24/users/9f53014630f6452b9393281621f9be06/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:15.202507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.255242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d89d1-53b9-418f-9a1e-d9adc99dd18f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.259944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d01271-6414-47f1-8122-00eeef3df844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.260701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01271-6414-47f1-8122-00eeef3df844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.261073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01271-6414-47f1-8122-00eeef3df844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.261446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01271-6414-47f1-8122-00eeef3df844 admin admin] PATH_INFO: `/v3/projects/cb2839bbedf643289a251019d9e79fc8/users/c7b5ba38c66d4d4a88b22337e70e56df/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.263995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e5af6-4413-4ba3-b51a-749cdb8d3e60 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.268642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00d10d-4fe5-4472-8933-e4b9ce95679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.269589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00d10d-4fe5-4472-8933-e4b9ce95679e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.269589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00d10d-4fe5-4472-8933-e4b9ce95679e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.269802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00d10d-4fe5-4472-8933-e4b9ce95679e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.270409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00d10d-4fe5-4472-8933-e4b9ce95679e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.272324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00d10d-4fe5-4472-8933-e4b9ce95679e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.275740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d01271-6414-47f1-8122-00eeef3df844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2839bbedf643289a251019d9e79fc8, user_id=c7b5ba38c66d4d4a88b22337e70e56df, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.278408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d01271-6414-47f1-8122-00eeef3df844 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.372615 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 637/1277] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:15 2022] PUT /identity/v3/projects/cb2839bbedf643289a251019d9e79fc8/users/c7b5ba38c66d4d4a88b22337e70e56df/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:15.373968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342d2b-3821-42ea-a3e4-d692373fd169 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.374279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342d2b-3821-42ea-a3e4-d692373fd169 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.374549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342d2b-3821-42ea-a3e4-d692373fd169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.385425 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 641/1278] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:15.386848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7bd49-07c7-4854-adcb-93633a6963bf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.387200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7bd49-07c7-4854-adcb-93633a6963bf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.387541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7bd49-07c7-4854-adcb-93633a6963bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.410217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-04342d2b-3821-42ea-a3e4-d692373fd169 None None] MFA Rules not processed for user `34675ffa7f9f4e76bad646189402680c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:15.411422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-04342d2b-3821-42ea-a3e4-d692373fd169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:15.417730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-71d7bd49-07c7-4854-adcb-93633a6963bf None None] MFA Rules not processed for user `3eb8c143cc1148df9a6628cb5347b442`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:15.419326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-71d7bd49-07c7-4854-adcb-93633a6963bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:15.424392 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:15.438676 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:15.479489 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 638/1279] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:15.480298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342d2b-3821-42ea-a3e4-d692373fd169 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.486515 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 642/1280] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:15.487997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7bd49-07c7-4854-adcb-93633a6963bf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.546261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342d2b-3821-42ea-a3e4-d692373fd169 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.550310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7bd49-07c7-4854-adcb-93633a6963bf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.551391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cba12-f772-4654-be26-312add67ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.552010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cba12-f772-4654-be26-312add67ccdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.552285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cba12-f772-4654-be26-312add67ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.552547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cba12-f772-4654-be26-312add67ccdf admin admin] PATH_INFO: `/v3/projects/b095d4940ef84515aaa3c6e0e4a07538/users/49264f1d1b5d40269c7a6853c702917f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.556562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.561257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.561257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.561257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] PATH_INFO: `/v3/projects/51e1c27b1f074880bb475777fc589530/users/73d46a77de9c4100a60ce44875d257f0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.568193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cba12-f772-4654-be26-312add67ccdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b095d4940ef84515aaa3c6e0e4a07538, user_id=49264f1d1b5d40269c7a6853c702917f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.570909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cba12-f772-4654-be26-312add67ccdf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.572958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e1c27b1f074880bb475777fc589530, user_id=73d46a77de9c4100a60ce44875d257f0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.575659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.650803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 639/1281] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:15 2022] PUT /identity/v3/projects/b095d4940ef84515aaa3c6e0e4a07538/users/49264f1d1b5d40269c7a6853c702917f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:15.651123 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 643/1282] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:15 2022] PUT /identity/v3/projects/51e1c27b1f074880bb475777fc589530/users/73d46a77de9c4100a60ce44875d257f0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:15.652078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.659856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc2996-32ea-4adc-9f4c-66f599a02774 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.660140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc2996-32ea-4adc-9f4c-66f599a02774 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.660409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc2996-32ea-4adc-9f4c-66f599a02774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.689274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-86cc2996-32ea-4adc-9f4c-66f599a02774 None None] MFA Rules not processed for user `5aeca2b9f4c443a388c4b89b512f7b29`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:15.690556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86cc2996-32ea-4adc-9f4c-66f599a02774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:15.721118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a603d-9736-4ffb-a2f5-0d210e01c8e6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.759772 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 640/1283] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:15.760922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d080ca-488e-4f4d-bf59-9ef98c0be4fc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.761213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d080ca-488e-4f4d-bf59-9ef98c0be4fc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.761500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d080ca-488e-4f4d-bf59-9ef98c0be4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.770646 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:15.780374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.780988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.781263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.781533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.782256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.786984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.789317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-96d080ca-488e-4f4d-bf59-9ef98c0be4fc None None] MFA Rules not processed for user `c7b5ba38c66d4d4a88b22337e70e56df`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:15.790537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-96d080ca-488e-4f4d-bf59-9ef98c0be4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:15.794512 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 644/1284] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:15.795425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.805020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a37a17-c888-4e4a-be0c-47ea61b245ec admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.810327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.810963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.811177 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:15.811331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.811641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.812257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.814146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.857416 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 641/1285] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:15.858263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d080ca-488e-4f4d-bf59-9ef98c0be4fc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.867871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d080ca-488e-4f4d-bf59-9ef98c0be4fc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.872285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253ba13-7775-4d04-b3b9-f96cf0446df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.872853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ba13-7775-4d04-b3b9-f96cf0446df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.873124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ba13-7775-4d04-b3b9-f96cf0446df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.873390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ba13-7775-4d04-b3b9-f96cf0446df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.874066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253ba13-7775-4d04-b3b9-f96cf0446df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.875934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253ba13-7775-4d04-b3b9-f96cf0446df0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.932673 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 645/1286] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:15.933392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:15.943184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4985243-4ed1-430a-aa5d-e7088ed9e909 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:15.947818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd3b6f-e4c0-4b58-808d-6800f7142141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:15.948428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd3b6f-e4c0-4b58-808d-6800f7142141 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.948706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd3b6f-e4c0-4b58-808d-6800f7142141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.948969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd3b6f-e4c0-4b58-808d-6800f7142141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.949603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd3b6f-e4c0-4b58-808d-6800f7142141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:15.951491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd3b6f-e4c0-4b58-808d-6800f7142141 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:15.965956 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 642/1287] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:15.965956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7812-3377-40d1-89ed-1ccda15c68e0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:15.965956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7812-3377-40d1-89ed-1ccda15c68e0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:15.965956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7812-3377-40d1-89ed-1ccda15c68e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:15.991659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-58fe7812-3377-40d1-89ed-1ccda15c68e0 None None] MFA Rules not processed for user `49264f1d1b5d40269c7a6853c702917f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:15.992839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-58fe7812-3377-40d1-89ed-1ccda15c68e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:16.051591 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 646/1288] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.051591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77dbdc-b22f-48ac-8a27-3b5af6ea10d2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.051591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77dbdc-b22f-48ac-8a27-3b5af6ea10d2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.051591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77dbdc-b22f-48ac-8a27-3b5af6ea10d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.057320 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 643/1289] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:16.061354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7812-3377-40d1-89ed-1ccda15c68e0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.078607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3c77dbdc-b22f-48ac-8a27-3b5af6ea10d2 None None] MFA Rules not processed for user `73d46a77de9c4100a60ce44875d257f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:16.079915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3c77dbdc-b22f-48ac-8a27-3b5af6ea10d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:16.119493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7812-3377-40d1-89ed-1ccda15c68e0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.144472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 647/1290] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:16.145364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77dbdc-b22f-48ac-8a27-3b5af6ea10d2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.150819 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:16.177631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.178450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.178821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.179184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.179941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.181906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.207809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77dbdc-b22f-48ac-8a27-3b5af6ea10d2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.212589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.213247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.213554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.213823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] PATH_INFO: `/v3/projects/a95bc00077144ab79343443ab76fcc24/users/9f53014630f6452b9393281621f9be06/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.215963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95bc00077144ab79343443ab76fcc24, user_id=9f53014630f6452b9393281621f9be06, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.218644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.228583 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 648/1291] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:16 2022] PUT /identity/v3/projects/a95bc00077144ab79343443ab76fcc24/users/9f53014630f6452b9393281621f9be06/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:16.229350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.262458 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:16.285897 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 644/1292] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.289749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.292179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea04cb-2888-4028-a193-0ed1a395857f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.348162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.348774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.349052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.349329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.350001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.351920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.353100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7219e0-3f26-4066-a5cc-e0e34ddf52ef admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.357778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.358393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.358671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.358942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.359579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.361147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.371855 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 645/1293] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:16.372640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.382341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412f12-e13f-43be-ad23-fe559ed975d3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.386952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.387515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.387788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.388054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.388670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.390564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.437046 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 649/1294] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.437046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.484370 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 646/1295] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.485185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.497406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d1af-b570-49eb-bf58-e117b27876a4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.501673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e0cc2-055d-41b4-a343-c6e783da91c9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.502111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a318-5cf0-48f0-9435-fa8d6f4e8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.503353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a318-5cf0-48f0-9435-fa8d6f4e8491 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.503637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a318-5cf0-48f0-9435-fa8d6f4e8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.503904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a318-5cf0-48f0-9435-fa8d6f4e8491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.504522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a318-5cf0-48f0-9435-fa8d6f4e8491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.506509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a318-5cf0-48f0-9435-fa8d6f4e8491 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.506868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.507471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.510443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.510443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.510443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.510728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.586758 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 650/1296] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/users => generated 305 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.587565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.597743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246e69-8ed5-4681-b6b9-dec27bb3d31e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.597940 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 647/1297] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.599591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d03f-46e4-4920-ac31-d6363385cdf6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.599970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d03f-46e4-4920-ac31-d6363385cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.600320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d03f-46e4-4920-ac31-d6363385cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.629327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-efe6d03f-46e4-4920-ac31-d6363385cdf6 None None] MFA Rules not processed for user `9f53014630f6452b9393281621f9be06`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:16.630670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-efe6d03f-46e4-4920-ac31-d6363385cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:16.648993 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:16.657474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.658229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.659477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.659477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.659683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.661481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.696158 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:16.699653 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 648/1298] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:16.700567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d03f-46e4-4920-ac31-d6363385cdf6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.710338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d03f-46e4-4920-ac31-d6363385cdf6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.715104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.717003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.717003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.717003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.717003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.718836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.745737 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 651/1299] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.745737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.804543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17610-7ad7-4eb6-829d-0f6aa6b27272 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.809035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.809684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.809959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.810270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] PATH_INFO: `/v3/projects/f7c3e6bcb228428aaf1ddbb2dda3af25/users/15cf44b2cdc345a883125e0522ccf08f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.824108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c3e6bcb228428aaf1ddbb2dda3af25, user_id=15cf44b2cdc345a883125e0522ccf08f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.826752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.829767 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 649/1300] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.833834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.843233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8f83a-a7b9-40d7-a433-355a5a7ae408 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:16.848268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:16.848840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:16.849111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:16.849377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:16.849999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:16.851987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:16.938433 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 652/1301] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:16 2022] PUT /identity/v3/projects/f7c3e6bcb228428aaf1ddbb2dda3af25/users/15cf44b2cdc345a883125e0522ccf08f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:16.939365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.950143 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 650/1302] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:16 2022] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:16.950895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:16.960655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dd388-ed6c-4563-8522-256b79a00e50 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.001780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520caf78-288f-4906-b724-0b1afa19df98 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.006583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.011448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.011448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.011448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.011448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.011448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.017069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6cadd-2b22-4427-9fe0-d5f8b817dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.017673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6cadd-2b22-4427-9fe0-d5f8b817dbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.017948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6cadd-2b22-4427-9fe0-d5f8b817dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.018264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6cadd-2b22-4427-9fe0-d5f8b817dbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.018908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6cadd-2b22-4427-9fe0-d5f8b817dbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.020161 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 653/1303] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.023667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6cadd-2b22-4427-9fe0-d5f8b817dbfc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.023784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.030235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bd8d8-febb-4045-bc4c-9ecc048ba95d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.034699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 651/1304] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.034699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8e61-2ac9-4e14-8d96-dd59a231f8d8 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.034699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8e61-2ac9-4e14-8d96-dd59a231f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.034699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8e61-2ac9-4e14-8d96-dd59a231f8d8 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.034699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 652/1305] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 23 01:10:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:17.035172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8e61-2ac9-4e14-8d96-dd59a231f8d8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.038634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.039231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.039546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.039817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.040432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.042440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.047297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8e61-2ac9-4e14-8d96-dd59a231f8d8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.052381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.052967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.053244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.053510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.054548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.056123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.153056 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 654/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:17 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:17.153927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.162370 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 653/1307] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:17 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:17.163285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.166731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb51b65-97df-4df2-8a3a-fe3f6fd618fd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.170681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.171281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.171558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.171828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.172490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.173691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7637f-bd09-4c39-8422-81bf1c7780ae admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.174087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.178283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.178926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.179209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.179477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.180107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.181713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.185103 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 655/1308] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.185910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.199963 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 654/1309] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.200183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86a4da-9998-492a-9b4c-f257840ebbb9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.200284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.203379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.203981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.204257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.204525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.205191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.207324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.207597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a9474-bd22-4260-9841-9679ed179a2f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.213461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3a411-50b6-4ece-a16d-21f6f51733ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.214217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a411-50b6-4ece-a16d-21f6f51733ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.214490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a411-50b6-4ece-a16d-21f6f51733ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.214755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a411-50b6-4ece-a16d-21f6f51733ef admin admin] PATH_INFO: `/v3/projects/4b32bb8e48604b8191d283f22bcccfdf/users/124c3118edc24087b301e83fa9a71087/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.219245 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 656/1310] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.219245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.228866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d363d-0364-424a-b009-95d59516bc04 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.230663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3a411-50b6-4ece-a16d-21f6f51733ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b32bb8e48604b8191d283f22bcccfdf, user_id=124c3118edc24087b301e83fa9a71087, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.233379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.233542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3a411-50b6-4ece-a16d-21f6f51733ef admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.234047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.234325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.234595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] PATH_INFO: `/v3/projects/24682a566a714ef586033a6e2992e4e4/users/a997cd84907845e2a0df8ae40a0fd4bf/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.248984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24682a566a714ef586033a6e2992e4e4, user_id=a997cd84907845e2a0df8ae40a0fd4bf, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.251651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.253853 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:17.301348 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 655/1311] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:17 2022] PUT /identity/v3/projects/4b32bb8e48604b8191d283f22bcccfdf/users/124c3118edc24087b301e83fa9a71087/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:17.302606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c22e43-dfa2-44eb-aa1a-bbfde12fbd84 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.302912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c22e43-dfa2-44eb-aa1a-bbfde12fbd84 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.303182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c22e43-dfa2-44eb-aa1a-bbfde12fbd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.340482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-77c22e43-dfa2-44eb-aa1a-bbfde12fbd84 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:17.341695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-77c22e43-dfa2-44eb-aa1a-bbfde12fbd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:17.353721 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 657/1312] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:17 2022] PUT /identity/v3/projects/24682a566a714ef586033a6e2992e4e4/users/a997cd84907845e2a0df8ae40a0fd4bf/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:17.354603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.391982 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:17.412440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 656/1313] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:17.413334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c22e43-dfa2-44eb-aa1a-bbfde12fbd84 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.415097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4aae-edd6-4afa-9501-8e902f8b9d6d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.421241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.421846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.422152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.422468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.423107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.424746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.438227 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 658/1314] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.438227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.445173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b795c-a328-4670-b301-4e334f2955bf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.449753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.456308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.456308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.456308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] PATH_INFO: `/v3/projects/11a5e014ab4a4e428241d0c3d708d557/users/baa70e1d28a64fe0b9be83556083e594/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.466853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a5e014ab4a4e428241d0c3d708d557, user_id=baa70e1d28a64fe0b9be83556083e594, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.469521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.477963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c22e43-dfa2-44eb-aa1a-bbfde12fbd84 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.482454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.484836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.484836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.484836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.484836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.485822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.495881 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 657/1315] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.496675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.505722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9743b-87aa-46e9-b60f-84248f3d05e9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.510192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.513500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.513500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.513500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] PATH_INFO: `/v3/projects/f7c3e6bcb228428aaf1ddbb2dda3af25/users/15cf44b2cdc345a883125e0522ccf08f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.513500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c3e6bcb228428aaf1ddbb2dda3af25, user_id=15cf44b2cdc345a883125e0522ccf08f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.515757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.526177 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 658/1316] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:17 2022] PUT /identity/v3/projects/f7c3e6bcb228428aaf1ddbb2dda3af25/users/15cf44b2cdc345a883125e0522ccf08f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:17.526905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.539440 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 659/1317] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:17 2022] PUT /identity/v3/projects/11a5e014ab4a4e428241d0c3d708d557/users/baa70e1d28a64fe0b9be83556083e594/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:17.540270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.592951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36720c21-3056-45fd-a9d5-e73bb9588173 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.602937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18059f4a-9dfa-47de-a71a-a103016e3466 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.607646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.608265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.608548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.608818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.609453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.611061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.620786 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 660/1318] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.621645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.632036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b74e2f-090e-4ab3-8b4b-2b0dc2387fe3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.636853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.637440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.637716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.637995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.638652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.640194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.649464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.650152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.650428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.650524 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 661/1319] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:17.654084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] PATH_INFO: `/v3/projects/f6c73949b77f4bc1a11502d092ace444/users/41bbdf429a464a5bbaf79131085193cb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.654186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.665187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c73949b77f4bc1a11502d092ace444, user_id=41bbdf429a464a5bbaf79131085193cb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.667858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.700912 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:17.720593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0697a8-c3e8-4411-a72a-95e29fc23df5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.726126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.726736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.727017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.727297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.728158 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:17.732995 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 659/1320] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:17 2022] PUT /identity/v3/projects/f6c73949b77f4bc1a11502d092ace444/users/41bbdf429a464a5bbaf79131085193cb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:17.733605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.786925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.788429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.793557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b805053-f0a3-413b-85b9-3896934c6047 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.798344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 662/1321] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:17.798844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8af143-9585-4fec-92a5-3943ef2852e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.799184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.799531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af143-9585-4fec-92a5-3943ef2852e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.799805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af143-9585-4fec-92a5-3943ef2852e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.800074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af143-9585-4fec-92a5-3943ef2852e9 admin admin] PATH_INFO: `/v3/projects/9dec106b1fee4cbaaf8052b1374d8192/users/f0a177c2d5b747fa889814116e3050df/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.808790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e981-d50a-48bb-a578-cb4c6c7653e4 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:17.813403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:17.814126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.814409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.814678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] PATH_INFO: `/v3/projects/8e8e761ba5b54075aae863301ebd01ba/users/de9126512e1c4dcca2855787f86b3b41/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.817226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8af143-9585-4fec-92a5-3943ef2852e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dec106b1fee4cbaaf8052b1374d8192, user_id=f0a177c2d5b747fa889814116e3050df, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.819916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8af143-9585-4fec-92a5-3943ef2852e9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.829864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8e761ba5b54075aae863301ebd01ba, user_id=de9126512e1c4dcca2855787f86b3b41, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:17.833145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:17.912882 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 660/1322] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:17 2022] PUT /identity/v3/projects/9dec106b1fee4cbaaf8052b1374d8192/users/f0a177c2d5b747fa889814116e3050df/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:17.914409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230a86f-440b-45cf-afd1-8ca760fa94b2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:17.914772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230a86f-440b-45cf-afd1-8ca760fa94b2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:17.917228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230a86f-440b-45cf-afd1-8ca760fa94b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:17.942891 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 663/1323] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:17 2022] PUT /identity/v3/projects/8e8e761ba5b54075aae863301ebd01ba/users/de9126512e1c4dcca2855787f86b3b41/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:17.946003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:17.946589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0230a86f-440b-45cf-afd1-8ca760fa94b2 None None] MFA Rules not processed for user `15cf44b2cdc345a883125e0522ccf08f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:17.947904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0230a86f-440b-45cf-afd1-8ca760fa94b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.009156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd894a0-da21-4898-9388-35f09812334b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.013667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.014306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.014589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.014862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.015504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.017093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.025431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 661/1324] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.026528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230a86f-440b-45cf-afd1-8ca760fa94b2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.030224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 664/1325] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:18.030224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.039472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b4386-0a9e-48d1-8ec2-62d27a64819a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.041477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230a86f-440b-45cf-afd1-8ca760fa94b2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.045853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.046662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.047022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.047479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] PATH_INFO: `/v3/projects/24682a566a714ef586033a6e2992e4e4/users/a997cd84907845e2a0df8ae40a0fd4bf/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.047632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.048527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.049120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.049882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24682a566a714ef586033a6e2992e4e4, user_id=a997cd84907845e2a0df8ae40a0fd4bf, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.050134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] PATH_INFO: `/v3/projects/4b32bb8e48604b8191d283f22bcccfdf/users/124c3118edc24087b301e83fa9a71087/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.060515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b32bb8e48604b8191d283f22bcccfdf, user_id=124c3118edc24087b301e83fa9a71087, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.060655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.060762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.066216 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 665/1326] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:18 2022] PUT /identity/v3/projects/24682a566a714ef586033a6e2992e4e4/users/a997cd84907845e2a0df8ae40a0fd4bf/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:18.067174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.075976 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 662/1327] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:18 2022] PUT /identity/v3/projects/4b32bb8e48604b8191d283f22bcccfdf/users/124c3118edc24087b301e83fa9a71087/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:18.075976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.119230 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.138892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab4568-61cd-472a-99e6-79cec140429d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.148860 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.154965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6745-7425-40e3-a635-b0167c04d6c1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.161343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.161954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.372771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.372771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.372771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.372771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.372771 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 663/1328] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:18.372771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.374526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a05a3-4fac-4276-80c0-79cc18a5d96e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.374526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.374526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.374526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.374851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.374851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.374851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.374851 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 664/1329] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:18.374851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.375262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f939-fb44-48e0-a98d-82dcc7221b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.375262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f939-fb44-48e0-a98d-82dcc7221b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.375262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f939-fb44-48e0-a98d-82dcc7221b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.375262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f939-fb44-48e0-a98d-82dcc7221b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.375851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f939-fb44-48e0-a98d-82dcc7221b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.375851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f939-fb44-48e0-a98d-82dcc7221b1c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.375972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372a13-292a-4391-9106-526d837a75e2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.375972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4f8e2-1635-4850-87c5-d7e4cd041042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.375972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4f8e2-1635-4850-87c5-d7e4cd041042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.376167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 666/1330] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:18.376234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4f8e2-1635-4850-87c5-d7e4cd041042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.376234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4f8e2-1635-4850-87c5-d7e4cd041042 admin admin] PATH_INFO: `/v3/projects/11a5e014ab4a4e428241d0c3d708d557/users/baa70e1d28a64fe0b9be83556083e594/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.376353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80778c6-904f-4ae7-9581-ba198339f4e5 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.376353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80778c6-904f-4ae7-9581-ba198339f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.376353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80778c6-904f-4ae7-9581-ba198339f4e5 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.376353 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 667/1331] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 23 01:10:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:18.376353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1b77-7656-409b-b4f8-86b98ba4f07f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.376634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4f8e2-1635-4850-87c5-d7e4cd041042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a5e014ab4a4e428241d0c3d708d557, user_id=baa70e1d28a64fe0b9be83556083e594, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.376716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1b77-7656-409b-b4f8-86b98ba4f07f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.376716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1b77-7656-409b-b4f8-86b98ba4f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.376849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4f8e2-1635-4850-87c5-d7e4cd041042 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.376849 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 665/1332] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:18 2022] PUT /identity/v3/projects/11a5e014ab4a4e428241d0c3d708d557/users/baa70e1d28a64fe0b9be83556083e594/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:18.376849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f997-bc8a-4eb5-bbd3-1b9660d6b86e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.376849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f997-bc8a-4eb5-bbd3-1b9660d6b86e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.376849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f997-bc8a-4eb5-bbd3-1b9660d6b86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.377150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2aef1b77-7656-409b-b4f8-86b98ba4f07f None None] MFA Rules not processed for user `a997cd84907845e2a0df8ae40a0fd4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:18.377150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2aef1b77-7656-409b-b4f8-86b98ba4f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.377347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6a43f997-bc8a-4eb5-bbd3-1b9660d6b86e None None] MFA Rules not processed for user `124c3118edc24087b301e83fa9a71087`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:18.377347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6a43f997-bc8a-4eb5-bbd3-1b9660d6b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.377500 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 668/1333] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.377500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef1b77-7656-409b-b4f8-86b98ba4f07f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.377627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 666/1334] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.377627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f997-bc8a-4eb5-bbd3-1b9660d6b86e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.401093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef1b77-7656-409b-b4f8-86b98ba4f07f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.407079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.408031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.408337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.409655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] PATH_INFO: `/v3/projects/9dec106b1fee4cbaaf8052b1374d8192/users/f0a177c2d5b747fa889814116e3050df/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.411589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dec106b1fee4cbaaf8052b1374d8192, user_id=f0a177c2d5b747fa889814116e3050df, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.414632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.426303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 669/1335] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:18 2022] PUT /identity/v3/projects/9dec106b1fee4cbaaf8052b1374d8192/users/f0a177c2d5b747fa889814116e3050df/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:18.435164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.438316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f997-bc8a-4eb5-bbd3-1b9660d6b86e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.489584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce853417-48d8-44bf-8af9-b9381e59ad37 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.494195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf295-3f56-4521-8886-04efe12e073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.494852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf295-3f56-4521-8886-04efe12e073d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.495124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf295-3f56-4521-8886-04efe12e073d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.495392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf295-3f56-4521-8886-04efe12e073d admin admin] PATH_INFO: `/v3/projects/f6c73949b77f4bc1a11502d092ace444/users/41bbdf429a464a5bbaf79131085193cb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.497352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf295-3f56-4521-8886-04efe12e073d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c73949b77f4bc1a11502d092ace444, user_id=41bbdf429a464a5bbaf79131085193cb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.500021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf295-3f56-4521-8886-04efe12e073d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.500443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50fa32-fd59-41de-b57e-be0666ac6727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.501107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50fa32-fd59-41de-b57e-be0666ac6727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.501384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50fa32-fd59-41de-b57e-be0666ac6727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.501654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50fa32-fd59-41de-b57e-be0666ac6727 admin admin] PATH_INFO: `/v3/projects/8e8e761ba5b54075aae863301ebd01ba/users/de9126512e1c4dcca2855787f86b3b41/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.504196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50fa32-fd59-41de-b57e-be0666ac6727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8e761ba5b54075aae863301ebd01ba, user_id=de9126512e1c4dcca2855787f86b3b41, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.506586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50fa32-fd59-41de-b57e-be0666ac6727 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.511069 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 670/1336] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:18 2022] PUT /identity/v3/projects/f6c73949b77f4bc1a11502d092ace444/users/41bbdf429a464a5bbaf79131085193cb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:18.515809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925de3-2582-4113-8df0-e44f41ea641e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.515809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925de3-2582-4113-8df0-e44f41ea641e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.515809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925de3-2582-4113-8df0-e44f41ea641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.516633 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 667/1337] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:18 2022] PUT /identity/v3/projects/8e8e761ba5b54075aae863301ebd01ba/users/de9126512e1c4dcca2855787f86b3b41/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:18.517848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7140d-d2c1-447b-b9e2-8a91fdf5450f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.518189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7140d-d2c1-447b-b9e2-8a91fdf5450f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.518465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7140d-d2c1-447b-b9e2-8a91fdf5450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.535736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-99925de3-2582-4113-8df0-e44f41ea641e None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:18.536925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-99925de3-2582-4113-8df0-e44f41ea641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.546353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-33d7140d-d2c1-447b-b9e2-8a91fdf5450f None None] MFA Rules not processed for user `baa70e1d28a64fe0b9be83556083e594`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:18.547531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-33d7140d-d2c1-447b-b9e2-8a91fdf5450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.559005 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.581783 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.604857 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 671/1338] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.605696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925de3-2582-4113-8df0-e44f41ea641e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.616567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925de3-2582-4113-8df0-e44f41ea641e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.617020 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 668/1339] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.618282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773d1b3-13c7-4929-92ff-e641e16f3565 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.618559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773d1b3-13c7-4929-92ff-e641e16f3565 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.618827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773d1b3-13c7-4929-92ff-e641e16f3565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.624563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c323-b792-4c20-8637-0d1f5e867da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.625162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c323-b792-4c20-8637-0d1f5e867da2 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.625434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c323-b792-4c20-8637-0d1f5e867da2 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.625701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c323-b792-4c20-8637-0d1f5e867da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.647022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2773d1b3-13c7-4929-92ff-e641e16f3565 None None] MFA Rules not processed for user `f0a177c2d5b747fa889814116e3050df`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:18.648324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2773d1b3-13c7-4929-92ff-e641e16f3565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.683115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2c323-b792-4c20-8637-0d1f5e867da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.684617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2c323-b792-4c20-8637-0d1f5e867da2 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.693846 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 672/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:18.695373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71865-869b-4dd3-9974-d267e8fc191b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.695373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71865-869b-4dd3-9974-d267e8fc191b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.695625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71865-869b-4dd3-9974-d267e8fc191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.718447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 669/1341] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.719690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e7b0a-0caf-4342-9347-17a7a9327637 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.719981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e7b0a-0caf-4342-9347-17a7a9327637 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.720244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e7b0a-0caf-4342-9347-17a7a9327637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.726355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8ba71865-869b-4dd3-9974-d267e8fc191b None None] MFA Rules not processed for user `41bbdf429a464a5bbaf79131085193cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:18.727740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ba71865-869b-4dd3-9974-d267e8fc191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.747389 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.748529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ce8e7b0a-0caf-4342-9347-17a7a9327637 None None] MFA Rules not processed for user `de9126512e1c4dcca2855787f86b3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:18.749727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce8e7b0a-0caf-4342-9347-17a7a9327637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:18.799549 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:18.800491 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 673/1342] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.801020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71865-869b-4dd3-9974-d267e8fc191b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.814739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71865-869b-4dd3-9974-d267e8fc191b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.818192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 670/1343] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:18.819155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e7b0a-0caf-4342-9347-17a7a9327637 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.820785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.821183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.822069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.822816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.831823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e7b0a-0caf-4342-9347-17a7a9327637 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.837346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.837961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.838335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.838772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.881790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.883403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.892772 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 674/1344] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:18.894079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.897568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.899244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.910357 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 671/1345] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:18.954558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e109a-1661-4604-a56a-1368aef00eb7 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:18.959688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:18.960293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:18.960575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:18.960848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:18.961468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:18.963369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:18.988294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:18.999856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ad00-9619-4876-8a8c-4bf6234c4f53 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.005259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.005852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.006151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.006418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.054329 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 675/1346] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:18 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:19.058370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.070810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.072509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.083724 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 672/1347] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:10:19.095412 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:19.122785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8e83d-1e20-40da-9e11-b6ce82bf22a6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.127411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.128670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.128954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.129222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.129844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.131770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.199092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.210689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb74ace-a278-4ef0-bdfb-0407ad2c4a76 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.244230 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 676/1348] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:19 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:19.244230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.275313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.275946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.276204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.276472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.288522 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:19.315884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727ee6-0b16-46df-b461-80c6819093f8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.321632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.322276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.322584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.322860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.336756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.338378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.347986 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 673/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:19.348775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.358461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fdb67-8561-44ef-b7ae-c9fadca98398 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.363361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.363987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.364306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.364595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.365195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.366846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.381588 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 674/1350] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:19.382478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.388185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.390578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.392891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2112c7-dc22-4a70-8680-85566b0b5934 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.398242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.399001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.399273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.399541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.400171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.402065 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 677/1351] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:19.406492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.419447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 675/1352] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:19.430800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.443036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4d5d0-e248-426e-973d-ce3c2b23a044 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.447597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.448318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.448593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.448863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] PATH_INFO: `/v3/projects/54d7ef46716d4cc1b7d197d0049492ed/users/17dcc33fe9414711a3692416ae9aa058/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.454833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.475384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe593335-ed90-4f58-83fe-5b5c5dc2432a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.475657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d7ef46716d4cc1b7d197d0049492ed, user_id=17dcc33fe9414711a3692416ae9aa058, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.478812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.480949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d813dc-8aa7-44ad-880d-6f569e58d65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.481571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d813dc-8aa7-44ad-880d-6f569e58d65f service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.481853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d813dc-8aa7-44ad-880d-6f569e58d65f service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.486138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d813dc-8aa7-44ad-880d-6f569e58d65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.548603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d813dc-8aa7-44ad-880d-6f569e58d65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.550308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d813dc-8aa7-44ad-880d-6f569e58d65f service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.559726 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 676/1353] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:19.564224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 678/1354] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:19 2022] PUT /identity/v3/projects/54d7ef46716d4cc1b7d197d0049492ed/users/17dcc33fe9414711a3692416ae9aa058/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:19.575753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4677e2-e070-40aa-be8d-bf3808f5ec4f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.576064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4677e2-e070-40aa-be8d-bf3808f5ec4f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.576341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4677e2-e070-40aa-be8d-bf3808f5ec4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.607263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7d4677e2-e070-40aa-be8d-bf3808f5ec4f None None] MFA Rules not processed for user `17dcc33fe9414711a3692416ae9aa058`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:19.608495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d4677e2-e070-40aa-be8d-bf3808f5ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:19.678672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.694009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 677/1355] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:19.715530 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:19.751388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe9f4-c5bc-4335-8592-612cdaf07d71 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.756804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.757402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.757673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.757939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.813873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.816094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:19.824830 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 679/1356] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:19.891719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4677e2-e070-40aa-be8d-bf3808f5ec4f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.905581 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:19.936983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:19.946339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2046fc7-fad6-4e71-a218-b7d83251d63b service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.951928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9da878-94ed-4aa9-8064-6ec0bd561c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.952530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da878-94ed-4aa9-8064-6ec0bd561c56 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.952810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da878-94ed-4aa9-8064-6ec0bd561c56 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.953078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da878-94ed-4aa9-8064-6ec0bd561c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.968557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4677e2-e070-40aa-be8d-bf3808f5ec4f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:19.973438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:19.974195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:19.974552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:19.974891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] PATH_INFO: `/v3/users/73d46a77de9c4100a60ce44875d257f0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:19.976099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d46a77de9c4100a60ce44875d257f0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:19.978210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:20.023562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9da878-94ed-4aa9-8064-6ec0bd561c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:20.025149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9da878-94ed-4aa9-8064-6ec0bd561c56 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:20.034844 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 680/1357] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:20.036178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fff08-7e0d-411e-adba-fa98d2641ccf None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.036471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fff08-7e0d-411e-adba-fa98d2641ccf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.036797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fff08-7e0d-411e-adba-fa98d2641ccf None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.038186 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 681/1358] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:20.043163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020afd4d-4356-4e3d-b6f5-e8ce194e35d8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.043444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020afd4d-4356-4e3d-b6f5-e8ce194e35d8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.043972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020afd4d-4356-4e3d-b6f5-e8ce194e35d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.063874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-020afd4d-4356-4e3d-b6f5-e8ce194e35d8 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:20.065631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-020afd4d-4356-4e3d-b6f5-e8ce194e35d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.116490 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:20.126192 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 682/1359] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:10:20.149829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020afd4d-4356-4e3d-b6f5-e8ce194e35d8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:20.159813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020afd4d-4356-4e3d-b6f5-e8ce194e35d8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:20.164733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5ab3e-4a71-4872-91b5-f560371bae44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:20.167123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5ab3e-4a71-4872-91b5-f560371bae44 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.167123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5ab3e-4a71-4872-91b5-f560371bae44 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.167123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5ab3e-4a71-4872-91b5-f560371bae44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.182928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5ab3e-4a71-4872-91b5-f560371bae44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:20.184501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5ab3e-4a71-4872-91b5-f560371bae44 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:20.195326 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 683/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:10:20.218218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d46a77de9c4100a60ce44875d257f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.225155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d46a77de9c4100a60ce44875d257f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.225869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d46a77de9c4100a60ce44875d257f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.292685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d46a77de9c4100a60ce44875d257f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.293302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ff50d89-0b8d-44f5-bd75-b47407612b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d46a77de9c4100a60ce44875d257f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.293618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.294188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.294466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.295821 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 684/1361] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:20.301252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:20.303397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.313250 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 678/1362] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:19 2022] DELETE /identity/v3/users/73d46a77de9c4100a60ce44875d257f0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:20.318029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.318326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.318607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.321446 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 23 01:10:20.321749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:20.323194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.336178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b962ba-361e-4524-82fb-8c44737fb1cb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:20.337474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:20.338706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.411759 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 679/1363] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:10:20.418130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41bbdf429a464a5bbaf79131085193cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c73949b77f4bc1a11502d092ace444', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:20.419148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.419502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.419860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] PATH_INFO: `/v3/projects/cb2839bbedf643289a251019d9e79fc8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.421098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb2839bbedf643289a251019d9e79fc8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:20.423617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:20.425314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:20.426283 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 685/1364] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:20 2022] GET /identity/v3/projects/cb2839bbedf643289a251019d9e79fc8 => generated 395 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:10:20.426955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.458865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:20.461628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.475367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a1e9-b941-4cd4-a7d2-560ec7d34372 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:20.478836 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:20.479846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:20.480472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.480748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.481047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] PATH_INFO: `/v3/users/3eb8c143cc1148df9a6628cb5347b442` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.482215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb8c143cc1148df9a6628cb5347b442)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:20.483233 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:10:20.483233 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:10:20.483233 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:10:20.484435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:20.503742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d24d0-d866-4ffd-b44d-3c5eac54a744 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:20.507521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae37cd7-6479-40d3-822b-e305fb84ffdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:20.508117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37cd7-6479-40d3-822b-e305fb84ffdf service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.508389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37cd7-6479-40d3-822b-e305fb84ffdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.508656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37cd7-6479-40d3-822b-e305fb84ffdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.518171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae37cd7-6479-40d3-822b-e305fb84ffdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:20.519758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae37cd7-6479-40d3-822b-e305fb84ffdf service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:20.535875 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 680/1365] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:10:20.587835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.588118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.588390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.589728 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 681/1366] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:10:20.594648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:20.598246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.689657 n-d-master-1 devstack@keystone.service[81936]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 23 01:10:20.689657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:20.700246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7184b-9fab-4edf-bdb5-c966515e7a87 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:20.714944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9805193-114e-4eba-a521-e07a09a69a79 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41bbdf429a464a5bbaf79131085193cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c73949b77f4bc1a11502d092ace444', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:20.728447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9805193-114e-4eba-a521-e07a09a69a79 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.728447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9805193-114e-4eba-a521-e07a09a69a79 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.728447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9805193-114e-4eba-a521-e07a09a69a79 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] PATH_INFO: `/v3/projects/cb2839bbedf643289a251019d9e79fc8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.728447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9805193-114e-4eba-a521-e07a09a69a79 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb2839bbedf643289a251019d9e79fc8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:20.728915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9805193-114e-4eba-a521-e07a09a69a79 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:20.728997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb8c143cc1148df9a6628cb5347b442'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.729887 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 682/1367] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:20 2022] GET /identity/v3/projects/cb2839bbedf643289a251019d9e79fc8 => generated 395 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:10:20.737596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1804b9f-a066-4d01-ac1c-91912be5d17e None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.737963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1804b9f-a066-4d01-ac1c-91912be5d17e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.738332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1804b9f-a066-4d01-ac1c-91912be5d17e None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.740174 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 683/1368] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:10:20.746291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57883-4739-472d-bdc5-ec74b45f912e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.746699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57883-4739-472d-bdc5-ec74b45f912e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.747003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57883-4739-472d-bdc5-ec74b45f912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.753821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb8c143cc1148df9a6628cb5347b442'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.754645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb8c143cc1148df9a6628cb5347b442'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.772882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e2e57883-4739-472d-bdc5-ec74b45f912e None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:20.774237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e2e57883-4739-472d-bdc5-ec74b45f912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.845482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb8c143cc1148df9a6628cb5347b442'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.847251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb8c143cc1148df9a6628cb5347b442'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:20.856013 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 684/1369] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:10:20.878020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 686/1370] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:20 2022] DELETE /identity/v3/users/3eb8c143cc1148df9a6628cb5347b442 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:10:20.881040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301df08e-4220-43fe-aa11-56959c07b5b7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.881443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301df08e-4220-43fe-aa11-56959c07b5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.881839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301df08e-4220-43fe-aa11-56959c07b5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.883845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:20.885226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.903074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-301df08e-4220-43fe-aa11-56959c07b5b7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:20.904266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-301df08e-4220-43fe-aa11-56959c07b5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.964127 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:20.966358 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:20.975127 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 685/1371] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:20.976495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.976775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.977045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:20.978528 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 686/1372] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:20.983577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:20.985436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:20.989595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8539255-3a33-4ff3-a4ca-595fd83e49d9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:20.995527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:20.996317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:20.996707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:20.996904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:21.006376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:21.007969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:21.020030 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 687/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:10:21.020173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:21.022533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:21.085319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:21.086745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:21.087410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8c821-db28-49ef-a513-9b78437bedcf service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:21.092143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:21.092944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:21.093216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:21.093616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:21.104802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:21.106950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:21.119025 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 688/1374] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:21.120069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:21.121423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:21.134553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b549dbe-8f6d-4b4c-adfc-430e012c004c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:21.139480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:21.140105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:21.140378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:21.140732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] PATH_INFO: `/v3/projects/51e1c27b1f074880bb475777fc589530` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:21.141753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e1c27b1f074880bb475777fc589530)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:21.143769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:21.164567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86b4d7-48ae-4843-96b1-e016dc32c70b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:21.170299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41bbdf429a464a5bbaf79131085193cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c73949b77f4bc1a11502d092ace444', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:21.171665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:21.171665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:21.171858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] PATH_INFO: `/v3/projects/cb2839bbedf643289a251019d9e79fc8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:21.173615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb2839bbedf643289a251019d9e79fc8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:21.177034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:21.178957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 687/1375] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:20 2022] GET /identity/v3/projects/cb2839bbedf643289a251019d9e79fc8 => generated 395 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:10:21.299866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e1c27b1f074880bb475777fc589530', 'request_id': 'req-49b1d506-f561-4811-b0e6-a6788f1fc0e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.305302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e1c27b1f074880bb475777fc589530', 'request_id': 'req-49b1d506-f561-4811-b0e6-a6788f1fc0e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.418403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e1c27b1f074880bb475777fc589530', 'request_id': 'req-49b1d506-f561-4811-b0e6-a6788f1fc0e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.433138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] The token cache is being invalidate because project 51e1c27b1f074880bb475777fc589530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:21.433423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.434148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.436061 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 689/1376] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:21 2022] DELETE /identity/v3/projects/51e1c27b1f074880bb475777fc589530 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:21.439934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:21.442204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:21.457685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ac8b7-8601-4abb-991a-cf11dc05a830 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:21.543088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:21.544333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:21.544689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:21.545014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] PATH_INFO: `/v3/users/de9126512e1c4dcca2855787f86b3b41` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:21.548448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9126512e1c4dcca2855787f86b3b41)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:21.557024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:21.718294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:21.719717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:21.733289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d506-f561-4811-b0e6-a6788f1fc0e7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:21.738087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:21.742632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:21.742632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:21.742632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] PATH_INFO: `/v3/projects/214eb4a11eec4d52a4270b378f9ec933` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:21.742632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214eb4a11eec4d52a4270b378f9ec933)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:21.742632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:21.769649 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:21.775990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9126512e1c4dcca2855787f86b3b41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.782961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9126512e1c4dcca2855787f86b3b41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.784212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9126512e1c4dcca2855787f86b3b41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.869525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9126512e1c4dcca2855787f86b3b41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.870815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9126512e1c4dcca2855787f86b3b41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.880340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214eb4a11eec4d52a4270b378f9ec933', 'request_id': 'req-d3a36e72-855b-453e-9560-874c1d3fb275'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.887822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214eb4a11eec4d52a4270b378f9ec933', 'request_id': 'req-d3a36e72-855b-453e-9560-874c1d3fb275'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.890665 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 688/1377] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:21 2022] DELETE /identity/v3/users/de9126512e1c4dcca2855787f86b3b41 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:21.891499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:21.895857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:21.972700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214eb4a11eec4d52a4270b378f9ec933', 'request_id': 'req-d3a36e72-855b-453e-9560-874c1d3fb275'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.974304 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:21.978720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e5206-ac2e-4b10-b828-a1afbf8d270a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:21.984983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:21.985701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:21.985875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:21.986181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:21.988166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:21.989130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] The token cache is being invalidate because project 214eb4a11eec4d52a4270b378f9ec933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:21.989630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.990663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:21.992869 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 690/1378] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:21 2022] DELETE /identity/v3/projects/214eb4a11eec4d52a4270b378f9ec933 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:21.993913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:21.996113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:22.054853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:22.056341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:22.061256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36e72-855b-453e-9560-874c1d3fb275 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:22.068020 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 689/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:22.068856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:22.070206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:22.162497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:22.163384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:22.163760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:22.164101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] PATH_INFO: `/v3/users/c6cb75369f08458687ef9be6a9df7806` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:22.165929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cb75369f08458687ef9be6a9df7806)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:22.168386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:22.183672 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:22.196451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30599dc0-b46d-4bee-ab7e-0010b1ae0594 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:22.201695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:22.202625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:22.202946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:22.207028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] PATH_INFO: `/v3/users/124c3118edc24087b301e83fa9a71087` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:22.207028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=124c3118edc24087b301e83fa9a71087)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:22.208136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:22.429679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124c3118edc24087b301e83fa9a71087'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.430261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cb75369f08458687ef9be6a9df7806'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.438835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124c3118edc24087b301e83fa9a71087'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.442170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124c3118edc24087b301e83fa9a71087'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.456042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cb75369f08458687ef9be6a9df7806'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.456800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cb75369f08458687ef9be6a9df7806'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.575991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124c3118edc24087b301e83fa9a71087'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.576902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124c3118edc24087b301e83fa9a71087'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.608419 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 690/1380] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:22 2022] DELETE /identity/v3/users/124c3118edc24087b301e83fa9a71087 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:22.610240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:22.614904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:22.672909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cb75369f08458687ef9be6a9df7806'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.673849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cb75369f08458687ef9be6a9df7806'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.703959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57283f35-da80-4050-887b-1468021f0581 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:22.709108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:22.709880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:22.710194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:22.710470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] PATH_INFO: `/v3/users/49264f1d1b5d40269c7a6853c702917f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:22.711794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49264f1d1b5d40269c7a6853c702917f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:22.712969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 691/1381] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:21 2022] DELETE /identity/v3/users/c6cb75369f08458687ef9be6a9df7806 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:22.713725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:22.714391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:22.716293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:22.747195 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:22.789358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788ffc4-3c4b-4ec7-80fa-d93437f21c9b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:22.794235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:22.794860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:22.795141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:22.795408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] PATH_INFO: `/v3/projects/8e8e761ba5b54075aae863301ebd01ba` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:22.796510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8e761ba5b54075aae863301ebd01ba)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:22.798472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:22.996537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49264f1d1b5d40269c7a6853c702917f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:22.997778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8e761ba5b54075aae863301ebd01ba', 'request_id': 'req-f6f9612c-794b-493f-8a21-066f95e39a43'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.004931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49264f1d1b5d40269c7a6853c702917f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.005050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8e761ba5b54075aae863301ebd01ba', 'request_id': 'req-f6f9612c-794b-493f-8a21-066f95e39a43'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.006157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49264f1d1b5d40269c7a6853c702917f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.121113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49264f1d1b5d40269c7a6853c702917f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.121682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49264f1d1b5d40269c7a6853c702917f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.139320 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 691/1382] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:22 2022] DELETE /identity/v3/users/49264f1d1b5d40269c7a6853c702917f => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:23.140159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:23.141501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.150529 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:23.184672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8e761ba5b54075aae863301ebd01ba', 'request_id': 'req-f6f9612c-794b-493f-8a21-066f95e39a43'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.198812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] The token cache is being invalidate because project 8e8e761ba5b54075aae863301ebd01ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:23.199210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.200022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6f9612c-794b-493f-8a21-066f95e39a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.204467 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 692/1383] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:22 2022] DELETE /identity/v3/projects/8e8e761ba5b54075aae863301ebd01ba => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:23.206616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7cfd-f6b8-402e-9742-e9f2d0536d9f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.206616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7cfd-f6b8-402e-9742-e9f2d0536d9f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.206877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7cfd-f6b8-402e-9742-e9f2d0536d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.229201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-354a7cfd-f6b8-402e-9742-e9f2d0536d9f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:23.230979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-354a7cfd-f6b8-402e-9742-e9f2d0536d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.244212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3a58-fa27-4bc4-b9e4-8c2c0a4a6291 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:23.250015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:23.250789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.251064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.251335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.253779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.295039 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 693/1384] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:23.296323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.296609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.296889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.313787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:23.315546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:23.317065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:23.318295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.324973 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 692/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:23.325702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:23.325815 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 694/1386] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:23.326646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:23.327894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.328321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.342063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00f913-d87a-40f0-b89d-3e61dc6b010b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:23.344098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca1a12-7248-4cd2-915f-6a26732754e3 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:23.349620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:23.350411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.350831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.351281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] PATH_INFO: `/v3/users/5aeca2b9f4c443a388c4b89b512f7b29` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.352608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aeca2b9f4c443a388c4b89b512f7b29)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:23.352822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:23.353515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.353798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.354104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] PATH_INFO: `/v3/projects/4b32bb8e48604b8191d283f22bcccfdf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.354807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:23.355233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b32bb8e48604b8191d283f22bcccfdf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:23.356239 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:10:23.356239 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:10:23.356239 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:10:23.357926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:23.525560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b32bb8e48604b8191d283f22bcccfdf', 'request_id': 'req-cea7c012-06aa-472a-855f-3e203f7c0356'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.535128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b32bb8e48604b8191d283f22bcccfdf', 'request_id': 'req-cea7c012-06aa-472a-855f-3e203f7c0356'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.598796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b32bb8e48604b8191d283f22bcccfdf', 'request_id': 'req-cea7c012-06aa-472a-855f-3e203f7c0356'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.617598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] The token cache is being invalidate because project 4b32bb8e48604b8191d283f22bcccfdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:23.617894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.618573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cea7c012-06aa-472a-855f-3e203f7c0356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.620115 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 693/1387] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:23 2022] DELETE /identity/v3/projects/4b32bb8e48604b8191d283f22bcccfdf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:23.621472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.621751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.622080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.641130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:23.642318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.671286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aeca2b9f4c443a388c4b89b512f7b29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.678280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aeca2b9f4c443a388c4b89b512f7b29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.678953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aeca2b9f4c443a388c4b89b512f7b29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.719624 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 694/1388] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:23.720723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:23.722954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.777521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fe3d4-fd58-4df2-b637-55f4fd0405e3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:23.781123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed641d3b-3d33-406a-9358-c3de3d7822c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:23.781718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed641d3b-3d33-406a-9358-c3de3d7822c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.782100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed641d3b-3d33-406a-9358-c3de3d7822c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.782394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed641d3b-3d33-406a-9358-c3de3d7822c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.783990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aeca2b9f4c443a388c4b89b512f7b29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.784120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ed641d3b-3d33-406a-9358-c3de3d7822c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.784676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aeca2b9f4c443a388c4b89b512f7b29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:23.799420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed641d3b-3d33-406a-9358-c3de3d7822c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:23.802278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed641d3b-3d33-406a-9358-c3de3d7822c7 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:23.806793 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 695/1389] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:23 2022] DELETE /identity/v3/users/5aeca2b9f4c443a388c4b89b512f7b29 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:23.807932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:23.809302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.816076 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 695/1390] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:23.817169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2efb80-efe3-432c-b1ad-ad3c4a5f1ae6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.817452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2efb80-efe3-432c-b1ad-ad3c4a5f1ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.817724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2efb80-efe3-432c-b1ad-ad3c4a5f1ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.839956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ee2efb80-efe3-432c-b1ad-ad3c4a5f1ae6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:23.841111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee2efb80-efe3-432c-b1ad-ad3c4a5f1ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.892582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc064-b75b-41a1-98d5-a470d48a16dc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:23.897824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d67fc-fe2b-4bd0-a204-7c94d4e5755c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:23.902296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d67fc-fe2b-4bd0-a204-7c94d4e5755c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.902296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d67fc-fe2b-4bd0-a204-7c94d4e5755c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.902296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d67fc-fe2b-4bd0-a204-7c94d4e5755c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.902611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-598d67fc-fe2b-4bd0-a204-7c94d4e5755c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.910002 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 696/1391] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:23.911191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa680e2-4053-4ef3-a868-df97d7a63cd1 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.911576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa680e2-4053-4ef3-a868-df97d7a63cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.911948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa680e2-4053-4ef3-a868-df97d7a63cd1 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.913311 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 697/1392] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:23.918915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdbd9-ee21-4eb4-8d0e-60d6cf5fc1d0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.919893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdbd9-ee21-4eb4-8d0e-60d6cf5fc1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.920002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d67fc-fe2b-4bd0-a204-7c94d4e5755c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:23.920087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdbd9-ee21-4eb4-8d0e-60d6cf5fc1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.920787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d67fc-fe2b-4bd0-a204-7c94d4e5755c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:23.931725 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 696/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:23.933043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.933334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.933605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.940977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4ccbdbd9-ee21-4eb4-8d0e-60d6cf5fc1d0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:23.942016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ccbdbd9-ee21-4eb4-8d0e-60d6cf5fc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.949991 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 698/1394] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:23.954299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12509de2-f9cc-46d0-ba32-4b9e9f04867e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:23.954584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12509de2-f9cc-46d0-ba32-4b9e9f04867e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:23.954859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12509de2-f9cc-46d0-ba32-4b9e9f04867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:23.955271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:23.956929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.958789 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:23.968533 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 697/1395] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:23.969582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:23.971245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.979538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-12509de2-f9cc-46d0-ba32-4b9e9f04867e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:23.981130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-12509de2-f9cc-46d0-ba32-4b9e9f04867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:23.992850 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 699/1396] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:23.993750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12509de2-f9cc-46d0-ba32-4b9e9f04867e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.004497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12509de2-f9cc-46d0-ba32-4b9e9f04867e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.010378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.011296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.011734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.012185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.013123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:24.013436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.015064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.027937 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 700/1397] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:24.032961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.032961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:24.047209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85e171-4ef7-40ad-a002-ee694b750cc5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.052732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.053353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.053679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.063569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.067191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.068633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.078871 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 701/1398] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:24.083526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.088335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.089590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:24.097238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20213-f6cb-40a5-a9f4-8457a8743c81 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.102850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09aa228-a668-4d2e-ab99-6c6572d6dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.103468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa228-a668-4d2e-ab99-6c6572d6dd32 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.103740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa228-a668-4d2e-ab99-6c6572d6dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.104347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa228-a668-4d2e-ab99-6c6572d6dd32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.105676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09aa228-a668-4d2e-ab99-6c6572d6dd32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:24.106178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09aa228-a668-4d2e-ab99-6c6572d6dd32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.108729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09aa228-a668-4d2e-ab99-6c6572d6dd32 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.113767 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:24.124043 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 702/1399] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:24.125510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166141fb-2825-4b91-bf19-b700cc51c725 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.125794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166141fb-2825-4b91-bf19-b700cc51c725 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.126104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166141fb-2825-4b91-bf19-b700cc51c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.156205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-166141fb-2825-4b91-bf19-b700cc51c725 None None] MFA Rules not processed for user `d61093911783470a94d53354c15df815`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:24.157427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-166141fb-2825-4b91-bf19-b700cc51c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:24.208999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ecb7-37c6-45a1-a628-a24a379048e9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.214743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41bbdf429a464a5bbaf79131085193cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c73949b77f4bc1a11502d092ace444', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.215389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.215727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.219141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] PATH_INFO: `/v3/projects/cb2839bbedf643289a251019d9e79fc8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.219141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb2839bbedf643289a251019d9e79fc8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.221305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.223270 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 698/1400] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:23 2022] GET /identity/v3/projects/cb2839bbedf643289a251019d9e79fc8 => generated 395 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:24.227537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.242292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0087e-64af-43f4-9a90-4697b7e4e586 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.245013 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 703/1401] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:24.245809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166141fb-2825-4b91-bf19-b700cc51c725 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.249939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.250598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.250871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.251370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.252005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.254632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.257813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166141fb-2825-4b91-bf19-b700cc51c725 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.263142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.263813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.264101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.264369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.265003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.267426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.387956 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 704/1402] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:24 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:24.389019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.390985 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 699/1403] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:24 2022] POST /identity/v3/projects => generated 401 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:24.391855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.392680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:24.495417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01b180-0b00-46e7-b463-5c4e617457bb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.500455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.501043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.501508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.501611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.502381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.504252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.523036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3c20-0a58-4fdf-aaf0-20db873621f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.605507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.606352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.606645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.606910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.609550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:24.655421 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 700/1404] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:24 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:24.659651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.666852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3fa15-f440-434c-91f1-83b32a7f46f8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.671803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.672409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.672689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.672958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.673579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.675539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.676735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.678344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.687297 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 705/1405] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:24.688140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.689445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:24.702345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84c7f-a45c-4521-b06c-121dfeff81bc service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.707575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.708198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.708483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.708739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] PATH_INFO: `/v3/projects/14bdf2810cec419483881665e90d785b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.709855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bdf2810cec419483881665e90d785b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.711822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.729666 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:24.763976 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 701/1406] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:24 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:24.764920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.766561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:24.778847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b086-de97-462c-97a7-362cbd71392d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:24.784607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:24.785244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.785549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.785825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] PATH_INFO: `/v3/projects/b095d4940ef84515aaa3c6e0e4a07538` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.786978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b095d4940ef84515aaa3c6e0e4a07538)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:24.788853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:24.852358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bdf2810cec419483881665e90d785b', 'request_id': 'req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:24.857594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bdf2810cec419483881665e90d785b', 'request_id': 'req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:24.935201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b095d4940ef84515aaa3c6e0e4a07538', 'request_id': 'req-95f57e3d-7f5b-484d-8b94-68d46048b289'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:24.940463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b095d4940ef84515aaa3c6e0e4a07538', 'request_id': 'req-95f57e3d-7f5b-484d-8b94-68d46048b289'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:24.943848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bdf2810cec419483881665e90d785b', 'request_id': 'req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:24.946275 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:24.957292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] The token cache is being invalidate because project 14bdf2810cec419483881665e90d785b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:24.957574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:24.958238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de023516-5fa0-40d3-bbcf-56b4cb1c8b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:24.959737 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 706/1407] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:24 2022] DELETE /identity/v3/projects/14bdf2810cec419483881665e90d785b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:24.960918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca699ad-9833-4d02-93de-85b9626bcf58 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:24.961198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca699ad-9833-4d02-93de-85b9626bcf58 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:24.961470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca699ad-9833-4d02-93de-85b9626bcf58 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:24.962729 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 707/1408] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:24.963414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca699ad-9833-4d02-93de-85b9626bcf58 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:24.964967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bca699ad-9833-4d02-93de-85b9626bcf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.028544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca699ad-9833-4d02-93de-85b9626bcf58 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.032990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.034244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.034515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.034783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] PATH_INFO: `/v3/projects/f56ec537f7f240a3b0ee057dadc6fbff` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.035887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56ec537f7f240a3b0ee057dadc6fbff)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.037771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.046617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b095d4940ef84515aaa3c6e0e4a07538', 'request_id': 'req-95f57e3d-7f5b-484d-8b94-68d46048b289'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.058959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] The token cache is being invalidate because project b095d4940ef84515aaa3c6e0e4a07538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:25.059245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.059918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.061409 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 702/1409] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:24 2022] DELETE /identity/v3/projects/b095d4940ef84515aaa3c6e0e4a07538 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:25.062200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.063465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.076132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f57e3d-7f5b-484d-8b94-68d46048b289 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.081273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12505c0-45c8-4e97-91f1-eeff5bc6d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.081855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12505c0-45c8-4e97-91f1-eeff5bc6d7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.082170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12505c0-45c8-4e97-91f1-eeff5bc6d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.082435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12505c0-45c8-4e97-91f1-eeff5bc6d7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.083061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12505c0-45c8-4e97-91f1-eeff5bc6d7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.084629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12505c0-45c8-4e97-91f1-eeff5bc6d7d0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.094175 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 703/1410] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:25.095303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ec67-053b-4aee-ae3e-352550dd2140 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.095585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ec67-053b-4aee-ae3e-352550dd2140 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.095888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ec67-053b-4aee-ae3e-352550dd2140 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.097088 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 704/1411] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:25.097779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ec67-053b-4aee-ae3e-352550dd2140 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.099373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a0c2ec67-053b-4aee-ae3e-352550dd2140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.113995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ec67-053b-4aee-ae3e-352550dd2140 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.118468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.119465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.119465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.119680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.120136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.121668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.131667 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 705/1412] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:25.132408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.133905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.146427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b1c19-dd8d-4181-8061-6132cc2ec398 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.150844 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:25.157650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56ec537f7f240a3b0ee057dadc6fbff', 'request_id': 'req-a3942283-dffa-4e4e-8cd5-6c0989a46601'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.163144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56ec537f7f240a3b0ee057dadc6fbff', 'request_id': 'req-a3942283-dffa-4e4e-8cd5-6c0989a46601'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.200110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.200694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.200976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.201252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] PATH_INFO: `/v3/users/9f53014630f6452b9393281621f9be06` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.202515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f53014630f6452b9393281621f9be06)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.204471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.254720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56ec537f7f240a3b0ee057dadc6fbff', 'request_id': 'req-a3942283-dffa-4e4e-8cd5-6c0989a46601'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.266091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] The token cache is being invalidate because project f56ec537f7f240a3b0ee057dadc6fbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:25.266381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.267033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.269125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 708/1413] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:24 2022] DELETE /identity/v3/projects/f56ec537f7f240a3b0ee057dadc6fbff => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:25.269889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:25.271181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.341121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.342382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.403728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942283-dffa-4e4e-8cd5-6c0989a46601 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.408344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41bbdf429a464a5bbaf79131085193cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c73949b77f4bc1a11502d092ace444', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.408977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.409253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.409528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] PATH_INFO: `/v3/projects/cb2839bbedf643289a251019d9e79fc8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.410613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb2839bbedf643289a251019d9e79fc8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.412695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.414417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 709/1414] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:25 2022] GET /identity/v3/projects/cb2839bbedf643289a251019d9e79fc8 => generated 395 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:25.415166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.416668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.430308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55409609-3b36-40fb-a22e-0615df0ae5e8 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.434772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.438567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.438567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.438567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] PATH_INFO: `/v3/users/f0a177c2d5b747fa889814116e3050df` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.438567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a177c2d5b747fa889814116e3050df)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.438880 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:25.438969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.439658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f53014630f6452b9393281621f9be06'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.447247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f53014630f6452b9393281621f9be06'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.447924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f53014630f6452b9393281621f9be06'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.514844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f53014630f6452b9393281621f9be06'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.515525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f53014630f6452b9393281621f9be06'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.515793 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:25.533081 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 706/1415] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:25 2022] DELETE /identity/v3/users/9f53014630f6452b9393281621f9be06 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:25.533909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.535242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.607597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b482cb3-80e6-45b1-82ce-62dc002727ca admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.612917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403a314-4be0-4215-9e5e-372e22a9cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.613531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a314-4be0-4215-9e5e-372e22a9cfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.613809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a314-4be0-4215-9e5e-372e22a9cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.614105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a314-4be0-4215-9e5e-372e22a9cfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.618454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403a314-4be0-4215-9e5e-372e22a9cfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.618454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403a314-4be0-4215-9e5e-372e22a9cfd7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.626220 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 707/1416] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:25.627981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.628263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.628537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.649190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:25.650437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.653382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a177c2d5b747fa889814116e3050df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.660295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a177c2d5b747fa889814116e3050df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.661063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a177c2d5b747fa889814116e3050df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.734235 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 708/1417] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:25.735139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.737092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.750663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4500eca-f563-481d-8e07-41b7d94118f3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.755796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.756405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.756677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.756962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.757579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.759200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.763758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a177c2d5b747fa889814116e3050df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.764588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a177c2d5b747fa889814116e3050df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:25.771509 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 709/1418] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:25.772267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.776314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.787851 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 710/1419] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:25 2022] DELETE /identity/v3/users/f0a177c2d5b747fa889814116e3050df => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:25.788857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:25.790356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:25.804994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c5d9b-b768-412f-a6c7-873d985d6241 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.891775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934279a-ac90-49be-9573-962051079825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.892153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934279a-ac90-49be-9573-962051079825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.892434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934279a-ac90-49be-9573-962051079825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.892797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934279a-ac90-49be-9573-962051079825 admin admin] PATH_INFO: `/v3/users/baa70e1d28a64fe0b9be83556083e594` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.894624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934279a-ac90-49be-9573-962051079825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa70e1d28a64fe0b9be83556083e594)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.896679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934279a-ac90-49be-9573-962051079825 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:25.906294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9e74-63bc-494f-a1c0-6ff2e64495d3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:25.913887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:25.915493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:25.916569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:25.916917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] PATH_INFO: `/v3/projects/daea0e5a728e484cac24474948c48425/users/4ae9e93870ce4247824e989c6ab7daa3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:25.930235 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:25.935093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daea0e5a728e484cac24474948c48425, user_id=4ae9e93870ce4247824e989c6ab7daa3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:25.937734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:26.039211 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 711/1420] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:25 2022] PUT /identity/v3/projects/daea0e5a728e484cac24474948c48425/users/4ae9e93870ce4247824e989c6ab7daa3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:26.039211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:26.040719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.096055 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:26.126582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d5d1d-9b13-4e56-a5af-f2b2d3a2a830 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:26.131271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:26.131889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.132170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.132647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.134295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2934279a-ac90-49be-9573-962051079825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa70e1d28a64fe0b9be83556083e594'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.134547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.141635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2934279a-ac90-49be-9573-962051079825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa70e1d28a64fe0b9be83556083e594'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.146093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2934279a-ac90-49be-9573-962051079825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa70e1d28a64fe0b9be83556083e594'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.200800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2934279a-ac90-49be-9573-962051079825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa70e1d28a64fe0b9be83556083e594'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.201444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2934279a-ac90-49be-9573-962051079825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa70e1d28a64fe0b9be83556083e594'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.206791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:26.208307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:26.219076 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 712/1421] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:26.219833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:26.220224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 710/1422] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:25 2022] DELETE /identity/v3/users/baa70e1d28a64fe0b9be83556083e594 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:26.221779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68e02a-7dfc-4916-8fd1-de8aa4a3c327 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.222139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.222270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68e02a-7dfc-4916-8fd1-de8aa4a3c327 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.222594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68e02a-7dfc-4916-8fd1-de8aa4a3c327 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.224385 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 711/1423] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:26.225106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68e02a-7dfc-4916-8fd1-de8aa4a3c327 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:26.235208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd68e02a-7dfc-4916-8fd1-de8aa4a3c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.322084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68e02a-7dfc-4916-8fd1-de8aa4a3c327 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:26.328622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:26.328622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.328622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.328622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] PATH_INFO: `/v3/projects/a95bc00077144ab79343443ab76fcc24` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.329765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95bc00077144ab79343443ab76fcc24)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:26.332802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:26.355984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321158-badd-4d6d-80e2-c4c0549b5133 service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:26.362881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c42965-8425-477f-ae9b-f8df3a6a9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:26.363775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c42965-8425-477f-ae9b-f8df3a6a9014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.364154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c42965-8425-477f-ae9b-f8df3a6a9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.364613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c42965-8425-477f-ae9b-f8df3a6a9014 admin admin] PATH_INFO: `/v3/projects/08b8e89ba0a14188bac8e28b66b5a197/users/9e535f9274b24a9f800ea0c3d8faba5a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.382318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c42965-8425-477f-ae9b-f8df3a6a9014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b8e89ba0a14188bac8e28b66b5a197, user_id=9e535f9274b24a9f800ea0c3d8faba5a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:26.385081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c42965-8425-477f-ae9b-f8df3a6a9014 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:26.453515 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 713/1424] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:26 2022] PUT /identity/v3/projects/08b8e89ba0a14188bac8e28b66b5a197/users/9e535f9274b24a9f800ea0c3d8faba5a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:26.455033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.455317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.455594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.479327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95bc00077144ab79343443ab76fcc24', 'request_id': 'req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.494595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95bc00077144ab79343443ab76fcc24', 'request_id': 'req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.508731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] MFA Rules not processed for user `4ae9e93870ce4247824e989c6ab7daa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:26.509996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.572176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95bc00077144ab79343443ab76fcc24', 'request_id': 'req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.582819 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 714/1425] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:26.584112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:26.586295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.587374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] The token cache is being invalidate because project a95bc00077144ab79343443ab76fcc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:26.588907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.589609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.595587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 712/1426] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:26 2022] DELETE /identity/v3/projects/a95bc00077144ab79343443ab76fcc24 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:26.597030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:26.599041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.676863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8526ae-ec3e-463f-a89e-239cb5f9a1d1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:26.682611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:26.683076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:26.683257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.683531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.683804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] PATH_INFO: `/v3/projects/9dec106b1fee4cbaaf8052b1374d8192` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.683925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.684936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dec106b1fee4cbaaf8052b1374d8192)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:26.687008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:26.747109 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:26.766576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1a52-49f9-4a7a-80c4-ec29b5eb3e94 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:26.771820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f5cf-0870-44a8-9b0d-9bc534994461 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41bbdf429a464a5bbaf79131085193cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6c73949b77f4bc1a11502d092ace444', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:26.772456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f5cf-0870-44a8-9b0d-9bc534994461 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.772731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f5cf-0870-44a8-9b0d-9bc534994461 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.773004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f5cf-0870-44a8-9b0d-9bc534994461 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] PATH_INFO: `/v3/projects/54d7ef46716d4cc1b7d197d0049492ed` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.774171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f5cf-0870-44a8-9b0d-9bc534994461 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorizing `identity:get_project(project_id=54d7ef46716d4cc1b7d197d0049492ed)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:26.776194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f5cf-0870-44a8-9b0d-9bc534994461 tempest-FlavorsAccessNegativeTestJSON-299257373 tempest-FlavorsAccessNegativeTestJSON-299257373-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:26.777867 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 715/1427] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:26 2022] GET /identity/v3/projects/54d7ef46716d4cc1b7d197d0049492ed => generated 393 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:26.782695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.782977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.783870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.806019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:26.807398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.818124 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 716/1428] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:26.818124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:26.818124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.830061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37a3a2-bd03-4229-b5c0-05b2cb92241c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:26.830864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dec106b1fee4cbaaf8052b1374d8192', 'request_id': 'req-847134df-35fa-4ff2-8ff0-292a02ee5322'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.836953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dec106b1fee4cbaaf8052b1374d8192', 'request_id': 'req-847134df-35fa-4ff2-8ff0-292a02ee5322'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.891334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:26.892098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.893018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.893379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.894132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:26.896434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:26.935463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dec106b1fee4cbaaf8052b1374d8192', 'request_id': 'req-847134df-35fa-4ff2-8ff0-292a02ee5322'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.963795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] The token cache is being invalidate because project 9dec106b1fee4cbaaf8052b1374d8192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:26.964090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.968659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-847134df-35fa-4ff2-8ff0-292a02ee5322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:26.968659 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 713/1429] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:26 2022] DELETE /identity/v3/projects/9dec106b1fee4cbaaf8052b1374d8192 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:26.970084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:26.970368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:26.970640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:26.990600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:26.991823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:26.999577 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 714/1430] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.000336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.003441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.012336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 717/1431] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:26 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:27.022006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.022006 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:27.022006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.022310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aed381-ce4b-4446-9f00-40a49c3594dc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.074659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed5366-9d5f-4ac0-98ff-af03496e0a30 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.078814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.079422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.079702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.079971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.082362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.084211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.084910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.085189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.085457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] PATH_INFO: `/v3/projects/11a5e014ab4a4e428241d0c3d708d557` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.086589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a5e014ab4a4e428241d0c3d708d557)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.088537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.096455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.098053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.108004 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 718/1432] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:27.111090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.113447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.126575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8000-22ea-4656-be34-8a4da21a4c12 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.131482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.132111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.132386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.132845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] PATH_INFO: `/v3/users/c7b5ba38c66d4d4a88b22337e70e56df` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.134058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b5ba38c66d4d4a88b22337e70e56df)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.135927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.197811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a5e014ab4a4e428241d0c3d708d557', 'request_id': 'req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.203187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a5e014ab4a4e428241d0c3d708d557', 'request_id': 'req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.322038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a5e014ab4a4e428241d0c3d708d557', 'request_id': 'req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.334418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] The token cache is being invalidate because project 11a5e014ab4a4e428241d0c3d708d557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:27.334706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.335354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1c3b5c2d-696d-4428-b59f-5228aa6ffdce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.336846 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 715/1433] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:26 2022] DELETE /identity/v3/projects/11a5e014ab4a4e428241d0c3d708d557 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:27.340425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fd23-433d-44b5-8fda-4704e83a3372 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.340425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fd23-433d-44b5-8fda-4704e83a3372 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.340425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fd23-433d-44b5-8fda-4704e83a3372 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.340425 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 716/1434] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 23 01:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:27.340904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5248c9-95d6-4a43-8ca3-def5fbc2fd8b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.341181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5248c9-95d6-4a43-8ca3-def5fbc2fd8b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.341470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5248c9-95d6-4a43-8ca3-def5fbc2fd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.360767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8a5248c9-95d6-4a43-8ca3-def5fbc2fd8b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:27.360942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b5ba38c66d4d4a88b22337e70e56df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.362088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a5248c9-95d6-4a43-8ca3-def5fbc2fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.367771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b5ba38c66d4d4a88b22337e70e56df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.368439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b5ba38c66d4d4a88b22337e70e56df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.422905 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 717/1435] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.429848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bc2ce-ea72-42a9-be79-d61bc697d7ee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.429848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bc2ce-ea72-42a9-be79-d61bc697d7ee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.429848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bc2ce-ea72-42a9-be79-d61bc697d7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.444229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b5ba38c66d4d4a88b22337e70e56df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.444947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b5ba38c66d4d4a88b22337e70e56df'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:27.480635 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 719/1436] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:27 2022] DELETE /identity/v3/users/c7b5ba38c66d4d4a88b22337e70e56df => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:27.481964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.484886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.588758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67e6c-5791-4f1e-ad78-0cf6bad8b9ca admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.592260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b07bc2ce-ea72-42a9-be79-d61bc697d7ee None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:27.593482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b07bc2ce-ea72-42a9-be79-d61bc697d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.595551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e566-6b75-4cd1-917b-9a2a2dd22751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.596391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e566-6b75-4cd1-917b-9a2a2dd22751 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.597026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e566-6b75-4cd1-917b-9a2a2dd22751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.600128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e566-6b75-4cd1-917b-9a2a2dd22751 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.600128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e566-6b75-4cd1-917b-9a2a2dd22751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.601753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e566-6b75-4cd1-917b-9a2a2dd22751 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.603193 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 718/1437] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.604440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01969c-9071-4027-8253-f51fb9bd0d2f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.604786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01969c-9071-4027-8253-f51fb9bd0d2f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.605172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01969c-9071-4027-8253-f51fb9bd0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.628489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ca01969c-9071-4027-8253-f51fb9bd0d2f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:27.629687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ca01969c-9071-4027-8253-f51fb9bd0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.637579 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 719/1438] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.639591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788384-6333-495f-a95d-cc957733cb8a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.639959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788384-6333-495f-a95d-cc957733cb8a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.640358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788384-6333-495f-a95d-cc957733cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.661390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8f788384-6333-495f-a95d-cc957733cb8a None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:27.662600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8f788384-6333-495f-a95d-cc957733cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.730446 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 720/1439] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:27.731964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828e61c-37ab-468d-9723-a9cd808f9e61 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.732314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828e61c-37ab-468d-9723-a9cd808f9e61 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.732657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828e61c-37ab-468d-9723-a9cd808f9e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.736192 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 720/1440] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.738213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f74380-15e1-4b64-a00b-d6d56520cf86 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.738665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f74380-15e1-4b64-a00b-d6d56520cf86 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.738988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f74380-15e1-4b64-a00b-d6d56520cf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.758286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e828e61c-37ab-468d-9723-a9cd808f9e61 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:27.758286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e828e61c-37ab-468d-9723-a9cd808f9e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.759096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c0f74380-15e1-4b64-a00b-d6d56520cf86 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:27.760265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c0f74380-15e1-4b64-a00b-d6d56520cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.764495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 721/1441] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.765329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828e61c-37ab-468d-9723-a9cd808f9e61 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.768106 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 721/1442] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.769373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5a56-68b4-4cb8-8556-a09ca7563b42 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.769712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5a56-68b4-4cb8-8556-a09ca7563b42 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.770070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5a56-68b4-4cb8-8556-a09ca7563b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.775202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828e61c-37ab-468d-9723-a9cd808f9e61 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.779933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.780537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.786838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.786838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.786838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:27.786838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.786838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.795702 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 722/1443] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:27.796610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.797945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-77ed5a56-68b4-4cb8-8556-a09ca7563b42 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:27.802595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-77ed5a56-68b4-4cb8-8556-a09ca7563b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.809029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96dc8-ee0e-41a1-a400-72cf6f14006b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.811018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 722/1444] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:27.812098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5a56-68b4-4cb8-8556-a09ca7563b42 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.814011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.815384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.815477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.815697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.816334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.818090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.823874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5a56-68b4-4cb8-8556-a09ca7563b42 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.828254 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 723/1445] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:27.829074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.829187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.829673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.829948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.830298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.832561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.839183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ce4c-fd4e-4428-9ffa-0a3c78af5d44 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.843693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.844373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.844589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.844711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.850118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.850118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:27.850118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.850353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.850429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.856345 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 723/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:27.857222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.858694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:27.860812 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 724/1447] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:27.862326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.870414 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:27.875388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861dc0-f79e-4244-9940-5b5a46731611 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.882543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.883140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.883410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.883740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.884366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.886430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.931236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da4665-6854-4704-b499-de1092edd9b5 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.935826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:27.936594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:27.936849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:27.937138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:27.948209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:27.950571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:27.970368 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 724/1448] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:27.971205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.980776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b857-b220-4959-a533-410e13d9365b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:27.981600 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 725/1449] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:27 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:27.982819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:27.995507 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:28.060350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95fcf5-29c6-4ed4-aeba-f698187108ab admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.063198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.065178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.065516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.065861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.065969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.066565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.066949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:28.067056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.067243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] PATH_INFO: `/v3/projects/5f3fe18dbdf44d5a8ba0c862e7626ca9/users/dc4340274bfa4bd1a89bf4281a3a559f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.067437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.069530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.086497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3fe18dbdf44d5a8ba0c862e7626ca9, user_id=dc4340274bfa4bd1a89bf4281a3a559f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.091882 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 725/1450] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:28.091882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.092059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.106300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5db818-61e0-4a61-bd75-b6d68b374fd8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.111353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.111955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.122778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.122778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.122778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.122778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.167200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 726/1451] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:27 2022] PUT /identity/v3/projects/5f3fe18dbdf44d5a8ba0c862e7626ca9/users/dc4340274bfa4bd1a89bf4281a3a559f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:28.168333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.223484 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 726/1452] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:28 2022] POST /identity/v3/projects => generated 397 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:28.223484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.236944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005e5c1-344b-4eb9-92c5-0344b2cb19e0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.286070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f91e0-12b7-41c6-920f-d7c51ab6f0cb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.290469 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:28.290733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448bf36-fd29-4678-bf65-3d449cf06eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.291408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448bf36-fd29-4678-bf65-3d449cf06eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.291686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448bf36-fd29-4678-bf65-3d449cf06eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.291955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448bf36-fd29-4678-bf65-3d449cf06eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.292589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448bf36-fd29-4678-bf65-3d449cf06eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.294848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448bf36-fd29-4678-bf65-3d449cf06eb8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.311828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.312581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.313140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.313785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.317847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.320023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.393257 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 727/1453] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:28 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:28.393814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075e7e-7112-4ec7-8742-3d49b4a90185 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.396294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075e7e-7112-4ec7-8742-3d49b4a90185 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.396294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075e7e-7112-4ec7-8742-3d49b4a90185 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.396294 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 728/1454] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:28.396519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32075e7e-7112-4ec7-8742-3d49b4a90185 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.436603 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:28.443274 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 727/1455] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:28 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:28.443274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.452500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c072-ce19-41dc-8dfc-8b06b5307f2b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.494407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32075e7e-7112-4ec7-8742-3d49b4a90185 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.499075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.499835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.500111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.500379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.501087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.503272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.516664 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 729/1456] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:28.517601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.527328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfce2f-df54-454c-b853-6f340416db2e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.532066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d32639-3f4b-4c5e-b1c5-6c65fa230407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.532654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32639-3f4b-4c5e-b1c5-6c65fa230407 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.532930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32639-3f4b-4c5e-b1c5-6c65fa230407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.533254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32639-3f4b-4c5e-b1c5-6c65fa230407 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.533899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32639-3f4b-4c5e-b1c5-6c65fa230407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.535812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32639-3f4b-4c5e-b1c5-6c65fa230407 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.546688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.547321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.547671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.548059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.549597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.551318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.705717 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 730/1457] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:28 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:28.705717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.705717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.705717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.708636 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 728/1458] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:28 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:28.710098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.729895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:28.731233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:28.732380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a3e07-bf40-4f7b-9fb1-633e69976fbc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.744991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.746312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.747407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.747861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.748754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.750965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.784036 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 729/1459] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:28.785172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.797929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acfc00-f615-4e7b-843f-f53d493b9035 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.804906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.805896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.806386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.807208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] PATH_INFO: `/v3/projects/5f3fe18dbdf44d5a8ba0c862e7626ca9/users/dc4340274bfa4bd1a89bf4281a3a559f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.809392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3fe18dbdf44d5a8ba0c862e7626ca9, user_id=dc4340274bfa4bd1a89bf4281a3a559f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.812950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.824730 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 731/1460] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:28.825824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.827186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:28.840665 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 730/1461] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:28 2022] PUT /identity/v3/projects/5f3fe18dbdf44d5a8ba0c862e7626ca9/users/dc4340274bfa4bd1a89bf4281a3a559f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:28.842450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.846237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183d4b-1aa4-454e-8e5b-2b563756a9e0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.914869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.915617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.915958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.916295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] PATH_INFO: `/v3/projects/cb2839bbedf643289a251019d9e79fc8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.917889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2839bbedf643289a251019d9e79fc8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.921283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.936265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2ec68-984b-4698-b2ce-184f53e2d485 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.942786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.943738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.944199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.944649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.945575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.947461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.958798 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 731/1462] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:28.959717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:28.970249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aeb52-a1e7-424f-9979-e4258e8efaeb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:28.977095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:28.977716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:28.978021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:28.978298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:28.979082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:28.980636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:28.997734 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 732/1463] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:28.998716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.014245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a96952-346a-4915-a143-8b2506f5488a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.022585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.023396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.023706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.024165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.024984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.027463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.041355 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 733/1464] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:29.041355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.041355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.070473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2839bbedf643289a251019d9e79fc8', 'request_id': 'req-7052e0fe-a072-4c5f-b718-ee7420965566'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.076903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2839bbedf643289a251019d9e79fc8', 'request_id': 'req-7052e0fe-a072-4c5f-b718-ee7420965566'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.101160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09440-0216-4165-b730-22219d0ad06a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.151748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.152295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.152572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.152844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.161305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2839bbedf643289a251019d9e79fc8', 'request_id': 'req-7052e0fe-a072-4c5f-b718-ee7420965566'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.177351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] The token cache is being invalidate because project cb2839bbedf643289a251019d9e79fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:29.177726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.178516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7052e0fe-a072-4c5f-b718-ee7420965566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.180419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 732/1465] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:28 2022] DELETE /identity/v3/projects/cb2839bbedf643289a251019d9e79fc8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:29.181739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.182120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.182475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.231284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] MFA Rules not processed for user `dc4340274bfa4bd1a89bf4281a3a559f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:29.231614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.233778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.233852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.258007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 734/1466] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:29.258937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.354941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 733/1467] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:29.356714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d21fb-82f8-4748-ba7c-83787a83ccb4 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.357281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.358737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.362981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.363708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.365929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.365929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.365929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.367662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.374150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ce1c-b5c0-4dc1-8167-835f7184d4a4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.381042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.381674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.382078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.382282 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 735/1468] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:29.382415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.383002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.383897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.385394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.390810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.400720 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 734/1469] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:29.401551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.403316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.409785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268488-c8e6-4fd9-a136-26dbde5216e7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.414962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.418175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.418773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.419211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] PATH_INFO: `/v3/projects/2727465e0be64f539440a2f3c9149e7c/users/e51e213730e042b88069ad3f96222041/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.419532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b17ea-bcfa-47c1-9b1f-b11a89089911 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.430517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.431436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.432063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.432883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] PATH_INFO: `/v3/users/41bbdf429a464a5bbaf79131085193cb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.434546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bbdf429a464a5bbaf79131085193cb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.435420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2727465e0be64f539440a2f3c9149e7c, user_id=e51e213730e042b88069ad3f96222041, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.437087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.438261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.539883 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 736/1470] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:29 2022] PUT /identity/v3/projects/2727465e0be64f539440a2f3c9149e7c/users/e51e213730e042b88069ad3f96222041/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:29.541714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.628439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a006a47-5260-4e08-9dd5-c4036961af0f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.631158 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:29.636222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.636919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.639340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.639340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.639340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:29.639340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.640348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.653814 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 737/1471] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:29.654785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.658810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.701561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bbdf429a464a5bbaf79131085193cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.711080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bbdf429a464a5bbaf79131085193cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.712223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bbdf429a464a5bbaf79131085193cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.744225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0a665-b488-46d6-8ef6-9a1977a02c6e tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:29.751640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb55856-bcd9-4f68-8f94-7f7cde8dd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:29.752430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb55856-bcd9-4f68-8f94-7f7cde8dd89d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.752773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb55856-bcd9-4f68-8f94-7f7cde8dd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.753118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb55856-bcd9-4f68-8f94-7f7cde8dd89d admin admin] PATH_INFO: `/v3/projects/389fbaaeff374fe7b4c1dd488e28a73a/users/3f91cb1a0ea84b5a9298680b3f81df64/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.782897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb55856-bcd9-4f68-8f94-7f7cde8dd89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=389fbaaeff374fe7b4c1dd488e28a73a, user_id=3f91cb1a0ea84b5a9298680b3f81df64, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:29.789027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb55856-bcd9-4f68-8f94-7f7cde8dd89d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:29.798257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bbdf429a464a5bbaf79131085193cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.799477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bbdf429a464a5bbaf79131085193cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:29.824549 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:29.843616 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 735/1472] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:29 2022] DELETE /identity/v3/users/41bbdf429a464a5bbaf79131085193cb => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:29.844892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:29.851357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.889193 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 738/1473] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:29 2022] PUT /identity/v3/projects/389fbaaeff374fe7b4c1dd488e28a73a/users/3f91cb1a0ea84b5a9298680b3f81df64/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:29.891994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:29.892278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:29.897130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:29.960699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] MFA Rules not processed for user `e51e213730e042b88069ad3f96222041`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:29.961947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:29.982860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0b5c-6049-4642-836f-483757ddc179 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:30.050217 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 739/1474] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:30.050217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:30.050217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:30.068980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67a2ab-1fc6-47ac-a9dc-e1a751f09ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:30.071700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67a2ab-1fc6-47ac-a9dc-e1a751f09ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.073115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67a2ab-1fc6-47ac-a9dc-e1a751f09ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.073616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67a2ab-1fc6-47ac-a9dc-e1a751f09ecc admin admin] PATH_INFO: `/v3/projects/33ebeb5bd09a489f81c7534e43b1ca44/users/055e1e9d12f8451a913462903fd60551/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.096682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67a2ab-1fc6-47ac-a9dc-e1a751f09ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ebeb5bd09a489f81c7534e43b1ca44, user_id=055e1e9d12f8451a913462903fd60551, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:30.100176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67a2ab-1fc6-47ac-a9dc-e1a751f09ecc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:30.167735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bed0fb-e374-4429-8b5d-b6b390c5b8a2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:30.178740 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 736/1475] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:29 2022] PUT /identity/v3/projects/33ebeb5bd09a489f81c7534e43b1ca44/users/055e1e9d12f8451a913462903fd60551/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:30.180115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.180395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.180664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.226148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] MFA Rules not processed for user `3f91cb1a0ea84b5a9298680b3f81df64`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:30.228714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:30.262111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692d5cb-c3d7-4518-bcd1-70de2289a938 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:30.262737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d5cb-c3d7-4518-bcd1-70de2289a938 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.263050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d5cb-c3d7-4518-bcd1-70de2289a938 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.263324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d5cb-c3d7-4518-bcd1-70de2289a938 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.263955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692d5cb-c3d7-4518-bcd1-70de2289a938 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:30.265903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692d5cb-c3d7-4518-bcd1-70de2289a938 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:30.313049 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 737/1476] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:30.314856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:30.316145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:30.332504 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:30.400370 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 740/1477] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:30 2022] POST /identity/v3/projects => generated 371 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:30.402571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.403246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.404361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.436853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22c849-f87a-4f10-a65c-332310ddacfb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:30.481502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] MFA Rules not processed for user `055e1e9d12f8451a913462903fd60551`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:30.484802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:30.572620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:30.573262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.573537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.573805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.576470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:30.579559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:30.639574 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 741/1478] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:30.640584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:30.646266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:30.676372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878d395-470c-4ae4-91ab-24196eb94a18 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:30.699425 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 738/1479] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:30 2022] POST /identity/v3/projects => generated 375 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:30.700415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:30.703442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:30.703867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:30.704082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.704361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.704695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.705388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:30.707546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:30.799910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f92d8-c98a-40d0-9443-a2c62eee71f2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:30.811362 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 742/1480] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:30 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:30.812275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:30.818330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:30.819006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.819339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.819607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] PATH_INFO: `/v3/projects/f6c73949b77f4bc1a11502d092ace444` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.821603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c73949b77f4bc1a11502d092ace444)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:30.828085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:30.890677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b449c-c241-4bf5-ba8c-86e8cc3e0d4d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:30.896253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:30.896867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:30.897142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:30.897413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:30.898146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:30.898448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:30.900193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:30.913511 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 743/1481] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:30.914353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:30.973564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c73949b77f4bc1a11502d092ace444', 'request_id': 'req-0ac900db-f13a-4350-96a1-c6bdca53565f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:30.983612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c73949b77f4bc1a11502d092ace444', 'request_id': 'req-0ac900db-f13a-4350-96a1-c6bdca53565f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.000023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac401c-a716-4a03-9cd0-32c871149ace tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:31.026586 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:31.070755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:31.071433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.071807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.072290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.073015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:31.075037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:31.078455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c73949b77f4bc1a11502d092ace444', 'request_id': 'req-0ac900db-f13a-4350-96a1-c6bdca53565f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.092066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] The token cache is being invalidate because project f6c73949b77f4bc1a11502d092ace444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:31.092405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.093100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.094775 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 739/1482] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:30 2022] DELETE /identity/v3/projects/f6c73949b77f4bc1a11502d092ace444 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:31.095724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.097048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:31.110140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac900db-f13a-4350-96a1-c6bdca53565f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:31.115326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:31.116198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.116571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.116916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.117623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:31.119661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:31.168919 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 744/1483] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:30 2022] POST /identity/v3/projects => generated 397 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:31.169512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.171181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:31.243080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1ead6-27a2-4d5b-9805-08f60a1f9057 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:31.264233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:31.264233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.264233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.264233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.264702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:31.264702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:31.264844 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 740/1484] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:31 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:31.265862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.269385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:31.381662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f44e6-e656-4004-934e-f3ece3b944a5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:31.387702 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:31.388693 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 745/1485] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:31 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:31.392380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.399001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:31.434644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93909000-f0dd-4b30-b9a6-488d5ecc2a87 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:31.452956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:31.453622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.454481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.454999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] PATH_INFO: `/v3/users/17dcc33fe9414711a3692416ae9aa058` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.460394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=17dcc33fe9414711a3692416ae9aa058)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:31.462381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:31.540360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:31.542152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.542703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.543200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.545624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:31.622380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:31.625001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:31.661892 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 741/1486] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:31.663021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.664484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:31.680555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeefa3-f103-43c2-92b6-501a45220337 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:31.685901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:31.686550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.686828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.687098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.687760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:31.690367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:31.713337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17dcc33fe9414711a3692416ae9aa058'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.721516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17dcc33fe9414711a3692416ae9aa058'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.722322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17dcc33fe9414711a3692416ae9aa058'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.810285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 742/1487] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:31 2022] POST /identity/v3/users => generated 305 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:31.811170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.829013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17dcc33fe9414711a3692416ae9aa058'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.829902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17dcc33fe9414711a3692416ae9aa058'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:31.843325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d16988-9d8a-4730-b2e6-dd422196c8e3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:31.859531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c93d-a1ba-4752-ad0d-45818775b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:31.863236 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 746/1488] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:31 2022] DELETE /identity/v3/users/17dcc33fe9414711a3692416ae9aa058 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:31.863970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c93d-a1ba-4752-ad0d-45818775b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.864475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c93d-a1ba-4752-ad0d-45818775b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.866081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c93d-a1ba-4752-ad0d-45818775b1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.868396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.868668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c93d-a1ba-4752-ad0d-45818775b1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:31.872248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:31.872954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c93d-a1ba-4752-ad0d-45818775b1c9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:31.896355 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 743/1489] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:31.900296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b59535-3126-40ba-b16e-455b3d0e5cca None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:31.900839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b59535-3126-40ba-b16e-455b3d0e5cca None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:31.901296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b59535-3126-40ba-b16e-455b3d0e5cca None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:31.903265 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 744/1490] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:31.904488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b59535-3126-40ba-b16e-455b3d0e5cca None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:31.907447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d6b59535-3126-40ba-b16e-455b3d0e5cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:32.025134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ae167-828a-436a-ae24-d3b96cec67ff admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.037080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.037939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.038383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.040788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.042470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.043160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b59535-3126-40ba-b16e-455b3d0e5cca None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.047510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.050371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.051428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.051812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.052320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.053429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.055214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.070654 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 745/1491] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:32.071915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.074742 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:32.074885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:32.088398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 747/1492] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:32.088398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:32.088398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:32.093355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98af2a-4e57-411b-8531-cae9fa799a71 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.100480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.101557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.102259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.102550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] PATH_INFO: `/v3/projects/e2638e9f5ffd466f83dc6dc0f11fbede/users/24295c4d8bb8494fb805773e70e4348d/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.128549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2638e9f5ffd466f83dc6dc0f11fbede, user_id=24295c4d8bb8494fb805773e70e4348d, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.134421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.187732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.190297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:32.258023 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 746/1493] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:32 2022] PUT /identity/v3/projects/e2638e9f5ffd466f83dc6dc0f11fbede/users/24295c4d8bb8494fb805773e70e4348d/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:32.258878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.302228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0da22-de7a-477b-8312-1a6aa04d304f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.402605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dadde-780f-49b7-8adc-ee6f6557038a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.413134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19bda0-435e-4668-9619-5b74cbc4b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.413844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19bda0-435e-4668-9619-5b74cbc4b570 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.414204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19bda0-435e-4668-9619-5b74cbc4b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.414410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19bda0-435e-4668-9619-5b74cbc4b570 admin admin] PATH_INFO: `/v3/projects/3895245eee0c4eeda3f70424e0ae710f/users/55621f878c964a21aedc9ed9a9cb2fe1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.422999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.424244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.424544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.424874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.426848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e4c71074ecd4892a79a283ed8cd3a51)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.428921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.444120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 748/1494] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:32 2022] GET /identity/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51 => generated 371 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:32.445925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.455849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19bda0-435e-4668-9619-5b74cbc4b570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3895245eee0c4eeda3f70424e0ae710f, user_id=55621f878c964a21aedc9ed9a9cb2fe1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.462107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19bda0-435e-4668-9619-5b74cbc4b570 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.462711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfe43c-84fe-4da0-902c-261de2111ee3 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.470451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.473252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.473766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.475971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] PATH_INFO: `/v3/projects/ce50c498e230477e8f6de32b04adc5d4/users/f0f6458c5b814306b6b07accb2453cf9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.512694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce50c498e230477e8f6de32b04adc5d4, user_id=f0f6458c5b814306b6b07accb2453cf9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.516030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.593224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 747/1495] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:32 2022] PUT /identity/v3/projects/3895245eee0c4eeda3f70424e0ae710f/users/55621f878c964a21aedc9ed9a9cb2fe1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:32.601727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd136-5355-4494-8a9e-5b2f680e2ece None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.602204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd136-5355-4494-8a9e-5b2f680e2ece None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.602548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd136-5355-4494-8a9e-5b2f680e2ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.656467 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 749/1496] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:32 2022] PUT /identity/v3/projects/ce50c498e230477e8f6de32b04adc5d4/users/f0f6458c5b814306b6b07accb2453cf9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:32.657454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.684856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e57fd136-5355-4494-8a9e-5b2f680e2ece None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:32.684856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e57fd136-5355-4494-8a9e-5b2f680e2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:32.780413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07a5-6617-438c-ab70-588ebcf37c53 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.790307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.791420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.793100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.793376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.796073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.796503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.802821 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 748/1497] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:32.803968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd136-5355-4494-8a9e-5b2f680e2ece None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.812270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 750/1498] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:32.813192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.823788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd136-5355-4494-8a9e-5b2f680e2ece None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.830873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe40a-5236-45e6-b262-558a2d42343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.831465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe40a-5236-45e6-b262-558a2d42343f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.831914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe40a-5236-45e6-b262-558a2d42343f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.832351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe40a-5236-45e6-b262-558a2d42343f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.833167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe40a-5236-45e6-b262-558a2d42343f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.834091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce5706-3939-4da3-9879-727a6cf03d7f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.835879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe40a-5236-45e6-b262-558a2d42343f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.841595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.845856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.846173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.846460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.847105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.848713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.850160 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 749/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:32.851615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc92d2-911e-4189-9bc8-2ffbea7c3464 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.852124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc92d2-911e-4189-9bc8-2ffbea7c3464 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.852561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc92d2-911e-4189-9bc8-2ffbea7c3464 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.858688 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 750/1500] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:32.859706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc92d2-911e-4189-9bc8-2ffbea7c3464 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.878340 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 751/1501] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:32.881962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:32.882094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc92d2-911e-4189-9bc8-2ffbea7c3464 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.888109 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:32.894536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:32.895710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:32.896158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:32.896658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] PATH_INFO: `/v3/projects/e2638e9f5ffd466f83dc6dc0f11fbede/users/24295c4d8bb8494fb805773e70e4348d/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:32.899050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2638e9f5ffd466f83dc6dc0f11fbede, user_id=24295c4d8bb8494fb805773e70e4348d, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:32.902704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:32.935355 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 751/1502] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:32 2022] PUT /identity/v3/projects/e2638e9f5ffd466f83dc6dc0f11fbede/users/24295c4d8bb8494fb805773e70e4348d/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:32.935355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:32.935627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95134cb-83b1-41a8-95b1-b0d069246c70 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:32.938448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:32.957299 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:33.050022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:33.051364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.051663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.051932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] PATH_INFO: `/v3/projects/3895245eee0c4eeda3f70424e0ae710f/users/55621f878c964a21aedc9ed9a9cb2fe1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.058476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3895245eee0c4eeda3f70424e0ae710f, user_id=55621f878c964a21aedc9ed9a9cb2fe1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:33.063552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:33.100116 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 752/1503] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:32 2022] PUT /identity/v3/projects/3895245eee0c4eeda3f70424e0ae710f/users/55621f878c964a21aedc9ed9a9cb2fe1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:33.100116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:33.159164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:33.279285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2ee3b-d220-4a68-868e-75613e612a80 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:33.295403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5739-ff43-440a-92af-be3303c12c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:33.296488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5739-ff43-440a-92af-be3303c12c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.298363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5739-ff43-440a-92af-be3303c12c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.299192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5739-ff43-440a-92af-be3303c12c11 admin admin] PATH_INFO: `/v3/projects/ce50c498e230477e8f6de32b04adc5d4/users/f0f6458c5b814306b6b07accb2453cf9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.302803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5739-ff43-440a-92af-be3303c12c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce50c498e230477e8f6de32b04adc5d4, user_id=f0f6458c5b814306b6b07accb2453cf9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:33.305964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5739-ff43-440a-92af-be3303c12c11 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:33.323123 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 753/1504] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:33 2022] PUT /identity/v3/projects/ce50c498e230477e8f6de32b04adc5d4/users/f0f6458c5b814306b6b07accb2453cf9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:33.328494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.328766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.329041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.332760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc251-6145-4c45-967a-4cbff90a7784 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:33.376258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] MFA Rules not processed for user `24295c4d8bb8494fb805773e70e4348d`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:33.382358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:33.442773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33d3b-51e3-47a2-9e74-2e37292531fd tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:33.445166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33d3b-51e3-47a2-9e74-2e37292531fd tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.445283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33d3b-51e3-47a2-9e74-2e37292531fd tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.445486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33d3b-51e3-47a2-9e74-2e37292531fd tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.446742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33d3b-51e3-47a2-9e74-2e37292531fd tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e4c71074ecd4892a79a283ed8cd3a51)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:33.449195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33d3b-51e3-47a2-9e74-2e37292531fd tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:33.464828 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 752/1505] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:32 2022] GET /identity/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51 => generated 371 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:33.466267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.466548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.466818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.506431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 754/1506] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:33.506431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:33.506431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:33.537895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] MFA Rules not processed for user `55621f878c964a21aedc9ed9a9cb2fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:33.539030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:33.655360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7a717-9c1b-4365-8db9-533c4c52f912 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:33.661113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:33.671902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.672281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.673131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] PATH_INFO: `/v3/projects/54d7ef46716d4cc1b7d197d0049492ed` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.675677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d7ef46716d4cc1b7d197d0049492ed)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:33.678209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:33.708910 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 753/1507] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:33.714011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:33.718948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:33.830607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d7ef46716d4cc1b7d197d0049492ed', 'request_id': 'req-051dd8ee-825b-43a6-8875-9fbc19ea988c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:33.836709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d7ef46716d4cc1b7d197d0049492ed', 'request_id': 'req-051dd8ee-825b-43a6-8875-9fbc19ea988c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:33.861917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aeda0-8d23-426c-b152-0e0e8c4ac91e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:33.929693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d7ef46716d4cc1b7d197d0049492ed', 'request_id': 'req-051dd8ee-825b-43a6-8875-9fbc19ea988c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:33.944869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] The token cache is being invalidate because project 54d7ef46716d4cc1b7d197d0049492ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:33.945501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:33.945861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:33.946801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-051dd8ee-825b-43a6-8875-9fbc19ea988c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:33.946956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.947224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.947496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.949271 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 755/1508] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:33 2022] DELETE /identity/v3/projects/54d7ef46716d4cc1b7d197d0049492ed => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:33.951068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:33.951580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:33.951701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:33.952218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:33.961130 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.004528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] MFA Rules not processed for user `f0f6458c5b814306b6b07accb2453cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:34.006688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.076741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:34.081545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:34.103650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 754/1509] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:10:34.104377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:34.107498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.140133 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 756/1510] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:34.140694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:34.142896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.159032 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.284593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6f310-e3e9-4a19-ac85-c389c54174e0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:34.289136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949be0-2324-48e8-b665-1e785d4d9e07 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:34.292243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:34.292860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.294864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.295057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.295755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:34.296754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:34.304345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:34.309638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081621d-c2cf-4806-b261-f60345a6a035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:34.310582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081621d-c2cf-4806-b261-f60345a6a035 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.310981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081621d-c2cf-4806-b261-f60345a6a035 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.311135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081621d-c2cf-4806-b261-f60345a6a035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.313044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5081621d-c2cf-4806-b261-f60345a6a035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.329260 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 757/1511] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:34.331033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:34.333657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.362272 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.385135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b534b-5805-4ce2-b97f-80ef39a9d584 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:34.405185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02844719-853f-4058-9135-f0a0760aa5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:34.405866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02844719-853f-4058-9135-f0a0760aa5f9 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.407572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02844719-853f-4058-9135-f0a0760aa5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.412727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02844719-853f-4058-9135-f0a0760aa5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.421471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-02844719-853f-4058-9135-f0a0760aa5f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.447054 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.469354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081621d-c2cf-4806-b261-f60345a6a035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:34.471654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081621d-c2cf-4806-b261-f60345a6a035 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:34.499766 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 755/1512] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:34.501078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666467d-dac2-48c7-8471-6b2a88c6e463 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.501466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666467d-dac2-48c7-8471-6b2a88c6e463 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.501671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666467d-dac2-48c7-8471-6b2a88c6e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.544479 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.576687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02844719-853f-4058-9135-f0a0760aa5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:34.578362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02844719-853f-4058-9135-f0a0760aa5f9 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:34.597595 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 758/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:34.600821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f3a3-7f2b-4807-acf3-9bdcd915a3db None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.601317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7666467d-dac2-48c7-8471-6b2a88c6e463 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:34.601785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f3a3-7f2b-4807-acf3-9bdcd915a3db None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.602502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f3a3-7f2b-4807-acf3-9bdcd915a3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.602623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7666467d-dac2-48c7-8471-6b2a88c6e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.657409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e715f3a3-7f2b-4807-acf3-9bdcd915a3db None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:34.659775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e715f3a3-7f2b-4807-acf3-9bdcd915a3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.722541 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.733125 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 756/1514] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 23 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:34.738221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.738374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.738876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.750303 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.773249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 759/1515] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:34.774376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715f3a3-7f2b-4807-acf3-9bdcd915a3db None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:34.799017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715f3a3-7f2b-4807-acf3-9bdcd915a3db None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:34.800071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] MFA Rules not processed for user `9e535f9274b24a9f800ea0c3d8faba5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:34.801377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.822775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:34.823418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.823700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.823990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.824817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:34.826987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:34.915460 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:34.923683 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 757/1516] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:34.925046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:34.927229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:34.945491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980b007-d276-4746-a0ec-bccc6d8a051a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:34.956870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:34.957516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:34.957881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:34.958278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] PATH_INFO: `/v3/users/3f91cb1a0ea84b5a9298680b3f81df64` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:34.961149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f91cb1a0ea84b5a9298680b3f81df64)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:34.963441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:34.984616 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 760/1517] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:34 2022] POST /identity/v3/users => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:34.986349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:35.002527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26252384-a920-4df9-a891-9bae558feb08 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:35.011403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:35.012109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:35.012391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:35.012664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:35.014851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:35.123832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:35.127463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:35.150899 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 761/1518] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:35.152573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:35.155900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:35.169825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c7be-b1bb-4e42-b0d8-09672004061c service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:35.236524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa97d89-b02b-4c9e-88b1-5577cab5083f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:35.236524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa97d89-b02b-4c9e-88b1-5577cab5083f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:35.236524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa97d89-b02b-4c9e-88b1-5577cab5083f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:35.236524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa97d89-b02b-4c9e-88b1-5577cab5083f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:35.237229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa97d89-b02b-4c9e-88b1-5577cab5083f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:35.237229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa97d89-b02b-4c9e-88b1-5577cab5083f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:35.237229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 762/1519] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:35.237229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:35.237229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:35.237229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:35.238084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:35.239175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:35.248707 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 763/1520] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:35.249482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:35.250900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:35.267463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a0bd5-372c-4dc6-8afb-c5ed7b08932b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:35.274152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:35.274775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:35.275050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:35.275360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:35.276133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:35.279899 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:35.426484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:35.503096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f91cb1a0ea84b5a9298680b3f81df64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:35.529426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f91cb1a0ea84b5a9298680b3f81df64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:35.530430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f91cb1a0ea84b5a9298680b3f81df64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:35.555785 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:35.811417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 764/1521] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:35 2022] POST /identity/v3/projects => generated 403 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:35.811417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:35.851161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f91cb1a0ea84b5a9298680b3f81df64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:35.852031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f91cb1a0ea84b5a9298680b3f81df64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:35.900513 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 758/1522] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:34 2022] DELETE /identity/v3/users/3f91cb1a0ea84b5a9298680b3f81df64 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:35.904349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:35.907179 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:35.908934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:35.952909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244b2d0-59bc-477f-874c-64b242d1e244 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:36.009363 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:36.035407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:36.038358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.038358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.038358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.038358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:36.038358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:36.039155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:36.072442 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:36.100124 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 765/1523] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:36.101035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:36.104130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99163de7-a370-40eb-b5ad-1713d475078a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:36.107628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:36.118697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:36.119468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.120166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.120541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.123529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:36.190835 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:36.224602 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:36.234846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:36.236975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:36.249570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4016-0bd6-4917-8419-b90e597ccab2 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:36.252082 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 759/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:36.252459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:36.253746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:36.274992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67f3af-299d-44cb-b1ca-891fce860089 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:36.281792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe647e6-f329-4eeb-9cb1-aac566530f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:36.283364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe647e6-f329-4eeb-9cb1-aac566530f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.283707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:36.284604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.284978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.285341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe647e6-f329-4eeb-9cb1-aac566530f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.285458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.286643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:36.289028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe647e6-f329-4eeb-9cb1-aac566530f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.289028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe647e6-f329-4eeb-9cb1-aac566530f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:36.289028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe647e6-f329-4eeb-9cb1-aac566530f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:36.292996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe647e6-f329-4eeb-9cb1-aac566530f47 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:36.295328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:36.337557 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 766/1525] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:36.339661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.350474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.351611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.394871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:36.399313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:36.442840 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 767/1526] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:36.443835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:36.448047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:36.464350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d3c0-87e8-4f3d-97ef-ad1ae8fe1605 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:36.483243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 760/1527] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:36 2022] POST /identity/v3/users => generated 308 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:36.483243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:36.492171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:36.492171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.492171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.492171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] PATH_INFO: `/v3/users/e51e213730e042b88069ad3f96222041` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.492557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51e213730e042b88069ad3f96222041)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:36.493072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:36.498302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ea40-4af6-4a48-acae-f1754c4b2c58 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:36.505467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e017b-b62e-4ccf-aba9-7a83fce5b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:36.506133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e017b-b62e-4ccf-aba9-7a83fce5b142 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.506393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e017b-b62e-4ccf-aba9-7a83fce5b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.507001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e017b-b62e-4ccf-aba9-7a83fce5b142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.507839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e017b-b62e-4ccf-aba9-7a83fce5b142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:36.511371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e017b-b62e-4ccf-aba9-7a83fce5b142 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:36.659503 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 761/1528] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:36 2022] POST /identity/v3/projects => generated 391 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:36.665720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb1c4-23a4-4242-be08-b2913aaf44db None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.665720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb1c4-23a4-4242-be08-b2913aaf44db None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.665720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb1c4-23a4-4242-be08-b2913aaf44db None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.665720 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 762/1529] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:36.665720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb1c4-23a4-4242-be08-b2913aaf44db None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:36.674392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b42eb1c4-23a4-4242-be08-b2913aaf44db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:36.782857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51e213730e042b88069ad3f96222041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:36.808304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51e213730e042b88069ad3f96222041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:36.809121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51e213730e042b88069ad3f96222041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:36.824955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb1c4-23a4-4242-be08-b2913aaf44db None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:36.830752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:36.831811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:36.832336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:36.832848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:36.908646 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:36.909526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51e213730e042b88069ad3f96222041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:36.910220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51e213730e042b88069ad3f96222041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:36.951554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 768/1530] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:36 2022] DELETE /identity/v3/users/e51e213730e042b88069ad3f96222041 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:36.955833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:36.958959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:36.990756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:36.992326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:37.005311 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 763/1531] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:37.006287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:37.035867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a446542-b532-493b-b48c-9b34afed26ec service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:37.122083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea088ef-46a3-4528-b873-00c8dd1af2d3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:37.129541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:37.130493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.130892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.131142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.132139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:37.134979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:37.149209 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:37.203609 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 769/1532] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:37.203609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:37.203839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:37.203944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:37.204036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.204036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.204036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.204505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:37.206700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:37.228379 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:37.310787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:37.312937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:37.342841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 764/1533] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:37 2022] POST /identity/v3/users => generated 296 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:37.344744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:37.356414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:37.408227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322c9d2-81ea-4e8a-abf8-a2a299872c8f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:37.434619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:37.437425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.438342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.439755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] PATH_INFO: `/v3/users/055e1e9d12f8451a913462903fd60551` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.442679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=055e1e9d12f8451a913462903fd60551)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:37.447394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:37.474768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb85cd-1e9d-49aa-9e23-bf2ff5561a8d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:37.496235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079c500-b945-4c9e-bc10-151f0ef67207 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:37.497694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c500-b945-4c9e-bc10-151f0ef67207 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.498013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c500-b945-4c9e-bc10-151f0ef67207 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.498299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c500-b945-4c9e-bc10-151f0ef67207 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.508834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079c500-b945-4c9e-bc10-151f0ef67207 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e4c71074ecd4892a79a283ed8cd3a51)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:37.513079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079c500-b945-4c9e-bc10-151f0ef67207 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:37.517243 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 770/1534] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:37 2022] GET /identity/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51 => generated 371 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:37.518669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67912b-c645-43d0-bb52-77e360ef78f5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.519099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67912b-c645-43d0-bb52-77e360ef78f5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.519403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67912b-c645-43d0-bb52-77e360ef78f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.547302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9c67912b-c645-43d0-bb52-77e360ef78f5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:37.549471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9c67912b-c645-43d0-bb52-77e360ef78f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:37.560303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 771/1535] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:37.562267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020f1b-f391-4ced-8c1f-4ae33109994c None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.562554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020f1b-f391-4ced-8c1f-4ae33109994c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.562901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d020f1b-f391-4ced-8c1f-4ae33109994c None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.564530 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 772/1536] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:37.565304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020f1b-f391-4ced-8c1f-4ae33109994c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:37.585270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d020f1b-f391-4ced-8c1f-4ae33109994c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:37.590966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:37.592604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.593938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.594065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] PATH_INFO: `/v3/projects/4fae1c4c88a241a3bf75ee0848fe9827/users/5067f5be07754742b075ada65db2dfcc/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.635956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fae1c4c88a241a3bf75ee0848fe9827, user_id=5067f5be07754742b075ada65db2dfcc, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:37.638821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:37.677047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055e1e9d12f8451a913462903fd60551'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:37.702904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055e1e9d12f8451a913462903fd60551'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:37.703818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055e1e9d12f8451a913462903fd60551'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:37.783888 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 773/1537] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:37 2022] PUT /identity/v3/projects/4fae1c4c88a241a3bf75ee0848fe9827/users/5067f5be07754742b075ada65db2dfcc/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:37.787575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:37.797909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:37.803033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055e1e9d12f8451a913462903fd60551'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:37.806800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ff33e636-dd7b-4fe9-994f-cd4896591bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055e1e9d12f8451a913462903fd60551'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:37.829968 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:37.836888 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 765/1538] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:37 2022] DELETE /identity/v3/users/055e1e9d12f8451a913462903fd60551 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:37.836888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:37.836888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:37.837466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:37.870862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:37.872277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:37.952413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f3f8-ca9a-4d53-9283-2ebdd67ce8dd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.009765 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 766/1539] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:38.010786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.013475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.119736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.120466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.120733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.121043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.121903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:38.126929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:38.140761 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:38.154424 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 774/1540] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:38.154424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.156764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.170165 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:38.172518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3205213-5d23-478e-bc64-55626f18f5a0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.176560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d322-e584-4241-8f0b-c9af49e9d989 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.178195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.183421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.183421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.183421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.183421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.189340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.190398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.190609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.190866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] PATH_INFO: `/v3/projects/389fbaaeff374fe7b4c1dd488e28a73a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.194843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389fbaaeff374fe7b4c1dd488e28a73a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:38.197033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:38.201192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:38.202713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:38.226174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 767/1541] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:38.227105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.232792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.250423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55327fbe-3c23-4ca6-822b-76b29d427aca service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.257824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ada1d1-b7b1-45a4-809b-e196994990dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.258309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ada1d1-b7b1-45a4-809b-e196994990dd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.258664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ada1d1-b7b1-45a4-809b-e196994990dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.258935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ada1d1-b7b1-45a4-809b-e196994990dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.261495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ada1d1-b7b1-45a4-809b-e196994990dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:38.263240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ada1d1-b7b1-45a4-809b-e196994990dd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:38.278886 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 768/1542] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:38.280269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a320-4b77-4534-abfe-5ca237f6b525 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.284746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a320-4b77-4534-abfe-5ca237f6b525 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.284746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a320-4b77-4534-abfe-5ca237f6b525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.308532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-43c6a320-4b77-4534-abfe-5ca237f6b525 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:38.308532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-43c6a320-4b77-4534-abfe-5ca237f6b525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.320303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 769/1543] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:38.322720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bcd8c-f1c4-43dd-bb99-ed63332f5d64 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.323006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bcd8c-f1c4-43dd-bb99-ed63332f5d64 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.323281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bcd8c-f1c4-43dd-bb99-ed63332f5d64 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.330619 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 770/1544] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:10:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:38.331419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bcd8c-f1c4-43dd-bb99-ed63332f5d64 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.333712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-461bcd8c-f1c4-43dd-bb99-ed63332f5d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.342351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389fbaaeff374fe7b4c1dd488e28a73a', 'request_id': 'req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:38.367304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389fbaaeff374fe7b4c1dd488e28a73a', 'request_id': 'req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:38.441136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389fbaaeff374fe7b4c1dd488e28a73a', 'request_id': 'req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:38.488631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] The token cache is being invalidate because project 389fbaaeff374fe7b4c1dd488e28a73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:38.488951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:38.490932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:38.495265 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 775/1545] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:38 2022] DELETE /identity/v3/projects/389fbaaeff374fe7b4c1dd488e28a73a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:38.495265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.497649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.528256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bcd8c-f1c4-43dd-bb99-ed63332f5d64 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.535293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.535983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.536607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.536607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.540673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.559251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:38.561134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:38.576777 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 771/1546] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:38.589472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.595681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.682716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6728c-7ce9-42c7-97a9-9634bf43faa4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.695677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.697333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.697570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.699458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.700896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:38.707053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:38.744128 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 776/1547] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:38.747494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:10:38.757561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.773210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b76be-d8f7-4c7f-a066-12a6db3f1ed0 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.780762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.781683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.782856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.783352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] PATH_INFO: `/v3/projects/4fae1c4c88a241a3bf75ee0848fe9827/users/5067f5be07754742b075ada65db2dfcc/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.785939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fae1c4c88a241a3bf75ee0848fe9827, user_id=5067f5be07754742b075ada65db2dfcc, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:38.789688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:38.810335 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 772/1548] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:38 2022] PUT /identity/v3/projects/4fae1c4c88a241a3bf75ee0848fe9827/users/5067f5be07754742b075ada65db2dfcc/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:38.811632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.814586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.814865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:38.819678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.907060 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:38.952682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86260d24-ce39-4677-9db4-c250afbfa7ec admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:38.963212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:38.966792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:38.966792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:38.966792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:38.971377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:38.987715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f98c82-bb2b-4849-a85d-9d65514ba3c9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:39.047008 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:39.146902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:39.148361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:39.155273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:39.157259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:39.159427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:39.160838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:39.162354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e4c71074ecd4892a79a283ed8cd3a51)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:39.167558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:39.171140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 777/1549] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:10:38 2022] GET /identity/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51 => generated 371 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:39.172238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:39.174118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:39.195163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 773/1550] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:39.196182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:39.213768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e36d4-6686-4315-9f85-ada4e383bcff tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:39.224697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13413c-f7a6-4d25-b9a4-3208125f77ce service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:39.235349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:39.236308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:39.236661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:39.237507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] PATH_INFO: `/v3/users/f0f6458c5b814306b6b07accb2453cf9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:39.241882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:39.242149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f6458c5b814306b6b07accb2453cf9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:39.242604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:39.242912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:39.243195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] PATH_INFO: `/v3/projects/34157e4127d14dcdb93f754d5e520161/users/28eb7a3d57fe46bf94d7cf720d9bcb74/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:39.246154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:39.282084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34157e4127d14dcdb93f754d5e520161, user_id=28eb7a3d57fe46bf94d7cf720d9bcb74, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:39.285255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:39.416841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 774/1551] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:39 2022] PUT /identity/v3/projects/34157e4127d14dcdb93f754d5e520161/users/28eb7a3d57fe46bf94d7cf720d9bcb74/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:39.416841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:39.417273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:39.577301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f6458c5b814306b6b07accb2453cf9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.604601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f6458c5b814306b6b07accb2453cf9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.607120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f6458c5b814306b6b07accb2453cf9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.615347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cef2b9-7ded-4872-89e5-3adffdea3c6d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:39.620867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:39.621860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:39.622182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:39.622692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] PATH_INFO: `/v3/projects/2727465e0be64f539440a2f3c9149e7c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:39.624191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2727465e0be64f539440a2f3c9149e7c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:39.626852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:39.682157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f6458c5b814306b6b07accb2453cf9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.684541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f6458c5b814306b6b07accb2453cf9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.715732 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 778/1552] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:39 2022] DELETE /identity/v3/users/f0f6458c5b814306b6b07accb2453cf9 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:39.715732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:39.716997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:39.815815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2727465e0be64f539440a2f3c9149e7c', 'request_id': 'req-61c5f175-28a0-48e1-9e52-89e59311b96b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.822941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2727465e0be64f539440a2f3c9149e7c', 'request_id': 'req-61c5f175-28a0-48e1-9e52-89e59311b96b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.915387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2727465e0be64f539440a2f3c9149e7c', 'request_id': 'req-61c5f175-28a0-48e1-9e52-89e59311b96b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.918726 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:39.956056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] The token cache is being invalidate because project 2727465e0be64f539440a2f3c9149e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:39.956960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.963235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61c5f175-28a0-48e1-9e52-89e59311b96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:39.965316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c040d7-8416-43bc-9d5e-d967e533c775 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:39.965770 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 775/1553] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:39 2022] DELETE /identity/v3/projects/2727465e0be64f539440a2f3c9149e7c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:39.971557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:39.972121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:39.972717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:40.052098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] MFA Rules not processed for user `28eb7a3d57fe46bf94d7cf720d9bcb74`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:40.053408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:40.077777 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:40.086454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:40.088098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:40.088409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:40.088702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/users/6a01f30a0402423194d515eecb1deddd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:40.112258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a01f30a0402423194d515eecb1deddd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:40.115199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:40.195709 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 776/1554] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:40.196044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:40.201370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:40.268713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a01f30a0402423194d515eecb1deddd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.282747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a01f30a0402423194d515eecb1deddd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.284282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a01f30a0402423194d515eecb1deddd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.381028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a01f30a0402423194d515eecb1deddd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.381847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a01f30a0402423194d515eecb1deddd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.416462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f582b49-a971-494e-acbd-f55e0224ff70 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:40.422938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:40.423596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:40.423875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:40.424723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] PATH_INFO: `/v3/projects/33ebeb5bd09a489f81c7534e43b1ca44` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:40.434510 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 779/1555] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:39 2022] DELETE /identity/v3/users/6a01f30a0402423194d515eecb1deddd => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:40.434667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ebeb5bd09a489f81c7534e43b1ca44)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:40.436258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:40.437786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:40.461509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:40.634276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ebeb5bd09a489f81c7534e43b1ca44', 'request_id': 'req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.636809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9f7d2-052e-4620-9323-4672f3f7d355 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:40.646539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ebeb5bd09a489f81c7534e43b1ca44', 'request_id': 'req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.734279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:40.735142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:40.735533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:40.736038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] PATH_INFO: `/v3/users/24295c4d8bb8494fb805773e70e4348d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:40.738116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24295c4d8bb8494fb805773e70e4348d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:40.741309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:40.754820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ebeb5bd09a489f81c7534e43b1ca44', 'request_id': 'req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.771145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] The token cache is being invalidate because project 33ebeb5bd09a489f81c7534e43b1ca44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:40.772160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.772998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:40.774784 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 777/1556] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:40 2022] DELETE /identity/v3/projects/33ebeb5bd09a489f81c7534e43b1ca44 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:40.775622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:40.777349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:40.793890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835db9-26da-4d5e-a3bb-4d40f4ff76c6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:40.805481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:40.806269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:40.806474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:40.806815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:40.807487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:40.809751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:40.996907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 778/1557] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:40 2022] POST /identity/v3/projects => generated 393 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:40.997965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:41.000172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:41.012309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24295c4d8bb8494fb805773e70e4348d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.022064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24295c4d8bb8494fb805773e70e4348d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.023370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24295c4d8bb8494fb805773e70e4348d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.090820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae0d6-3fcb-404a-994d-ac57573ef766 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:41.096440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc4340274bfa4bd1a89bf4281a3a559f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:41.097235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:41.097617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:41.097998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] PATH_INFO: `/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:41.099558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e4c71074ecd4892a79a283ed8cd3a51)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:41.103055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:41.137692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24295c4d8bb8494fb805773e70e4348d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.138566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24295c4d8bb8494fb805773e70e4348d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.172129 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:41.174329 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 780/1558] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:40 2022] DELETE /identity/v3/users/24295c4d8bb8494fb805773e70e4348d => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:41.175394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:41.176862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:41.290075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e3620-d555-434c-8d36-5ade802ad28f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:41.294182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4c71074ecd4892a79a283ed8cd3a51', 'request_id': 'req-750f3d2b-4c24-428e-83d8-1d65f8d924d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.302402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4c71074ecd4892a79a283ed8cd3a51', 'request_id': 'req-750f3d2b-4c24-428e-83d8-1d65f8d924d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.373657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:41.374412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:41.374808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:41.375204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] PATH_INFO: `/v3/projects/ce50c498e230477e8f6de32b04adc5d4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:41.376410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce50c498e230477e8f6de32b04adc5d4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:41.378862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:41.415807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4c71074ecd4892a79a283ed8cd3a51', 'request_id': 'req-750f3d2b-4c24-428e-83d8-1d65f8d924d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.432008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] The token cache is being invalidate because project 9e4c71074ecd4892a79a283ed8cd3a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:41.432609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.433448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.439822 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 779/1559] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:40 2022] DELETE /identity/v3/projects/9e4c71074ecd4892a79a283ed8cd3a51 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:41.441295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:41.458833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:41.495402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f3d2b-4c24-428e-83d8-1d65f8d924d4 tempest-QuotasAdminTestV257-993651291 tempest-QuotasAdminTestV257-993651291-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:41.503840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:41.505112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:41.505399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:41.505708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] PATH_INFO: `/v3/users/55621f878c964a21aedc9ed9a9cb2fe1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:41.507575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=55621f878c964a21aedc9ed9a9cb2fe1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:41.510316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:41.561113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce50c498e230477e8f6de32b04adc5d4', 'request_id': 'req-52f361cc-f419-42fa-929a-87d0e0ea539a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.570056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce50c498e230477e8f6de32b04adc5d4', 'request_id': 'req-52f361cc-f419-42fa-929a-87d0e0ea539a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.675888 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:41.677427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce50c498e230477e8f6de32b04adc5d4', 'request_id': 'req-52f361cc-f419-42fa-929a-87d0e0ea539a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.695432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] The token cache is being invalidate because project ce50c498e230477e8f6de32b04adc5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:41.695934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.696767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.707269 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 781/1560] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:41 2022] DELETE /identity/v3/projects/ce50c498e230477e8f6de32b04adc5d4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:41.708351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:41.710857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:41.729561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55621f878c964a21aedc9ed9a9cb2fe1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.743896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55621f878c964a21aedc9ed9a9cb2fe1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.744823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55621f878c964a21aedc9ed9a9cb2fe1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.811802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55621f878c964a21aedc9ed9a9cb2fe1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.812621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55621f878c964a21aedc9ed9a9cb2fe1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:41.850451 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 780/1561] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:41 2022] DELETE /identity/v3/users/55621f878c964a21aedc9ed9a9cb2fe1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:41.850451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:41.850635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:41.852243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f361cc-f419-42fa-929a-87d0e0ea539a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:41.975351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984dd9-ff7e-4bd3-a5c6-1bc6838c8fcb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:41.999201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:41.999201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:41.999201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:41.999201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] PATH_INFO: `/v3/users/4ae9e93870ce4247824e989c6ab7daa3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.000613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae9e93870ce4247824e989c6ab7daa3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:42.007320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:42.014704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a148-57ba-4cdc-9c61-eb7233d546a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:42.015345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a148-57ba-4cdc-9c61-eb7233d546a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.015620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a148-57ba-4cdc-9c61-eb7233d546a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.015890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a148-57ba-4cdc-9c61-eb7233d546a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.017044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a148-57ba-4cdc-9c61-eb7233d546a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:42.019476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a148-57ba-4cdc-9c61-eb7233d546a4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:42.159420 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 782/1562] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:41 2022] POST /identity/v3/users => generated 303 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:42.160523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.160806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.161074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.195791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:42.197091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.206394 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 783/1563] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:42.207369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:42.214250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.228922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ec1c-0c55-4d59-b150-14a267a1f229 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:42.234537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:42.236612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.237122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.237619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] PATH_INFO: `/v3/projects/e2638e9f5ffd466f83dc6dc0f11fbede` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.243273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2638e9f5ffd466f83dc6dc0f11fbede)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:42.247516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:42.269027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae9e93870ce4247824e989c6ab7daa3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.284073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae9e93870ce4247824e989c6ab7daa3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.285713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae9e93870ce4247824e989c6ab7daa3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.400723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae9e93870ce4247824e989c6ab7daa3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.405131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae9e93870ce4247824e989c6ab7daa3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.432075 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 781/1564] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:41 2022] DELETE /identity/v3/users/4ae9e93870ce4247824e989c6ab7daa3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:42.432699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:42.434092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.460066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2638e9f5ffd466f83dc6dc0f11fbede', 'request_id': 'req-48250126-5f9d-42e6-b559-481a5af6ad46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.468911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2638e9f5ffd466f83dc6dc0f11fbede', 'request_id': 'req-48250126-5f9d-42e6-b559-481a5af6ad46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.538463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2638e9f5ffd466f83dc6dc0f11fbede', 'request_id': 'req-48250126-5f9d-42e6-b559-481a5af6ad46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.541657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377481-762c-4dda-9f44-066647db95b1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:42.554046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638b5c-a962-4e38-82c7-6b749078aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:42.554710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638b5c-a962-4e38-82c7-6b749078aa9f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.555031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638b5c-a962-4e38-82c7-6b749078aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.555355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638b5c-a962-4e38-82c7-6b749078aa9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.556255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638b5c-a962-4e38-82c7-6b749078aa9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:42.558004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638b5c-a962-4e38-82c7-6b749078aa9f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:42.560419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] The token cache is being invalidate because project e2638e9f5ffd466f83dc6dc0f11fbede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:42.562991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.571411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48250126-5f9d-42e6-b559-481a5af6ad46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:42.573939 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 784/1565] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:42 2022] DELETE /identity/v3/projects/e2638e9f5ffd466f83dc6dc0f11fbede => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:42.575575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0ad9-55e8-47f8-9d9f-1deb6cc13543 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.576126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0ad9-55e8-47f8-9d9f-1deb6cc13543 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.576449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0ad9-55e8-47f8-9d9f-1deb6cc13543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.580640 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 782/1566] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:42.581476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.581772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.582068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.603999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4e7e0ad9-55e8-47f8-9d9f-1deb6cc13543 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:42.605436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4e7e0ad9-55e8-47f8-9d9f-1deb6cc13543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.611988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:42.613448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.627436 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 785/1567] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:42.627436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110aad9-e7e7-423d-a416-815cab525720 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.627436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110aad9-e7e7-423d-a416-815cab525720 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.627436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110aad9-e7e7-423d-a416-815cab525720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.631852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 783/1568] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:42.632722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:42.634080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.654471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b110aad9-e7e7-423d-a416-815cab525720 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:42.654951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0ba81-4750-4a06-b846-02582f1f9bd6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:42.657787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b110aad9-e7e7-423d-a416-815cab525720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.662974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb78f4-434f-428b-8422-45533915a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:42.664149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb78f4-434f-428b-8422-45533915a884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.664519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb78f4-434f-428b-8422-45533915a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.664798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb78f4-434f-428b-8422-45533915a884 admin admin] PATH_INFO: `/v3/projects/ab6c175605394bada4db03c05e501acb/users/20c2158bdd9d41f28272d786d1bee4a8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.675625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 786/1569] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:42.677619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110aad9-e7e7-423d-a416-815cab525720 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:42.693114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110aad9-e7e7-423d-a416-815cab525720 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:42.709690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb78f4-434f-428b-8422-45533915a884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6c175605394bada4db03c05e501acb, user_id=20c2158bdd9d41f28272d786d1bee4a8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:42.716714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:42.718619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb78f4-434f-428b-8422-45533915a884 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:42.719080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.719711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.720631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.721661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:42.722506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:42.725450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:42.763906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 787/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:42.765780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:42.769921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.793718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 784/1571] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:42 2022] PUT /identity/v3/projects/ab6c175605394bada4db03c05e501acb/users/20c2158bdd9d41f28272d786d1bee4a8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:42.794849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb649097-6d7f-4418-9d07-a41a806e1b53 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:42.795288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb649097-6d7f-4418-9d07-a41a806e1b53 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:42.799871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb649097-6d7f-4418-9d07-a41a806e1b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:42.843846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cb649097-6d7f-4418-9d07-a41a806e1b53 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:42.851092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cb649097-6d7f-4418-9d07-a41a806e1b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:42.910758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82dfdc-87a5-4e8a-b5ae-b7529500761f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:42.968092 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 785/1572] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:42.970544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb649097-6d7f-4418-9d07-a41a806e1b53 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:42.999787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb649097-6d7f-4418-9d07-a41a806e1b53 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:43.006177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.006849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.007124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.008345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.009753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.010275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.011096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.011547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.012059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.013815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.028045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.029964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.046162 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 788/1573] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:43.046162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:43.070784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ab7c-194c-4c10-b024-1aad2592d8d3 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:43.089769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.094939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.094939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.094939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.095762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.102505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.127721 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 786/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:42 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:43.128754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:43.138121 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 789/1575] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:43.143177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:43.145576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:43.163962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135edf-7e08-497c-8c93-348e03b7067f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:43.261727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.262640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.263015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.263763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] PATH_INFO: `/v3/projects/3895245eee0c4eeda3f70424e0ae710f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.265398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3895245eee0c4eeda3f70424e0ae710f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.269176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.273236 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:43.353900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148afd-adf1-425b-a42d-79aba5452759 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:43.360436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.361605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.364867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.365665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.365909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:43.366356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.367975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.400104 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 787/1576] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:43.402447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:43.420294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3895245eee0c4eeda3f70424e0ae710f', 'request_id': 'req-82a0e478-c63a-468d-b816-10f671933357'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:43.437008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3895245eee0c4eeda3f70424e0ae710f', 'request_id': 'req-82a0e478-c63a-468d-b816-10f671933357'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:43.441247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e6f04-3729-41b5-946c-e021f2d92d56 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:43.548866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3895245eee0c4eeda3f70424e0ae710f', 'request_id': 'req-82a0e478-c63a-468d-b816-10f671933357'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:43.576494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] The token cache is being invalidate because project 3895245eee0c4eeda3f70424e0ae710f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:43.576677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:43.580393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:43.586246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 790/1577] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:43 2022] DELETE /identity/v3/projects/3895245eee0c4eeda3f70424e0ae710f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:43.587142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:43.598324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:43.599416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.600169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.600456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.600777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.601480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.603980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.686748 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:43.731445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 788/1578] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:43 2022] POST /identity/v3/users => generated 287 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:43.731445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:43.731445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:43.756577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b5b3d-7314-4e09-81fd-2dea6007ec5c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:43.774582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebbeef-f6b8-4274-a293-778b9f510632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.775706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0e478-c63a-468d-b816-10f671933357 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:43.784159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac71aa0-76fb-44cd-a225-4601b59161cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:43.785195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac71aa0-76fb-44cd-a225-4601b59161cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.785694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac71aa0-76fb-44cd-a225-4601b59161cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.786161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac71aa0-76fb-44cd-a225-4601b59161cc admin admin] PATH_INFO: `/v3/projects/ab6c175605394bada4db03c05e501acb/users/20c2158bdd9d41f28272d786d1bee4a8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.787142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebbeef-f6b8-4274-a293-778b9f510632 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.788356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebbeef-f6b8-4274-a293-778b9f510632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.788461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac71aa0-76fb-44cd-a225-4601b59161cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6c175605394bada4db03c05e501acb, user_id=20c2158bdd9d41f28272d786d1bee4a8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.789254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebbeef-f6b8-4274-a293-778b9f510632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.791239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebbeef-f6b8-4274-a293-778b9f510632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:43.791594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac71aa0-76fb-44cd-a225-4601b59161cc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.794337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebbeef-f6b8-4274-a293-778b9f510632 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:43.807067 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 791/1579] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:43 2022] PUT /identity/v3/projects/ab6c175605394bada4db03c05e501acb/users/20c2158bdd9d41f28272d786d1bee4a8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:43.819285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.819584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.819860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.846718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:43.848455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:43.943418 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 792/1580] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:43.943418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:43.943418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:43.943792 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 789/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:43 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:43.944320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287339dc-f0bd-40b8-8039-a0502dae9686 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:43.944615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287339dc-f0bd-40b8-8039-a0502dae9686 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:43.944895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287339dc-f0bd-40b8-8039-a0502dae9686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:43.978756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec36b4-6a3b-4fb5-8c44-65b7cde5fbcd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.010952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-287339dc-f0bd-40b8-8039-a0502dae9686 None None] MFA Rules not processed for user `20c2158bdd9d41f28272d786d1bee4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:44.010952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-287339dc-f0bd-40b8-8039-a0502dae9686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.114173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.114720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.115004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.115326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.116252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.118422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.132109 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 793/1582] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:44.137011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.137148 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 790/1583] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:44.137228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.137297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287339dc-f0bd-40b8-8039-a0502dae9686 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.163954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287339dc-f0bd-40b8-8039-a0502dae9686 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.169848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6489a5-795d-4fb5-98f4-00d0b088bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.170619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6489a5-795d-4fb5-98f4-00d0b088bdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.170887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6489a5-795d-4fb5-98f4-00d0b088bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.171297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6489a5-795d-4fb5-98f4-00d0b088bdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.171885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6489a5-795d-4fb5-98f4-00d0b088bdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.175800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6489a5-795d-4fb5-98f4-00d0b088bdb9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.176417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a968-2c61-466d-9bd8-a488c03e19f7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.182381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.183100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.183379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.183655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] PATH_INFO: `/v3/projects/daea0e5a728e484cac24474948c48425` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.185023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daea0e5a728e484cac24474948c48425)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.187647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.307534 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 791/1584] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:44 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:44.309186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173847f6-abeb-4f10-b02a-bf1e2d3523bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.309503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173847f6-abeb-4f10-b02a-bf1e2d3523bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.309737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173847f6-abeb-4f10-b02a-bf1e2d3523bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.349205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-173847f6-abeb-4f10-b02a-bf1e2d3523bd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:44.372947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-173847f6-abeb-4f10-b02a-bf1e2d3523bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.373477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daea0e5a728e484cac24474948c48425', 'request_id': 'req-36123d7a-81f2-49b7-be01-e203891e0b28'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:44.390705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daea0e5a728e484cac24474948c48425', 'request_id': 'req-36123d7a-81f2-49b7-be01-e203891e0b28'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:44.477332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daea0e5a728e484cac24474948c48425', 'request_id': 'req-36123d7a-81f2-49b7-be01-e203891e0b28'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:44.500464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] The token cache is being invalidate because project daea0e5a728e484cac24474948c48425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:44.500830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:44.502762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:44.503900 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 792/1585] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:44.505011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173847f6-abeb-4f10-b02a-bf1e2d3523bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.506809 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 794/1586] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:44 2022] DELETE /identity/v3/projects/daea0e5a728e484cac24474948c48425 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:44.507631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.512726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.518958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173847f6-abeb-4f10-b02a-bf1e2d3523bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.525752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.528341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.529094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.529534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.530464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.533231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.555570 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 793/1587] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:44.560761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.563110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.588926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440b08-440c-47fa-876a-61bb2e7d8c6a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.612849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.626485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.627172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.628734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.629749 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:44.631428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.633609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.667762 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 794/1588] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:44.669095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.672668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123d7a-81f2-49b7-be01-e203891e0b28 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.678099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.683521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.689263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.689497 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:44.690421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.690989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.694115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.712227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff930a0-ce7f-4d58-94bf-7c3d4d96b8e4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.740186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.744729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.747695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.748298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.752195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:44.752864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.754776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.785651 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 795/1589] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:44.787401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.790004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.812743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2466-bb24-484d-8864-bfc2cd54aac9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.816907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.817711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.818131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.818534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] PATH_INFO: `/v3/users/dc4340274bfa4bd1a89bf4281a3a559f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.820119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4340274bfa4bd1a89bf4281a3a559f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.822792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.830976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.834913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:44.868054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 795/1590] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:44.870195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:44.876404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:44.923909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ecc1b-77d1-4c06-8e27-4482f6fb8284 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:44.946943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:44.947626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:44.947901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:44.948504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] PATH_INFO: `/v3/projects/9d9e602fc8c244c0a1bbd6a20c1c7f99/users/49c497e36a214f749f621c6e111a8a49/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:44.966523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9e602fc8c244c0a1bbd6a20c1c7f99, user_id=49c497e36a214f749f621c6e111a8a49, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:44.976470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:45.075076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4340274bfa4bd1a89bf4281a3a559f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:45.082551 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 796/1591] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:44 2022] PUT /identity/v3/projects/9d9e602fc8c244c0a1bbd6a20c1c7f99/users/49c497e36a214f749f621c6e111a8a49/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:45.083248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4340274bfa4bd1a89bf4281a3a559f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:45.083448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:45.084586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4340274bfa4bd1a89bf4281a3a559f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:45.199868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4340274bfa4bd1a89bf4281a3a559f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:45.201091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4340274bfa4bd1a89bf4281a3a559f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:45.229888 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 796/1592] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:44 2022] DELETE /identity/v3/users/dc4340274bfa4bd1a89bf4281a3a559f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:45.231260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:45.233187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:45.289729 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:45.329589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b7d1-e63b-4150-b930-45e0dae431dd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:45.332694 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:45.416463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b81b9-e1f5-4168-bf93-6970c991c8ce admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:45.428849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:45.430406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:45.431060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:45.432544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:45.433843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:45.437866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:45.511426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3e699-2f2b-4004-9684-ca69c26f48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:45.512394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3e699-2f2b-4004-9684-ca69c26f48af admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:45.512901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3e699-2f2b-4004-9684-ca69c26f48af admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:45.513397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3e699-2f2b-4004-9684-ca69c26f48af admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:45.514440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3e699-2f2b-4004-9684-ca69c26f48af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:45.517066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3e699-2f2b-4004-9684-ca69c26f48af admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:45.553440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 797/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:45.554930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:45.555217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:45.555495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:45.588254 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 797/1594] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:45 2022] POST /identity/v3/projects => generated 393 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:45.589261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:45.596912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:45.679492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] MFA Rules not processed for user `49c497e36a214f749f621c6e111a8a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:45.680966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:45.786772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71627d-e23b-476a-8767-3e42fa6bc985 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:45.796801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:45.799854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:45.800365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:45.800967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] PATH_INFO: `/v3/users/28eb7a3d57fe46bf94d7cf720d9bcb74` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:45.802494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eb7a3d57fe46bf94d7cf720d9bcb74)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:45.807512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:45.840877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 798/1595] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:45.843678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:45.850626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:45.883456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b6954-46a4-4b7c-bbf9-1c54f88129b4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:45.892761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:45.893173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:45.893451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:45.893722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] PATH_INFO: `/v3/projects/2ca00e22cb684f799091f0d1ffae7cab/users/8d55132fb2c14cc7ba75333d50d36757/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:45.926588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca00e22cb684f799091f0d1ffae7cab, user_id=8d55132fb2c14cc7ba75333d50d36757, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:45.929677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:46.061029 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 799/1596] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:45 2022] PUT /identity/v3/projects/2ca00e22cb684f799091f0d1ffae7cab/users/8d55132fb2c14cc7ba75333d50d36757/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:46.062219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.099316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eb7a3d57fe46bf94d7cf720d9bcb74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.108452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eb7a3d57fe46bf94d7cf720d9bcb74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.109332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eb7a3d57fe46bf94d7cf720d9bcb74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.181286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c0cf5-cfb2-49e1-af30-3db468275472 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:46.186077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:46.186762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.187495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.187495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.187926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:46.190390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:46.191878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eb7a3d57fe46bf94d7cf720d9bcb74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.192801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eb7a3d57fe46bf94d7cf720d9bcb74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.213674 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 798/1597] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:45 2022] DELETE /identity/v3/users/28eb7a3d57fe46bf94d7cf720d9bcb74 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:46.214511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.215837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:46.225038 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:46.300953 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 800/1598] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:46 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:46.301999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.306447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:46.342885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06e9af-6cfa-44fd-b823-3b601669eec6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:46.347826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d29f-9209-45ae-a4c7-6831fbd68e1c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:46.354723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3824f-ffdb-465e-9425-e7326966fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:46.356189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3824f-ffdb-465e-9425-e7326966fa8b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.356477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3824f-ffdb-465e-9425-e7326966fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.356749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3824f-ffdb-465e-9425-e7326966fa8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.357486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:46.357616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3824f-ffdb-465e-9425-e7326966fa8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:46.359493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.359614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3824f-ffdb-465e-9425-e7326966fa8b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:46.360786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.361478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] PATH_INFO: `/v3/projects/5f3fe18dbdf44d5a8ba0c862e7626ca9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.364027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3fe18dbdf44d5a8ba0c862e7626ca9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:46.371388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:46.500578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 799/1599] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:46 2022] POST /identity/v3/projects => generated 375 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:46.500578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc853518-d7ba-478e-97ee-0b6f0eaa99c9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.500578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc853518-d7ba-478e-97ee-0b6f0eaa99c9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.504059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc853518-d7ba-478e-97ee-0b6f0eaa99c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.552686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bc853518-d7ba-478e-97ee-0b6f0eaa99c9 None None] MFA Rules not processed for user `8d55132fb2c14cc7ba75333d50d36757`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:46.554470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bc853518-d7ba-478e-97ee-0b6f0eaa99c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:46.557314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'request_id': 'req-2625a6d9-8acc-43a5-b201-48650426f1d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.577833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'request_id': 'req-2625a6d9-8acc-43a5-b201-48650426f1d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.639113 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 800/1600] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:46.640557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.640557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.640824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.660380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:46.661633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:46.665898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3fe18dbdf44d5a8ba0c862e7626ca9', 'request_id': 'req-2625a6d9-8acc-43a5-b201-48650426f1d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.740662 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 801/1601] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:46.753093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.756414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:46.773332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68f588-f931-4df4-a2bf-f04717dbb5be None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:46.779891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:46.780586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.780871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.781142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.782333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:46.784454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:46.799214 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 802/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:46.800711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.825739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0f26-00b4-4d5a-b357-b04a26a7454d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:46.838336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:46.839783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.839783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.839783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.840285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:46.845160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:46.850162 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:46.856636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] The token cache is being invalidate because project 5f3fe18dbdf44d5a8ba0c862e7626ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:46.856907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.857664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:46.859636 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 801/1603] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:46 2022] DELETE /identity/v3/projects/5f3fe18dbdf44d5a8ba0c862e7626ca9 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:46.861520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.866629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:46.880116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625a6d9-8acc-43a5-b201-48650426f1d1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:46.885204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:46.885836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:46.886134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:46.886408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:46.887343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:46.889271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:46.941760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 803/1604] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:46 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:46.942785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.944658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:46.954721 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:46.993926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 802/1605] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:46 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:46.995306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:46.998502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:47.024896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc2f5-69ab-4ca6-a3d2-2bd5738c2fc3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.093594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1d55-f3ad-4640-ba72-f5c066c3563f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.095886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.101366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3224f-2261-4297-8577-6da4feef5490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.101909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.102388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3224f-2261-4297-8577-6da4feef5490 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.102477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.102557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3224f-2261-4297-8577-6da4feef5490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.102627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.102882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3224f-2261-4297-8577-6da4feef5490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.103770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3224f-2261-4297-8577-6da4feef5490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.105052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:47.109501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3224f-2261-4297-8577-6da4feef5490 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.120313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.122089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.129843 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 803/1606] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:47.129843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736eb73-773e-482d-8d97-1d012086b91c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.129843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736eb73-773e-482d-8d97-1d012086b91c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.129843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736eb73-773e-482d-8d97-1d012086b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.133409 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 804/1607] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:47.134423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.142249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:47.149424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca803f-bd52-4362-9e0e-1f2f910d0745 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.154474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.155117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.155291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9736eb73-773e-482d-8d97-1d012086b91c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:47.155404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.155651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.156303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.156560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9736eb73-773e-482d-8d97-1d012086b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:47.158515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.167417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 804/1608] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:47.170126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736eb73-773e-482d-8d97-1d012086b91c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.174043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 805/1609] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:47.175210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.185059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736eb73-773e-482d-8d97-1d012086b91c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.190983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d82df5-f63e-4c05-849e-08b28cb91ce0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.194589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2635-1fb2-459a-a19e-d9a13a217d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.195388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2635-1fb2-459a-a19e-d9a13a217d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.195663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2635-1fb2-459a-a19e-d9a13a217d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.196384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2635-1fb2-459a-a19e-d9a13a217d83 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.197418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2635-1fb2-459a-a19e-d9a13a217d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.198790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.204441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.204441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.204441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] PATH_INFO: `/v3/projects/61c2d5bf6a264cdeb0886578c750a8cc/users/1c5523ec9d4f46f7863b2e0fc7fe23a5/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.204694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2635-1fb2-459a-a19e-d9a13a217d83 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.221553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c2d5bf6a264cdeb0886578c750a8cc, user_id=1c5523ec9d4f46f7863b2e0fc7fe23a5, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.224497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.356830 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 806/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:47 2022] PUT /identity/v3/projects/61c2d5bf6a264cdeb0886578c750a8cc/users/1c5523ec9d4f46f7863b2e0fc7fe23a5/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:47.358350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.359364 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 805/1611] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:47 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:47.361426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bab55-746a-40b4-a458-5aa01e0cd452 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.362190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bab55-746a-40b4-a458-5aa01e0cd452 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.362190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bab55-746a-40b4-a458-5aa01e0cd452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.386610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-eb3bab55-746a-40b4-a458-5aa01e0cd452 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:47.388281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eb3bab55-746a-40b4-a458-5aa01e0cd452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:47.520120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacceab-0b4a-4419-9efc-45c58de726aa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.521535 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 806/1612] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:47.522626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bab55-746a-40b4-a458-5aa01e0cd452 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.531384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.532775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.533203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.534296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] PATH_INFO: `/v3/projects/5a9908580d244fbca799c549b2f3fabc/users/7d0e89026b5c4cd39defdf99e54f2da1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.544651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bab55-746a-40b4-a458-5aa01e0cd452 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.570241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ce269-df7a-4627-8dfa-ca8e782e12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.570960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce269-df7a-4627-8dfa-ca8e782e12d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.571305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce269-df7a-4627-8dfa-ca8e782e12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.571642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ce269-df7a-4627-8dfa-ca8e782e12d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.572853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ce269-df7a-4627-8dfa-ca8e782e12d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.574907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ce269-df7a-4627-8dfa-ca8e782e12d2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.577536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9908580d244fbca799c549b2f3fabc, user_id=7d0e89026b5c4cd39defdf99e54f2da1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.582137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.599001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 807/1613] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:47.602967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093752b2-b6ae-45e5-85b3-b9227500e33a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.603503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093752b2-b6ae-45e5-85b3-b9227500e33a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.603973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093752b2-b6ae-45e5-85b3-b9227500e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.662426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-093752b2-b6ae-45e5-85b3-b9227500e33a None None] MFA Rules not processed for user `1c5523ec9d4f46f7863b2e0fc7fe23a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:47.664640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-093752b2-b6ae-45e5-85b3-b9227500e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:47.692344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 807/1614] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:47 2022] PUT /identity/v3/projects/5a9908580d244fbca799c549b2f3fabc/users/7d0e89026b5c4cd39defdf99e54f2da1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:47.694912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.777052 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 808/1615] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:47.778162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093752b2-b6ae-45e5-85b3-b9227500e33a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.795464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093752b2-b6ae-45e5-85b3-b9227500e33a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.813744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9d123-1d5a-4879-a115-5927109bb679 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.827341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.827976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.828250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.828514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.829210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:47.829509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.831269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.845654 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 808/1616] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:47.847151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.863382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23059-b043-4f75-8848-47fd1d12efdb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.869099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.869881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.870348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.870691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.878044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.880030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.899008 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 809/1617] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:47.900135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:47.912415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a68f38-82cf-4132-97d4-56df10275d4d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:47.919534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.920169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.920472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.920825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.921376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.925399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:47.928264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:47.929772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:47.930277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:47.930855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] PATH_INFO: `/v3/projects/129dc37259de478a88662a2181fc0a7b/users/194bf2348d4545b5999a5a58202a5788/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:47.949310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129dc37259de478a88662a2181fc0a7b, user_id=194bf2348d4545b5999a5a58202a5788, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:47.954304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.019991 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 810/1618] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:47 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:48.019991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.074390 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 809/1619] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:47 2022] PUT /identity/v3/projects/129dc37259de478a88662a2181fc0a7b/users/194bf2348d4545b5999a5a58202a5788/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:48.075414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.077411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.087479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08901f8a-352e-4eff-9c28-a6923768fdff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.143428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c5652-0be6-41c2-9494-030f2b7ff832 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.147856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.148484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.148767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.149044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.149683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:48.150321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.150976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.151250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.151515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] PATH_INFO: `/v3/projects/34157e4127d14dcdb93f754d5e520161` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.151681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.153152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34157e4127d14dcdb93f754d5e520161)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:48.155649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.159965 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:48.273578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 811/1620] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:48 2022] POST /identity/v3/projects => generated 407 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:48.274621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.294314 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:48.308731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34157e4127d14dcdb93f754d5e520161', 'request_id': 'req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.315586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34157e4127d14dcdb93f754d5e520161', 'request_id': 'req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.340522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901536b-4170-4674-aa3b-2678bc1ed301 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.387952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34157e4127d14dcdb93f754d5e520161', 'request_id': 'req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.402693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.403645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.403945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.404346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] PATH_INFO: `/v3/projects/5a9908580d244fbca799c549b2f3fabc/users/7d0e89026b5c4cd39defdf99e54f2da1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.406903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9908580d244fbca799c549b2f3fabc, user_id=7d0e89026b5c4cd39defdf99e54f2da1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:48.408436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] The token cache is being invalidate because project 34157e4127d14dcdb93f754d5e520161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:48.414052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.414169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.414281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4bb9bd7c-ef97-4379-88ad-2717a3e4f574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.414281 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 810/1621] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:48 2022] DELETE /identity/v3/projects/34157e4127d14dcdb93f754d5e520161 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:48.414281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.414281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.414281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.421318 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 812/1622] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:48 2022] PUT /identity/v3/projects/5a9908580d244fbca799c549b2f3fabc/users/7d0e89026b5c4cd39defdf99e54f2da1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:48.423825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.427637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.446626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] MFA Rules not processed for user `5067f5be07754742b075ada65db2dfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:48.447848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.501600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae7b5-94fc-448e-addb-1f7b0a7e49b3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.506541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.507161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.507436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.507704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.508335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:48.510349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.541063 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 811/1623] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:48.541911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.543589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.557611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcbcf6-06bb-419f-8518-7d88b4df95ad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.562647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.563316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.563593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.563862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.564506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:48.566147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.576127 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 812/1624] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:48.576897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.578688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.590771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5bb66-2607-4195-9457-6ccb9cc4733e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.596829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c336-938e-45b7-bfeb-f5cb99123d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.597440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c336-938e-45b7-bfeb-f5cb99123d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.597717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c336-938e-45b7-bfeb-f5cb99123d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.598004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c336-938e-45b7-bfeb-f5cb99123d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.598649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c336-938e-45b7-bfeb-f5cb99123d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:48.600729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c336-938e-45b7-bfeb-f5cb99123d46 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.637832 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 813/1625] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:48 2022] POST /identity/v3/users => generated 303 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:48.638818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.640337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.653477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a48f7c-ec81-4c60-861a-dfd0c4fe13c6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.658904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.659516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.659790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.660056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] PATH_INFO: `/v3/users/20c2158bdd9d41f28272d786d1bee4a8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.661169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c2158bdd9d41f28272d786d1bee4a8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:48.663137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:48.737399 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 813/1626] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:48 2022] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:48.741675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.741952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.742306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.773630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] MFA Rules not processed for user `7d0e89026b5c4cd39defdf99e54f2da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:48.774936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.853663 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 814/1627] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:48.854605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.856800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.875245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c2158bdd9d41f28272d786d1bee4a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.883393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c2158bdd9d41f28272d786d1bee4a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.884572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c2158bdd9d41f28272d786d1bee4a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.913788 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:48.936953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbad03d-5f56-49a5-adfc-67892cf264c5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:48.939772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c2158bdd9d41f28272d786d1bee4a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.949180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c2158bdd9d41f28272d786d1bee4a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:48.950100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:48.950100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:48.950100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:48.950100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:48.951317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:48.961994 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 814/1628] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:48 2022] DELETE /identity/v3/users/20c2158bdd9d41f28272d786d1bee4a8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:48.962838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:48.964195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.026647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.028503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.044243 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 815/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:48 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:49.045106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.046651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.054187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35321c-5c82-4af7-85a7-fbc4328e873d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.061129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec79bf-eecc-4ff9-877a-5e0f93d77fd1 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.061727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.063685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.066225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.069491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] PATH_INFO: `/v3/projects/129dc37259de478a88662a2181fc0a7b/users/194bf2348d4545b5999a5a58202a5788/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.069722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.069722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.069722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.069722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.070098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.070320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129dc37259de478a88662a2181fc0a7b, user_id=194bf2348d4545b5999a5a58202a5788, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.070696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.080542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.082718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 816/1630] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:49.083747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.085489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.097937 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 815/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:48 2022] PUT /identity/v3/projects/129dc37259de478a88662a2181fc0a7b/users/194bf2348d4545b5999a5a58202a5788/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:49.102152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.102263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feaff5-9dd2-4668-bc2d-e13920aad442 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.103355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.146125 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:49.169511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.170146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.170473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.170743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.171378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.173022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.186749 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 817/1632] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:49.187760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.198287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251842c-6ff3-4c93-97ac-6a6277b698ee admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.200230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277f2a-0092-4f7c-a59f-d9d2fac22fd5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.204166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b909b0c-ff54-48ae-9646-ef22ba3e0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.204869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909b0c-ff54-48ae-9646-ef22ba3e0001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.205144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909b0c-ff54-48ae-9646-ef22ba3e0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.205415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909b0c-ff54-48ae-9646-ef22ba3e0001 admin admin] PATH_INFO: `/v3/projects/ce6865bbb2374fbbb99be847367409af/users/55ded981f6004c1bb793b4ff42bd0230/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.209748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.210613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.210969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.211315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.213549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.220506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b909b0c-ff54-48ae-9646-ef22ba3e0001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6865bbb2374fbbb99be847367409af, user_id=55ded981f6004c1bb793b4ff42bd0230, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.223380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b909b0c-ff54-48ae-9646-ef22ba3e0001 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.295125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.296727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.310058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 816/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:49.316635 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 818/1634] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:49 2022] PUT /identity/v3/projects/ce6865bbb2374fbbb99be847367409af/users/55ded981f6004c1bb793b4ff42bd0230/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:49.318088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf4ede-58a5-48e2-8ecd-2c13f390e7e9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.318683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf4ede-58a5-48e2-8ecd-2c13f390e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.319139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf4ede-58a5-48e2-8ecd-2c13f390e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.321187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.323599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.350461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edb443-9724-4aa1-bc25-73a5433873f7 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.374173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-95bf4ede-58a5-48e2-8ecd-2c13f390e7e9 None None] MFA Rules not processed for user `194bf2348d4545b5999a5a58202a5788`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:49.375090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-95bf4ede-58a5-48e2-8ecd-2c13f390e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.440186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.440808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.441205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.441541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.443437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.470149 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 819/1635] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:49.471133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf4ede-58a5-48e2-8ecd-2c13f390e7e9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.529689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.531335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.542220 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 817/1636] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:49.543379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.570824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf4ede-58a5-48e2-8ecd-2c13f390e7e9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.575975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.576581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.576857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.577136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.577777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.579446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.594879 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 820/1637] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:49.594879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.595673 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:49.609116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701e36-4ac8-4708-bc02-c0edfa848b03 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.619006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.619634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.619907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.620175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.622371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8aa9-01c3-4455-aa7f-630e3b1b305e service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.629034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.629518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.629665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.629933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.630231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.630878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.631113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.632471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.648585 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 818/1638] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:49.649484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.651324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:49.659411 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 821/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:49.660569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.664071 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:49.668767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c190e1b-819c-4cae-a7c4-3dcb80bded84 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.675716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.676645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.677131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.677557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] PATH_INFO: `/v3/projects/ab6c175605394bada4db03c05e501acb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.679067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6c175605394bada4db03c05e501acb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.682836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.686310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde8a06-8fd0-4046-9ca3-02a0b9198731 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.698300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:49.698892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.699167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.699437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] PATH_INFO: `/v3/projects/b001bb5269734fbaa1e472ca4e014305/users/2c57dc6850824421b67d2b23e9aa8b00/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:49.721750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b001bb5269734fbaa1e472ca4e014305, user_id=2c57dc6850824421b67d2b23e9aa8b00, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:49.724518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:49.875507 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 822/1640] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:49 2022] PUT /identity/v3/projects/b001bb5269734fbaa1e472ca4e014305/users/2c57dc6850824421b67d2b23e9aa8b00/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:49.875507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:49.898121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6c175605394bada4db03c05e501acb', 'request_id': 'req-14e56769-e5e9-4651-b614-5810f427f3b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:49.905243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6c175605394bada4db03c05e501acb', 'request_id': 'req-14e56769-e5e9-4651-b614-5810f427f3b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:49.974506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6c175605394bada4db03c05e501acb', 'request_id': 'req-14e56769-e5e9-4651-b614-5810f427f3b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:49.982065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c580f2-a6fa-451b-b69d-3e217fa9208e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:49.989284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] The token cache is being invalidate because project ab6c175605394bada4db03c05e501acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:49.995273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:49.995273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e56769-e5e9-4651-b614-5810f427f3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:49.995273 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 819/1641] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:49 2022] DELETE /identity/v3/projects/ab6c175605394bada4db03c05e501acb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:49.995273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f92b9-f241-4dce-b7ad-ec02adeaf844 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:49.995273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f92b9-f241-4dce-b7ad-ec02adeaf844 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:49.995273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f92b9-f241-4dce-b7ad-ec02adeaf844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.028940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-991f92b9-f241-4dce-b7ad-ec02adeaf844 None None] MFA Rules not processed for user `2c57dc6850824421b67d2b23e9aa8b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:50.029751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-991f92b9-f241-4dce-b7ad-ec02adeaf844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.061730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149da89-11ca-4cdc-9507-e2e19ed1b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.062424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149da89-11ca-4cdc-9507-e2e19ed1b453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.065219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149da89-11ca-4cdc-9507-e2e19ed1b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.065507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149da89-11ca-4cdc-9507-e2e19ed1b453 admin admin] PATH_INFO: `/v3/projects/ce6865bbb2374fbbb99be847367409af/users/55ded981f6004c1bb793b4ff42bd0230/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.067515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149da89-11ca-4cdc-9507-e2e19ed1b453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6865bbb2374fbbb99be847367409af, user_id=55ded981f6004c1bb793b4ff42bd0230, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.070782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149da89-11ca-4cdc-9507-e2e19ed1b453 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.106701 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 823/1642] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:49 2022] PUT /identity/v3/projects/ce6865bbb2374fbbb99be847367409af/users/55ded981f6004c1bb793b4ff42bd0230/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:50.108116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.108399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.108666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.123027 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 820/1643] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:50.123312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89263-d101-4b97-a7fd-798093d70fb0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.123770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89263-d101-4b97-a7fd-798093d70fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.124147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89263-d101-4b97-a7fd-798093d70fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.148733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:50.150305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.167241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-79e89263-d101-4b97-a7fd-798093d70fb0 None None] MFA Rules not processed for user `55ded981f6004c1bb793b4ff42bd0230`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:50.169020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-79e89263-d101-4b97-a7fd-798093d70fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.222490 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:50.244773 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 824/1644] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:50.245801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.247372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.263472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ebc7-6d22-405d-ac8b-f5e626d622a5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.277413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.278069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.278348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.278618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.279247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.281476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.300474 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 821/1645] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:50.301764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e02c7-8287-4057-b77f-830245391c2f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.302069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e02c7-8287-4057-b77f-830245391c2f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.302340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e02c7-8287-4057-b77f-830245391c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.324618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-527e02c7-8287-4057-b77f-830245391c2f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:50.325895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-527e02c7-8287-4057-b77f-830245391c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.334892 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 822/1646] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:50.335659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e02c7-8287-4057-b77f-830245391c2f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.339714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-527e02c7-8287-4057-b77f-830245391c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.352712 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:50.388881 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 825/1647] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:50 2022] POST /identity/v3/projects => generated 407 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:50.391796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.445859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e02c7-8287-4057-b77f-830245391c2f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.479460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00dc5-0c7e-4ad8-800b-6356a4d87f45 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.493430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.494241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.494664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.495540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.496630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:50.496630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.498939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.517652 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 826/1648] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:50.518977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.532763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec468b-fa35-41e0-af28-f7b756c6ae44 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.537927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.538913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.538913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.539205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.540012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.541941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.557022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.557746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.558121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.558478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.622433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.625033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.633623 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 823/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:50.634531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.644351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b4709-ffbc-4dec-8e80-19f6b422f090 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.650034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.650465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.651092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.651092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.651592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.653597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.671596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 827/1650] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:50 2022] POST /identity/v3/users => generated 310 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:50.673562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.677856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.706607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2144527-3e1b-4256-befb-6190b0a3ab2e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.718187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.718870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.719681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.719948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] PATH_INFO: `/v3/users/49c497e36a214f749f621c6e111a8a49` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.721140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c497e36a214f749f621c6e111a8a49)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.723554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.759155 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 824/1651] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:50 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:50.760403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.826278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07152255-89bf-49c6-9aef-805959843763 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.830885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.831492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.831765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.832077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.832667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.834280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:50.844847 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 825/1652] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:50.845663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:50.849955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:50.869672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879031ed-ec4e-4707-8dc9-a1118b02d718 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:50.874631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:50.876602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:50.876887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:50.877223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] PATH_INFO: `/v3/users/1c5523ec9d4f46f7863b2e0fc7fe23a5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:50.879370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5523ec9d4f46f7863b2e0fc7fe23a5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:50.881656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:51.501096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c497e36a214f749f621c6e111a8a49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.508249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c497e36a214f749f621c6e111a8a49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.508971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c497e36a214f749f621c6e111a8a49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.690457 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:51.808739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c497e36a214f749f621c6e111a8a49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.811632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c497e36a214f749f621c6e111a8a49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.826695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5523ec9d4f46f7863b2e0fc7fe23a5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.834065 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 828/1653] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:50 2022] DELETE /identity/v3/users/49c497e36a214f749f621c6e111a8a49 => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:51.834065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:51.834297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:51.836860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5523ec9d4f46f7863b2e0fc7fe23a5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.837633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5523ec9d4f46f7863b2e0fc7fe23a5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.908727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff05a8-f48c-4360-b03b-e4fe44a90d04 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:51.913946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf83c-f96f-40c8-a276-88eab44d850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:51.914586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf83c-f96f-40c8-a276-88eab44d850a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:51.914866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf83c-f96f-40c8-a276-88eab44d850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:51.915138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf83c-f96f-40c8-a276-88eab44d850a admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:51.915770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf83c-f96f-40c8-a276-88eab44d850a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:51.917663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf83c-f96f-40c8-a276-88eab44d850a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:51.919823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5523ec9d4f46f7863b2e0fc7fe23a5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.920536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5523ec9d4f46f7863b2e0fc7fe23a5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:51.939952 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 826/1654] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:50 2022] DELETE /identity/v3/users/1c5523ec9d4f46f7863b2e0fc7fe23a5 => generated 0 bytes in 1095 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:51.940759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:51.943008 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:51.944043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.010561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bcf2b-8122-4c80-b29d-96406ff6ac2c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.015432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.016143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.016419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.016687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] PATH_INFO: `/v3/projects/3fdc2e45837f4cb4b5d0ca3bcfb73a5e/users/b1adf43c0cc6443d9d3c02504a0a3bb8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.023011 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 829/1655] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:51 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:52.024327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d978-29fd-42ce-9912-f383d08ae8eb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.024609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d978-29fd-42ce-9912-f383d08ae8eb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.024879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d978-29fd-42ce-9912-f383d08ae8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.033374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdc2e45837f4cb4b5d0ca3bcfb73a5e, user_id=b1adf43c0cc6443d9d3c02504a0a3bb8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.036251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.044939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7693d978-29fd-42ce-9912-f383d08ae8eb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:52.046163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7693d978-29fd-42ce-9912-f383d08ae8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.054680 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 830/1656] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:52.056011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.056296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.056567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.079879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:52.079879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.086709 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 831/1657] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:52.087828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.089340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.101584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9191e5-9835-4a86-ba3d-11348089fa83 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.106497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.109289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.109289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.109289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.109289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.110673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.120714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 832/1658] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:52.121639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.123252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.137095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 827/1659] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:51 2022] PUT /identity/v3/projects/3fdc2e45837f4cb4b5d0ca3bcfb73a5e/users/b1adf43c0cc6443d9d3c02504a0a3bb8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:52.137928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.141357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.178784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455abab-74f7-403c-aa0f-bc22c90d6294 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.202039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be55cec-92cf-48ba-9623-9ec6bd57b72f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.206170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.206831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.207112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.207383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.243846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.245028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.245593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.246092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.280264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.282689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.299644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 828/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:52.300504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.312603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5b655-afe1-4077-8efc-4ef1245d4f43 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.320434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.322183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.332493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.334290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.334572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.334842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.340071 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 833/1661] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:52.341489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.341715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.347817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.355377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079e1b-ee8f-43e0-895f-9ed78662f088 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.363254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.363961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.364240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.364511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.365158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.369774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.376865 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 829/1662] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:52.378743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.383287 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 834/1663] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:52.387274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.401558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c80746-4339-434a-80ff-b43580ea7c0d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.407864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301dbf4-b5e9-4f5d-a138-442aa16b3d1d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.409604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34536c-3653-409e-8c95-f8eed991170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.420478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34536c-3653-409e-8c95-f8eed991170b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.420478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34536c-3653-409e-8c95-f8eed991170b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.420478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34536c-3653-409e-8c95-f8eed991170b admin admin] PATH_INFO: `/v3/projects/d46a7166e4144f55a102ea6335c5f820/users/1c2310cbc3574eb29a6ca6291ba7808e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.426730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3baf3-29af-41f7-8275-3bcfb226ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.427621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3baf3-29af-41f7-8275-3bcfb226ce54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.428567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3baf3-29af-41f7-8275-3bcfb226ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.429161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3baf3-29af-41f7-8275-3bcfb226ce54 admin admin] PATH_INFO: `/v3/projects/3fdc2e45837f4cb4b5d0ca3bcfb73a5e/users/b1adf43c0cc6443d9d3c02504a0a3bb8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.431773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3baf3-29af-41f7-8275-3bcfb226ce54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdc2e45837f4cb4b5d0ca3bcfb73a5e, user_id=b1adf43c0cc6443d9d3c02504a0a3bb8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.434624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3baf3-29af-41f7-8275-3bcfb226ce54 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.437390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34536c-3653-409e-8c95-f8eed991170b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46a7166e4144f55a102ea6335c5f820, user_id=1c2310cbc3574eb29a6ca6291ba7808e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.442033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34536c-3653-409e-8c95-f8eed991170b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.461206 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 835/1664] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:52 2022] PUT /identity/v3/projects/3fdc2e45837f4cb4b5d0ca3bcfb73a5e/users/b1adf43c0cc6443d9d3c02504a0a3bb8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:10:52.463482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890154e-9e30-4259-9ffb-0b6f1d26423c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.463760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890154e-9e30-4259-9ffb-0b6f1d26423c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.464048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890154e-9e30-4259-9ffb-0b6f1d26423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.500598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3890154e-9e30-4259-9ffb-0b6f1d26423c None None] MFA Rules not processed for user `b1adf43c0cc6443d9d3c02504a0a3bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:52.502064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3890154e-9e30-4259-9ffb-0b6f1d26423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.591418 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 836/1665] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:10:52.599673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890154e-9e30-4259-9ffb-0b6f1d26423c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.614754 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 830/1666] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:52 2022] PUT /identity/v3/projects/d46a7166e4144f55a102ea6335c5f820/users/1c2310cbc3574eb29a6ca6291ba7808e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:52.616794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.617204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.617569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.649218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:52.651171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.681491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890154e-9e30-4259-9ffb-0b6f1d26423c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.743212 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 831/1667] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:52.745493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.746701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.746701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.746944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] PATH_INFO: `/v3/users/2c57dc6850824421b67d2b23e9aa8b00` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.748092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c57dc6850824421b67d2b23e9aa8b00)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.750083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.752859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:52.754309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:52.824080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131a853-9552-45cf-8fb4-1b7f64cff461 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:52.828031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f97ec-a5cf-4750-97f8-bb0f300daafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:52.829271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f97ec-a5cf-4750-97f8-bb0f300daafa service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:52.829543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f97ec-a5cf-4750-97f8-bb0f300daafa service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:52.829811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f97ec-a5cf-4750-97f8-bb0f300daafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:52.839525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f97ec-a5cf-4750-97f8-bb0f300daafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:52.861580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f97ec-a5cf-4750-97f8-bb0f300daafa service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:52.861580 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 832/1668] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:53.006796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c57dc6850824421b67d2b23e9aa8b00'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.018851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c57dc6850824421b67d2b23e9aa8b00'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.020245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c57dc6850824421b67d2b23e9aa8b00'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.109456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c57dc6850824421b67d2b23e9aa8b00'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.110519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c57dc6850824421b67d2b23e9aa8b00'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.134920 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 837/1669] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:52 2022] DELETE /identity/v3/users/2c57dc6850824421b67d2b23e9aa8b00 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:10:53.143982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:53.144327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:53.147578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:53.177272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:53.182019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:53.262552 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 833/1670] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:53.269576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:53.269726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:53.271166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:53.271691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:53.284929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d52485-49a6-4ebe-bb33-bdf7a7971cdb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:53.296819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:53.298119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:53.299791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:53.300251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] PATH_INFO: `/v3/projects/9d9e602fc8c244c0a1bbd6a20c1c7f99` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:53.302693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9e602fc8c244c0a1bbd6a20c1c7f99)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:53.307333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:53.350241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa79a-989b-4338-90ba-664cd04e3f56 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:53.354938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:53.355663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:53.356039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:53.356399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:53.372236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:53.372236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:53.381636 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 834/1671] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:10:53.428350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:53.430020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:53.446080 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:53.458143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ebc06-9304-4ee0-a4c0-f9ad6d0dda53 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:53.466159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:53.467050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:53.467527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:53.467941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] PATH_INFO: `/v3/projects/61c2d5bf6a264cdeb0886578c750a8cc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:53.473703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c2d5bf6a264cdeb0886578c750a8cc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:53.473703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:53.520913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9e602fc8c244c0a1bbd6a20c1c7f99', 'request_id': 'req-a4661828-168a-4d11-ae84-a1e2b2956a6a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.527372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9e602fc8c244c0a1bbd6a20c1c7f99', 'request_id': 'req-a4661828-168a-4d11-ae84-a1e2b2956a6a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.769211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9e602fc8c244c0a1bbd6a20c1c7f99', 'request_id': 'req-a4661828-168a-4d11-ae84-a1e2b2956a6a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.791045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] The token cache is being invalidate because project 9d9e602fc8c244c0a1bbd6a20c1c7f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:53.792147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.795189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4661828-168a-4d11-ae84-a1e2b2956a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.800426 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 838/1672] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:53 2022] DELETE /identity/v3/projects/9d9e602fc8c244c0a1bbd6a20c1c7f99 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:53.800426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c50a-9c5c-4356-aaad-4b058e1a3cde None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:53.800426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c50a-9c5c-4356-aaad-4b058e1a3cde None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:53.800426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c50a-9c5c-4356-aaad-4b058e1a3cde None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:53.801382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c2d5bf6a264cdeb0886578c750a8cc', 'request_id': 'req-8344141e-2c71-4971-8262-fe4fb3a4ba62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.803765 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 839/1673] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:10:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:10:53.806799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c50a-9c5c-4356-aaad-4b058e1a3cde None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:53.809318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c2d5bf6a264cdeb0886578c750a8cc', 'request_id': 'req-8344141e-2c71-4971-8262-fe4fb3a4ba62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.813217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c14c50a-9c5c-4356-aaad-4b058e1a3cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:53.843736 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:53.889026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c2d5bf6a264cdeb0886578c750a8cc', 'request_id': 'req-8344141e-2c71-4971-8262-fe4fb3a4ba62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.909840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] The token cache is being invalidate because project 61c2d5bf6a264cdeb0886578c750a8cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:53.910189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.910823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8344141e-2c71-4971-8262-fe4fb3a4ba62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:53.912086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c50a-9c5c-4356-aaad-4b058e1a3cde None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:53.913132 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 835/1674] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:53 2022] DELETE /identity/v3/projects/61c2d5bf6a264cdeb0886578c750a8cc => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:53.915672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3e24-22a4-4232-b6c2-e64ab6392c19 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:53.916238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3e24-22a4-4232-b6c2-e64ab6392c19 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:53.923217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db3e24-22a4-4232-b6c2-e64ab6392c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:53.923343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:53.923343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:53.923343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:53.923343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] PATH_INFO: `/v3/users/7d0e89026b5c4cd39defdf99e54f2da1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:53.924333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0e89026b5c4cd39defdf99e54f2da1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:53.926540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:53.959550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-36db3e24-22a4-4232-b6c2-e64ab6392c19 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:53.977287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-36db3e24-22a4-4232-b6c2-e64ab6392c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:54.045250 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 836/1675] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:54.047480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:54.047771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:54.048041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:54.071389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] MFA Rules not processed for user `9e535f9274b24a9f800ea0c3d8faba5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:54.072733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:54.137433 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 837/1676] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:54.137433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:54.137433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:54.155486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203456b-5fbc-4d59-994b-b25327bf76d2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:54.161926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:54.163064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:54.163348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:54.163617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] PATH_INFO: `/v3/users/55ded981f6004c1bb793b4ff42bd0230` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:54.164916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ded981f6004c1bb793b4ff42bd0230)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:54.166988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:54.183911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0e89026b5c4cd39defdf99e54f2da1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.194877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0e89026b5c4cd39defdf99e54f2da1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.196027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0e89026b5c4cd39defdf99e54f2da1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.302530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0e89026b5c4cd39defdf99e54f2da1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.303164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0e89026b5c4cd39defdf99e54f2da1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.325574 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 840/1677] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:53 2022] DELETE /identity/v3/users/7d0e89026b5c4cd39defdf99e54f2da1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:54.325574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:54.325574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:54.436075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481714f0-48e8-4222-8465-94731e5ac479 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:54.444588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ded981f6004c1bb793b4ff42bd0230'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.446387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:54.447169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:54.447441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:54.447738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:54.449767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:54.461992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ded981f6004c1bb793b4ff42bd0230'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.464580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ded981f6004c1bb793b4ff42bd0230'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.491061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:54.492680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:54.505091 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 841/1678] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:54.506130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:54.508933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:54.588863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ded981f6004c1bb793b4ff42bd0230'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.589739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0ccdbe1-cd5a-4d68-8ec8-0593031d3f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ded981f6004c1bb793b4ff42bd0230'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.660803 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 838/1679] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:54 2022] DELETE /identity/v3/users/55ded981f6004c1bb793b4ff42bd0230 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:54.712638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4584-b208-4af8-a10b-f3436746325c service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:54.803074 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:54.816251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:54.818362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:54.819868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:54.820909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] PATH_INFO: `/v3/projects/b001bb5269734fbaa1e472ca4e014305` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:54.824279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b001bb5269734fbaa1e472ca4e014305)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:54.826876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:54.908585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:54.908986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:54.910217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:54.931850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:54.933063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:54.971181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b001bb5269734fbaa1e472ca4e014305', 'request_id': 'req-77ee8990-7871-4dec-b123-559342b890f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.976695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b001bb5269734fbaa1e472ca4e014305', 'request_id': 'req-77ee8990-7871-4dec-b123-559342b890f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:54.989681 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 839/1680] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:10:55.001920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:55.011409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:55.013880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be09e-a933-4c09-85bd-321f86e169a9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:55.034679 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:55.068216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:55.068836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:55.069334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:55.070122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:55.078075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:55.080212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:55.088790 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 840/1681] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:10:55.089637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:55.091568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:55.092510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b001bb5269734fbaa1e472ca4e014305', 'request_id': 'req-77ee8990-7871-4dec-b123-559342b890f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.116522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] The token cache is being invalidate because project b001bb5269734fbaa1e472ca4e014305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:55.117416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.118392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.120718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 842/1682] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:54 2022] DELETE /identity/v3/projects/b001bb5269734fbaa1e472ca4e014305 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:55.126137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:55.128357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:55.223929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596fa8e-9bb5-4a84-9616-b861f4f0c7d0 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:55.237433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:55.238773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:55.239260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:55.239735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] PATH_INFO: `/v3/projects/5a9908580d244fbca799c549b2f3fabc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:55.242693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9908580d244fbca799c549b2f3fabc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:55.248244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:55.249178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee8990-7871-4dec-b123-559342b890f0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:55.268228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:55.269155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:55.269583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:55.270048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] PATH_INFO: `/v3/users/b1adf43c0cc6443d9d3c02504a0a3bb8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:55.272124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1adf43c0cc6443d9d3c02504a0a3bb8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:55.276901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:55.386764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9908580d244fbca799c549b2f3fabc', 'request_id': 'req-cf624c6e-2ea3-41dd-9951-e25356b0a18d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.395813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9908580d244fbca799c549b2f3fabc', 'request_id': 'req-cf624c6e-2ea3-41dd-9951-e25356b0a18d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.520367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9908580d244fbca799c549b2f3fabc', 'request_id': 'req-cf624c6e-2ea3-41dd-9951-e25356b0a18d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.547408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1adf43c0cc6443d9d3c02504a0a3bb8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.553892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] The token cache is being invalidate because project 5a9908580d244fbca799c549b2f3fabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:55.557648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1adf43c0cc6443d9d3c02504a0a3bb8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.569493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.569898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1adf43c0cc6443d9d3c02504a0a3bb8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.572398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.576791 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 841/1683] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:55 2022] DELETE /identity/v3/projects/5a9908580d244fbca799c549b2f3fabc => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:55.582362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:55.586712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:55.658508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1adf43c0cc6443d9d3c02504a0a3bb8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.659255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3d409f3-b4fe-445f-adee-62692d21daca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1adf43c0cc6443d9d3c02504a0a3bb8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.678503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf624c6e-2ea3-41dd-9951-e25356b0a18d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:55.683137 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 843/1684] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:10:55 2022] DELETE /identity/v3/users/b1adf43c0cc6443d9d3c02504a0a3bb8 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:55.683137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3a62-4cac-4d2e-803d-c364d5e0d318 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:55.683137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3a62-4cac-4d2e-803d-c364d5e0d318 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:55.683137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3a62-4cac-4d2e-803d-c364d5e0d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:55.722825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4f4f3a62-4cac-4d2e-803d-c364d5e0d318 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:55.724460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f4f3a62-4cac-4d2e-803d-c364d5e0d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:55.804378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:55.805338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:55.805825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:55.806491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] PATH_INFO: `/v3/projects/ce6865bbb2374fbbb99be847367409af` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:55.811105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6865bbb2374fbbb99be847367409af)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:55.814028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:55.902089 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 844/1685] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:55.907267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac943-7cfd-4c2e-9c9e-054f07b909ad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:55.907553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac943-7cfd-4c2e-9c9e-054f07b909ad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:55.907828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac943-7cfd-4c2e-9c9e-054f07b909ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:55.934072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8c3ac943-7cfd-4c2e-9c9e-054f07b909ad None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:55.944194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8c3ac943-7cfd-4c2e-9c9e-054f07b909ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:55.965780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6865bbb2374fbbb99be847367409af', 'request_id': 'req-aba4bec3-f33a-450a-9665-33a318c48890'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:55.984401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6865bbb2374fbbb99be847367409af', 'request_id': 'req-aba4bec3-f33a-450a-9665-33a318c48890'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:56.039212 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 845/1686] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:56.043918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac943-7cfd-4c2e-9c9e-054f07b909ad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.053424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac943-7cfd-4c2e-9c9e-054f07b909ad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.054778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6865bbb2374fbbb99be847367409af', 'request_id': 'req-aba4bec3-f33a-450a-9665-33a318c48890'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:56.068863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.070649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.071443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.072150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.074698 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:56.075478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:56.076559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.079743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.093833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] The token cache is being invalidate because project ce6865bbb2374fbbb99be847367409af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:56.094317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:56.095147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aba4bec3-f33a-450a-9665-33a318c48890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:56.099598 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 846/1688] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:10:56.101734 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 842/1688] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:55 2022] DELETE /identity/v3/projects/ce6865bbb2374fbbb99be847367409af => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:56.101870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.103525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcb6a-d14a-4d56-a70f-06f719708846 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.103988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcb6a-d14a-4d56-a70f-06f719708846 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.104262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcb6a-d14a-4d56-a70f-06f719708846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.104370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:56.121597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf678-f634-463a-a272-29875cee1ad8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.128913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.129451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e9bdcb6a-d14a-4d56-a70f-06f719708846 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:56.129843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.130278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.130654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.131718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.132042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e9bdcb6a-d14a-4d56-a70f-06f719708846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:56.136916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.153407 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 843/1689] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:56.156040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5127c-7bc8-4c82-9264-48759fd4ad91 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.157147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5127c-7bc8-4c82-9264-48759fd4ad91 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.157549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5127c-7bc8-4c82-9264-48759fd4ad91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.187220 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:56.218598 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 847/1690] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:56 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:56.224677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.234836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-07f5127c-7bc8-4c82-9264-48759fd4ad91 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:56.234836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-07f5127c-7bc8-4c82-9264-48759fd4ad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:56.355299 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 844/1691] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:56.364767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5127c-7bc8-4c82-9264-48759fd4ad91 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.381296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5127c-7bc8-4c82-9264-48759fd4ad91 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.395153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.396094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.401816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.401816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.401816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:56.401816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.402202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a4ce-7d1a-4d0c-8e45-f0383788f3eb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.402384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.408086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.411048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.411637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.412033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.413214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.415398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.433377 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 845/1692] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:56.435279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.455666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847690-4d74-4fc6-b682-39a9b2c3b80a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.462261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.463166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.463521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.463706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.464490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.466750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.568432 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 848/1693] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:56 2022] POST /identity/v3/users => generated 297 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:56.571011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.577090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:56.592495 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 846/1694] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:56 2022] POST /identity/v3/projects => generated 359 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:56.592968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.608833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10046a1-5a1a-414e-97f9-76fa5dd9e113 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.735834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86d6cd-0935-4f1a-b996-f107614b87e7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.745082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.745283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.745756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.745840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.745840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.746143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.746234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] PATH_INFO: `/v3/projects/3fdc2e45837f4cb4b5d0ca3bcfb73a5e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.746311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.746311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.747250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.751405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdc2e45837f4cb4b5d0ca3bcfb73a5e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.753663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.761296 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 847/1695] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:56.762396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.777207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e13c20-02de-445f-93ac-009570188617 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.783377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.784143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.784530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.785183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.785700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.787946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.817785 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:56.944195 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 848/1696] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:56 2022] POST /identity/v3/users => generated 280 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:56.944195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.951723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cdd1a-74d8-4fce-8d13-381e2697444c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:56.956706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:56.957384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:56.957728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:56.958102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:56.958881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:56.960475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:56.978323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 849/1697] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:56.978323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:56.989957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7567-d857-40ec-9d14-0aaf54680d3e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.013125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdc2e45837f4cb4b5d0ca3bcfb73a5e', 'request_id': 'req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:57.020127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdc2e45837f4cb4b5d0ca3bcfb73a5e', 'request_id': 'req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:57.068388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.069180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.069556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.069924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.070792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.072539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.084179 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 850/1698] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:57.085021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:57.098454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db69f1-6bd4-477c-8a6d-be3895e041f7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.101854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.102635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.102999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.103341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] PATH_INFO: `/v3/projects/efa16b9c333c42ff8860639c213453c6/users/ec43833fb4d646ab9f26d425cdb0b694/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.131809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa16b9c333c42ff8860639c213453c6, user_id=ec43833fb4d646ab9f26d425cdb0b694, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.135084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.142074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdc2e45837f4cb4b5d0ca3bcfb73a5e', 'request_id': 'req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:57.164713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] The token cache is being invalidate because project 3fdc2e45837f4cb4b5d0ca3bcfb73a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:10:57.166978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:57.166978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:10:57.168151 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 849/1699] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:10:56 2022] DELETE /identity/v3/projects/3fdc2e45837f4cb4b5d0ca3bcfb73a5e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:57.169134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:57.170672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:57.186235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e458ae0-82cf-42ad-8fd9-88c0d85659d5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.191932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f9279-d164-4365-9b34-c0ddbba564a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.192636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f9279-d164-4365-9b34-c0ddbba564a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.192982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f9279-d164-4365-9b34-c0ddbba564a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.193342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f9279-d164-4365-9b34-c0ddbba564a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.194344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f9279-d164-4365-9b34-c0ddbba564a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.195953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f9279-d164-4365-9b34-c0ddbba564a7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.214428 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 850/1700] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:57.214428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f119-f9b9-4a43-ac42-3e57c4d5aafe None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.214428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f119-f9b9-4a43-ac42-3e57c4d5aafe None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.214428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f119-f9b9-4a43-ac42-3e57c4d5aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.220429 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 851/1701] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:57 2022] PUT /identity/v3/projects/efa16b9c333c42ff8860639c213453c6/users/ec43833fb4d646ab9f26d425cdb0b694/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:57.221146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:57.268106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3494f119-f9b9-4a43-ac42-3e57c4d5aafe None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:57.269374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3494f119-f9b9-4a43-ac42-3e57c4d5aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:57.304493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf5887-df86-43e2-bc12-09ccbf022f09 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.313133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57fff8-ffd5-4206-abaf-796fc3d9e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.313875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fff8-ffd5-4206-abaf-796fc3d9e5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.314176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fff8-ffd5-4206-abaf-796fc3d9e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.314495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fff8-ffd5-4206-abaf-796fc3d9e5ee admin admin] PATH_INFO: `/v3/projects/b12ed5e16f2d4f9bb561e3f57bcce40c/users/57c25d29b3744e348ddb3dfc9d2e5be8/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.318890 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:57.333949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57fff8-ffd5-4206-abaf-796fc3d9e5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12ed5e16f2d4f9bb561e3f57bcce40c, user_id=57c25d29b3744e348ddb3dfc9d2e5be8, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.337093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57fff8-ffd5-4206-abaf-796fc3d9e5ee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.347126 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 851/1702] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:57.348729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa01a4-ed65-457e-86a6-e7b8572eed9b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.349143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa01a4-ed65-457e-86a6-e7b8572eed9b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.349829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa01a4-ed65-457e-86a6-e7b8572eed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.387056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-52fa01a4-ed65-457e-86a6-e7b8572eed9b None None] MFA Rules not processed for user `ec43833fb4d646ab9f26d425cdb0b694`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:57.388509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-52fa01a4-ed65-457e-86a6-e7b8572eed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:57.423916 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 852/1703] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:57 2022] PUT /identity/v3/projects/b12ed5e16f2d4f9bb561e3f57bcce40c/users/57c25d29b3744e348ddb3dfc9d2e5be8/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:57.425320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.425609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.425877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.463254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:57.464503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:57.503344 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 852/1704] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:57.504728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769913b-ea96-489a-93dc-e20c7147e00e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.505012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769913b-ea96-489a-93dc-e20c7147e00e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.505280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769913b-ea96-489a-93dc-e20c7147e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.537645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a769913b-ea96-489a-93dc-e20c7147e00e None None] MFA Rules not processed for user `57c25d29b3744e348ddb3dfc9d2e5be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:57.539132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a769913b-ea96-489a-93dc-e20c7147e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:57.586645 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 853/1705] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:57.587644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:57.590221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:57.607801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bc0df-c3f2-466e-8a61-2285c562de06 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.618801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.620040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.620759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.621792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.623013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.625487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.663299 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 853/1706] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:57.663299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769913b-ea96-489a-93dc-e20c7147e00e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:57.679219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769913b-ea96-489a-93dc-e20c7147e00e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.685151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.686052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.686539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.686989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.687971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:10:57.688497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.705929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.734242 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 854/1707] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:10:57.734242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:57.748365 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 854/1708] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:57.748365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:57.752383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342a88-4ddb-40b3-a59c-a10236bd22cd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.846247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e1a56-f099-41cb-ba5a-67f81ad9ac51 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:57.850947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.851565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.851840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.852177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.852822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.853603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:57.854569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:57.857663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:57.857780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.857872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:57.857872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:57.858710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:57.977140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 855/1709] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/projects => generated 359 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:57.978321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.001782 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 855/1710] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:58.005152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.095480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3934497-4f63-43ea-9d10-b3fd07fd077d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.106745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.107438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.107738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.107995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.109065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.111277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.112423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf90c7-1273-4b2b-903c-bc2d270ff8b6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.122899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.123681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.124072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.124471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.125785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.128345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.276009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 856/1711] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:57 2022] POST /identity/v3/users => generated 303 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:58.276009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.276447 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 856/1712] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:58 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:58.290009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.299538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9c769-51cc-438c-9d56-b029982bf5a3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.301782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d019b3-d2bf-4268-8c16-c879e3882034 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.313863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.316754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.316754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.316754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.316754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.318342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.319156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.320429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.320907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.321421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.322428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.324724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.343388 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 857/1713] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:58.344855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.356260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52629-676b-4838-bc9f-39c28fdba44a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.362017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.362733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.363097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.363427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.364827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.365918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.385300 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 858/1714] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:58.386530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.398324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5d607-e7d8-4ae1-b1de-d53746f46079 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.412289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.412289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.412289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.412289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] PATH_INFO: `/v3/projects/8521ce0aa50c4ddd89b9aeaffbbfda60/users/ca315992f7ac45fbbb646bd343d6b877/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.412679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 857/1715] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:58 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:58.412679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.431667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e10c-c37a-496a-b5bb-b99f41c7bc1b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.435903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8521ce0aa50c4ddd89b9aeaffbbfda60, user_id=ca315992f7ac45fbbb646bd343d6b877, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.440522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.445535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.447205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.447510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.448255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] PATH_INFO: `/v3/projects/927d09d6caf947edad1ca3b547ba12b9/users/c346f5b1d92143a0aea75249ccf3e11e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.467033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d09d6caf947edad1ca3b547ba12b9, user_id=c346f5b1d92143a0aea75249ccf3e11e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.470497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.572586 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 859/1716] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:58 2022] PUT /identity/v3/projects/8521ce0aa50c4ddd89b9aeaffbbfda60/users/ca315992f7ac45fbbb646bd343d6b877/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:58.573513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.615132 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 858/1717] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:58 2022] PUT /identity/v3/projects/927d09d6caf947edad1ca3b547ba12b9/users/c346f5b1d92143a0aea75249ccf3e11e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:58.619025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.665100 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:58.721741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1d07-7857-4d64-93bf-02a072a5ac82 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.727754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce40365-c0d8-44bf-b46c-690d092c3fc8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.732973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.733588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.733861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.734001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.734723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.735377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.735932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.736288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.736635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.737097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.737424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.739323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.751710 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 859/1718] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:58.751710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.764243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce7bae-aca7-4178-a1b7-a3d727166472 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.773738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.774764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.775261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.775762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.776610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.778639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.788124 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 860/1719] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:58.790291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.807490 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 860/1720] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:58.807490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.815077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfcfa0-40ad-43d2-9f92-b8a6dd7761ef admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.830736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf44ea-6788-4036-9ede-a0929f4ab4fe admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.833346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.834133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.834478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.834924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] PATH_INFO: `/v3/projects/8521ce0aa50c4ddd89b9aeaffbbfda60/users/ca315992f7ac45fbbb646bd343d6b877/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.838421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8521ce0aa50c4ddd89b9aeaffbbfda60, user_id=ca315992f7ac45fbbb646bd343d6b877, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.840392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.841191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.841463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.841800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.842266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.843056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.845409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.862414 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 861/1721] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:10:58.863513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.869324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 861/1722] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:58 2022] PUT /identity/v3/projects/8521ce0aa50c4ddd89b9aeaffbbfda60/users/ca315992f7ac45fbbb646bd343d6b877/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:58.870334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:58.873951 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:10:58.878003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eebf4-edc2-4882-ab22-611a170f526e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:58.978886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399720a-c275-4959-9e3c-f44831ecf26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:58.979818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399720a-c275-4959-9e3c-f44831ecf26e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:58.980097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399720a-c275-4959-9e3c-f44831ecf26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:58.980367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399720a-c275-4959-9e3c-f44831ecf26e admin admin] PATH_INFO: `/v3/projects/927d09d6caf947edad1ca3b547ba12b9/users/c346f5b1d92143a0aea75249ccf3e11e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:58.982417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399720a-c275-4959-9e3c-f44831ecf26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d09d6caf947edad1ca3b547ba12b9, user_id=c346f5b1d92143a0aea75249ccf3e11e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:58.985661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399720a-c275-4959-9e3c-f44831ecf26e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:58.998072 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 862/1723] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:58 2022] PUT /identity/v3/projects/927d09d6caf947edad1ca3b547ba12b9/users/c346f5b1d92143a0aea75249ccf3e11e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:59.001297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce36d-17a1-469f-a6ae-4311cf8b3430 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.001581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce36d-17a1-469f-a6ae-4311cf8b3430 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.001858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce36d-17a1-469f-a6ae-4311cf8b3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.003973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0580047-4fb8-4661-9e01-a27d8c24943f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:59.038469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c23ce36d-17a1-469f-a6ae-4311cf8b3430 None None] MFA Rules not processed for user `ca315992f7ac45fbbb646bd343d6b877`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:59.039991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c23ce36d-17a1-469f-a6ae-4311cf8b3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:59.094526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd71d35-096e-4bd6-9a8d-e3878ffac0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:59.095495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71d35-096e-4bd6-9a8d-e3878ffac0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.096479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71d35-096e-4bd6-9a8d-e3878ffac0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.096923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd71d35-096e-4bd6-9a8d-e3878ffac0ae admin admin] PATH_INFO: `/v3/projects/de8fc10844034e78852b2a584aa350ff/users/ffe99f99e6364e99af82483e24d5d65b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.123621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd71d35-096e-4bd6-9a8d-e3878ffac0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8fc10844034e78852b2a584aa350ff, user_id=ffe99f99e6364e99af82483e24d5d65b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:59.129361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd71d35-096e-4bd6-9a8d-e3878ffac0ae admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:59.164541 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 863/1724] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:59.166120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47348f1f-083c-4030-917d-3866e811a074 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.166544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47348f1f-083c-4030-917d-3866e811a074 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.166946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47348f1f-083c-4030-917d-3866e811a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.209147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-47348f1f-083c-4030-917d-3866e811a074 None None] MFA Rules not processed for user `c346f5b1d92143a0aea75249ccf3e11e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:59.210657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47348f1f-083c-4030-917d-3866e811a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:59.213124 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 862/1725] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:10:58 2022] PUT /identity/v3/projects/de8fc10844034e78852b2a584aa350ff/users/ffe99f99e6364e99af82483e24d5d65b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:10:59.225250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057bb9-834a-4e27-bb0c-cc9086286fb4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.237677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057bb9-834a-4e27-bb0c-cc9086286fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.237677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057bb9-834a-4e27-bb0c-cc9086286fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.268027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-08057bb9-834a-4e27-bb0c-cc9086286fb4 None None] MFA Rules not processed for user `ec43833fb4d646ab9f26d425cdb0b694`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:59.270337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-08057bb9-834a-4e27-bb0c-cc9086286fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:59.366664 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 863/1726] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:59.367995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b897f-a4b6-4acf-9575-21cce7c6c1cd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.368394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b897f-a4b6-4acf-9575-21cce7c6c1cd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.368761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b897f-a4b6-4acf-9575-21cce7c6c1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.386323 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 864/1727] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:59.387278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47348f1f-083c-4030-917d-3866e811a074 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:59.388772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47348f1f-083c-4030-917d-3866e811a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:59.401073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-304b897f-a4b6-4acf-9575-21cce7c6c1cd None None] MFA Rules not processed for user `ffe99f99e6364e99af82483e24d5d65b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:10:59.402608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-304b897f-a4b6-4acf-9575-21cce7c6c1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:59.517810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 864/1728] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:10:59.519186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47348f1f-083c-4030-917d-3866e811a074 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:59.521802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b897f-a4b6-4acf-9575-21cce7c6c1cd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:59.529027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:59.529555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.529832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.530127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.553581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:59.555368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:59.587883 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 865/1729] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:59.588766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:59.591056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:10:59.610588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a0afc-9936-4322-b1ae-6125006b0c72 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:59.618730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:59.620112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.620409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.620678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.634414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:59.638465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:59.670218 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 866/1730] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:10:59.724738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b897f-a4b6-4acf-9575-21cce7c6c1cd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:10:59.732239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:10:59.733179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:10:59.733179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:10:59.733486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:10:59.734735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:10:59.737317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:10:59.860723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 865/1731] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:10:59 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:10:59.865105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:10:59.878765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2be1c-dc1b-4b0e-a658-9139649bc21d service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:00.002412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:00.003245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:00.003534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:00.004983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:00.006877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:00.009696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:00.150811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 867/1732] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:10:59 2022] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:00.155617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:00.169967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807720-3818-4aca-8da2-cf1c930985c2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:00.174880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:00.175517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:00.175826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:00.176155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:00.180190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:00.180190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:00.192777 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 866/1733] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:00.197419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:00.211345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95352286-82df-47d8-bb1e-6ce2e7c8e61a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:00.217374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:00.218261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:00.219164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:00.219354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] PATH_INFO: `/v3/projects/bc1dfd944037494eaf9a306fc5562c4c/users/07d5af3ca067496693875482851aca10/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:00.259339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1dfd944037494eaf9a306fc5562c4c, user_id=07d5af3ca067496693875482851aca10, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:00.262942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:00.315147 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:00.359218 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 868/1734] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:00 2022] PUT /identity/v3/projects/bc1dfd944037494eaf9a306fc5562c4c/users/07d5af3ca067496693875482851aca10/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:00.363425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:00.389539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde509-60ca-4ca2-b576-ccac61553de5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:00.567135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2450f-b698-4d9d-865f-96fed03a3657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:00.568433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2450f-b698-4d9d-865f-96fed03a3657 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:00.568721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2450f-b698-4d9d-865f-96fed03a3657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:00.569016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2450f-b698-4d9d-865f-96fed03a3657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:00.569670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2450f-b698-4d9d-865f-96fed03a3657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:00.571334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2450f-b698-4d9d-865f-96fed03a3657 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:00.609742 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:00.615552 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 867/1735] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:00.617126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:00.634328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a8007-95f6-42e6-a586-3615f0b05b42 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:00.641660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c821d6-ad10-4488-9498-961e0ad69b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:00.642507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c821d6-ad10-4488-9498-961e0ad69b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:00.642879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c821d6-ad10-4488-9498-961e0ad69b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:00.643641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c821d6-ad10-4488-9498-961e0ad69b4d admin admin] PATH_INFO: `/v3/projects/bc1dfd944037494eaf9a306fc5562c4c/users/07d5af3ca067496693875482851aca10/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:00.657055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c821d6-ad10-4488-9498-961e0ad69b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1dfd944037494eaf9a306fc5562c4c, user_id=07d5af3ca067496693875482851aca10, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:00.670836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c821d6-ad10-4488-9498-961e0ad69b4d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:00.735894 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 869/1736] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:00 2022] PUT /identity/v3/projects/bc1dfd944037494eaf9a306fc5562c4c/users/07d5af3ca067496693875482851aca10/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:00.739566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:00.740047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:00.741047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:00.797824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] MFA Rules not processed for user `07d5af3ca067496693875482851aca10`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:00.800705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:00.941154 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 868/1737] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:00.975958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d37a2-e838-42ac-9ea1-6b44f313fe38 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:00.976531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d37a2-e838-42ac-9ea1-6b44f313fe38 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:00.976531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d37a2-e838-42ac-9ea1-6b44f313fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:00.982326 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:01.070946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-322d37a2-e838-42ac-9ea1-6b44f313fe38 None None] MFA Rules not processed for user `1c2310cbc3574eb29a6ca6291ba7808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:01.072171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-322d37a2-e838-42ac-9ea1-6b44f313fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:01.193832 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:01.245140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 870/1738] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:01.251155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:01.254946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:01.332801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d37a2-e838-42ac-9ea1-6b44f313fe38 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:01.398280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eead7d7-267c-4501-bdc2-9709555fd24e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:01.407245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:01.407838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:01.408115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:01.414126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:01.416937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:01.421154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:01.475896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d37a2-e838-42ac-9ea1-6b44f313fe38 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:01.504579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:01.505740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:01.505740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:01.506229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:01.515515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:01.517118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:01.535350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 871/1739] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:01.539373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:01.548345 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 869/1740] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:01 2022] POST /identity/v3/projects => generated 369 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:01.553401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8c5e1-1b84-434c-afb5-ae4b3ff82f2f service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:01.660672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:01.660672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:01.660672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:01.660672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:01.661042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:01.662380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:01.820584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:01.838443 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 872/1741] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:01 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:01.842893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:01.849224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef74e-358b-43a5-82c2-7ed3663b2b7a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:01.862039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f528f3-13c9-47fa-9ba7-45766574ed06 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:01.863547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:01.864160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:01.864536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:01.864671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] PATH_INFO: `/v3/users/57c25d29b3744e348ddb3dfc9d2e5be8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:01.866517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c25d29b3744e348ddb3dfc9d2e5be8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:01.871280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:01.879438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:01.880068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:01.880935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:01.881229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:01.881924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:01.892647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:01.912557 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 873/1742] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:01.918281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:01.936005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80e089-e78e-409b-b424-c5af1403f3cc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:01.941605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:01.942305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:01.942614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:01.942897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] PATH_INFO: `/v3/projects/cf7cdd7334d24d00b9439b34644d1935/users/59827d8d8a744684b85ecef7bb489552/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:01.974878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7cdd7334d24d00b9439b34644d1935, user_id=59827d8d8a744684b85ecef7bb489552, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:01.979560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:02.098031 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 874/1743] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:01 2022] PUT /identity/v3/projects/cf7cdd7334d24d00b9439b34644d1935/users/59827d8d8a744684b85ecef7bb489552/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:02.098877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:02.108249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c25d29b3744e348ddb3dfc9d2e5be8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.127902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c25d29b3744e348ddb3dfc9d2e5be8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.128760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c25d29b3744e348ddb3dfc9d2e5be8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.202410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c25d29b3744e348ddb3dfc9d2e5be8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.204867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c25d29b3744e348ddb3dfc9d2e5be8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.252002 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 870/1744] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:01 2022] DELETE /identity/v3/users/57c25d29b3744e348ddb3dfc9d2e5be8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:02.252002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:02.252002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:02.266630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b62f24-f12a-4108-ab71-f6c148392ad1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:02.373259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:02.373917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:02.376645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:02.376989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] PATH_INFO: `/v3/users/ffe99f99e6364e99af82483e24d5d65b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:02.379888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe99f99e6364e99af82483e24d5d65b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:02.382509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:02.395223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90a990-8186-4be6-ab58-091546a90e51 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:02.401484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f79cd-4aa2-4cdf-9691-43ea55531647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:02.402404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f79cd-4aa2-4cdf-9691-43ea55531647 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:02.402688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f79cd-4aa2-4cdf-9691-43ea55531647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:02.402997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f79cd-4aa2-4cdf-9691-43ea55531647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:02.403846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f79cd-4aa2-4cdf-9691-43ea55531647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:02.411320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f79cd-4aa2-4cdf-9691-43ea55531647 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:02.432037 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 871/1745] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:02.432037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ddfe-3ba5-40e3-bb4e-f1327aae5cc7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:02.432037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ddfe-3ba5-40e3-bb4e-f1327aae5cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:02.432037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ddfe-3ba5-40e3-bb4e-f1327aae5cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:02.456171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-baa5ddfe-3ba5-40e3-bb4e-f1327aae5cc7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:02.457410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-baa5ddfe-3ba5-40e3-bb4e-f1327aae5cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:02.467975 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 872/1746] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:02.469313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ddfe-3ba5-40e3-bb4e-f1327aae5cc7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:02.497080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ddfe-3ba5-40e3-bb4e-f1327aae5cc7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:02.503255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:02.504144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:02.504491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:02.504775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] PATH_INFO: `/v3/projects/cf7cdd7334d24d00b9439b34644d1935/users/59827d8d8a744684b85ecef7bb489552/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:02.507106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7cdd7334d24d00b9439b34644d1935, user_id=59827d8d8a744684b85ecef7bb489552, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:02.510404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:02.526256 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 873/1747] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:02 2022] PUT /identity/v3/projects/cf7cdd7334d24d00b9439b34644d1935/users/59827d8d8a744684b85ecef7bb489552/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:02.526256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:02.529795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:02.549850 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:02.621494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe99f99e6364e99af82483e24d5d65b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.644151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510188e-d97d-4d29-9333-39436c55c44e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:02.658765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe99f99e6364e99af82483e24d5d65b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.661998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:02.663503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe99f99e6364e99af82483e24d5d65b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.669486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:02.669486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:02.669486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:02.733550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe99f99e6364e99af82483e24d5d65b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.741161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b463c2e1-6682-4749-9292-5360e7f4a55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe99f99e6364e99af82483e24d5d65b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:02.777737 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 875/1748] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:02 2022] DELETE /identity/v3/users/ffe99f99e6364e99af82483e24d5d65b => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:02.779579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:02.779879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:02.780151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:02.792540 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:02.819013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:02.819897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:02.825614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:02.825773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:02.837036 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 874/1749] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:02.899985 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 876/1750] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:02.911735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:02.917301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:02.926852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df2bc-a712-4118-86ff-ed0dcefe4c98 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:02.988572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:02.989956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:02.989956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:02.992175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:03.013729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:03.016161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:03.028773 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 875/1751] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:03.541563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:03.543780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:03.564363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0280ab7-3abe-4a0d-b000-3a6f22288aa2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:03.582175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:03.582889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:03.583171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:03.583471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] PATH_INFO: `/v3/projects/b12ed5e16f2d4f9bb561e3f57bcce40c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:03.584766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12ed5e16f2d4f9bb561e3f57bcce40c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:03.586726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:03.619722 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:03.669138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:03.670720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:03.687118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2afe9-4df8-47ef-adbd-8f2726457d18 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:03.692419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:03.692990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:03.693271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:03.693547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] PATH_INFO: `/v3/projects/de8fc10844034e78852b2a584aa350ff` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:03.694708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8fc10844034e78852b2a584aa350ff)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:03.696658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:03.744063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12ed5e16f2d4f9bb561e3f57bcce40c', 'request_id': 'req-25d7b1fd-336e-41ff-8947-32964358407f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.758848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12ed5e16f2d4f9bb561e3f57bcce40c', 'request_id': 'req-25d7b1fd-336e-41ff-8947-32964358407f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.840243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8fc10844034e78852b2a584aa350ff', 'request_id': 'req-b32ab77b-039b-4d34-82f4-0f2b59f08a24'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.842625 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:03.856309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8fc10844034e78852b2a584aa350ff', 'request_id': 'req-b32ab77b-039b-4d34-82f4-0f2b59f08a24'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.871508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12ed5e16f2d4f9bb561e3f57bcce40c', 'request_id': 'req-25d7b1fd-336e-41ff-8947-32964358407f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.894377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] The token cache is being invalidate because project b12ed5e16f2d4f9bb561e3f57bcce40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:03.894825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.895809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.898004 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 877/1752] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:03 2022] DELETE /identity/v3/projects/b12ed5e16f2d4f9bb561e3f57bcce40c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:03.902224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:03.904210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:03.945596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8fc10844034e78852b2a584aa350ff', 'request_id': 'req-b32ab77b-039b-4d34-82f4-0f2b59f08a24'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.967495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] The token cache is being invalidate because project de8fc10844034e78852b2a584aa350ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:03.968998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.971526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:03.976848 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 876/1753] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:03 2022] DELETE /identity/v3/projects/de8fc10844034e78852b2a584aa350ff => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:03.980695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:03.985930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:04.055246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b1fd-336e-41ff-8947-32964358407f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:04.181688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab77b-039b-4d34-82f4-0f2b59f08a24 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:04.195055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:04.195918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:04.196193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:04.196589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] PATH_INFO: `/v3/users/07d5af3ca067496693875482851aca10` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:04.198110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d5af3ca067496693875482851aca10)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:04.200177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:04.200570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:04.200925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:04.201215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:04.201489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] PATH_INFO: `/v3/users/c346f5b1d92143a0aea75249ccf3e11e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:04.204521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c346f5b1d92143a0aea75249ccf3e11e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:04.209951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:04.431409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d5af3ca067496693875482851aca10'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.450500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d5af3ca067496693875482851aca10'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.453221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d5af3ca067496693875482851aca10'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.462321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c346f5b1d92143a0aea75249ccf3e11e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.479962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c346f5b1d92143a0aea75249ccf3e11e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.480713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c346f5b1d92143a0aea75249ccf3e11e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.488099 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:04.536302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d5af3ca067496693875482851aca10'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.537049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d5af3ca067496693875482851aca10'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.567967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 877/1754] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:03 2022] DELETE /identity/v3/users/07d5af3ca067496693875482851aca10 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:04.605071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c346f5b1d92143a0aea75249ccf3e11e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.606806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-833d242f-72cb-4cbc-aa05-606aa0fb4dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c346f5b1d92143a0aea75249ccf3e11e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:04.637373 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 878/1755] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:03 2022] DELETE /identity/v3/users/c346f5b1d92143a0aea75249ccf3e11e => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:04.774414 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:06.054573 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:06.128440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:06.132287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:06.134985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:06.135442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:06.136201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:06.202519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:06.210747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:06.316979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ae97-f3b2-4d45-b31c-6923076ea1cb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:06.357020 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 879/1756] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 23 01:11:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:06.357020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:06.357739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:06.466909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a640594-76c2-4eac-af2e-54ed534deac7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:06.481312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:06.492688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:06.517565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:06.517565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] PATH_INFO: `/v3/projects/bc1dfd944037494eaf9a306fc5562c4c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:06.517565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1dfd944037494eaf9a306fc5562c4c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:06.517565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:06.522196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:06.523171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:06.523462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:06.524458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] PATH_INFO: `/v3/projects/927d09d6caf947edad1ca3b547ba12b9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:06.528397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=927d09d6caf947edad1ca3b547ba12b9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:06.535461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:06.652037 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:06.718971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927d09d6caf947edad1ca3b547ba12b9', 'request_id': 'req-22dcb240-f7a4-4ce1-be30-4fb300bed27b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.730148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927d09d6caf947edad1ca3b547ba12b9', 'request_id': 'req-22dcb240-f7a4-4ce1-be30-4fb300bed27b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.730672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1dfd944037494eaf9a306fc5562c4c', 'request_id': 'req-741f9782-cc50-4ee4-9489-e474a53806f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.739862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1dfd944037494eaf9a306fc5562c4c', 'request_id': 'req-741f9782-cc50-4ee4-9489-e474a53806f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.828452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927d09d6caf947edad1ca3b547ba12b9', 'request_id': 'req-22dcb240-f7a4-4ce1-be30-4fb300bed27b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.851805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] The token cache is being invalidate because project 927d09d6caf947edad1ca3b547ba12b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:06.852105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.854122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.861904 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 878/1757] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:06 2022] DELETE /identity/v3/projects/927d09d6caf947edad1ca3b547ba12b9 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:06.861904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:06.870848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1dfd944037494eaf9a306fc5562c4c', 'request_id': 'req-741f9782-cc50-4ee4-9489-e474a53806f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.881022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:06.888191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] The token cache is being invalidate because project bc1dfd944037494eaf9a306fc5562c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:06.889242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.907035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-741f9782-cc50-4ee4-9489-e474a53806f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:06.914375 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 880/1758] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:06 2022] DELETE /identity/v3/projects/bc1dfd944037494eaf9a306fc5562c4c => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:06.917589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9616a4-8d6b-4bdf-a5b7-e5264f2020ff None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:06.918300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9616a4-8d6b-4bdf-a5b7-e5264f2020ff None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:06.918637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9616a4-8d6b-4bdf-a5b7-e5264f2020ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:06.952060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fd9616a4-8d6b-4bdf-a5b7-e5264f2020ff None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:06.955703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd9616a4-8d6b-4bdf-a5b7-e5264f2020ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:07.030255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcb240-f7a4-4ce1-be30-4fb300bed27b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.041453 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 881/1759] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:07.050974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861ab9-35d2-4415-af70-6f4488839d0b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.051520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861ab9-35d2-4415-af70-6f4488839d0b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.051946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861ab9-35d2-4415-af70-6f4488839d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.080119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c9861ab9-35d2-4415-af70-6f4488839d0b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:07.081372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c9861ab9-35d2-4415-af70-6f4488839d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:07.097784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 882/1760] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:07.100266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9244f1-73e7-4950-8997-e90903b5118b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.100709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9244f1-73e7-4950-8997-e90903b5118b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.101143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9244f1-73e7-4950-8997-e90903b5118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.131077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1f9244f1-73e7-4950-8997-e90903b5118b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:07.132767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f9244f1-73e7-4950-8997-e90903b5118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:07.148411 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 883/1761] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:07.148411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8166d-a26d-4acd-886a-665db1edf19d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.148411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8166d-a26d-4acd-886a-665db1edf19d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.148411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8166d-a26d-4acd-886a-665db1edf19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.158889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.161757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.161757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.161757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.164780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:07.186151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.199027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.205522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d2b8166d-a26d-4acd-886a-665db1edf19d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:07.208052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d2b8166d-a26d-4acd-886a-665db1edf19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:07.210335 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 879/1762] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:07.211526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.221449 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 884/1763] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:07.227561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8166d-a26d-4acd-886a-665db1edf19d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.237313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8166d-a26d-4acd-886a-665db1edf19d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.244065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.244590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5a08-c1c7-4a08-bab8-44ae0f4a7c15 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.244707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.244963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.245230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.246078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:07.246390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.248462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.251594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.252555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.252993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.253413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.254226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:07.260056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.261919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.275009 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 880/1764] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:07.279471 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 885/1765] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:07.282986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.284513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.297166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753a265-be71-4842-aa4e-8a9298aa5caf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.302167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.303340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.303340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.303609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.304425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.306401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.320598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21273d-cd2b-458b-8b7a-4d5a9a5724b5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.328792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.329611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.330063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.330515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.331476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.333774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.454301 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 886/1766] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:07 2022] POST /identity/v3/projects => generated 411 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:07.460969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 881/1767] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:07 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:07.461685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.464534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.559308 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:07.594170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce18b0-f873-4c31-bfc6-f998a199538a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.611260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.611982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.612193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.613572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.614258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.617491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.625072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f274e2-848d-4993-a412-1dea29d3fd03 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.633001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.635862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.635862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.635862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.636347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.641444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.743821 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 887/1768] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:07 2022] POST /identity/v3/users => generated 306 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:07.747921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.776393 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 882/1769] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:07 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:07.782649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.784473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b43a9-24b8-46e0-b0de-7f60bd9c6e92 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.798742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107eb0-8f17-450d-80d0-f364405f3255 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.799653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.800290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.800564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.800834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.801482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.803108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.817031 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 888/1770] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:07.819890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.822640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.824738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.825944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.830068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.830998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.832760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.845435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c9e3b-44d9-4317-bbf4-8f6475a2dda8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.855148 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 883/1771] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:07.859578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.860637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.861268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.861538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.862339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.862941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.865667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.896449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cc356-83ad-49fe-85f2-a63ad7503887 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.900823 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 889/1772] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:07.907179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:07.926136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.926776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.927056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.927324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.934042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:07.935639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:07.950021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914d16f-8002-40f5-b998-907ddff6c46a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:07.970971 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 884/1773] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:07.971699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34196002-49c8-4284-ac04-4ea007b28292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:07.972655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196002-49c8-4284-ac04-4ea007b28292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:07.972655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196002-49c8-4284-ac04-4ea007b28292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:07.972952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196002-49c8-4284-ac04-4ea007b28292 admin admin] PATH_INFO: `/v3/projects/b7864a40d26e402d815d39ef0c0f91a1/users/74c84b03f3f8431e9d3c0cbb792aeaf9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:07.996250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:08.017828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bf73-cbf9-43e0-b274-7997f995b2fd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:08.021332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34196002-49c8-4284-ac04-4ea007b28292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7864a40d26e402d815d39ef0c0f91a1, user_id=74c84b03f3f8431e9d3c0cbb792aeaf9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:08.028221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c725b2-2a35-4b25-8e2e-1dd1ad701beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:08.029450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c725b2-2a35-4b25-8e2e-1dd1ad701beb admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:08.031304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c725b2-2a35-4b25-8e2e-1dd1ad701beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:08.032203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34196002-49c8-4284-ac04-4ea007b28292 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:08.034562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c725b2-2a35-4b25-8e2e-1dd1ad701beb admin admin] PATH_INFO: `/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27/users/24b0acb3037d4187ad72bf96b2b6b6a8/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:08.083873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c725b2-2a35-4b25-8e2e-1dd1ad701beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7cff3fb8aab4d0eb2b247cae880ba27, user_id=24b0acb3037d4187ad72bf96b2b6b6a8, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:08.094182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c725b2-2a35-4b25-8e2e-1dd1ad701beb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:08.158588 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 890/1774] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:07 2022] PUT /identity/v3/projects/b7864a40d26e402d815d39ef0c0f91a1/users/74c84b03f3f8431e9d3c0cbb792aeaf9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:08.163982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:08.164264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:08.165947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:08.177015 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 885/1775] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:07 2022] PUT /identity/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27/users/24b0acb3037d4187ad72bf96b2b6b6a8/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:08.189727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae66d9-0f05-4ca1-af5c-a54c3b6e87fc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:08.190783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae66d9-0f05-4ca1-af5c-a54c3b6e87fc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:08.191999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae66d9-0f05-4ca1-af5c-a54c3b6e87fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:08.237924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:08.254923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:08.273518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3cae66d9-0f05-4ca1-af5c-a54c3b6e87fc None None] MFA Rules not processed for user `24b0acb3037d4187ad72bf96b2b6b6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:08.277801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3cae66d9-0f05-4ca1-af5c-a54c3b6e87fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:08.426300 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 886/1776] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:08.430915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae66d9-0f05-4ca1-af5c-a54c3b6e87fc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:08.439150 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 891/1777] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:08.460270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae66d9-0f05-4ca1-af5c-a54c3b6e87fc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:08.471815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:08.473439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:08.473439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:08.473439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:08.474371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:08.476426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:08.515922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:08.517740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:08.647302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b105-ef20-4bbf-9be3-dbc7bc2b2912 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:08.658147 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 887/1778] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:08 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:08.659066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:08.659199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:08.659910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:08.660510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:08.660889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:08.683722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:08.685432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:08.710228 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 892/1779] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:08.806622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d722a-91d2-4f81-b3eb-920c205128fc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:08.824387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:08.825461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:08.825923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:08.826429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:08.828842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:08.834719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:08.976366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:08.977398 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 888/1780] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:08 2022] POST /identity/v3/users => generated 294 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:08.988275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51df1b-3668-4ad1-8a22-eeace6afb2ff service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:09.000101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:09.002598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:09.002598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:09.004318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:09.005808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:09.009224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:09.033171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 893/1781] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:09.034060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:09.048143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ce5fa-e177-49c2-aba6-edf4f1b3df4c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:09.056898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:09.058336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:09.058772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:09.059383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] PATH_INFO: `/v3/projects/b5494c458ae245ebaeef3fddae85a45e/users/55b25fc856084ef0b792dbaad27f9e36/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:09.107026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5494c458ae245ebaeef3fddae85a45e, user_id=55b25fc856084ef0b792dbaad27f9e36, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:09.110265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:09.128262 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:09.222914 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 889/1782] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:09 2022] PUT /identity/v3/projects/b5494c458ae245ebaeef3fddae85a45e/users/55b25fc856084ef0b792dbaad27f9e36/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:09.226745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:09.243783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276354-bb68-4a5a-a50d-2756533813d1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:09.356858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b269132-c5b2-4b72-9a8c-f475f577df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:09.357954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b269132-c5b2-4b72-9a8c-f475f577df65 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:09.358454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b269132-c5b2-4b72-9a8c-f475f577df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:09.359693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b269132-c5b2-4b72-9a8c-f475f577df65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:09.360881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b269132-c5b2-4b72-9a8c-f475f577df65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:09.363928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b269132-c5b2-4b72-9a8c-f475f577df65 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:09.377703 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 894/1783] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:09.381903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:09.394889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8526ca-e7da-495f-8810-c54234b97b38 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:09.401256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:09.402426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:09.402894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:09.403310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] PATH_INFO: `/v3/projects/b5494c458ae245ebaeef3fddae85a45e/users/55b25fc856084ef0b792dbaad27f9e36/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:09.406633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5494c458ae245ebaeef3fddae85a45e, user_id=55b25fc856084ef0b792dbaad27f9e36, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:09.409751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:09.422794 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 890/1784] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:09 2022] PUT /identity/v3/projects/b5494c458ae245ebaeef3fddae85a45e/users/55b25fc856084ef0b792dbaad27f9e36/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:09.433721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ae186-1aa5-45c1-be61-525b8e615141 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:09.434048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ae186-1aa5-45c1-be61-525b8e615141 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:09.434628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ae186-1aa5-45c1-be61-525b8e615141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:09.467386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0f0ae186-1aa5-45c1-be61-525b8e615141 None None] MFA Rules not processed for user `55b25fc856084ef0b792dbaad27f9e36`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:09.469456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0f0ae186-1aa5-45c1-be61-525b8e615141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:09.556616 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 895/1785] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:09.568732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:09.587298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e523c9-6e7d-41fa-9044-6dd571b68142 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:09.601311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:09.601962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:09.602267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:09.602547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:09.603865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:09.604185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:09.605846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:09.637708 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 891/1786] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:09.642696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ae186-1aa5-45c1-be61-525b8e615141 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:09.656879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ae186-1aa5-45c1-be61-525b8e615141 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:09.668296 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:09.675522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:09.676647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:09.677083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:09.677545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:09.678541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:09.687821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:09.867766 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 896/1787] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:09 2022] POST /identity/v3/projects => generated 369 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:09.872949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:09.892660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14aa30-593a-48d6-b21a-a7e3e092d98c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:10.031409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108620d2-6f73-40f8-87b6-1e562c3a3989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:10.037269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108620d2-6f73-40f8-87b6-1e562c3a3989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:10.038189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108620d2-6f73-40f8-87b6-1e562c3a3989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:10.038983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108620d2-6f73-40f8-87b6-1e562c3a3989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:10.040029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108620d2-6f73-40f8-87b6-1e562c3a3989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:10.040561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108620d2-6f73-40f8-87b6-1e562c3a3989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:10.042541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108620d2-6f73-40f8-87b6-1e562c3a3989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:10.059035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 892/1788] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:10.254342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:10.256109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:10.374585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a72a9e-5c90-4137-87db-e63d6253c989 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:10.394981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:10.395957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:10.396384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:10.397608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:10.418687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:10.420652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:10.438336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 897/1789] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:10.460291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c058e-36b3-4b81-903c-b586118949cb None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:10.460779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c058e-36b3-4b81-903c-b586118949cb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:10.460779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c058e-36b3-4b81-903c-b586118949cb None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:10.462666 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 893/1790] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:10.476557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:10.507160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:10.521066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7c1d-0645-41a2-8a04-9d5c3a1f61bc service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:10.528482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:10.529503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:10.529934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:10.538050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:10.538050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2efc362bbe34b99804cf5b7f1c0951f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:10.538050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:10.543604 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 898/1791] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:10 2022] GET /identity/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f => generated 369 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:10.734883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5cdb-7af3-4e9d-9210-9eed45dbab4c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:10.735830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5cdb-7af3-4e9d-9210-9eed45dbab4c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:10.736109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5cdb-7af3-4e9d-9210-9eed45dbab4c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:10.738786 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 894/1792] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:10.744029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:10.746856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:10.774658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:10.790577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd30ac-c640-45e0-aa98-caf30d476c62 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:10.816117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:10.829181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:10.830003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:10.831363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:10.845292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2efc362bbe34b99804cf5b7f1c0951f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:10.852249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:10.887516 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 899/1793] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:10 2022] GET /identity/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f => generated 369 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:11.307216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a397-ad55-4e8c-91a3-c5511cecccba None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:11.307817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a397-ad55-4e8c-91a3-c5511cecccba None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:11.308259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16a397-ad55-4e8c-91a3-c5511cecccba None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:11.311008 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 895/1794] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:11.322795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:11.345906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:11.370584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35807f9-29d4-48d8-ac16-3e93d3b0873a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:11.380462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f02b6-ce71-44c7-b800-2c81831ddea7 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:11.381450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f02b6-ce71-44c7-b800-2c81831ddea7 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:11.381935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f02b6-ce71-44c7-b800-2c81831ddea7 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:11.382459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f02b6-ce71-44c7-b800-2c81831ddea7 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:11.390798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f02b6-ce71-44c7-b800-2c81831ddea7 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2efc362bbe34b99804cf5b7f1c0951f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:11.393835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f02b6-ce71-44c7-b800-2c81831ddea7 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:11.400801 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 900/1795] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:11 2022] GET /identity/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f => generated 369 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:11.446366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16a397-ad55-4e8c-91a3-c5511cecccba None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:11.481261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16a397-ad55-4e8c-91a3-c5511cecccba None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:11.491834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:11.492953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:11.493466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:11.493890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:11.499926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2efc362bbe34b99804cf5b7f1c0951f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:11.509164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:11.659792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aaec1-18b1-45c7-ac05-cd6248bc5f13 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:11.660476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aaec1-18b1-45c7-ac05-cd6248bc5f13 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:11.660758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aaec1-18b1-45c7-ac05-cd6248bc5f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:11.709516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2efc362bbe34b99804cf5b7f1c0951f', 'request_id': 'req-951f0004-274a-4e3f-b100-1b099ef9e6be'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:11.745938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2efc362bbe34b99804cf5b7f1c0951f', 'request_id': 'req-951f0004-274a-4e3f-b100-1b099ef9e6be'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:11.758604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ce1aaec1-18b1-45c7-ac05-cd6248bc5f13 None None] MFA Rules not processed for user `59827d8d8a744684b85ecef7bb489552`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:11.762369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce1aaec1-18b1-45c7-ac05-cd6248bc5f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:11.832631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2efc362bbe34b99804cf5b7f1c0951f', 'request_id': 'req-951f0004-274a-4e3f-b100-1b099ef9e6be'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:11.850868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] The token cache is being invalidate because project e2efc362bbe34b99804cf5b7f1c0951f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:11.851170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:11.852435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-951f0004-274a-4e3f-b100-1b099ef9e6be tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:11.884382 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 896/1796] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:11 2022] DELETE /identity/v3/projects/e2efc362bbe34b99804cf5b7f1c0951f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:11.892178 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 901/1797] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:11.904707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:11.905305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:11.906390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:11.947457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] MFA Rules not processed for user `1c2310cbc3574eb29a6ca6291ba7808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:11.947457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:12.013210 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 897/1798] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:12.172152 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:12.211693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae9ab-7241-44d0-96c0-c24b4b4b413e None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.212003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae9ab-7241-44d0-96c0-c24b4b4b413e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.212253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae9ab-7241-44d0-96c0-c24b4b4b413e None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.213754 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 902/1799] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:12.218761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:12.220173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:12.300540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:12.301944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:12.325742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae9ab-7241-44d0-96c0-c24b4b4b413e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:12.327856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-20dae9ab-7241-44d0-96c0-c24b4b4b413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:12.376327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae9ab-7241-44d0-96c0-c24b4b4b413e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:12.387549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:12.389384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.392912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.393453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.397238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:12.422601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:12.425718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb044dd-451f-48d9-bc74-a6e226ca51ca None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:12.427269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:12.438088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:12.439493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.439868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.440235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.442899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7cff3fb8aab4d0eb2b247cae880ba27)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:12.447935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:12.458197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 903/1800] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:12.458503 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 898/1801] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:12 2022] GET /identity/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27 => generated 375 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:12.468281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:12.503760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa0a2-ffe1-4324-8f8a-94ce34786632 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:12.516309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:12.517260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.517680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.518079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.518827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:12.519233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:12.523436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:12.553298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 904/1802] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:12.557545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:12.571980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efd241-7743-4e15-9e68-df4ecf553676 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:12.581478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941fb90-3ca1-4b17-acf3-d62413739598 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:12.582738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fb90-3ca1-4b17-acf3-d62413739598 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.583877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fb90-3ca1-4b17-acf3-d62413739598 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.584598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fb90-3ca1-4b17-acf3-d62413739598 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.586174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941fb90-3ca1-4b17-acf3-d62413739598 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:12.588739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941fb90-3ca1-4b17-acf3-d62413739598 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:12.717148 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 899/1803] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:12 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:12.721881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:12.732273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde56a7-2080-4344-8b19-ba848592d223 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:12.851904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f67fb-1a40-4371-9e85-ac1d287e4b17 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:12.854564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f67fb-1a40-4371-9e85-ac1d287e4b17 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.854564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f67fb-1a40-4371-9e85-ac1d287e4b17 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.854564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f67fb-1a40-4371-9e85-ac1d287e4b17 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.854564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f67fb-1a40-4371-9e85-ac1d287e4b17 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:12.854564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f67fb-1a40-4371-9e85-ac1d287e4b17 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:12.856456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f67fb-1a40-4371-9e85-ac1d287e4b17 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:12.891894 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 905/1804] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:12.932073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d5db-cef6-4ba2-8dc6-e6352fbcceef None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.932168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d5db-cef6-4ba2-8dc6-e6352fbcceef None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.932424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d5db-cef6-4ba2-8dc6-e6352fbcceef None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.933859 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 900/1805] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:12.943490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6349-9353-4fe0-9e76-e7c45148ab84 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:12.943793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6349-9353-4fe0-9e76-e7c45148ab84 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:12.944074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6349-9353-4fe0-9e76-e7c45148ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:12.981510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1f4d6349-9353-4fe0-9e76-e7c45148ab84 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:12.982877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f4d6349-9353-4fe0-9e76-e7c45148ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:13.126208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d5db-cef6-4ba2-8dc6-e6352fbcceef None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:13.127961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2543d5db-cef6-4ba2-8dc6-e6352fbcceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:13.132080 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 906/1806] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:11:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:13.140025 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:13.151450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d5db-cef6-4ba2-8dc6-e6352fbcceef None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:13.201371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:13.202656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:13.202997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:13.207704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:13.212083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:13.213620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:13.224950 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 901/1807] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:13.319377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4b64-eb2f-473d-aed0-8f39ed0c4827 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:13.327762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4b64-eb2f-473d-aed0-8f39ed0c4827 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:13.327762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4b64-eb2f-473d-aed0-8f39ed0c4827 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:13.327762 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 907/1808] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:13.328843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:13.426937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:13.439746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41361b45-3c94-449c-8f2e-444efdb87c5c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:13.447649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:13.448629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:13.449088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:13.449587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:13.450934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=5cbb8702ad114778af2cf17ac8f6f9e0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:13.453865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:13.458091 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 902/1809] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:13 2022] GET /identity/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:13.993303 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:14.243416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dc04f-ed9c-4423-8cb1-348996a5b71f None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:14.243696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dc04f-ed9c-4423-8cb1-348996a5b71f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:14.244661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dc04f-ed9c-4423-8cb1-348996a5b71f None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:14.246513 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 908/1810] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:14.256995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:14.271663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:14.302750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a108c-1e54-445f-b3c4-e239bbccd9ef tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:14.314413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:14.315077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:14.315891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:14.316171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:14.320968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=5cbb8702ad114778af2cf17ac8f6f9e0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:14.329604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:14.346965 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 903/1811] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:14 2022] GET /identity/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0 => generated 371 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:14.419755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dc04f-ed9c-4423-8cb1-348996a5b71f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:14.457589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dc04f-ed9c-4423-8cb1-348996a5b71f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:14.479384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:14.480197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:14.480371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:14.480623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:14.481292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:14.481595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:14.494812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:14.524789 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 909/1812] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:14.525669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:14.547053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b560c2-ebe2-4dc1-b65c-f92f83b5929d tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:14.559987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b2ed9-cd1c-4f7e-ac04-6af1a8b4eb54 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:14.560627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b2ed9-cd1c-4f7e-ac04-6af1a8b4eb54 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:14.570444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b2ed9-cd1c-4f7e-ac04-6af1a8b4eb54 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:14.573159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b2ed9-cd1c-4f7e-ac04-6af1a8b4eb54 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:14.573159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b2ed9-cd1c-4f7e-ac04-6af1a8b4eb54 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:14.585814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b2ed9-cd1c-4f7e-ac04-6af1a8b4eb54 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:14.693306 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:14.745491 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 904/1813] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:14 2022] POST /identity/v3/users => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:14.749562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:14.771121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443fc6-3d88-4d80-9562-d96ce501e7d1 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:14.784382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:14.785279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:14.785803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:14.786286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:14.787109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:14.787562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:14.789464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:14.831392 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 910/1814] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:15.115135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d08a0-6b7c-4d7f-9cfe-d79834f22624 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:15.115698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d08a0-6b7c-4d7f-9cfe-d79834f22624 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:15.115698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d08a0-6b7c-4d7f-9cfe-d79834f22624 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:15.121627 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 905/1815] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:15.128358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:15.155864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:15.176288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aab50-4056-4842-839c-a404dec95f98 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:15.190560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:15.190560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:15.190560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:15.190805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:15.192489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=5cbb8702ad114778af2cf17ac8f6f9e0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:15.196441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:15.199100 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 911/1816] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:15 2022] GET /identity/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:11:15.484662 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:15.558182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4c007-69c2-48e3-a0ab-714fc6b4a071 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:15.558470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4c007-69c2-48e3-a0ab-714fc6b4a071 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:15.558748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4c007-69c2-48e3-a0ab-714fc6b4a071 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:15.560094 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 906/1817] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:15.572009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:15.595362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:15.617755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3300fb-98ba-4c47-8206-d02dc939506c tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:15.633580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:15.634277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:15.634560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:15.634830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:15.635961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=5cbb8702ad114778af2cf17ac8f6f9e0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:15.638421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:15.644267 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 912/1818] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:15 2022] GET /identity/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:15.700241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4c007-69c2-48e3-a0ab-714fc6b4a071 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:15.733772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4c007-69c2-48e3-a0ab-714fc6b4a071 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:15.737137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:15.738006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:15.739703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:15.739983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/users/2dfad1a0fddd43689b44f69b25036342` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:15.770718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2dfad1a0fddd43689b44f69b25036342)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:15.772867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:15.801864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:15.803631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:15.882329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf493c5-1b84-4c36-99b3-5c5c9f8df694 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:15.887429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:15.888462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:15.888928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:15.890082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] PATH_INFO: `/v3/users/8d55132fb2c14cc7ba75333d50d36757` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:15.891499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d55132fb2c14cc7ba75333d50d36757)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:15.893729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:15.925557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfad1a0fddd43689b44f69b25036342'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:15.938101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfad1a0fddd43689b44f69b25036342'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:15.939368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfad1a0fddd43689b44f69b25036342'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.095554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfad1a0fddd43689b44f69b25036342'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.096555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfad1a0fddd43689b44f69b25036342'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.132380 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 907/1819] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:15 2022] DELETE /identity/v3/users/2dfad1a0fddd43689b44f69b25036342 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:16.136656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:16.138731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:16.192486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d55132fb2c14cc7ba75333d50d36757'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.207642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d55132fb2c14cc7ba75333d50d36757'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.208865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d55132fb2c14cc7ba75333d50d36757'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.330213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d55132fb2c14cc7ba75333d50d36757'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.331233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a074bce5-1fb6-42a8-af45-30c5e2a593bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d55132fb2c14cc7ba75333d50d36757'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.338412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7c26-0eaa-4476-9d26-7c792111aa5a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:16.370284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:16.372677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:16.373229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:16.373229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:16.377343 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 913/1820] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:15 2022] DELETE /identity/v3/users/8d55132fb2c14cc7ba75333d50d36757 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:16.378994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:16.379412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:16.379806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5cbb8702ad114778af2cf17ac8f6f9e0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:16.379933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:16.387227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:16.393341 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:16.438096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:16.439385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:16.586388 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 914/1821] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:16.595352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:16.597448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:16.626754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbb8702ad114778af2cf17ac8f6f9e0', 'request_id': 'req-ce3308fa-4007-4ff6-a38a-494d0bcc0520'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.644470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbb8702ad114778af2cf17ac8f6f9e0', 'request_id': 'req-ce3308fa-4007-4ff6-a38a-494d0bcc0520'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.721779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbb8702ad114778af2cf17ac8f6f9e0', 'request_id': 'req-ce3308fa-4007-4ff6-a38a-494d0bcc0520'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.722830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b844b3-b138-4617-ad00-115a51f89f65 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:16.740456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] The token cache is being invalidate because project 5cbb8702ad114778af2cf17ac8f6f9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:16.740743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.741845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce3308fa-4007-4ff6-a38a-494d0bcc0520 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:16.743842 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 908/1822] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:16 2022] DELETE /identity/v3/projects/5cbb8702ad114778af2cf17ac8f6f9e0 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:16.855656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:16.861235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:16.861235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:16.861235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:16.861235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:16.963914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:16.965640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:16.990038 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 915/1823] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:17.126656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983358a-0f91-4f79-8d9f-0b6633daffb4 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:17.126936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983358a-0f91-4f79-8d9f-0b6633daffb4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:17.127206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983358a-0f91-4f79-8d9f-0b6633daffb4 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:17.128762 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 909/1824] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:17.143770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:17.145351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:17.335931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:17.337850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:17.405407 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:17.431810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f8bf-e849-4c09-848d-d3469c804b9b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:17.432284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f8bf-e849-4c09-848d-d3469c804b9b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:17.433073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f8bf-e849-4c09-848d-d3469c804b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:17.467267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddb60-5246-48a9-9b1a-283a96cfe1e2 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:17.477831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa729a8e-2419-47c2-a0c0-16a2e60881fa tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:17.478716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729a8e-2419-47c2-a0c0-16a2e60881fa tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:17.479188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729a8e-2419-47c2-a0c0-16a2e60881fa tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:17.479467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729a8e-2419-47c2-a0c0-16a2e60881fa tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:17.480784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa729a8e-2419-47c2-a0c0-16a2e60881fa tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7cff3fb8aab4d0eb2b247cae880ba27)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:17.488131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa729a8e-2419-47c2-a0c0-16a2e60881fa tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:17.506309 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 916/1825] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:17 2022] GET /identity/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27 => generated 375 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:17.532031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-51b7f8bf-e849-4c09-848d-d3469c804b9b None None] MFA Rules not processed for user `74c84b03f3f8431e9d3c0cbb792aeaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:17.533295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-51b7f8bf-e849-4c09-848d-d3469c804b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:17.650788 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 910/1826] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:17 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:17.664325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:17.664897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:17.664897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:17.675776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cebfc-a3c4-45e5-bed0-f4c38e97ab31 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:17.676259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cebfc-a3c4-45e5-bed0-f4c38e97ab31 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:17.676684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cebfc-a3c4-45e5-bed0-f4c38e97ab31 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:17.678288 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 911/1827] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:11:17.691330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cebfc-a3c4-45e5-bed0-f4c38e97ab31 None None] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:17.695114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] MFA Rules not processed for user `74c84b03f3f8431e9d3c0cbb792aeaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:17.696319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:17.714957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 917/1828] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:17 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:17.717276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cebfc-a3c4-45e5-bed0-f4c38e97ab31 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:17.748027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cebfc-a3c4-45e5-bed0-f4c38e97ab31 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:17.765303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:17.766215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:17.771937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:17.771937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:17.771937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7cff3fb8aab4d0eb2b247cae880ba27)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:17.771937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:17.784167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 912/1829] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:17 2022] GET /identity/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27 => generated 375 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:11:17.904697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:17.906271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:17.931228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1123ea-7180-4ec6-9eb9-7d09ae2b44cc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:17.946783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:17.946783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:17.946783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:17.946783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] PATH_INFO: `/v3/projects/2ca00e22cb684f799091f0d1ffae7cab` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:17.947370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca00e22cb684f799091f0d1ffae7cab)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:17.949496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:18.131403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:18.133917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:18.142488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca00e22cb684f799091f0d1ffae7cab', 'request_id': 'req-321f94a6-9afe-4e0e-aafa-48363d2da34e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.157957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca00e22cb684f799091f0d1ffae7cab', 'request_id': 'req-321f94a6-9afe-4e0e-aafa-48363d2da34e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.158230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a52129-4644-460b-9a8f-6a9c30f709e6 tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:18.248056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca00e22cb684f799091f0d1ffae7cab', 'request_id': 'req-321f94a6-9afe-4e0e-aafa-48363d2da34e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.265439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] The token cache is being invalidate because project 2ca00e22cb684f799091f0d1ffae7cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:18.266061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.267135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.274880 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 918/1830] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:17 2022] DELETE /identity/v3/projects/2ca00e22cb684f799091f0d1ffae7cab => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:18.275714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:18.279128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:18.312214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:18.313263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:18.314930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:18.320733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:18.320733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:18.458875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f94a6-9afe-4e0e-aafa-48363d2da34e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:18.464678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:18.464990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:18.465446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:18.465713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] PATH_INFO: `/v3/users/194bf2348d4545b5999a5a58202a5788` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:18.467677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194bf2348d4545b5999a5a58202a5788)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:18.469574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:18.482458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:18.487945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:18.502387 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 913/1831] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:18 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:18.684087 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:18.725430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194bf2348d4545b5999a5a58202a5788'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.736619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194bf2348d4545b5999a5a58202a5788'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.738737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194bf2348d4545b5999a5a58202a5788'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.822177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194bf2348d4545b5999a5a58202a5788'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.823010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1de93982-9c7a-4c5f-a57c-9ce14c35b243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194bf2348d4545b5999a5a58202a5788'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:18.844512 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 919/1832] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:18 2022] DELETE /identity/v3/users/194bf2348d4545b5999a5a58202a5788 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:19.380991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:19.395195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8068f-3d6b-49ce-9aa8-42aa49a0c60a service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:19.530462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:19.531114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:19.531395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:19.531734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] PATH_INFO: `/v3/projects/129dc37259de478a88662a2181fc0a7b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:19.535281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=129dc37259de478a88662a2181fc0a7b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:19.539125 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:19.539910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:19.686470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129dc37259de478a88662a2181fc0a7b', 'request_id': 'req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:19.704157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129dc37259de478a88662a2181fc0a7b', 'request_id': 'req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:19.827289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129dc37259de478a88662a2181fc0a7b', 'request_id': 'req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:19.845668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] The token cache is being invalidate because project 129dc37259de478a88662a2181fc0a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:19.850426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:19.851403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3140ec8-4267-49f2-80eb-d81e1e3eb6fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:19.853412 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 914/1833] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:19 2022] DELETE /identity/v3/projects/129dc37259de478a88662a2181fc0a7b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:19.858416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9305-375c-4c01-8ba7-766780ab101c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:19.859617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9305-375c-4c01-8ba7-766780ab101c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:19.860319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9305-375c-4c01-8ba7-766780ab101c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:19.909564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d22c9305-375c-4c01-8ba7-766780ab101c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:19.910936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d22c9305-375c-4c01-8ba7-766780ab101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:19.994514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 920/1834] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:20.003105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f14e6-9504-4e27-9c27-0e0b68a6c955 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.003333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f14e6-9504-4e27-9c27-0e0b68a6c955 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.003631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f14e6-9504-4e27-9c27-0e0b68a6c955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.037726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e68f14e6-9504-4e27-9c27-0e0b68a6c955 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:20.039453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e68f14e6-9504-4e27-9c27-0e0b68a6c955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:20.049815 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 915/1835] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:20.053999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9305-375c-4c01-8ba7-766780ab101c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.064226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9305-375c-4c01-8ba7-766780ab101c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.069081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab76a8b-b4ed-4c5c-be29-b5f6db27d03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.069701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab76a8b-b4ed-4c5c-be29-b5f6db27d03b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.070001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab76a8b-b4ed-4c5c-be29-b5f6db27d03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.070276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab76a8b-b4ed-4c5c-be29-b5f6db27d03b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.070924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab76a8b-b4ed-4c5c-be29-b5f6db27d03b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:20.071454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab76a8b-b4ed-4c5c-be29-b5f6db27d03b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.073128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab76a8b-b4ed-4c5c-be29-b5f6db27d03b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.089095 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 921/1836] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:20.090846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f14e6-9504-4e27-9c27-0e0b68a6c955 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.101740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f14e6-9504-4e27-9c27-0e0b68a6c955 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.106905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.111792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.111792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.111792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.111792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.111792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.225575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.226329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.226329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.227723 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 922/1837] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:20.235108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:11:20.237748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:20.307480 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 916/1838] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:20 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:20.308842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.401346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.405706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:20.427201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90aa7c-0291-40c8-9b27-5c6103f4c595 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.454694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.455329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.455606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.455877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.458645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.464457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.472307 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:20.540618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e8134-2801-415d-9aa8-ddd033e3329d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.599869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b25fc856084ef0b792dbaad27f9e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5494c458ae245ebaeef3fddae85a45e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.600528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.600945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.601222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] PATH_INFO: `/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.602415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7cff3fb8aab4d0eb2b247cae880ba27)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.604496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.606484 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 923/1839] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:11:20 2022] GET /identity/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27 => generated 375 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:20.628502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.636863 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 917/1840] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:20 2022] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:20.639673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:20.642481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.659838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8828d0-d39e-4e8d-972c-83e32053914a tempest-QuotasAdminTestJSON-1241968156 tempest-QuotasAdminTestJSON-1241968156-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.664891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.671375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.671375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.671375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] PATH_INFO: `/v3/users/34675ffa7f9f4e76bad646189402680c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.671375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34675ffa7f9f4e76bad646189402680c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.671375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.686288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae94cc-3cb1-400a-9621-cd374a72f187 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.709306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.712414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.712769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.713113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.714468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.719838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.737720 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 918/1841] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:20.741413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.765039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128bab7-2dad-41f0-9d7a-2bf171f96e9d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.774090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.775246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.776003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.776997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.778245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.782613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.797772 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 919/1842] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:20.802384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:20.814806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71994367-669b-459a-804a-60976cf5dbbc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:20.823337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2bb51-8c1e-4575-a90e-972ecf45d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:20.824464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bb51-8c1e-4575-a90e-972ecf45d2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:20.824843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bb51-8c1e-4575-a90e-972ecf45d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:20.837442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bb51-8c1e-4575-a90e-972ecf45d2d5 admin admin] PATH_INFO: `/v3/projects/8f2336f5a71d481bb02938d8cbbbba8d/users/2ef08e7351e54f0e9a030e47b1d7560d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:20.885414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34675ffa7f9f4e76bad646189402680c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:20.890441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2bb51-8c1e-4575-a90e-972ecf45d2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2336f5a71d481bb02938d8cbbbba8d, user_id=2ef08e7351e54f0e9a030e47b1d7560d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:20.892117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2bb51-8c1e-4575-a90e-972ecf45d2d5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:20.905389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34675ffa7f9f4e76bad646189402680c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:20.906169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34675ffa7f9f4e76bad646189402680c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:21.034045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34675ffa7f9f4e76bad646189402680c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:21.035298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc3cefd0-b571-4f04-9d6c-1c928911cff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34675ffa7f9f4e76bad646189402680c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:21.055351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 920/1843] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:20 2022] PUT /identity/v3/projects/8f2336f5a71d481bb02938d8cbbbba8d/users/2ef08e7351e54f0e9a030e47b1d7560d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:21.057187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:21.057641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:21.057748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:21.084958 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 924/1844] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:20 2022] DELETE /identity/v3/users/34675ffa7f9f4e76bad646189402680c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:21.089367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:21.090601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:21.090601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:21.100178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] MFA Rules not processed for user `2ef08e7351e54f0e9a030e47b1d7560d`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:21.101460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:21.109405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:21.110617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:21.225467 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 921/1845] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:21.243466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:21.245771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:21.267423 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 925/1846] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:21.277543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:21.278973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:21.360839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcdd82-9fee-4225-96a4-809ea24487a9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:21.367022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:21.367877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:21.368303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:21.368657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:21.370011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:21.372405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:21.397212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789637e9-b040-4218-9a3a-d93d35425335 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:21.411318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:21.412051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:21.412390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:21.412728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:21.423674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:21.425416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:21.440430 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 926/1847] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:21.520072 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 922/1848] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:21 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:21.523927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:21.534509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c5c5-c313-4e62-85dd-5dc47bc01ece service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:21.630396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:21.634044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:21.634044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:21.634044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:21.634044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:21.635769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:21.750981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:21.759432 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 927/1849] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:21 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:21.766973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4488b28-2fe3-48ca-9fb1-584654fdf52b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:21.772713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:21.773621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:21.774095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:21.775226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:21.776280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:21.779244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:21.794364 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 923/1850] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:21.803887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:21.824957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3853-0106-49c9-b539-3e39d55466e7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:21.831350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:21.832211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:21.832787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:21.833378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] PATH_INFO: `/v3/projects/08e0450d9c7946caa4e2c434f92a4f69/users/ff4747cbca4e4e838b2aef7b9949b55f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:21.865757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e0450d9c7946caa4e2c434f92a4f69, user_id=ff4747cbca4e4e838b2aef7b9949b55f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:21.869169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:21.996710 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 928/1851] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:21 2022] PUT /identity/v3/projects/08e0450d9c7946caa4e2c434f92a4f69/users/ff4747cbca4e4e838b2aef7b9949b55f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:22.000767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:22.010947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7beef-f2a4-4290-860a-16fef178f5a1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:22.101823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74e7fa-caa5-4503-a5dd-369a58273666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:22.102776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e7fa-caa5-4503-a5dd-369a58273666 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:22.103259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e7fa-caa5-4503-a5dd-369a58273666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:22.104223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e7fa-caa5-4503-a5dd-369a58273666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:22.104891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74e7fa-caa5-4503-a5dd-369a58273666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:22.107693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74e7fa-caa5-4503-a5dd-369a58273666 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:22.122333 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 924/1852] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:22.126245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:22.143590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a525696-7c0a-4871-a305-b1479b3b48f0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:22.149057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:22.150072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:22.150549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:22.151016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] PATH_INFO: `/v3/projects/08e0450d9c7946caa4e2c434f92a4f69/users/ff4747cbca4e4e838b2aef7b9949b55f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:22.153774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e0450d9c7946caa4e2c434f92a4f69, user_id=ff4747cbca4e4e838b2aef7b9949b55f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:22.157493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:22.202023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:22.202392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:22.202704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:22.204249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 929/1853] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:22 2022] PUT /identity/v3/projects/08e0450d9c7946caa4e2c434f92a4f69/users/ff4747cbca4e4e838b2aef7b9949b55f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:22.277827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] MFA Rules not processed for user `ff4747cbca4e4e838b2aef7b9949b55f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:22.279126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:22.282377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:22.287361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:22.439342 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 925/1854] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:22.492012 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:22.497591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d1e07-7b13-40fe-a7b3-f295ba4f62f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:22.502803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:22.504689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:22.504995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:22.505280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] PATH_INFO: `/v3/projects/f5e8c9aca8184f35a7b6f80eea34b649` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:22.506570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e8c9aca8184f35a7b6f80eea34b649)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:22.508496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:22.576901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:22.578255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:22.647195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e8c9aca8184f35a7b6f80eea34b649', 'request_id': 'req-ec71aed7-a99d-4552-8e4c-3cd9441905bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:22.653106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e8c9aca8184f35a7b6f80eea34b649', 'request_id': 'req-ec71aed7-a99d-4552-8e4c-3cd9441905bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:22.665330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7c341-1eb5-4220-b038-6fb06ff08084 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:22.751578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:22.752252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:22.752252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:22.752421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:22.769180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e8c9aca8184f35a7b6f80eea34b649', 'request_id': 'req-ec71aed7-a99d-4552-8e4c-3cd9441905bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:22.794820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] The token cache is being invalidate because project f5e8c9aca8184f35a7b6f80eea34b649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:22.795707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:22.796595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:22.798656 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 930/1855] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:22 2022] DELETE /identity/v3/projects/f5e8c9aca8184f35a7b6f80eea34b649 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:22.802763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:22.804287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:22.835987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:22.837939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:22.864663 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 926/1856] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:22.934798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71aed7-a99d-4552-8e4c-3cd9441905bd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:22.940174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:22.941065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:22.941443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:22.941814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] PATH_INFO: `/v3/users/a997cd84907845e2a0df8ae40a0fd4bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:22.943131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a997cd84907845e2a0df8ae40a0fd4bf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:22.946093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:22.980556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:22.982000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:22.997756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ca44-8491-484e-a1e6-38d62ab55ca6 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:23.004676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:23.005380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:23.005660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:23.005931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] PATH_INFO: `/v3/users/24b0acb3037d4187ad72bf96b2b6b6a8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:23.007180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b0acb3037d4187ad72bf96b2b6b6a8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:23.009154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:23.223231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b0acb3037d4187ad72bf96b2b6b6a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.232903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b0acb3037d4187ad72bf96b2b6b6a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.237914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b0acb3037d4187ad72bf96b2b6b6a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.238057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a997cd84907845e2a0df8ae40a0fd4bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.246227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a997cd84907845e2a0df8ae40a0fd4bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.247103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a997cd84907845e2a0df8ae40a0fd4bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.339416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b0acb3037d4187ad72bf96b2b6b6a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.340441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51a2c425-67ce-4706-a6a5-633c1c14b997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b0acb3037d4187ad72bf96b2b6b6a8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.387435 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 927/1857] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:22 2022] DELETE /identity/v3/users/24b0acb3037d4187ad72bf96b2b6b6a8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:23.397640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:23.398046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:23.398391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:23.428863 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:23.430867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:23.431596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:23.473123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a997cd84907845e2a0df8ae40a0fd4bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.473598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a997cd84907845e2a0df8ae40a0fd4bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:23.529012 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 931/1858] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:22 2022] DELETE /identity/v3/users/a997cd84907845e2a0df8ae40a0fd4bf => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:23.557138 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 928/1859] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:23.584942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:23.586711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:23.656761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ae95f-4782-4de7-8345-8f0464a0f1da admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:23.660688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:23.661385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:23.661726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:23.662106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:23.765538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:23.767155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:23.777628 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 932/1860] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:24.135317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:24.137809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:24.168267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ab984-8f95-430b-860f-1a16c0b62ee6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:24.180792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:24.181447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:24.181724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:24.182011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] PATH_INFO: `/v3/users/d61093911783470a94d53354c15df815` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:24.183833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61093911783470a94d53354c15df815)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:24.185793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:24.406191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:24.407692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:24.428630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4750-ae88-4eae-ad9e-b92e7c86d534 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:24.434611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:24.436443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:24.436869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:24.437296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] PATH_INFO: `/v3/projects/24682a566a714ef586033a6e2992e4e4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:24.438707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24682a566a714ef586033a6e2992e4e4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:24.440775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:24.515039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61093911783470a94d53354c15df815'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.525642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61093911783470a94d53354c15df815'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.526407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61093911783470a94d53354c15df815'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.617876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24682a566a714ef586033a6e2992e4e4', 'request_id': 'req-5b59854d-bb29-4c68-b115-80c7fb7e25d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.624656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24682a566a714ef586033a6e2992e4e4', 'request_id': 'req-5b59854d-bb29-4c68-b115-80c7fb7e25d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.639302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61093911783470a94d53354c15df815'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.639302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61093911783470a94d53354c15df815'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.672211 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 929/1861] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:24 2022] DELETE /identity/v3/users/d61093911783470a94d53354c15df815 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:24.672211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:24.672211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:24.746742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dcea6-1d45-48b7-93ef-047f6e07decb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:24.752200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:24.752835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:24.753132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:24.753429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] PATH_INFO: `/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:24.755263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7cff3fb8aab4d0eb2b247cae880ba27)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:24.757143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:24.761561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24682a566a714ef586033a6e2992e4e4', 'request_id': 'req-5b59854d-bb29-4c68-b115-80c7fb7e25d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.784760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] The token cache is being invalidate because project 24682a566a714ef586033a6e2992e4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:24.785055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.788068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5b59854d-bb29-4c68-b115-80c7fb7e25d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.789379 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 933/1862] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:24 2022] DELETE /identity/v3/projects/24682a566a714ef586033a6e2992e4e4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:24.793437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:24.794013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:24.794508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:24.819680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:24.821598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:24.835944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 934/1863] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:24.835944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:24.835944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:24.843956 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:24.852775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0072-5b03-4cdf-a92a-44d282ae6cac None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:24.863397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:24.864124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:24.864471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:24.864938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] PATH_INFO: `/v3/users/2ef08e7351e54f0e9a030e47b1d7560d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:24.875585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef08e7351e54f0e9a030e47b1d7560d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:24.875585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:24.901877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7cff3fb8aab4d0eb2b247cae880ba27', 'request_id': 'req-d962831b-0981-4f79-84d5-7326a869f497'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.908131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7cff3fb8aab4d0eb2b247cae880ba27', 'request_id': 'req-d962831b-0981-4f79-84d5-7326a869f497'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:24.977481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7cff3fb8aab4d0eb2b247cae880ba27', 'request_id': 'req-d962831b-0981-4f79-84d5-7326a869f497'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.000971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] The token cache is being invalidate because project c7cff3fb8aab4d0eb2b247cae880ba27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:25.001304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.002276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d962831b-0981-4f79-84d5-7326a869f497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.004027 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 930/1864] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:24 2022] DELETE /identity/v3/projects/c7cff3fb8aab4d0eb2b247cae880ba27 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:25.005604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.005948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.006244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.034009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:25.035422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.081646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef08e7351e54f0e9a030e47b1d7560d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.096622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef08e7351e54f0e9a030e47b1d7560d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.099002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef08e7351e54f0e9a030e47b1d7560d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.161043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 931/1865] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:25.162807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:25.164269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.195932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef08e7351e54f0e9a030e47b1d7560d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.196953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef08e7351e54f0e9a030e47b1d7560d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.220676 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 935/1866] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:24 2022] DELETE /identity/v3/users/2ef08e7351e54f0e9a030e47b1d7560d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:25.222294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:25.224190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.256550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f80a37-6fbd-4e3d-99eb-21e5221a7cae None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:25.304540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138c23a-bff3-457c-84c3-8aead2e8155d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:25.311344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:25.311994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.312425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.312705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] PATH_INFO: `/v3/users/55b25fc856084ef0b792dbaad27f9e36` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.314246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b25fc856084ef0b792dbaad27f9e36)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:25.315868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:25.321286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660095d8-c4af-4d30-9367-886e43696922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:25.322400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660095d8-c4af-4d30-9367-886e43696922 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.322400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660095d8-c4af-4d30-9367-886e43696922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.322946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660095d8-c4af-4d30-9367-886e43696922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.325004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-660095d8-c4af-4d30-9367-886e43696922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.339569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660095d8-c4af-4d30-9367-886e43696922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:25.344203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660095d8-c4af-4d30-9367-886e43696922 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:25.351159 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 932/1867] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:25.352256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8697ab-5a89-4e19-aa75-2ff249b8adbf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.352537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8697ab-5a89-4e19-aa75-2ff249b8adbf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.352805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8697ab-5a89-4e19-aa75-2ff249b8adbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.374143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ba8697ab-5a89-4e19-aa75-2ff249b8adbf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:25.375386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba8697ab-5a89-4e19-aa75-2ff249b8adbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.383896 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 933/1868] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:25.384953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7ee38-a37d-494f-82a7-6f86d489e0d7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.385239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7ee38-a37d-494f-82a7-6f86d489e0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.385511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7ee38-a37d-494f-82a7-6f86d489e0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.405429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-eed7ee38-a37d-494f-82a7-6f86d489e0d7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:25.406680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eed7ee38-a37d-494f-82a7-6f86d489e0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.414592 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 934/1869] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:25.415445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7ee38-a37d-494f-82a7-6f86d489e0d7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:25.427197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7ee38-a37d-494f-82a7-6f86d489e0d7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:25.435787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:25.436487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.437499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.437844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.438840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:25.439896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:25.445762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:25.456620 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 935/1870] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:25.457821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:25.459915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.478745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57736606-52d2-463b-8fca-ddbb3d1594ff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:25.489923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:25.490254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.490608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.490888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.504217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:25.505863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:25.516649 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 936/1871] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:25.517384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:25.527610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd07d9-7785-4efc-9631-8598b9c4c165 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:25.533061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:25.533740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.534172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.534569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.536090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:25.537334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:25.629900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b25fc856084ef0b792dbaad27f9e36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.639734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b25fc856084ef0b792dbaad27f9e36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.640467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b25fc856084ef0b792dbaad27f9e36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.688075 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 937/1872] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:25 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:25.692263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:25.754871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b25fc856084ef0b792dbaad27f9e36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.755516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b25fc856084ef0b792dbaad27f9e36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:25.814025 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 936/1873] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:25 2022] DELETE /identity/v3/users/55b25fc856084ef0b792dbaad27f9e36 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:25.814025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:25.823624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:25.828392 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:25.828392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f417fe6-b6fa-4649-8498-bb33b8e6940c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:25.959384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:25.959892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:25.960174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:25.967418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:25.969516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:25.971847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:25.986232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f7fe-c403-43d1-b649-20d40f7cb4ca admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:26.001365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:26.003006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.003006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.003006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] PATH_INFO: `/v3/projects/f3a80a158b5c4e3baf87e83a284970c3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.004065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a80a158b5c4e3baf87e83a284970c3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:26.006625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:26.108992 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 938/1874] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:25 2022] POST /identity/v3/users => generated 292 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:26.113055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:26.116678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:26.146045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6ec5c-b49f-4532-ba28-4a6663066aee admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:26.182887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a80a158b5c4e3baf87e83a284970c3', 'request_id': 'req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.207045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a80a158b5c4e3baf87e83a284970c3', 'request_id': 'req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.284345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:26.291992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.292530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.292814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.293919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:26.300158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a80a158b5c4e3baf87e83a284970c3', 'request_id': 'req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.300478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:26.318890 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 939/1875] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:26.318890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:26.321266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] The token cache is being invalidate because project f3a80a158b5c4e3baf87e83a284970c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:26.321571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:26.322331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.323513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.330737 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 937/1876] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:25 2022] DELETE /identity/v3/projects/f3a80a158b5c4e3baf87e83a284970c3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:26.335588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:26.337399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:26.358893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96feb-c2ea-47ee-9d2b-453b0db4a8e4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:26.367284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80069a0-0962-4f13-866e-07442d4aed6f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:26.371964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:26.373266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.373820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.374429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.380709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:26.380709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:26.381303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:26.382801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.383075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.383348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] PATH_INFO: `/v3/projects/8f2336f5a71d481bb02938d8cbbbba8d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.384663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2336f5a71d481bb02938d8cbbbba8d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:26.386916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:26.396870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 938/1877] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:26.398020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:26.401599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:26.423171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6680-b0d8-4729-ad89-dad4d6ac30f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:26.428774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:26.429597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.429909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.430906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] PATH_INFO: `/v3/users/15cf44b2cdc345a883125e0522ccf08f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.437214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cf44b2cdc345a883125e0522ccf08f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:26.437214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:26.544753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2336f5a71d481bb02938d8cbbbba8d', 'request_id': 'req-aa932427-4a10-4adc-8a0f-d65fff397723'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.554121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2336f5a71d481bb02938d8cbbbba8d', 'request_id': 'req-aa932427-4a10-4adc-8a0f-d65fff397723'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.625144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2336f5a71d481bb02938d8cbbbba8d', 'request_id': 'req-aa932427-4a10-4adc-8a0f-d65fff397723'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.638175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] The token cache is being invalidate because project 8f2336f5a71d481bb02938d8cbbbba8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:26.638489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.640105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.641863 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 940/1878] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:26 2022] DELETE /identity/v3/projects/8f2336f5a71d481bb02938d8cbbbba8d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:26.642517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:26.643810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:26.708021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cf44b2cdc345a883125e0522ccf08f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.717872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cf44b2cdc345a883125e0522ccf08f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.718873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cf44b2cdc345a883125e0522ccf08f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.738394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa932427-4a10-4adc-8a0f-d65fff397723 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:26.743238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f441a4-76b4-4d03-8ff2-749d8e3b577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:26.743987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f441a4-76b4-4d03-8ff2-749d8e3b577c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.744436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f441a4-76b4-4d03-8ff2-749d8e3b577c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.744654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f441a4-76b4-4d03-8ff2-749d8e3b577c admin admin] PATH_INFO: `/v3/projects/96bbe4cfe1c94f02a5bd89b588c910a2/users/fbc7953d38a445029159a14c378f6670/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.760778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f441a4-76b4-4d03-8ff2-749d8e3b577c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bbe4cfe1c94f02a5bd89b588c910a2, user_id=fbc7953d38a445029159a14c378f6670, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:26.763481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f441a4-76b4-4d03-8ff2-749d8e3b577c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:26.789430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cf44b2cdc345a883125e0522ccf08f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.790069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cf44b2cdc345a883125e0522ccf08f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:26.808297 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 939/1879] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:26 2022] DELETE /identity/v3/users/15cf44b2cdc345a883125e0522ccf08f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:26.809110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:26.811107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:26.876636 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 941/1880] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:26 2022] PUT /identity/v3/projects/96bbe4cfe1c94f02a5bd89b588c910a2/users/fbc7953d38a445029159a14c378f6670/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:26.887374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.887876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.888000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.906301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ac293-df2d-483c-9d92-719be4e2c096 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:26.939958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] MFA Rules not processed for user `fbc7953d38a445029159a14c378f6670`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:26.941186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:26.991589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:26.993029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:26.993722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:26.994547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] PATH_INFO: `/v3/users/ff4747cbca4e4e838b2aef7b9949b55f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:26.995894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4747cbca4e4e838b2aef7b9949b55f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:26.999161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:27.054879 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 942/1881] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:27.055881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:27.057228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:27.071687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2866e-f101-451e-8b16-22d639ab6cc4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:27.076538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:27.077170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:27.077446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:27.077713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] PATH_INFO: `/v3/projects/b5494c458ae245ebaeef3fddae85a45e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:27.078888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5494c458ae245ebaeef3fddae85a45e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:27.082656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:27.239662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4747cbca4e4e838b2aef7b9949b55f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.243614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5494c458ae245ebaeef3fddae85a45e', 'request_id': 'req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.249563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4747cbca4e4e838b2aef7b9949b55f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.251193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4747cbca4e4e838b2aef7b9949b55f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.265955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5494c458ae245ebaeef3fddae85a45e', 'request_id': 'req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.343461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4747cbca4e4e838b2aef7b9949b55f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.344130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4747cbca4e4e838b2aef7b9949b55f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.364412 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 940/1882] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:26 2022] DELETE /identity/v3/users/ff4747cbca4e4e838b2aef7b9949b55f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:27.365709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:27.367535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:27.433896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8837-ec33-4a1b-a528-47d23e246a4f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:27.435982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5494c458ae245ebaeef3fddae85a45e', 'request_id': 'req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.443627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac08f-091d-4740-ae6c-0e2a62805bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:27.445236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac08f-091d-4740-ae6c-0e2a62805bca service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:27.446239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac08f-091d-4740-ae6c-0e2a62805bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:27.447618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac08f-091d-4740-ae6c-0e2a62805bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:27.450265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6dfac08f-091d-4740-ae6c-0e2a62805bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:27.451027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] The token cache is being invalidate because project b5494c458ae245ebaeef3fddae85a45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:27.451564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.452305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.459457 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 943/1883] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:27 2022] DELETE /identity/v3/projects/b5494c458ae245ebaeef3fddae85a45e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:27.460378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:27.461805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:27.515606 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:27.549062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac08f-091d-4740-ae6c-0e2a62805bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:27.551115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac08f-091d-4740-ae6c-0e2a62805bca service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:27.551437 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:27.563942 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 941/1884] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:27.566327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f3f0-cc37-4e01-bada-481cce61ffb0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:27.566842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f3f0-cc37-4e01-bada-481cce61ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:27.567521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f3f0-cc37-4e01-bada-481cce61ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:27.603356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d7f9f3f0-cc37-4e01-bada-481cce61ffb0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:27.603933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d6a1c-f608-4c17-a396-2fbc7aead2ab admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:27.605906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d7f9f3f0-cc37-4e01-bada-481cce61ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:27.715755 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 942/1885] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:27.724452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007baf-cf44-4a9f-8d34-939908a05659 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:27.724886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007baf-cf44-4a9f-8d34-939908a05659 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:27.726970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007baf-cf44-4a9f-8d34-939908a05659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:27.750787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:27.754357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:27.755707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:27.755707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] PATH_INFO: `/v3/projects/f7c3e6bcb228428aaf1ddbb2dda3af25` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:27.756473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c3e6bcb228428aaf1ddbb2dda3af25)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:27.758466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:27.766361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ea007baf-cf44-4a9f-8d34-939908a05659 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:27.770848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea007baf-cf44-4a9f-8d34-939908a05659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:27.798058 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 943/1886] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:27.798993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007baf-cf44-4a9f-8d34-939908a05659 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:27.822245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007baf-cf44-4a9f-8d34-939908a05659 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:27.831271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:27.831896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:27.832173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:27.832445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:27.833095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:27.833397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:27.835593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:27.854684 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 944/1887] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:27.856090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:27.873715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23872e6d-1d35-45c9-bd3e-a4d1c90e4a33 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:27.876766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:27.877625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:27.878114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:27.878564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:27.879440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:27.881869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:27.949817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c3e6bcb228428aaf1ddbb2dda3af25', 'request_id': 'req-44292431-72ae-45b0-b48c-fc6969d301fd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:27.956332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c3e6bcb228428aaf1ddbb2dda3af25', 'request_id': 'req-44292431-72ae-45b0-b48c-fc6969d301fd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.043480 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 945/1888] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:27 2022] POST /identity/v3/projects => generated 391 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:28.044502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.049733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c3e6bcb228428aaf1ddbb2dda3af25', 'request_id': 'req-44292431-72ae-45b0-b48c-fc6969d301fd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.071524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] The token cache is being invalidate because project f7c3e6bcb228428aaf1ddbb2dda3af25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:28.074204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.075452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44292431-72ae-45b0-b48c-fc6969d301fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.083496 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 944/1889] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:27 2022] DELETE /identity/v3/projects/f7c3e6bcb228428aaf1ddbb2dda3af25 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:28.091551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e13be-2c24-4276-8710-a2b8abec50cf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.091908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e13be-2c24-4276-8710-a2b8abec50cf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.092106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e13be-2c24-4276-8710-a2b8abec50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.127118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2d6e13be-2c24-4276-8710-a2b8abec50cf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:28.130486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d6e13be-2c24-4276-8710-a2b8abec50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:28.194840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844b142-aefb-4040-8a28-16d80637670b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.215358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.220293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.220647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.221208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.221897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.225672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.268459 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 945/1890] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:28.270350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126a88-caea-47af-8ea1-37d159c59e03 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.270833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126a88-caea-47af-8ea1-37d159c59e03 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.271346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3126a88-caea-47af-8ea1-37d159c59e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.305450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f3126a88-caea-47af-8ea1-37d159c59e03 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:28.306773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f3126a88-caea-47af-8ea1-37d159c59e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:28.316181 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 946/1891] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:28.323579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126a88-caea-47af-8ea1-37d159c59e03 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.336699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3126a88-caea-47af-8ea1-37d159c59e03 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.342642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.343262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.343541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.343810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.344469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:28.344761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.346589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.366213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 946/1892] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:28 2022] POST /identity/v3/users => generated 296 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:28.372602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.374534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:28.388885 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 947/1893] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:28.390770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.403393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f0d4c-0b26-4839-87cc-444c3871551f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.415670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.416386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.416785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53cbcb-913d-4e78-b6f5-8f105ab7a92e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.417955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.418661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.419801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.423896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.429918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.430694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.430975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.431245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.431898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.437462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.447914 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 947/1894] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:28.453328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.488736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49353-c9f3-480a-b549-56c2878a4fea admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.501641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.502432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.502720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.502993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.503710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.505641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.520118 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 948/1895] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:28.520289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.522068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:28.541356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caf0a1-b951-4f30-b398-2444c0cebd54 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.552006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.553036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.553462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.553941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] PATH_INFO: `/v3/users/fbc7953d38a445029159a14c378f6670` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.555362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc7953d38a445029159a14c378f6670)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.557763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.570866 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 948/1896] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:28 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:28.570866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.667940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9dad2-41ac-484c-a0c4-ad0acf2b6504 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.673201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.673884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.674196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.674476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] PATH_INFO: `/v3/projects/33378554326c4850bdf71c709882f064/users/d4fe15e77b8c401d9f0307ee769c5bf6/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.692038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33378554326c4850bdf71c709882f064, user_id=d4fe15e77b8c401d9f0307ee769c5bf6, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.694790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.768655 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 949/1897] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:28 2022] PUT /identity/v3/projects/33378554326c4850bdf71c709882f064/users/d4fe15e77b8c401d9f0307ee769c5bf6/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:28.769650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:28.790214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc7953d38a445029159a14c378f6670'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.798910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc7953d38a445029159a14c378f6670'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.799770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc7953d38a445029159a14c378f6670'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.857189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc9c35-cb52-4cb3-a2dd-9c2819dfb870 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:28.863008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5dff3-ed04-44af-8b59-568a8a210b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:28.863630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5dff3-ed04-44af-8b59-568a8a210b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.864066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5dff3-ed04-44af-8b59-568a8a210b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.864346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5dff3-ed04-44af-8b59-568a8a210b2c admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.864979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5dff3-ed04-44af-8b59-568a8a210b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:28.865083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc7953d38a445029159a14c378f6670'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.865731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e54ee74d-9795-4786-b423-025f35644adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc7953d38a445029159a14c378f6670'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:28.867274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5dff3-ed04-44af-8b59-568a8a210b2c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:28.890021 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 949/1898] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:28 2022] DELETE /identity/v3/users/fbc7953d38a445029159a14c378f6670 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:28.894943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.895442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.895751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.933872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] MFA Rules not processed for user `d4fe15e77b8c401d9f0307ee769c5bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:28.935837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:28.951799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 950/1899] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:28 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:28.951799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:28.951799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:28.951799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:28.973629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:28.975263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:29.044945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 950/1900] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:29.045900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.047211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:29.052369 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 951/1901] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:29.053209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.054650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:29.064007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60c739-1d2f-481e-8db3-2f433a51f27f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.070765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:29.071507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.071837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.072113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.072763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:29.073203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d9df8-1adb-479a-b7e7-4f0ec4ec8b46 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.074479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:29.080821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:29.082397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.083114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.083488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.084298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:29.086034 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 951/1902] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:29.086657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:29.089921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.091771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:29.151258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efab9ee-fb76-44e3-ac93-6f93c4590f00 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.155471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:29.156158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.156431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.156698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.167934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:29.170121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:29.190171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 952/1903] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:29.192377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.204810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141669a-616e-4e68-8905-84466cb9aa18 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.211312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:29.212624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.212911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.213185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.213828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:29.216067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:29.230043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 952/1904] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:29 2022] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:29.230043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.231087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:29.244384 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 953/1905] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:29.245433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.258622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021007b-71f5-484a-9425-0ecc7973ad2f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.346573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:29.347473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.347829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.348170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.348827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:29.350975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:29.360672 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:29.365879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808e7b-c0b2-4efc-bf18-ab9aa6f2260e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.370977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:29.371685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.372022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.372377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] PATH_INFO: `/v3/projects/08e0450d9c7946caa4e2c434f92a4f69` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.374171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e0450d9c7946caa4e2c434f92a4f69)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:29.376045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:29.464388 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 954/1906] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:29 2022] POST /identity/v3/users => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:29.466136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.480678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030249e4-5f40-4c03-b106-fa084aba6b45 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.499740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:29.502836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.502836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.502836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] PATH_INFO: `/v3/projects/23f22fb0ca7346c4ab225ce82d69118c/users/76739eabf8804ec2af41abc4c1e6fd4b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.513068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e0450d9c7946caa4e2c434f92a4f69', 'request_id': 'req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:29.517482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f22fb0ca7346c4ab225ce82d69118c, user_id=76739eabf8804ec2af41abc4c1e6fd4b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:29.520748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e0450d9c7946caa4e2c434f92a4f69', 'request_id': 'req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:29.522525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:29.650251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e0450d9c7946caa4e2c434f92a4f69', 'request_id': 'req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:29.664350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 955/1907] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:29 2022] PUT /identity/v3/projects/23f22fb0ca7346c4ab225ce82d69118c/users/76739eabf8804ec2af41abc4c1e6fd4b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:29.665439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:29.687408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] The token cache is being invalidate because project 08e0450d9c7946caa4e2c434f92a4f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:29.687874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:29.689936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c0fffab-175d-4e3f-a0ff-4480c2f6a734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:29.698395 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 953/1908] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:29 2022] DELETE /identity/v3/projects/08e0450d9c7946caa4e2c434f92a4f69 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:29.700151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cffabf-c00f-4bb2-840c-03a8cdc2176d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:29.700611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cffabf-c00f-4bb2-840c-03a8cdc2176d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:29.701103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cffabf-c00f-4bb2-840c-03a8cdc2176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:29.806558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-20cffabf-c00f-4bb2-840c-03a8cdc2176d None None] MFA Rules not processed for user `76739eabf8804ec2af41abc4c1e6fd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:29.808408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-20cffabf-c00f-4bb2-840c-03a8cdc2176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:29.925564 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:29.978028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b02c01-f3cf-4f17-9a14-125eae18c562 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:29.994182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.001384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.001384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.001384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.001777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.012029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.051141 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 954/1909] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:30.052650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4cc2-8b8a-4100-88ba-5dff31d83181 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.052650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4cc2-8b8a-4100-88ba-5dff31d83181 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.062447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4cc2-8b8a-4100-88ba-5dff31d83181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.070018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 956/1910] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:30.084536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.092517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-07cb4cc2-8b8a-4100-88ba-5dff31d83181 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:30.094406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.099813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-07cb4cc2-8b8a-4100-88ba-5dff31d83181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.122329 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 955/1911] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:30.125855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287f452-b00c-4e24-8ce9-291bf8b92b34 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.126202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287f452-b00c-4e24-8ce9-291bf8b92b34 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.126659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287f452-b00c-4e24-8ce9-291bf8b92b34 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.129106 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 956/1912] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:11:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:11:30.130165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287f452-b00c-4e24-8ce9-291bf8b92b34 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.138069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f38f5-c5f7-4709-9e85-0bca01d13b0b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.141734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4287f452-b00c-4e24-8ce9-291bf8b92b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.146203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.147390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.147980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.148645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] PATH_INFO: `/v3/projects/96bbe4cfe1c94f02a5bd89b588c910a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.151360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bbe4cfe1c94f02a5bd89b588c910a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.155377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.204035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287f452-b00c-4e24-8ce9-291bf8b92b34 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.211728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.212798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.213427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.213877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.214837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.217153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.323746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bbe4cfe1c94f02a5bd89b588c910a2', 'request_id': 'req-48609824-64eb-4216-994f-b483e08966ad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.328622 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 957/1913] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:30 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:30.329609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.332290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.335209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bbe4cfe1c94f02a5bd89b588c910a2', 'request_id': 'req-48609824-64eb-4216-994f-b483e08966ad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.409238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bbe4cfe1c94f02a5bd89b588c910a2', 'request_id': 'req-48609824-64eb-4216-994f-b483e08966ad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.420303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8783e-b959-4219-86ba-86a7e997b3f9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.426141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.426877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.427162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.427458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] PATH_INFO: `/v3/projects/2013486e83be4ba9be0252ab1f77a57d/users/737ca9793357406cbd651f6b1bbbb537/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.446038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] The token cache is being invalidate because project 96bbe4cfe1c94f02a5bd89b588c910a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:30.454947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.460294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-48609824-64eb-4216-994f-b483e08966ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.464945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 957/1914] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:30 2022] DELETE /identity/v3/projects/96bbe4cfe1c94f02a5bd89b588c910a2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:30.466877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf64e2-bde2-42f4-9dee-d90369dbb48c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.467159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf64e2-bde2-42f4-9dee-d90369dbb48c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.470036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf64e2-bde2-42f4-9dee-d90369dbb48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.480174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2013486e83be4ba9be0252ab1f77a57d, user_id=737ca9793357406cbd651f6b1bbbb537, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.497392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.507238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-49bf64e2-bde2-42f4-9dee-d90369dbb48c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:30.509785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-49bf64e2-bde2-42f4-9dee-d90369dbb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.515915 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 958/1915] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:30.517173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e634e-7544-464f-a60c-f84fc0b8d82e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.517459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e634e-7544-464f-a60c-f84fc0b8d82e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.517731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e634e-7544-464f-a60c-f84fc0b8d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.537827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cf5e634e-7544-464f-a60c-f84fc0b8d82e None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:30.538971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cf5e634e-7544-464f-a60c-f84fc0b8d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.606623 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 958/1916] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:30 2022] PUT /identity/v3/projects/2013486e83be4ba9be0252ab1f77a57d/users/737ca9793357406cbd651f6b1bbbb537/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:30.608635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.610590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.611573 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 959/1917] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:30.612737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.613086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.613461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.645158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:30.646963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.698258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3ac3d-ff81-4422-a599-7fa80378282d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.704184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.704993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.705420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.705863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.706686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.708759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.732289 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 960/1918] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:30.733272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.734607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.747434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2954b2d-901f-403b-b412-0ef57cd0446b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.752460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.753272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.753552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.753824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] PATH_INFO: `/v3/users/ec43833fb4d646ab9f26d425cdb0b694` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.755000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec43833fb4d646ab9f26d425cdb0b694)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.756944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.815844 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 959/1919] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:30 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:30.815844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.824171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2c313-fca8-4808-ae6b-f8b7daf27e53 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.829583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.830218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.830497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.830772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.831451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:30.831755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.833359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.846434 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 960/1920] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:30.847371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.849068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.861765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a8304-84e9-4592-8a65-783f46d1a813 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.866769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.867404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.867672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.867949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.868655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.870275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.884284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 961/1921] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:30.884284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:30.884561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:30.959194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42168a3e-d48f-411a-bc07-bf74a27c7421 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:30.960750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec43833fb4d646ab9f26d425cdb0b694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.964979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b8588-2adf-436a-a343-2036d7911d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:30.965600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8588-2adf-436a-a343-2036d7911d39 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.965905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8588-2adf-436a-a343-2036d7911d39 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.966202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8588-2adf-436a-a343-2036d7911d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:30.970215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec43833fb4d646ab9f26d425cdb0b694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.971121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec43833fb4d646ab9f26d425cdb0b694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:30.975999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b8588-2adf-436a-a343-2036d7911d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:30.977586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b8588-2adf-436a-a343-2036d7911d39 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:30.987897 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 962/1922] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:30.989195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad12da-09a8-4bdf-b3f2-27d095ce7ce5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:30.989480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad12da-09a8-4bdf-b3f2-27d095ce7ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:30.989748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad12da-09a8-4bdf-b3f2-27d095ce7ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.010208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-54ad12da-09a8-4bdf-b3f2-27d095ce7ce5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:31.013773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-54ad12da-09a8-4bdf-b3f2-27d095ce7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.021090 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 963/1923] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:31.022102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad12da-09a8-4bdf-b3f2-27d095ce7ce5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.034320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad12da-09a8-4bdf-b3f2-27d095ce7ce5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.042726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.043350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.043618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.043881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.044650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.046184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.054921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec43833fb4d646ab9f26d425cdb0b694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:31.055641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec43833fb4d646ab9f26d425cdb0b694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:31.057081 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 964/1924] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:31.057889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.059653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.072978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1164a-4379-43ac-a5ce-9e92c4bc3bc4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.078535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.079221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.079561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.079918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.080816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.082613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.083160 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 961/1925] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:30 2022] DELETE /identity/v3/users/ec43833fb4d646ab9f26d425cdb0b694 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:31.085261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.086663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.108196 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:31.164893 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 965/1926] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:31 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:31.165681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.167873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.176873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347708-cbe4-4570-85ee-a4260bd50be8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.251014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618f8d8-b113-4e03-b5b5-dd909bedf173 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.258148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.258862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.259146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.259416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.260080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:31.260384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.262262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.278924 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 966/1927] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:31.279943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.282945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.299912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aeae1-75a2-454b-8b98-0060b73fea5a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.303801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e46111-deee-483f-918d-3306905a30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.304579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e46111-deee-483f-918d-3306905a30d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.305077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e46111-deee-483f-918d-3306905a30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.305373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e46111-deee-483f-918d-3306905a30d6 admin admin] PATH_INFO: `/v3/projects/2013486e83be4ba9be0252ab1f77a57d/users/737ca9793357406cbd651f6b1bbbb537/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.307495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e46111-deee-483f-918d-3306905a30d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2013486e83be4ba9be0252ab1f77a57d, user_id=737ca9793357406cbd651f6b1bbbb537, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.309656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.311207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e46111-deee-483f-918d-3306905a30d6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.311712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.312401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.313098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] PATH_INFO: `/v3/projects/cb3dfb94faab4c4eab8d74725c976780/users/9ab6e1b0016a4959958deda4467ef3e5/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.315384 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:31.330133 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 962/1928] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:31 2022] PUT /identity/v3/projects/2013486e83be4ba9be0252ab1f77a57d/users/737ca9793357406cbd651f6b1bbbb537/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:31.332422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1256cb-d393-4cfa-8c52-d73c79bb0170 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.335476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1256cb-d393-4cfa-8c52-d73c79bb0170 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.335476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1256cb-d393-4cfa-8c52-d73c79bb0170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.348288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3dfb94faab4c4eab8d74725c976780, user_id=9ab6e1b0016a4959958deda4467ef3e5, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.352279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.358788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ab1256cb-d393-4cfa-8c52-d73c79bb0170 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:31.359590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab1256cb-d393-4cfa-8c52-d73c79bb0170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.427408 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 963/1929] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:31.428679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1256cb-d393-4cfa-8c52-d73c79bb0170 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.440113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1256cb-d393-4cfa-8c52-d73c79bb0170 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.448572 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 967/1930] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:31 2022] PUT /identity/v3/projects/cb3dfb94faab4c4eab8d74725c976780/users/9ab6e1b0016a4959958deda4467ef3e5/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:31.448572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.580444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad52808-bb4d-447d-8963-db2b9e277e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.580444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad52808-bb4d-447d-8963-db2b9e277e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.580444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad52808-bb4d-447d-8963-db2b9e277e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.580444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad52808-bb4d-447d-8963-db2b9e277e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.580840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad52808-bb4d-447d-8963-db2b9e277e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.582291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad52808-bb4d-447d-8963-db2b9e277e6e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.588559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c73ef-4ada-499f-b6c1-fe1848ad036b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.604300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.604300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.604300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.615118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.615118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.615118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.713276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 964/1931] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:31 2022] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:31.714787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c6e6b-7cbb-4e03-90c6-7f75431bac89 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.715145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c6e6b-7cbb-4e03-90c6-7f75431bac89 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.715492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c6e6b-7cbb-4e03-90c6-7f75431bac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.741407 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 968/1932] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:31 2022] POST /identity/v3/projects => generated 381 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:31.742625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.745421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.751042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5c2c6e6b-7cbb-4e03-90c6-7f75431bac89 None None] MFA Rules not processed for user `737ca9793357406cbd651f6b1bbbb537`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:31.753759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5c2c6e6b-7cbb-4e03-90c6-7f75431bac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:31.868358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ddb4e-062b-4227-bbe9-d1ce56f46737 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.876517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.877312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.877613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.877855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.877968 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 965/1933] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:31.878849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c6e6b-7cbb-4e03-90c6-7f75431bac89 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:31.975510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c6e6b-7cbb-4e03-90c6-7f75431bac89 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:31.979584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.980537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:31.981786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.981965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:31.982990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:31.983342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:31.984062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:31.986533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:31.997299 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 969/1934] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:31.999067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.000244 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 966/1935] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:32.001341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.010085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e856e-dcd4-4b4b-b6b6-4d89fbb41508 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.013721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ebc41-c766-467d-ad58-ff4bd5dfdaa7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.016858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.017553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.017838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.018323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.019383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.020277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.023927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.023927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.024185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.024261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.024261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.024261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.033445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 970/1936] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:32.034183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.036289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.124745 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 967/1937] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:32 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:32.125652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.139144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb1c83-cd9a-446b-836d-eee75b037711 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.142443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890da8-e5f1-432c-9935-634043852b02 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.151247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.151932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.152210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.152485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] PATH_INFO: `/v3/projects/cb3dfb94faab4c4eab8d74725c976780/users/9ab6e1b0016a4959958deda4467ef3e5/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.153935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.154577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.154855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.155169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.157161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3dfb94faab4c4eab8d74725c976780, user_id=9ab6e1b0016a4959958deda4467ef3e5, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.159841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.163202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.197347 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 968/1938] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:32 2022] PUT /identity/v3/projects/cb3dfb94faab4c4eab8d74725c976780/users/9ab6e1b0016a4959958deda4467ef3e5/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:32.197347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.239584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.241170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.251235 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 971/1939] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:32.259007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.267031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54f8f9-ef83-4153-b145-cf7cb3e298b1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.269369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8324-f835-4129-9862-27987222c1ab service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.272894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78a1c-e652-4000-8526-ccd047ae62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.273750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78a1c-e652-4000-8526-ccd047ae62b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.274076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78a1c-e652-4000-8526-ccd047ae62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.274348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78a1c-e652-4000-8526-ccd047ae62b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.275038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78a1c-e652-4000-8526-ccd047ae62b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.275152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.275806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.276143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.276480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.276663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78a1c-e652-4000-8526-ccd047ae62b7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.277273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.279216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.289877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 969/1940] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:32.291493 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 972/1941] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:32.292685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.295203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.297699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670510a-edb1-4898-9a38-69093a7380cd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.298002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670510a-edb1-4898-9a38-69093a7380cd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.298291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670510a-edb1-4898-9a38-69093a7380cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.314272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba24e3-d450-4005-80ee-621f4c9f5fc0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.321550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.322247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.322580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.322866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] PATH_INFO: `/v3/projects/efa16b9c333c42ff8860639c213453c6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.324589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa16b9c333c42ff8860639c213453c6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.327082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.351744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9670510a-edb1-4898-9a38-69093a7380cd None None] MFA Rules not processed for user `9ab6e1b0016a4959958deda4467ef3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:32.353037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9670510a-edb1-4898-9a38-69093a7380cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.424139 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 970/1942] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:32.425010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670510a-edb1-4898-9a38-69093a7380cd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.443549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670510a-edb1-4898-9a38-69093a7380cd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.449646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.450488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.451514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.451912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] PATH_INFO: `/v3/projects/0cc43f11a4a8477e990875a151eb2a79/users/652d767610944be79d80fb16e13b6fe2/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.475411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa16b9c333c42ff8860639c213453c6', 'request_id': 'req-85499194-beaa-4af9-966b-0b0cb32c5f7a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.478686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc43f11a4a8477e990875a151eb2a79, user_id=652d767610944be79d80fb16e13b6fe2, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.482335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.490888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa16b9c333c42ff8860639c213453c6', 'request_id': 'req-85499194-beaa-4af9-966b-0b0cb32c5f7a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.565189 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 971/1943] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:32 2022] PUT /identity/v3/projects/0cc43f11a4a8477e990875a151eb2a79/users/652d767610944be79d80fb16e13b6fe2/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:32.566126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.580644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa16b9c333c42ff8860639c213453c6', 'request_id': 'req-85499194-beaa-4af9-966b-0b0cb32c5f7a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.598949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] The token cache is being invalidate because project efa16b9c333c42ff8860639c213453c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:32.599266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.599959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85499194-beaa-4af9-966b-0b0cb32c5f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.601758 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 973/1944] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:32 2022] DELETE /identity/v3/projects/efa16b9c333c42ff8860639c213453c6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:32.606559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.606559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.606559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.626463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] MFA Rules not processed for user `76739eabf8804ec2af41abc4c1e6fd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:32.627977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.649753 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:32.662539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf0e1c-4a2b-405e-912d-6a73b7d07fcf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.667990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356c2c7-df23-4311-b2c9-9eb28adfa6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.668972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c2c7-df23-4311-b2c9-9eb28adfa6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.670108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c2c7-df23-4311-b2c9-9eb28adfa6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.670614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356c2c7-df23-4311-b2c9-9eb28adfa6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.671473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356c2c7-df23-4311-b2c9-9eb28adfa6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.673686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356c2c7-df23-4311-b2c9-9eb28adfa6e5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.686968 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 972/1945] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:32.688453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.688792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.689062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.701275 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 974/1946] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:32.702751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.704500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.719334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e73764-6721-40de-9bb3-b4c85c4af213 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.723992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] MFA Rules not processed for user `652d767610944be79d80fb16e13b6fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:32.725426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.726470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.727852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.728209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.728554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] PATH_INFO: `/v3/users/ca315992f7ac45fbbb646bd343d6b877` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.730048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca315992f7ac45fbbb646bd343d6b877)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.731768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.799055 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 973/1947] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:32.800002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.801614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:32.815128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a5f01-f010-44d8-8961-298e06461765 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:32.821100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:32.822034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:32.822146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:32.822388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] PATH_INFO: `/v3/projects/37875974503449409bf580c2c46365eb/users/269ef25716954fa2b7b80cfcda99cb6e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:32.838764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37875974503449409bf580c2c46365eb, user_id=269ef25716954fa2b7b80cfcda99cb6e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:32.845727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:32.953360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca315992f7ac45fbbb646bd343d6b877'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.960648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca315992f7ac45fbbb646bd343d6b877'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.961327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca315992f7ac45fbbb646bd343d6b877'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:32.973624 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 974/1948] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:32 2022] PUT /identity/v3/projects/37875974503449409bf580c2c46365eb/users/269ef25716954fa2b7b80cfcda99cb6e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:32.974402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:32.976296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:33.039636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014e3a2-2e1f-4cd6-8998-22c85db029a5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.044582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec937f-fcd6-45e8-bd3f-e63a7af703f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.045180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec937f-fcd6-45e8-bd3f-e63a7af703f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.045453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec937f-fcd6-45e8-bd3f-e63a7af703f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.045720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec937f-fcd6-45e8-bd3f-e63a7af703f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.046380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec937f-fcd6-45e8-bd3f-e63a7af703f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.048253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec937f-fcd6-45e8-bd3f-e63a7af703f3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.052656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca315992f7ac45fbbb646bd343d6b877'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:33.053317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca315992f7ac45fbbb646bd343d6b877'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:33.072715 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 975/1949] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:32 2022] DELETE /identity/v3/users/ca315992f7ac45fbbb646bd343d6b877 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:33.073781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.075319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:33.147384 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 975/1950] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:32 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:33.148828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.149110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.149645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.165652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6c674-d6bb-48b5-a7bc-b016becdcc11 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.184538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] MFA Rules not processed for user `269ef25716954fa2b7b80cfcda99cb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:33.185885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:33.238590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.240113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.240390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.240654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.243174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:33.296710 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 976/1951] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:33.296710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.299386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:33.346609 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:33.357941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.360514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.371594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 976/1952] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:33.373142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.374410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:33.444823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5674b-3ef4-42c4-80a8-dcfd0767211a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.452809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8112ce-75b0-45c4-99ac-896361c14341 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.453264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.459338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.459338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.459338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.459338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.459338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.459700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.459700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.459700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.459700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.460055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.461219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.597955 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 977/1953] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:33 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:33.597955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.599077 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 977/1954] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:33 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:33.599665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.601755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:33.628315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c44f-7b44-4fe5-9261-bec4d7974396 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.689515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861763b-b556-4ee0-9e5c-6840343481b7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.696066 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:33.696929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.699575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.699575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.699575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.699575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.701889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.705915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.706687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.707031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.707746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] PATH_INFO: `/v3/projects/8521ce0aa50c4ddd89b9aeaffbbfda60` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.708689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8521ce0aa50c4ddd89b9aeaffbbfda60)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.710808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.715791 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 978/1955] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:33.716727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.726839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958801d8-4ec7-4a0c-a94f-3b860a2f9a38 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.733077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.733681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.733960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.734261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.734963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.736860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.828145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8521ce0aa50c4ddd89b9aeaffbbfda60', 'request_id': 'req-8e32a53f-4e11-4662-bc33-e09099ef5594'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:33.833844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8521ce0aa50c4ddd89b9aeaffbbfda60', 'request_id': 'req-8e32a53f-4e11-4662-bc33-e09099ef5594'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:33.871401 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 979/1956] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:33 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:33.871401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.882826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cea1-8347-4506-b7d0-08b5cf82fbc3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:33.943781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8521ce0aa50c4ddd89b9aeaffbbfda60', 'request_id': 'req-8e32a53f-4e11-4662-bc33-e09099ef5594'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:33.954538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:33.955298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:33.955639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:33.956099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] PATH_INFO: `/v3/projects/d8cb261092214e0d8620ee09da1ed06e/users/26e2c6e42f214fed8f81ece5231ebca0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:33.968314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] The token cache is being invalidate because project 8521ce0aa50c4ddd89b9aeaffbbfda60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:33.968604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:33.969814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:33.972665 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 978/1957] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:33 2022] DELETE /identity/v3/projects/8521ce0aa50c4ddd89b9aeaffbbfda60 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:33.976232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cb261092214e0d8620ee09da1ed06e, user_id=26e2c6e42f214fed8f81ece5231ebca0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:33.976379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:33.976803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:33.977382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.055931 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 980/1958] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:33 2022] PUT /identity/v3/projects/d8cb261092214e0d8620ee09da1ed06e/users/26e2c6e42f214fed8f81ece5231ebca0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:34.055931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.055931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.071166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a53f-4e11-4662-bc33-e09099ef5594 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.129014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dda65-dc9b-4028-8ed5-f7a07ea6370f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.134275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.134897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.135176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.135447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.136093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.137737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.148661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 981/1959] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:34.150135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.151143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4d94-cc33-4a8d-8d78-43407f6851a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.152226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4d94-cc33-4a8d-8d78-43407f6851a5 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.153491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.154171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4d94-cc33-4a8d-8d78-43407f6851a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.154429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4d94-cc33-4a8d-8d78-43407f6851a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.156475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-17cd4d94-cc33-4a8d-8d78-43407f6851a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.171375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad784-3306-48aa-bf7d-5c2658daa81d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.178567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.179239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.179519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.179793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.181589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.222847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4d94-cc33-4a8d-8d78-43407f6851a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.225073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4d94-cc33-4a8d-8d78-43407f6851a5 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.235906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 979/1960] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:34.237248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50630-aee5-47fb-9a2c-162ca372b2db None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.237581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50630-aee5-47fb-9a2c-162ca372b2db None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.237854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50630-aee5-47fb-9a2c-162ca372b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.246940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.249266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.257003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5dc50630-aee5-47fb-9a2c-162ca372b2db None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:34.258302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5dc50630-aee5-47fb-9a2c-162ca372b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.261428 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 982/1961] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:34.263441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.265219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.267944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 980/1962] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:34.268984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc50630-aee5-47fb-9a2c-162ca372b2db None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.278482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc50630-aee5-47fb-9a2c-162ca372b2db None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.284641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfd21d-e75c-4453-9d8f-691d5c23126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.285673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd21d-e75c-4453-9d8f-691d5c23126d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.286316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd21d-e75c-4453-9d8f-691d5c23126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.286859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfd21d-e75c-4453-9d8f-691d5c23126d admin admin] PATH_INFO: `/v3/projects/35e58672e40e46ee820ed3aff1ab9650/users/6ffe41f702774aa8967a4788938f2d6a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.293784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108637f-9a4a-4f39-8a12-7baf40300b27 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.302903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599109-f558-42fc-8708-191b53324fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.306053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599109-f558-42fc-8708-191b53324fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.306053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599109-f558-42fc-8708-191b53324fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.306053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599109-f558-42fc-8708-191b53324fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.306053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599109-f558-42fc-8708-191b53324fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.307273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599109-f558-42fc-8708-191b53324fc3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.307414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfd21d-e75c-4453-9d8f-691d5c23126d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e58672e40e46ee820ed3aff1ab9650, user_id=6ffe41f702774aa8967a4788938f2d6a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.310773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfd21d-e75c-4453-9d8f-691d5c23126d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.318908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 983/1963] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:34.320241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e79ea-7369-4b66-8dd2-ae20da40773c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.320524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e79ea-7369-4b66-8dd2-ae20da40773c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.321526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e79ea-7369-4b66-8dd2-ae20da40773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.341828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b60e79ea-7369-4b66-8dd2-ae20da40773c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:34.343160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b60e79ea-7369-4b66-8dd2-ae20da40773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.351258 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 984/1964] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:34.352086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e79ea-7369-4b66-8dd2-ae20da40773c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.362519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e79ea-7369-4b66-8dd2-ae20da40773c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.367290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.368047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.368326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.368601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] PATH_INFO: `/v3/projects/d8cb261092214e0d8620ee09da1ed06e/users/26e2c6e42f214fed8f81ece5231ebca0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.370594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cb261092214e0d8620ee09da1ed06e, user_id=26e2c6e42f214fed8f81ece5231ebca0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.373354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.384176 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 985/1965] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:34 2022] PUT /identity/v3/projects/d8cb261092214e0d8620ee09da1ed06e/users/26e2c6e42f214fed8f81ece5231ebca0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:34.385052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.452444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454917e-a4ad-49b7-8acd-9ab4da366fb8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.457511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.463355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.463355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.463355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.463355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:34.463355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.463355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.469741 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 981/1966] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:34 2022] PUT /identity/v3/projects/35e58672e40e46ee820ed3aff1ab9650/users/6ffe41f702774aa8967a4788938f2d6a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:34.469741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec573-efd4-4591-a60f-fac41c7d61b0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.469741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec573-efd4-4591-a60f-fac41c7d61b0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.469741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec573-efd4-4591-a60f-fac41c7d61b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.500662 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 986/1967] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:34.500662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.501685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79f2ca-7781-4362-b81a-193d044a4648 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.519823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-677ec573-efd4-4591-a60f-fac41c7d61b0 None None] MFA Rules not processed for user `26e2c6e42f214fed8f81ece5231ebca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:34.519823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-677ec573-efd4-4591-a60f-fac41c7d61b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.568976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.569637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.569807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.570110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.570848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.573385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.590695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 987/1968] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:34.592460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.604064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4712-c896-4ddd-903e-0aad9412570f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.610964 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 982/1969] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:34.612006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.612574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ec573-efd4-4591-a60f-fac41c7d61b0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.613047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.613514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.613858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.614610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.617272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.625079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ec573-efd4-4591-a60f-fac41c7d61b0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.630972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d458-c7df-48c8-8fcb-0d70ff85727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.631802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d458-c7df-48c8-8fcb-0d70ff85727e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.632288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d458-c7df-48c8-8fcb-0d70ff85727e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.632723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d458-c7df-48c8-8fcb-0d70ff85727e admin admin] PATH_INFO: `/v3/projects/35e58672e40e46ee820ed3aff1ab9650/users/6ffe41f702774aa8967a4788938f2d6a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.634773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d458-c7df-48c8-8fcb-0d70ff85727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e58672e40e46ee820ed3aff1ab9650, user_id=6ffe41f702774aa8967a4788938f2d6a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.637464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d458-c7df-48c8-8fcb-0d70ff85727e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.649285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 983/1970] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:34 2022] PUT /identity/v3/projects/35e58672e40e46ee820ed3aff1ab9650/users/6ffe41f702774aa8967a4788938f2d6a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:34.659998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676c3f-d0a0-4d30-ae52-a49740cecdb7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.661218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676c3f-d0a0-4d30-ae52-a49740cecdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.661218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676c3f-d0a0-4d30-ae52-a49740cecdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.688175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-99676c3f-d0a0-4d30-ae52-a49740cecdb7 None None] MFA Rules not processed for user `6ffe41f702774aa8967a4788938f2d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:34.689374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-99676c3f-d0a0-4d30-ae52-a49740cecdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:34.764403 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 988/1971] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:34 2022] POST /identity/v3/projects => generated 393 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:34.769196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:34.769678 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 984/1972] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:34.843896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586babaa-2471-47cf-92f9-5cd5773e9e96 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:34.850873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:34.861538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:34.861538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:34.861538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:34.861538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:34.861538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:34.943247 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 989/1973] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:34 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:34.947684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99676c3f-d0a0-4d30-ae52-a49740cecdb7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.012231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99676c3f-d0a0-4d30-ae52-a49740cecdb7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.017549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.018326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.018818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.019081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.019793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.021485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.034969 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 985/1974] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:35.036157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.046723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb2cd-13f2-49ac-9376-359f8f6e6163 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.051411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dee78-7cf4-4555-8530-f09184bb1b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.052038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dee78-7cf4-4555-8530-f09184bb1b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.052315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dee78-7cf4-4555-8530-f09184bb1b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.052580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dee78-7cf4-4555-8530-f09184bb1b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.053421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dee78-7cf4-4555-8530-f09184bb1b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.055142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dee78-7cf4-4555-8530-f09184bb1b84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.055295 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:35.070306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 990/1975] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:35.071437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.082379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a543f2-0c6d-4c24-bc4f-8aefc52213ae admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.087268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.090517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.090517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.090517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] PATH_INFO: `/v3/projects/936723f56dc549bd9b8e73c97297edf1/users/7b22ae04637942879cfd29edc41a5483/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.104648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936723f56dc549bd9b8e73c97297edf1, user_id=7b22ae04637942879cfd29edc41a5483, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.107382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.215228 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 986/1976] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:35 2022] PUT /identity/v3/projects/936723f56dc549bd9b8e73c97297edf1/users/7b22ae04637942879cfd29edc41a5483/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:35.226178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bc413-1359-4e84-82cc-505af0c47cea None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.226465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bc413-1359-4e84-82cc-505af0c47cea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.226736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bc413-1359-4e84-82cc-505af0c47cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.265846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-740bc413-1359-4e84-82cc-505af0c47cea None None] MFA Rules not processed for user `7b22ae04637942879cfd29edc41a5483`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:35.267289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-740bc413-1359-4e84-82cc-505af0c47cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:35.278700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.340470 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 991/1977] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:35.345151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bc413-1359-4e84-82cc-505af0c47cea None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.353172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0607ba4-b099-44ea-ade6-02163dd00a71 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.366516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.367373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.367658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.367936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.409898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bc413-1359-4e84-82cc-505af0c47cea None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.414545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.415154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.415430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.415700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.416327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.418529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.436137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.437733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.447591 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 987/1978] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:35.448911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.458940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb94d0-7015-4df6-813a-680978ec0283 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.464563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.465160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.465431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.465699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.467460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:35.550478 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 992/1979] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:35 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:35.551394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.557830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.559454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.578731 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 988/1980] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:35.590015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.602456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182963f-fc6a-4749-8221-14b52c1ebaf2 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.632742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b62bb-5564-4456-b23a-d5d5004d0daf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.638614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.639224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.639502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.639818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.647549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.647549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.674948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.678376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.678376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.678376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] PATH_INFO: `/v3/users/269ef25716954fa2b7b80cfcda99cb6e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.678376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] RBAC: Authorizing `identity:delete_user(user_id=269ef25716954fa2b7b80cfcda99cb6e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.679505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.739398 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 993/1981] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:35 2022] POST /identity/v3/users => generated 303 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:35.739398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:35.750360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d23b5-d840-42a5-bafb-ef1aa0d44c7b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:35.756813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:35.757699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:35.757990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:35.758327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] PATH_INFO: `/v3/users/652d767610944be79d80fb16e13b6fe2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:35.759792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652d767610944be79d80fb16e13b6fe2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:35.761829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:35.781655 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:35.898117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269ef25716954fa2b7b80cfcda99cb6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:35.905920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269ef25716954fa2b7b80cfcda99cb6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:35.906690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269ef25716954fa2b7b80cfcda99cb6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:35.972970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652d767610944be79d80fb16e13b6fe2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:35.988551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652d767610944be79d80fb16e13b6fe2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:35.989341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652d767610944be79d80fb16e13b6fe2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:36.006582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269ef25716954fa2b7b80cfcda99cb6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:36.007336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269ef25716954fa2b7b80cfcda99cb6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:36.026899 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 989/1982] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:35 2022] DELETE /identity/v3/users/269ef25716954fa2b7b80cfcda99cb6e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:36.034408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:36.037409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.087127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652d767610944be79d80fb16e13b6fe2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:36.087760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05c1b2ca-41e3-4f80-9a21-cb5fefd829c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652d767610944be79d80fb16e13b6fe2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:36.113394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39582c-e1d4-4a86-a525-79abf2f1887e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:36.118133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bc0d6-24c9-4cbb-96ec-11aecd71ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:36.118751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc0d6-24c9-4cbb-96ec-11aecd71ff38 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.119035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc0d6-24c9-4cbb-96ec-11aecd71ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.119302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc0d6-24c9-4cbb-96ec-11aecd71ff38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.119966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bc0d6-24c9-4cbb-96ec-11aecd71ff38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:36.121587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bc0d6-24c9-4cbb-96ec-11aecd71ff38 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:36.129622 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 994/1983] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:35 2022] DELETE /identity/v3/users/652d767610944be79d80fb16e13b6fe2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:36.133732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.138495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.138495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.144830 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 990/1984] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:36.147450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.148395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.150189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.160174 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:36.167014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:36.169273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.173773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:36.175134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.249678 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 995/1985] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:36.251776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:36.256434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.267784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 991/1986] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:36.269015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:36.276566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.285067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aef615-ef43-4fa6-87cf-9c42b9f68bf7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:36.302190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:36.302880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.303160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.303432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] PATH_INFO: `/v3/projects/4c55f111971443bf81b406b2b3293dde/users/db217c0607e74fec95a6155a6cdeb5e9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.337859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c55f111971443bf81b406b2b3293dde, user_id=db217c0607e74fec95a6155a6cdeb5e9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:36.341399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:36.370719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e742cfb-eddf-4424-b81a-662284e6e8ca None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:36.391554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:36.392209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.392488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.392964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.405157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:36.406845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:36.425731 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 992/1987] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:36.426893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:36.436422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e24a8-9f50-4fdc-b973-bf11047edb9e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:36.440417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:36.440924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.441252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.441524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.452108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:36.453577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:36.466675 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 993/1988] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:36.490383 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 996/1989] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:36 2022] PUT /identity/v3/projects/4c55f111971443bf81b406b2b3293dde/users/db217c0607e74fec95a6155a6cdeb5e9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:36.494309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:36.514115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5b62-6499-4efd-a8fb-49b2f51f1a02 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:36.560967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:36.562496 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:36.562931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.585251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:36.586008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.586219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.586772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.587807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:36.589255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:36.612383 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 994/1990] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:36.616790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:36.630549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d7dc-effc-4cb2-b116-ab9e38267338 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:36.636197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f59f4-8d12-4e74-b2ff-78b07fcf6943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:36.637317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f59f4-8d12-4e74-b2ff-78b07fcf6943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.637701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f59f4-8d12-4e74-b2ff-78b07fcf6943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.638903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f59f4-8d12-4e74-b2ff-78b07fcf6943 admin admin] PATH_INFO: `/v3/projects/4c55f111971443bf81b406b2b3293dde/users/db217c0607e74fec95a6155a6cdeb5e9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.641088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f59f4-8d12-4e74-b2ff-78b07fcf6943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c55f111971443bf81b406b2b3293dde, user_id=db217c0607e74fec95a6155a6cdeb5e9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:36.644161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f59f4-8d12-4e74-b2ff-78b07fcf6943 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:36.658859 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 995/1991] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:36 2022] PUT /identity/v3/projects/4c55f111971443bf81b406b2b3293dde/users/db217c0607e74fec95a6155a6cdeb5e9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:36.668959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d195e10-6399-4c76-96f6-7d455e8b0784 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.670015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d195e10-6399-4c76-96f6-7d455e8b0784 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.670374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d195e10-6399-4c76-96f6-7d455e8b0784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.678306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb50cd-d9f6-4804-b2a2-2e5adaca6783 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:36.713821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5d195e10-6399-4c76-96f6-7d455e8b0784 None None] MFA Rules not processed for user `db217c0607e74fec95a6155a6cdeb5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:36.716296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d195e10-6399-4c76-96f6-7d455e8b0784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.775921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:36.778432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.781700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.781700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.782665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.811683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:36.816529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:36.830558 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 996/1992] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:36.837748 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 997/1993] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:36.843857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:36.844146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:36.844623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:36.865908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] MFA Rules not processed for user `7b22ae04637942879cfd29edc41a5483`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:36.867224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:36.985441 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 997/1994] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:37.054513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:37.056052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:37.159126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1b37-9efe-429c-9950-9278054ecda2 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:37.165410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:37.166282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:37.166752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:37.169866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] PATH_INFO: `/v3/projects/37875974503449409bf580c2c46365eb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:37.169866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37875974503449409bf580c2c46365eb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:37.170088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:37.171308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:37.171682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:37.195332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876652d-5951-49c9-882b-6394723cbdb4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:37.204902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:37.205615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:37.205958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:37.206226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] PATH_INFO: `/v3/projects/0cc43f11a4a8477e990875a151eb2a79` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:37.207399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc43f11a4a8477e990875a151eb2a79)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:37.209478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:37.336398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37875974503449409bf580c2c46365eb', 'request_id': 'req-f4794e92-a88d-47aa-98a7-3955adca0f2d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.351513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37875974503449409bf580c2c46365eb', 'request_id': 'req-f4794e92-a88d-47aa-98a7-3955adca0f2d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.352386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc43f11a4a8477e990875a151eb2a79', 'request_id': 'req-64e6d988-a29f-4592-9fb2-e502543e17ef'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.359703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc43f11a4a8477e990875a151eb2a79', 'request_id': 'req-64e6d988-a29f-4592-9fb2-e502543e17ef'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.470340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37875974503449409bf580c2c46365eb', 'request_id': 'req-f4794e92-a88d-47aa-98a7-3955adca0f2d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.482304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] The token cache is being invalidate because project 37875974503449409bf580c2c46365eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:37.482810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.484218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.486159 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 998/1995] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:37 2022] DELETE /identity/v3/projects/37875974503449409bf580c2c46365eb => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:37.489842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:37.491746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:37.560589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4794e92-a88d-47aa-98a7-3955adca0f2d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:37.574480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc43f11a4a8477e990875a151eb2a79', 'request_id': 'req-64e6d988-a29f-4592-9fb2-e502543e17ef'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.587284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] The token cache is being invalidate because project 0cc43f11a4a8477e990875a151eb2a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:37.587606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.588678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.590611 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 998/1996] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:37 2022] DELETE /identity/v3/projects/0cc43f11a4a8477e990875a151eb2a79 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:37.595115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:37.596744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:37.628593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:37.629214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:37.629479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:37.629778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] PATH_INFO: `/v3/users/6ffe41f702774aa8967a4788938f2d6a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:37.631114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffe41f702774aa8967a4788938f2d6a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:37.633030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:37.708993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d988-a29f-4592-9fb2-e502543e17ef admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:37.711378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:37.711886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:37.712231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:37.712479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] PATH_INFO: `/v3/users/26e2c6e42f214fed8f81ece5231ebca0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:37.714203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e2c6e42f214fed8f81ece5231ebca0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:37.716159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:37.817532 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:37.819165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffe41f702774aa8967a4788938f2d6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.826755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffe41f702774aa8967a4788938f2d6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.827480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffe41f702774aa8967a4788938f2d6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.902243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffe41f702774aa8967a4788938f2d6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.903086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb19b46b-976d-469e-aa1f-846de72c00b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffe41f702774aa8967a4788938f2d6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.924517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e2c6e42f214fed8f81ece5231ebca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.926216 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:37.938351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 999/1997] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:37 2022] DELETE /identity/v3/users/6ffe41f702774aa8967a4788938f2d6a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:37.938551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e2c6e42f214fed8f81ece5231ebca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:37.939309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e2c6e42f214fed8f81ece5231ebca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.018084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e2c6e42f214fed8f81ece5231ebca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.019064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9009bdc1-43d8-41fe-84f8-68410d78ffdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e2c6e42f214fed8f81ece5231ebca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.043246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 999/1998] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:37 2022] DELETE /identity/v3/users/26e2c6e42f214fed8f81ece5231ebca0 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:38.245554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad01f-b3a5-4de2-a582-0249b6641ca4 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:38.245945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad01f-b3a5-4de2-a582-0249b6641ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:38.246258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad01f-b3a5-4de2-a582-0249b6641ca4 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:38.248775 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1000/1999] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:11:38.255513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:38.256349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:38.256625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:38.274074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ad01f-b3a5-4de2-a582-0249b6641ca4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:38.275808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-763ad01f-b3a5-4de2-a582-0249b6641ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:38.285002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:38.285002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:38.398323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ad01f-b3a5-4de2-a582-0249b6641ca4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:38.409732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:38.411329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:38.411329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:38.411329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:38.413584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:38.415298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1000/2000] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:38.431725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:38.434519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:38.507594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:38.509380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:38.512157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90c28c-bcba-4b51-b00b-46feeccf6ff2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:38.515834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:38.516440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:38.516713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:38.517012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:38.519131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1001/2001] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:38.529815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:38.531487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:38.546797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:38.548955 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1001/2002] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:38.555811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:38.568055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:38.570347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:38.676111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ba14-42cc-42f5-9fed-1d43efa423a6 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:38.686364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:38.687343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:38.687817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:38.688187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] PATH_INFO: `/v3/projects/35e58672e40e46ee820ed3aff1ab9650` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:38.689673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e58672e40e46ee820ed3aff1ab9650)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:38.692116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:38.703053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df2b6-1f73-492a-ae4a-72ffe26b505a service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:38.707792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:38.708565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:38.709182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:38.709464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] PATH_INFO: `/v3/projects/d8cb261092214e0d8620ee09da1ed06e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:38.711115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cb261092214e0d8620ee09da1ed06e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:38.713108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:38.829096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e58672e40e46ee820ed3aff1ab9650', 'request_id': 'req-bd0ea46c-1008-425d-ad57-6eddb02601b7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.835393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e58672e40e46ee820ed3aff1ab9650', 'request_id': 'req-bd0ea46c-1008-425d-ad57-6eddb02601b7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.867170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cb261092214e0d8620ee09da1ed06e', 'request_id': 'req-b532aa06-587d-4a32-94eb-aed84cbbc80b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.868886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cb261092214e0d8620ee09da1ed06e', 'request_id': 'req-b532aa06-587d-4a32-94eb-aed84cbbc80b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.901087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e58672e40e46ee820ed3aff1ab9650', 'request_id': 'req-bd0ea46c-1008-425d-ad57-6eddb02601b7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.918896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] The token cache is being invalidate because project 35e58672e40e46ee820ed3aff1ab9650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:38.919665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.920329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd0ea46c-1008-425d-ad57-6eddb02601b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.926949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1002/2003] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:38 2022] DELETE /identity/v3/projects/35e58672e40e46ee820ed3aff1ab9650 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:38.926949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a6736-133d-4353-abfe-1417f59fd89c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:38.926949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a6736-133d-4353-abfe-1417f59fd89c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:38.926949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a6736-133d-4353-abfe-1417f59fd89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:38.948242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a21a6736-133d-4353-abfe-1417f59fd89c None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:38.950813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a21a6736-133d-4353-abfe-1417f59fd89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:38.980284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cb261092214e0d8620ee09da1ed06e', 'request_id': 'req-b532aa06-587d-4a32-94eb-aed84cbbc80b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.997291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] The token cache is being invalidate because project d8cb261092214e0d8620ee09da1ed06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:38.997626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:38.998563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b532aa06-587d-4a32-94eb-aed84cbbc80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:39.003946 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1002/2004] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:38 2022] DELETE /identity/v3/projects/d8cb261092214e0d8620ee09da1ed06e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:39.003946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.003946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.003946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.020663 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1003/2005] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:39.022229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa132-f000-4a92-baa6-79f97885c6ef None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.022699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa132-f000-4a92-baa6-79f97885c6ef None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.023172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa132-f000-4a92-baa6-79f97885c6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.032116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:39.034566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:39.050104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4e0aa132-f000-4a92-baa6-79f97885c6ef None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:39.052613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4e0aa132-f000-4a92-baa6-79f97885c6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:39.110123 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1003/2006] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:39.111183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.112716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:39.118058 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:39.147005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034d6c6-4571-4021-90c0-9b137fbd608e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.150915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd48783-f792-4ce1-8006-ba60a862b4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.151617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48783-f792-4ce1-8006-ba60a862b4ff service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.151799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48783-f792-4ce1-8006-ba60a862b4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.152057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48783-f792-4ce1-8006-ba60a862b4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.161511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd48783-f792-4ce1-8006-ba60a862b4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.162976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd48783-f792-4ce1-8006-ba60a862b4ff service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.170480 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1004/2007] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:39.170480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb027-2d0a-4a88-89a2-7d2677e65670 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.170480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb027-2d0a-4a88-89a2-7d2677e65670 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.170480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb027-2d0a-4a88-89a2-7d2677e65670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.172268 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1004/2008] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:39.173781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae96f-168d-43c4-b385-d35e5724de54 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.173781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae96f-168d-43c4-b385-d35e5724de54 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.174086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae96f-168d-43c4-b385-d35e5724de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.191641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-888fb027-2d0a-4a88-89a2-7d2677e65670 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:39.195862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-888fb027-2d0a-4a88-89a2-7d2677e65670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:39.196088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6cbae96f-168d-43c4-b385-d35e5724de54 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:39.197205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6cbae96f-168d-43c4-b385-d35e5724de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:39.205886 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1005/2009] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:39.207513 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1005/2010] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:39.210269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fb027-2d0a-4a88-89a2-7d2677e65670 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.211784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbae96f-168d-43c4-b385-d35e5724de54 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.220810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fb027-2d0a-4a88-89a2-7d2677e65670 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.224153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbae96f-168d-43c4-b385-d35e5724de54 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.225944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.226585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.227073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.227183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.227748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:39.228045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.229879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.232419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.233421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.233869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.234258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.235157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:39.235568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.238219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.246055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1006/2011] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:39.252793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.255260 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1006/2012] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:11:39.261452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.263661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde161dd-b2cc-49b7-937c-257e10970d23 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.269360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.270012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.270325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.270613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.271257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.273337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.276654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2d358-7eda-4807-ae39-cc0e80cd0a4a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.284680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.285494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.286001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.286273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.293749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.293749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.408461 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1007/2013] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/projects => generated 403 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:39.408654 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1007/2014] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:39.409513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.413967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.509593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a689-b4e9-4d69-81f0-549de4b5232e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.518777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27bab-90d8-45ea-ad0f-5c9df542a2c4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.521149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.521793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.522099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.524726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.524726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.526296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.526450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.527238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.538348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.538531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.541474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.544822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.572333 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:39.644193 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1008/2015] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:39.646009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.652883 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1008/2016] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/users => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:39.657633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.669453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba687d-3887-4fce-ba51-269eea4d3f13 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.674944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82c31-9c72-486d-9c00-cccc2333b7a0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.681130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.681449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.682320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.682962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.683389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.686853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.686853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.687049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.687049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.687049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.687744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.688285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.699393 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1009/2017] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:39.707123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.717755 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1009/2018] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:39.719283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.726535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c85a30-6a7f-437f-9f50-c55441718cfd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.740132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.741278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.741728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.742637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.743411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e95b06-21e1-44bd-aeb8-f9bcdb22b3ca admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.743642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.745850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.753869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.760408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.762029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.763106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.763836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.766225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.783123 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1010/2019] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:39.784585 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:39.788215 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1010/2020] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:39.793745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.794759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:39.800580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89001005-e4d6-45c7-aaac-c3e8dcfc937d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.802148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb7ae6-5fbe-442d-8b33-c8b15ac5b99a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:39.807107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3add70-871f-4ac2-b7bf-c67aa46324f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.808340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3add70-871f-4ac2-b7bf-c67aa46324f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.808615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3add70-871f-4ac2-b7bf-c67aa46324f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.808886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3add70-871f-4ac2-b7bf-c67aa46324f0 admin admin] PATH_INFO: `/v3/projects/d1e334890b744215a418d581f3dea796/users/f265dfe79906425b8faa787dcf4bb154/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.810043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1861311-1a37-4ce3-990e-568b6cb567fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:39.810894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1861311-1a37-4ce3-990e-568b6cb567fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.811264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1861311-1a37-4ce3-990e-568b6cb567fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.812052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1861311-1a37-4ce3-990e-568b6cb567fe admin admin] PATH_INFO: `/v3/projects/f78b3e125cf549dbbce0f49864e9e91d/users/765c706a2ca846ebb377f808517f36a0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.834008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1861311-1a37-4ce3-990e-568b6cb567fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78b3e125cf549dbbce0f49864e9e91d, user_id=765c706a2ca846ebb377f808517f36a0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.836716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3add70-871f-4ac2-b7bf-c67aa46324f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e334890b744215a418d581f3dea796, user_id=f265dfe79906425b8faa787dcf4bb154, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:39.838658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1861311-1a37-4ce3-990e-568b6cb567fe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.840305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3add70-871f-4ac2-b7bf-c67aa46324f0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:39.948840 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1011/2021] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:39 2022] PUT /identity/v3/projects/f78b3e125cf549dbbce0f49864e9e91d/users/765c706a2ca846ebb377f808517f36a0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:39.956841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47ea7-e743-4bf7-8288-84e3f4d9a68f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.957268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47ea7-e743-4bf7-8288-84e3f4d9a68f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.957586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47ea7-e743-4bf7-8288-84e3f4d9a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.974689 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1011/2022] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:39 2022] PUT /identity/v3/projects/d1e334890b744215a418d581f3dea796/users/f265dfe79906425b8faa787dcf4bb154/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:39.989635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0917db-24d8-44c1-933f-ba8bdac23ae7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:39.990124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0917db-24d8-44c1-933f-ba8bdac23ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:39.990491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0917db-24d8-44c1-933f-ba8bdac23ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:39.996969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bbe47ea7-e743-4bf7-8288-84e3f4d9a68f None None] MFA Rules not processed for user `765c706a2ca846ebb377f808517f36a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:39.999906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bbe47ea7-e743-4bf7-8288-84e3f4d9a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:40.023018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ba0917db-24d8-44c1-933f-ba8bdac23ae7 None None] MFA Rules not processed for user `f265dfe79906425b8faa787dcf4bb154`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:40.024704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba0917db-24d8-44c1-933f-ba8bdac23ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:40.068095 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1012/2023] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:40.075561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe47ea7-e743-4bf7-8288-84e3f4d9a68f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.104161 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1012/2024] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:40.108960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0917db-24d8-44c1-933f-ba8bdac23ae7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.123031 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:40.151989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe47ea7-e743-4bf7-8288-84e3f4d9a68f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.157719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.158477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.158680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.163418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.163418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.163418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.205753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0917db-24d8-44c1-933f-ba8bdac23ae7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.210575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.214989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.214989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.214989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.214989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.214989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.284627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1013/2025] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:40 2022] POST /identity/v3/projects => generated 401 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:40.288282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.352625 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1013/2026] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:40 2022] POST /identity/v3/projects => generated 391 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:40.357650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.371818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b1b43-c7c7-4d0e-8f2e-618995be221f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.441845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd989b77-c0dd-43cf-81c9-375183a0d6db admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.447853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.448738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.448863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.449112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.449750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.452035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.452558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.453102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.472978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.472978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.474806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.477175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.599144 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1014/2027] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:40 2022] POST /identity/v3/users => generated 307 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:40.602902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1014/2028] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:40 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:40.603194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.604620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.616809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776d2f-f729-409e-a4e7-2d9c8f4f594d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.622770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.623607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.628944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.628944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.628944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.629421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19b74b-616a-4e98-a3b2-0c4ea37d835e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.629519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.644106 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1015/2029] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:40.646112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.657902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.658952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.659263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.659531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.660230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.661867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7db8f-8ec9-439b-96fd-436f349fad35 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.662035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.666790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.667821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.668198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.668563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] PATH_INFO: `/v3/projects/d2f2a869e13b4fd781ddd560f8825a35/users/78f922ba52134aafb488fd15a12522d2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.680614 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1015/2030] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:40.681782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.685082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f2a869e13b4fd781ddd560f8825a35, user_id=78f922ba52134aafb488fd15a12522d2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.689499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.693999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc4f33-5bd4-4a1f-aae7-89a74c785245 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.700524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.701160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.701435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.701787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] PATH_INFO: `/v3/projects/6cf59e209bde4f738931d4c94b67b314/users/fa4971f5a30847bfb2f3a6fca69f5b23/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.728410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf59e209bde4f738931d4c94b67b314, user_id=fa4971f5a30847bfb2f3a6fca69f5b23, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.731216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.803834 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1016/2031] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:40 2022] PUT /identity/v3/projects/d2f2a869e13b4fd781ddd560f8825a35/users/78f922ba52134aafb488fd15a12522d2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:40.808854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.860302 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1016/2032] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:40 2022] PUT /identity/v3/projects/6cf59e209bde4f738931d4c94b67b314/users/fa4971f5a30847bfb2f3a6fca69f5b23/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:40.864987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:40.912404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c91b-2534-4c60-9226-36fdf785e6d7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.983515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3cbd-9dfc-46e2-8260-bbb728e3d5f4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:40.988779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:40.989526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:40.989907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:40.990307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:40.991050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:40.992809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:40.999559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:41.000454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:41.000740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:41.001004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:41.001768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:41.003525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:41.006987 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1017/2033] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:41.011025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:41.021152 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1017/2034] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:41.023398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e7b2b-1a4c-48c9-82a6-0101003645b9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:41.027250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:41.029402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10b1b7-d7bc-4642-88e7-2dfa3fa1eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:41.030094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b1b7-d7bc-4642-88e7-2dfa3fa1eb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:41.030366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b1b7-d7bc-4642-88e7-2dfa3fa1eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:41.030637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b1b7-d7bc-4642-88e7-2dfa3fa1eb72 admin admin] PATH_INFO: `/v3/projects/6cf59e209bde4f738931d4c94b67b314/users/fa4971f5a30847bfb2f3a6fca69f5b23/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:41.032555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10b1b7-d7bc-4642-88e7-2dfa3fa1eb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf59e209bde4f738931d4c94b67b314, user_id=fa4971f5a30847bfb2f3a6fca69f5b23, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:41.035382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10b1b7-d7bc-4642-88e7-2dfa3fa1eb72 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:41.042684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bba29-6ea2-40b2-9f18-04e7464a5534 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:41.048443 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1018/2035] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:41 2022] PUT /identity/v3/projects/6cf59e209bde4f738931d4c94b67b314/users/fa4971f5a30847bfb2f3a6fca69f5b23/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:41.061947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:41.062247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:41.062522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:41.099642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] MFA Rules not processed for user `fa4971f5a30847bfb2f3a6fca69f5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:41.102049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:41.117301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9190d6-0cc9-461b-89d0-d2e136f40dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:41.118252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9190d6-0cc9-461b-89d0-d2e136f40dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:41.118460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9190d6-0cc9-461b-89d0-d2e136f40dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:41.118679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9190d6-0cc9-461b-89d0-d2e136f40dba admin admin] PATH_INFO: `/v3/projects/d2f2a869e13b4fd781ddd560f8825a35/users/78f922ba52134aafb488fd15a12522d2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:41.120652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9190d6-0cc9-461b-89d0-d2e136f40dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f2a869e13b4fd781ddd560f8825a35, user_id=78f922ba52134aafb488fd15a12522d2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:41.123849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9190d6-0cc9-461b-89d0-d2e136f40dba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:41.136122 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1018/2036] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:41 2022] PUT /identity/v3/projects/d2f2a869e13b4fd781ddd560f8825a35/users/78f922ba52134aafb488fd15a12522d2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:41.154566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c969d-c2bc-4177-9088-3787e9fc42f2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:41.155190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c969d-c2bc-4177-9088-3787e9fc42f2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:41.155503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c969d-c2bc-4177-9088-3787e9fc42f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:41.195273 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1019/2037] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:41.195477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-474c969d-c2bc-4177-9088-3787e9fc42f2 None None] MFA Rules not processed for user `78f922ba52134aafb488fd15a12522d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:41.195477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-474c969d-c2bc-4177-9088-3787e9fc42f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:41.273534 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1019/2038] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:41.427198 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:41.694782 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:42.076021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:42.078209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:42.157844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4494fc-1ed4-4217-b3c4-d5aa51b2ecc2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:42.226736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:42.227426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:42.227706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:42.227978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:42.291470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:42.293306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:42.303180 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1020/2039] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:42.427235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c969d-c2bc-4177-9088-3787e9fc42f2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:42.440626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c969d-c2bc-4177-9088-3787e9fc42f2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:42.446431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:42.447051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:42.447332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:42.447603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:42.456466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:42.458089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:42.468546 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1020/2040] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:42.834591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:42.847927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cfb25-2b8a-496c-962a-4f316bc230aa service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:42.853644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1902f-3ccb-46ba-82b6-22212d3b14a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:42.854454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1902f-3ccb-46ba-82b6-22212d3b14a7 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:42.854685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1902f-3ccb-46ba-82b6-22212d3b14a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:42.855017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1902f-3ccb-46ba-82b6-22212d3b14a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:42.913174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1902f-3ccb-46ba-82b6-22212d3b14a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:42.914949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1902f-3ccb-46ba-82b6-22212d3b14a7 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:42.926741 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1021/2041] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:43.035140 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:43.140364 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:43.379998 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:43.511794 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:43.635260 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:43.749529 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:43.909676 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:44.178867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:44.180277 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:44.251519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c7c1-45ad-4517-badc-870a5ce896bf service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:44.256291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:44.256929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:44.257209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:44.257484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] PATH_INFO: `/v3/users/f265dfe79906425b8faa787dcf4bb154` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:44.258628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f265dfe79906425b8faa787dcf4bb154)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:44.260591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:44.491106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f265dfe79906425b8faa787dcf4bb154'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:44.498902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f265dfe79906425b8faa787dcf4bb154'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:44.499648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f265dfe79906425b8faa787dcf4bb154'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:44.576493 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:44.578361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f265dfe79906425b8faa787dcf4bb154'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:44.583273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f265dfe79906425b8faa787dcf4bb154'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:44.622604 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1021/2042] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:44 2022] DELETE /identity/v3/users/f265dfe79906425b8faa787dcf4bb154 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:44.627125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:44.627409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:44.627687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:44.648877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:44.650160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:44.718326 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1022/2043] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:44.727869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:44.729894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:44.806853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60dad-a249-4893-bb0e-b5d10f922f32 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:44.810515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:44.811133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:44.811408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:44.811676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:44.821809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:44.826070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:44.834564 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1022/2044] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:44.983564 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:45.018034 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:45.273339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:45.275770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:45.290216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc646a-aeb0-49d6-b739-d050d71c22cd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:45.295569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:45.304924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:45.304924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:45.304924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] PATH_INFO: `/v3/projects/d1e334890b744215a418d581f3dea796` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:45.304924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e334890b744215a418d581f3dea796)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:45.304924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:45.440921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e334890b744215a418d581f3dea796', 'request_id': 'req-44cf25b9-5b12-40af-ae35-1e156ab60e61'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.446936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e334890b744215a418d581f3dea796', 'request_id': 'req-44cf25b9-5b12-40af-ae35-1e156ab60e61'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.532038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e334890b744215a418d581f3dea796', 'request_id': 'req-44cf25b9-5b12-40af-ae35-1e156ab60e61'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.544765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] The token cache is being invalidate because project d1e334890b744215a418d581f3dea796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:45.545052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.545769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.547786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1023/2045] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:45 2022] DELETE /identity/v3/projects/d1e334890b744215a418d581f3dea796 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:45.551751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:45.562457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89a6c-7f74-4047-b8ae-e5275f99925d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:45.654949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:45.656116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:45.656388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:45.656655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] PATH_INFO: `/v3/users/fa4971f5a30847bfb2f3a6fca69f5b23` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:45.657888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4971f5a30847bfb2f3a6fca69f5b23)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:45.660040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:45.670377 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:45.754240 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:45.879803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4971f5a30847bfb2f3a6fca69f5b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.890680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4971f5a30847bfb2f3a6fca69f5b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.892003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4971f5a30847bfb2f3a6fca69f5b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:45.937844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:45.939782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:45.961019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf25b9-5b12-40af-ae35-1e156ab60e61 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:45.968544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:45.969603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:45.970084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:45.971837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] PATH_INFO: `/v3/users/d4fe15e77b8c401d9f0307ee769c5bf6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:45.972169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fe15e77b8c401d9f0307ee769c5bf6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:45.974487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:46.020936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4971f5a30847bfb2f3a6fca69f5b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:46.021654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85d0cfaa-cef0-489c-a759-348f599263e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4971f5a30847bfb2f3a6fca69f5b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:46.044231 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1023/2046] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:45 2022] DELETE /identity/v3/users/fa4971f5a30847bfb2f3a6fca69f5b23 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:46.271177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fe15e77b8c401d9f0307ee769c5bf6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:46.286169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fe15e77b8c401d9f0307ee769c5bf6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:46.288743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fe15e77b8c401d9f0307ee769c5bf6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:46.391424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fe15e77b8c401d9f0307ee769c5bf6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:46.392156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fe15e77b8c401d9f0307ee769c5bf6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:46.417394 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1024/2047] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:45 2022] DELETE /identity/v3/users/d4fe15e77b8c401d9f0307ee769c5bf6 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:46.421158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:46.421448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:46.421722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:46.443092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:46.444481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:46.495513 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:46.542067 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1024/2048] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:46.549728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:46.552210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:46.610230 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:46.643155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef228d7-cc51-44e0-8aa3-809472172c7f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:46.648011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:46.648795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:46.651018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:46.651018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:46.661570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:46.663212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:46.675164 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1025/2049] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:46.832129 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:46.868911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:46.871279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:46.888290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:46.889904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:46.910704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bf6a0-2c2b-4b72-bd6c-dfa304eefdab service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:46.919289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:46.920082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:46.920485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:46.920895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] PATH_INFO: `/v3/projects/6cf59e209bde4f738931d4c94b67b314` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:46.922763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf59e209bde4f738931d4c94b67b314)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:46.924968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:46.983787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d988137-bdda-4e1b-b770-83e2fc6136e4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:46.989778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:46.990470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:46.990748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:46.991621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:46.993419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:47.082136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf59e209bde4f738931d4c94b67b314', 'request_id': 'req-026f591b-fe8b-46b3-9a1a-052f7af7fe12'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.094852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf59e209bde4f738931d4c94b67b314', 'request_id': 'req-026f591b-fe8b-46b3-9a1a-052f7af7fe12'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.095231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.097056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.108658 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1025/2050] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:47.110671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.112255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:47.128967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf90b0b-cfce-4d59-944b-62d11e71eb95 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.174993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf59e209bde4f738931d4c94b67b314', 'request_id': 'req-026f591b-fe8b-46b3-9a1a-052f7af7fe12'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.194281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] The token cache is being invalidate because project 6cf59e209bde4f738931d4c94b67b314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:47.194711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.195983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-026f591b-fe8b-46b3-9a1a-052f7af7fe12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.199025 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1026/2051] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:46 2022] DELETE /identity/v3/projects/6cf59e209bde4f738931d4c94b67b314 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:47.204491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b65b06-bfc9-4535-aa0f-4d5466ecc85f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.205041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b65b06-bfc9-4535-aa0f-4d5466ecc85f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.205618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b65b06-bfc9-4535-aa0f-4d5466ecc85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.220581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.221221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.221497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.221771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] PATH_INFO: `/v3/projects/33378554326c4850bdf71c709882f064` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.222997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33378554326c4850bdf71c709882f064)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.225258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.238900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-41b65b06-bfc9-4535-aa0f-4d5466ecc85f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:47.240101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-41b65b06-bfc9-4535-aa0f-4d5466ecc85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:47.250104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1027/2052] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:47.257355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02b006-07b7-497e-ba5a-54a4e74f1f05 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.258964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02b006-07b7-497e-ba5a-54a4e74f1f05 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.258964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02b006-07b7-497e-ba5a-54a4e74f1f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.277750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8a02b006-07b7-497e-ba5a-54a4e74f1f05 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:47.278999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8a02b006-07b7-497e-ba5a-54a4e74f1f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:47.287360 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1028/2053] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:47.291445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02b006-07b7-497e-ba5a-54a4e74f1f05 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.305317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02b006-07b7-497e-ba5a-54a4e74f1f05 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.308852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.310481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.310760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.311024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.311674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:47.311969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.313708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.332404 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1029/2054] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:11:47.336901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.351955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d97cbf-d272-4faa-81e0-9b2ae97cfe41 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.363887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33378554326c4850bdf71c709882f064', 'request_id': 'req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.387172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33378554326c4850bdf71c709882f064', 'request_id': 'req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.412296 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:47.442201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.442823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.443105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.443383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.444159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.446142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.463007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33378554326c4850bdf71c709882f064', 'request_id': 'req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.476528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] The token cache is being invalidate because project 33378554326c4850bdf71c709882f064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:47.476839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.477793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.479229 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1026/2055] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:47 2022] DELETE /identity/v3/projects/33378554326c4850bdf71c709882f064 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:47.483264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.484711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:47.499163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3034ea-b60f-45f0-b7ff-55bf8e9cc407 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.504106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.504856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.505236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.505612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] PATH_INFO: `/v3/users/737ca9793357406cbd651f6b1bbbb537` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.507064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=737ca9793357406cbd651f6b1bbbb537)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.509055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.545417 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:47.554555 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1030/2056] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:47 2022] POST /identity/v3/projects => generated 409 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:47.559964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.562222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:47.631973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006b1f-5ba9-4722-9072-a10242cbf591 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.637779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.638909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.639261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.639609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.640314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.642342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.702649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737ca9793357406cbd651f6b1bbbb537'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.702649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737ca9793357406cbd651f6b1bbbb537'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.702649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737ca9793357406cbd651f6b1bbbb537'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:47.837843 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1031/2057] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:47 2022] POST /identity/v3/users => generated 305 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:47.840177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.849933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31627-54cb-4227-bc38-e111201e4826 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.854593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.855176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.855478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.855841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.856473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.858093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.867947 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1032/2058] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:47.872686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.882409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c0f7d-8c77-4c57-8163-e247cde7273a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.886997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.888103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.888380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.888649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.889272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.890876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:47.901344 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1033/2059] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:47.905539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:47.914854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855bec3-ae50-423d-8540-f3946477999c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:47.920159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:47.920783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:47.921698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:47.922105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] PATH_INFO: `/v3/projects/42cd18675c45498bb2b0e5938e4b95ad/users/4366c04cd148419cac2a79c4ba1f7170/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:47.937412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cd18675c45498bb2b0e5938e4b95ad, user_id=4366c04cd148419cac2a79c4ba1f7170, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:47.940054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.086316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737ca9793357406cbd651f6b1bbbb537'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:48.087191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ab8d158e-eadc-4b5a-bd86-86ddc153b7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737ca9793357406cbd651f6b1bbbb537'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:48.104824 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1027/2060] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:47 2022] DELETE /identity/v3/users/737ca9793357406cbd651f6b1bbbb537 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:48.169751 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1034/2061] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:47 2022] PUT /identity/v3/projects/42cd18675c45498bb2b0e5938e4b95ad/users/4366c04cd148419cac2a79c4ba1f7170/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:48.173739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.174267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.177734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.229406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] MFA Rules not processed for user `4366c04cd148419cac2a79c4ba1f7170`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:48.234062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:48.311294 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1028/2062] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:48.315877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.317614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:48.374588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.379093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:48.392146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fadcb-a282-431f-b248-89c9dda52751 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:48.392928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff034-1443-45cc-b235-5cffbeaa8e15 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:48.398591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:48.399391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.399673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.399800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:48.399946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] PATH_INFO: `/v3/projects/2013486e83be4ba9be0252ab1f77a57d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.400760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.401106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2013486e83be4ba9be0252ab1f77a57d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:48.401240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.401650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.402480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:48.407627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.407771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.512249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1035/2063] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:48 2022] POST /identity/v3/projects => generated 409 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:48.513151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.523387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2013486e83be4ba9be0252ab1f77a57d', 'request_id': 'req-f265445c-111f-4287-a547-bf3aea5aa0e1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:48.530184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2013486e83be4ba9be0252ab1f77a57d', 'request_id': 'req-f265445c-111f-4287-a547-bf3aea5aa0e1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:48.586181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be36c8-9cb5-4995-adc3-933e5163ce04 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:48.591875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:48.592838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.593127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.593394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.594052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:48.596010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.628695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2013486e83be4ba9be0252ab1f77a57d', 'request_id': 'req-f265445c-111f-4287-a547-bf3aea5aa0e1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:48.636121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] The token cache is being invalidate because project 2013486e83be4ba9be0252ab1f77a57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:48.636412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:48.637592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f265445c-111f-4287-a547-bf3aea5aa0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:48.639164 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1029/2064] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:48 2022] DELETE /identity/v3/projects/2013486e83be4ba9be0252ab1f77a57d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:48.643821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8803-c64c-4ae8-aee8-2015f4cd2abf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.644103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8803-c64c-4ae8-aee8-2015f4cd2abf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.644430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8803-c64c-4ae8-aee8-2015f4cd2abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.670892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9daf8803-c64c-4ae8-aee8-2015f4cd2abf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:48.672188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9daf8803-c64c-4ae8-aee8-2015f4cd2abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:48.679986 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1030/2065] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:48.687749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b877-ddeb-4d9f-b58a-2222f722bd8c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.688030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b877-ddeb-4d9f-b58a-2222f722bd8c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.688300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b877-ddeb-4d9f-b58a-2222f722bd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.707913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9af5b877-ddeb-4d9f-b58a-2222f722bd8c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:48.709314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9af5b877-ddeb-4d9f-b58a-2222f722bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:48.718326 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1031/2066] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:48.725755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b877-ddeb-4d9f-b58a-2222f722bd8c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.734916 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1036/2067] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:48 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:48.735178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.737109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b877-ddeb-4d9f-b58a-2222f722bd8c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:48.737544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:48.742052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:48.742660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.742965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.743257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.743990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:48.744352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:48.745957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.751758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e1624-b5d9-474b-95d7-de67fcd202dc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:48.764100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:48.764262 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1032/2068] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:48.764387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.764387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.764387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.764387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:48.765914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.766087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.777565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1037/2069] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:48.781034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af6600-1418-42a4-89aa-340331a7deb5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:48.782608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.786742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:48.789248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.789796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.790899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.792436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:48.794742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4ff6-2f06-47ad-afc5-b39f8a7fd4d8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:48.797189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.799430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:48.800164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:48.800505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:48.800946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] PATH_INFO: `/v3/projects/9c6cb02a58204c49af8c4c53ef8a12c6/users/1c871a4f1ef84451906b10cbc32051b3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:48.817335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6cb02a58204c49af8c4c53ef8a12c6, user_id=1c871a4f1ef84451906b10cbc32051b3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:48.820141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:48.909307 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1033/2070] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:48 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:48.913227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:48.937278 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1038/2071] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:48 2022] PUT /identity/v3/projects/9c6cb02a58204c49af8c4c53ef8a12c6/users/1c871a4f1ef84451906b10cbc32051b3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:48.940741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.037880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3372-2645-45fd-9057-2a77b845574a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.054115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0603dd-5fad-4077-95bd-06a244783aa5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.060927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.061892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.062415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.062894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.063745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.066586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.081218 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1039/2072] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:49.085618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.095194 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:49.100431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c55543-90f7-46ca-89cb-872e7eebf433 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.109229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5494e04-ff44-45da-9c55-9a7f00975bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.110213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494e04-ff44-45da-9c55-9a7f00975bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.110493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494e04-ff44-45da-9c55-9a7f00975bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.110765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494e04-ff44-45da-9c55-9a7f00975bf9 admin admin] PATH_INFO: `/v3/projects/9c6cb02a58204c49af8c4c53ef8a12c6/users/1c871a4f1ef84451906b10cbc32051b3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.112836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5494e04-ff44-45da-9c55-9a7f00975bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6cb02a58204c49af8c4c53ef8a12c6, user_id=1c871a4f1ef84451906b10cbc32051b3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.114884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.115719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.115992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5494e04-ff44-45da-9c55-9a7f00975bf9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.116108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.116393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.117188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.119546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.130261 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1040/2073] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:49 2022] PUT /identity/v3/projects/9c6cb02a58204c49af8c4c53ef8a12c6/users/1c871a4f1ef84451906b10cbc32051b3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:49.140860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588bc6-6f07-4058-99e2-a6161d576130 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.141139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588bc6-6f07-4058-99e2-a6161d576130 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.141397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588bc6-6f07-4058-99e2-a6161d576130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.156478 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:49.185273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-06588bc6-6f07-4058-99e2-a6161d576130 None None] MFA Rules not processed for user `1c871a4f1ef84451906b10cbc32051b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:49.187321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-06588bc6-6f07-4058-99e2-a6161d576130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:49.210245 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1034/2074] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:48 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:49.213721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.225537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5333e-9575-4d81-acb1-8e8d9069f46d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.295859 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1041/2075] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:49.306298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.306925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.307205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.307475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.308160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.310447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.322012 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1035/2076] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:49.328138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06588bc6-6f07-4058-99e2-a6161d576130 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.342635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06588bc6-6f07-4058-99e2-a6161d576130 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.349180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0f39c-468f-4ccd-8c5b-6c0c720465f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.349862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0f39c-468f-4ccd-8c5b-6c0c720465f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.359414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0f39c-468f-4ccd-8c5b-6c0c720465f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.359414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0f39c-468f-4ccd-8c5b-6c0c720465f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.359414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0f39c-468f-4ccd-8c5b-6c0c720465f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.359414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0f39c-468f-4ccd-8c5b-6c0c720465f7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.368889 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1042/2077] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:49.373749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.384959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafe8-7bde-42b7-904b-093772a1c255 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.390257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.392024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.392024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.392024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] PATH_INFO: `/v3/projects/e6bf637f9ea9423cb3e4e2c74d0382a7/users/275cdb98ca7a48f68441d6c934740df0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.408270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bf637f9ea9423cb3e4e2c74d0382a7, user_id=275cdb98ca7a48f68441d6c934740df0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.410994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.480446 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1036/2078] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:49 2022] PUT /identity/v3/projects/e6bf637f9ea9423cb3e4e2c74d0382a7/users/275cdb98ca7a48f68441d6c934740df0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:49.493207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153dba-cb56-43d8-b2ce-2de3ddd4fd14 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.493620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153dba-cb56-43d8-b2ce-2de3ddd4fd14 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.493916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153dba-cb56-43d8-b2ce-2de3ddd4fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.524658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f3153dba-cb56-43d8-b2ce-2de3ddd4fd14 None None] MFA Rules not processed for user `275cdb98ca7a48f68441d6c934740df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:49.525937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f3153dba-cb56-43d8-b2ce-2de3ddd4fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:49.599083 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1043/2079] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:49.603854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.668279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c26a5-20a5-4987-8eff-b4e50ba90bc5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.673149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.673761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.674068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.674334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.674968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.676905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.683491 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:49.705661 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:49.761535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1037/2080] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:49 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:49.762842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153dba-cb56-43d8-b2ce-2de3ddd4fd14 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.773631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153dba-cb56-43d8-b2ce-2de3ddd4fd14 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.831873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.832516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.832795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.833065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.833859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.836883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.904073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.913563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:49.916677 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1044/2081] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:49 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:49.917926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:49.921636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:49.940800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fd9e9-d722-44ba-aaa6-37d14f478e79 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:49.949458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:49.959401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:49.959401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:49.959401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] PATH_INFO: `/v3/users/765c706a2ca846ebb377f808517f36a0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:49.959401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] RBAC: Authorizing `identity:delete_user(user_id=765c706a2ca846ebb377f808517f36a0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:49.959401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:49.978107 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:50.024208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e518-9dd5-4dd8-971a-51a7e0c02603 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:50.030317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:50.031041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.031407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.031745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.068798 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:50.095720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:50.097314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:50.106972 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1045/2082] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:50.107851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:50.117909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d633bd-3648-4cce-a90b-21a47d89d18e service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:50.123648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:50.124365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.124713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.125101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.125846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:50.127577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:50.140351 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1046/2083] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:50.144665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:50.154863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5477-5065-44f5-be32-547f505a1674 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:50.157641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765c706a2ca846ebb377f808517f36a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:50.160223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:50.161208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.161770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.162041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] PATH_INFO: `/v3/projects/9998de26f7ea47e781c1d05c2da2685f/users/fc1e8bc8f2284be29d91692a273dcb54/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.172928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765c706a2ca846ebb377f808517f36a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:50.173963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765c706a2ca846ebb377f808517f36a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:50.196322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9998de26f7ea47e781c1d05c2da2685f, user_id=fc1e8bc8f2284be29d91692a273dcb54, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:50.196322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:50.274305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765c706a2ca846ebb377f808517f36a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:50.275468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9f0bde3-4692-4394-973a-f2d52fe9a62a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765c706a2ca846ebb377f808517f36a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:50.284166 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1047/2084] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:50 2022] PUT /identity/v3/projects/9998de26f7ea47e781c1d05c2da2685f/users/fc1e8bc8f2284be29d91692a273dcb54/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:50.285392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:50.287086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:50.300984 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1038/2085] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:49 2022] DELETE /identity/v3/users/765c706a2ca846ebb377f808517f36a0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:50.305408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.306946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.306946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.328307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:50.330108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:50.362565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2db3e-e2c9-47e3-90d4-3a79ceeda460 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:50.402563 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1039/2086] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:50.412706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:50.416498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:50.453699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:50.454343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.454623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.454893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.455721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:50.457518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:50.475093 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1048/2087] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:50.476286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:50.478834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:50.514269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f740808-5a50-4f59-8752-29bee2ba7918 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:50.514269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:50.514269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.514269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.515089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.530665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:50.533230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:50.550816 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1040/2088] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:50.555854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:50.567024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358318b-392c-48ea-9124-6905dcaff18c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:50.575977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53593371-d12f-4d88-981a-3f6bd2b9ec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:50.578813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53593371-d12f-4d88-981a-3f6bd2b9ec71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.578813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53593371-d12f-4d88-981a-3f6bd2b9ec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.578813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53593371-d12f-4d88-981a-3f6bd2b9ec71 admin admin] PATH_INFO: `/v3/projects/9998de26f7ea47e781c1d05c2da2685f/users/fc1e8bc8f2284be29d91692a273dcb54/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.592024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53593371-d12f-4d88-981a-3f6bd2b9ec71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9998de26f7ea47e781c1d05c2da2685f, user_id=fc1e8bc8f2284be29d91692a273dcb54, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:50.594724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53593371-d12f-4d88-981a-3f6bd2b9ec71 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:50.598605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea491d6-caaf-4de0-ae51-1e3b013ea539 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:50.607565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd3827-eef0-4474-b3a7-0fefef267bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:50.610165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3827-eef0-4474-b3a7-0fefef267bd9 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.610458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3827-eef0-4474-b3a7-0fefef267bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.610732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3827-eef0-4474-b3a7-0fefef267bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.614191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-acfd3827-eef0-4474-b3a7-0fefef267bd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:50.614412 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1041/2089] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:50 2022] PUT /identity/v3/projects/9998de26f7ea47e781c1d05c2da2685f/users/fc1e8bc8f2284be29d91692a273dcb54/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:50.625414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.625702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.626002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.684678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] MFA Rules not processed for user `fc1e8bc8f2284be29d91692a273dcb54`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:50.686967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:50.707817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd3827-eef0-4474-b3a7-0fefef267bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:50.709474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd3827-eef0-4474-b3a7-0fefef267bd9 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:50.722517 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1049/2090] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:50 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:50.768030 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1042/2091] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:50.781490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:50.781490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:50.781490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:50.828006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] MFA Rules not processed for user `275cdb98ca7a48f68441d6c934740df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:50.828006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:50.949998 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1050/2092] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:51.130055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:51.132650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:51.191149 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:51.204132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1b32c-6e58-4fac-b01b-d961d2426394 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:51.208701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:51.209335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:51.209617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:51.209887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] PATH_INFO: `/v3/projects/f78b3e125cf549dbbce0f49864e9e91d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:51.211054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78b3e125cf549dbbce0f49864e9e91d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:51.212959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:51.269115 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:51.327499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:51.328997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:51.344168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78b3e125cf549dbbce0f49864e9e91d', 'request_id': 'req-bf1cb777-93d0-47a5-ad79-020064511a9f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.344511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b43d-d43c-4a16-8559-4fdb591b60c0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:51.351941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78b3e125cf549dbbce0f49864e9e91d', 'request_id': 'req-bf1cb777-93d0-47a5-ad79-020064511a9f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.406847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:51.408907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:51.408907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:51.408907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] PATH_INFO: `/v3/users/4366c04cd148419cac2a79c4ba1f7170` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:51.409526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4366c04cd148419cac2a79c4ba1f7170)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:51.411506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:51.465317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78b3e125cf549dbbce0f49864e9e91d', 'request_id': 'req-bf1cb777-93d0-47a5-ad79-020064511a9f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.483074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] The token cache is being invalidate because project f78b3e125cf549dbbce0f49864e9e91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:51.483363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.484020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.485510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1043/2093] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:51 2022] DELETE /identity/v3/projects/f78b3e125cf549dbbce0f49864e9e91d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:51.486377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:51.487677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:51.562913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cb777-93d0-47a5-ad79-020064511a9f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:51.568699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:51.569312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:51.569595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:51.569868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:51.571679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:51.627524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:51.629126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:51.639139 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1044/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:51.640067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:51.641741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:51.655623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf87ad-b72c-4a45-a5fb-9f635ed51cc9 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:51.660327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:51.660958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:51.661240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:51.661515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] PATH_INFO: `/v3/users/78f922ba52134aafb488fd15a12522d2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:51.662741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f922ba52134aafb488fd15a12522d2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:51.664649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:51.701299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4366c04cd148419cac2a79c4ba1f7170'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.723334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4366c04cd148419cac2a79c4ba1f7170'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.725254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4366c04cd148419cac2a79c4ba1f7170'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.794961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4366c04cd148419cac2a79c4ba1f7170'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.795846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7255404-080e-4d37-9ace-8f34fbe17b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4366c04cd148419cac2a79c4ba1f7170'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.815288 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1051/2095] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:51 2022] DELETE /identity/v3/users/4366c04cd148419cac2a79c4ba1f7170 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:51.819546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:51.819883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:51.820161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:51.839330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:51.840585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:51.872392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f922ba52134aafb488fd15a12522d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.881138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f922ba52134aafb488fd15a12522d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.887141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f922ba52134aafb488fd15a12522d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.910959 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1052/2096] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:51.927102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:51.928735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:51.968651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f922ba52134aafb488fd15a12522d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:51.969341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f922ba52134aafb488fd15a12522d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:52.018917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05847c41-71d1-400f-9ed2-d169c2d422cc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:52.023223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15929b9-1c64-48e2-ba2a-e461447bbc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:52.024084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15929b9-1c64-48e2-ba2a-e461447bbc42 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:52.024240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15929b9-1c64-48e2-ba2a-e461447bbc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:52.024507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15929b9-1c64-48e2-ba2a-e461447bbc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:52.026181 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1045/2097] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:51 2022] DELETE /identity/v3/users/78f922ba52134aafb488fd15a12522d2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:52.026578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b15929b9-1c64-48e2-ba2a-e461447bbc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:52.040218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15929b9-1c64-48e2-ba2a-e461447bbc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:52.042540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15929b9-1c64-48e2-ba2a-e461447bbc42 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:52.058040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1053/2098] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:11:52.236420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:52.238712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:52.239701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:52.240334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:52.241237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:52.280535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] MFA Rules not processed for user `275cdb98ca7a48f68441d6c934740df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:52.281763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:52.370935 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1054/2099] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:52.373214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc59e62-fed4-47f7-b9dd-ca7cc072f5a2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:52.379753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:52.380440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:52.380846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:52.381178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:52.383230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:52.499993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:52.502713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:52.517131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1046/2100] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:52.700732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:52.702680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:52.723435 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:52.794016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d50c8-b6a9-4448-b18b-af1e919d0285 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:52.796822 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:52.799071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:52.799721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:52.799999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:52.800269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] PATH_INFO: `/v3/projects/42cd18675c45498bb2b0e5938e4b95ad` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:52.802095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42cd18675c45498bb2b0e5938e4b95ad)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:52.806681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:52.926798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42cd18675c45498bb2b0e5938e4b95ad', 'request_id': 'req-c57863ea-8586-4ebf-8791-5ce910065d68'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:52.933102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42cd18675c45498bb2b0e5938e4b95ad', 'request_id': 'req-c57863ea-8586-4ebf-8791-5ce910065d68'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.071254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42cd18675c45498bb2b0e5938e4b95ad', 'request_id': 'req-c57863ea-8586-4ebf-8791-5ce910065d68'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.085340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] The token cache is being invalidate because project 42cd18675c45498bb2b0e5938e4b95ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:53.085636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.086405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.088150 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1055/2101] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:52 2022] DELETE /identity/v3/projects/42cd18675c45498bb2b0e5938e4b95ad => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:53.092573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:53.103881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b4408-df18-4612-a194-3e82e7ee34c1 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:53.172262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:53.172892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:53.173171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:53.173440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] PATH_INFO: `/v3/users/1c871a4f1ef84451906b10cbc32051b3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:53.174566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c871a4f1ef84451906b10cbc32051b3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:53.176503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:53.179467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:53.181190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:53.195856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57863ea-8586-4ebf-8791-5ce910065d68 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:53.201653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:53.202388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:53.202769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:53.203138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] PATH_INFO: `/v3/projects/d2f2a869e13b4fd781ddd560f8825a35` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:53.204503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f2a869e13b4fd781ddd560f8825a35)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:53.206604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:53.393924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c871a4f1ef84451906b10cbc32051b3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.395280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f2a869e13b4fd781ddd560f8825a35', 'request_id': 'req-99b5e792-5cd4-45d8-a66b-9c41c6312101'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.406902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f2a869e13b4fd781ddd560f8825a35', 'request_id': 'req-99b5e792-5cd4-45d8-a66b-9c41c6312101'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.408580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c871a4f1ef84451906b10cbc32051b3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.409313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c871a4f1ef84451906b10cbc32051b3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.520211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f2a869e13b4fd781ddd560f8825a35', 'request_id': 'req-99b5e792-5cd4-45d8-a66b-9c41c6312101'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.533161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] The token cache is being invalidate because project d2f2a869e13b4fd781ddd560f8825a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:53.533911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.534298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99b5e792-5cd4-45d8-a66b-9c41c6312101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.535973 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1056/2102] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:53 2022] DELETE /identity/v3/projects/d2f2a869e13b4fd781ddd560f8825a35 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:53.540968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709915-0cea-424d-ad31-d2e40f8392d3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:53.541245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709915-0cea-424d-ad31-d2e40f8392d3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:53.541517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709915-0cea-424d-ad31-d2e40f8392d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:53.566013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-56709915-0cea-424d-ad31-d2e40f8392d3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:53.567548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-56709915-0cea-424d-ad31-d2e40f8392d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:53.577194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c871a4f1ef84451906b10cbc32051b3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.578342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0577413b-2aa5-430e-88ce-d62d3f4302e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c871a4f1ef84451906b10cbc32051b3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:53.599113 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1047/2103] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:53 2022] DELETE /identity/v3/users/1c871a4f1ef84451906b10cbc32051b3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:53.631910 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1057/2104] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:53.641245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d34e7-f8a8-404a-8a98-49f65f185876 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:53.641612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d34e7-f8a8-404a-8a98-49f65f185876 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:53.642031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d34e7-f8a8-404a-8a98-49f65f185876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:53.672060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cf8d34e7-f8a8-404a-8a98-49f65f185876 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:53.673762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf8d34e7-f8a8-404a-8a98-49f65f185876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:53.752604 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1048/2105] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:53.756956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56709915-0cea-424d-ad31-d2e40f8392d3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:53.768300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56709915-0cea-424d-ad31-d2e40f8392d3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:53.773079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:53.773686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:53.773962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:53.774283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:53.774930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:53.775231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:53.776827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:53.790835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1058/2106] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:11:53.795586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d34e7-f8a8-404a-8a98-49f65f185876 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:53.804754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d34e7-f8a8-404a-8a98-49f65f185876 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:53.810534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:53.813926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:53.813926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:53.813926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:53.813926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:53.814867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:53.902607 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1049/2107] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:53 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:53.905546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:53.915414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60578a2-0f2f-4992-a16a-e4c834c3d750 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:53.977703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:53.978794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:53.979080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:53.979347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:53.981357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:53.990641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:54.091324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:54.094518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:54.096789 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1059/2108] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:53 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:54.100826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:54.123099 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:54.126440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e1876-2182-4f92-998b-19cbe7ce8b0b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:54.139017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4759f17-07f0-4de9-8e2d-b4bb236883c0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:54.140370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:54.141564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.142896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.144505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:54.145201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.145478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] PATH_INFO: `/v3/projects/9c6cb02a58204c49af8c4c53ef8a12c6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.145581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.145895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.146712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:54.148351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:54.148679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6cb02a58204c49af8c4c53ef8a12c6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:54.157250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:54.160806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1060/2109] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:54.165703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:54.183354 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:54.187431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06058f95-f327-4e77-8600-94336ac0cb32 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:54.202944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:54.203634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.203915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.204183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.204824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:54.206444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:54.240214 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1061/2110] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:54.241148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:54.254193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7fe4a-4319-42e4-97c6-17ccbca369e4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:54.276963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c794-0591-4f00-952a-86c09927734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:54.278643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c794-0591-4f00-952a-86c09927734c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.278926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c794-0591-4f00-952a-86c09927734c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.279193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c794-0591-4f00-952a-86c09927734c admin admin] PATH_INFO: `/v3/projects/eb058785345d4e58a5820445efe09bee/users/547aed83a7e44becb9c89dc6bae62255/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.300475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c794-0591-4f00-952a-86c09927734c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb058785345d4e58a5820445efe09bee, user_id=547aed83a7e44becb9c89dc6bae62255, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:54.309329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c794-0591-4f00-952a-86c09927734c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:54.454178 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1062/2111] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:54 2022] PUT /identity/v3/projects/eb058785345d4e58a5820445efe09bee/users/547aed83a7e44becb9c89dc6bae62255/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:54.471340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10911e2-b24c-456b-a41c-acaf973d9d5c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.471880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10911e2-b24c-456b-a41c-acaf973d9d5c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.474812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10911e2-b24c-456b-a41c-acaf973d9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.514981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6cb02a58204c49af8c4c53ef8a12c6', 'request_id': 'req-9b914e24-6514-4897-8945-82232e9b3108'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:54.528852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6cb02a58204c49af8c4c53ef8a12c6', 'request_id': 'req-9b914e24-6514-4897-8945-82232e9b3108'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:54.581832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a10911e2-b24c-456b-a41c-acaf973d9d5c None None] MFA Rules not processed for user `547aed83a7e44becb9c89dc6bae62255`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:54.583325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a10911e2-b24c-456b-a41c-acaf973d9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:54.657548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6cb02a58204c49af8c4c53ef8a12c6', 'request_id': 'req-9b914e24-6514-4897-8945-82232e9b3108'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:54.677394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] The token cache is being invalidate because project 9c6cb02a58204c49af8c4c53ef8a12c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:11:54.678187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:54.679523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9b914e24-6514-4897-8945-82232e9b3108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:54.680906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1063/2112] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:54.681653 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1050/2113] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:11:54 2022] DELETE /identity/v3/projects/9c6cb02a58204c49af8c4c53ef8a12c6 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:54.686249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10911e2-b24c-456b-a41c-acaf973d9d5c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:54.687237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba940-e5e4-4e37-9a9f-e5107360bbf6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.687525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba940-e5e4-4e37-9a9f-e5107360bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.687803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba940-e5e4-4e37-9a9f-e5107360bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.716132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c81ba940-e5e4-4e37-9a9f-e5107360bbf6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:54.716132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c81ba940-e5e4-4e37-9a9f-e5107360bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:54.814255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10911e2-b24c-456b-a41c-acaf973d9d5c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:54.823868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:54.824597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.827837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.827837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.827837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:54.828341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:54.865889 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1051/2114] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:54.874933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a70b-3b1e-4075-9244-0d99cfc96324 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.875806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a70b-3b1e-4075-9244-0d99cfc96324 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.875806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a70b-3b1e-4075-9244-0d99cfc96324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.898394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-31d1a70b-3b1e-4075-9244-0d99cfc96324 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:54.901216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-31d1a70b-3b1e-4075-9244-0d99cfc96324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:54.913584 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1052/2115] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:54.914670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a70b-3b1e-4075-9244-0d99cfc96324 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:54.929220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a70b-3b1e-4075-9244-0d99cfc96324 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:54.958641 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1064/2116] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:54 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:54.959597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:54.967621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:54.969735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:54.971204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:54.971531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:54.971810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:54.975568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:11:54.975919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:54.985135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.032779 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1053/2117] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:11:55.038404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.069823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc83c-2fe6-4865-9ddd-dafe09e1792c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.139840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d7ff-8385-4c5f-8db2-02edd198f644 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.154389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.155916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.159414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.159414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.159414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.160925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.204433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.205294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.205756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.206321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.207581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.210282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.287120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1065/2118] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:54 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:55.288281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.314077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661f377-50c5-4883-8660-649e2938c2dd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.320420 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1054/2119] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:55 2022] POST /identity/v3/projects => generated 409 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:11:55.321505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.470241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.471912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.472514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.473046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.473962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.475823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.482990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de26b8-6a1b-49e4-b17a-b5a71a7bcbc9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.492215 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1066/2120] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:55.498404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.498547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.499131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.499541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.499802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.500450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.502680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.514135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c167ce-aecf-4720-9112-23ee42b3045a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.523274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.523274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.523274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.523274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] PATH_INFO: `/v3/projects/264d2f683757471183644d46da75d365/users/dce640e690324a588f758650bf3c4f9a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.543940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] RBAC: Authorizing `identity:create_grant(project_id=264d2f683757471183644d46da75d365, user_id=dce640e690324a588f758650bf3c4f9a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.546912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.589133 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1055/2121] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:55 2022] POST /identity/v3/users => generated 305 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:55.597332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.609225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c9a2-e0a7-476b-9abf-080fbad74074 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.616563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.617410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.617906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.618075 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1067/2122] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:55 2022] PUT /identity/v3/projects/264d2f683757471183644d46da75d365/users/dce640e690324a588f758650bf3c4f9a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:55.618602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.619548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.621673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.623510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.637711 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1056/2123] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:55.643527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.671810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e7b90-45b0-4606-975f-c37f5d32e619 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.781360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3a0e-72bb-437b-aa6e-c8c1f9f138be admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.796528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.797159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.797437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.797708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.798418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.800020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.814620 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1068/2124] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:55.818442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.832770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313772f-6509-47a5-b85b-33e2f998b54f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.839859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c44e33-950d-4b67-9d20-934d847fb284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.840620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44e33-950d-4b67-9d20-934d847fb284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.840901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44e33-950d-4b67-9d20-934d847fb284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.841180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44e33-950d-4b67-9d20-934d847fb284 admin admin] PATH_INFO: `/v3/projects/264d2f683757471183644d46da75d365/users/dce640e690324a588f758650bf3c4f9a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.843354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c44e33-950d-4b67-9d20-934d847fb284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264d2f683757471183644d46da75d365, user_id=dce640e690324a588f758650bf3c4f9a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.846852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c44e33-950d-4b67-9d20-934d847fb284 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.854884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:55.855720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.857049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.857335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.858024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:55.859686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:55.862566 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1069/2125] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:55 2022] PUT /identity/v3/projects/264d2f683757471183644d46da75d365/users/dce640e690324a588f758650bf3c4f9a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:11:55.872802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1057/2126] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:11:55.876279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc1e0-d345-4e4f-8d20-b8d0095d0013 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:55.876606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc1e0-d345-4e4f-8d20-b8d0095d0013 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:55.876846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc1e0-d345-4e4f-8d20-b8d0095d0013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:55.880515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:55.893099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6490-eb7e-407e-b5d4-9233b60cb432 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:55.921006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bdadc1e0-d345-4e4f-8d20-b8d0095d0013 None None] MFA Rules not processed for user `dce640e690324a588f758650bf3c4f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:55.922751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bdadc1e0-d345-4e4f-8d20-b8d0095d0013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:56.003139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:56.004608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.005089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.005595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] PATH_INFO: `/v3/projects/9c8cc5b7223b4cb3ba8c1763c44fa5b0/users/a659d51e02d8443c942e3ff164eb9683/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.030670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8cc5b7223b4cb3ba8c1763c44fa5b0, user_id=a659d51e02d8443c942e3ff164eb9683, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:56.033070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:56.049407 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1070/2127] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:56.060368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4658dfc-f758-471b-ac98-76b412ec3a4a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.060654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4658dfc-f758-471b-ac98-76b412ec3a4a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.060950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4658dfc-f758-471b-ac98-76b412ec3a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.077099 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:56.084273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e4658dfc-f758-471b-ac98-76b412ec3a4a None None] MFA Rules not processed for user `547aed83a7e44becb9c89dc6bae62255`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:56.089618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e4658dfc-f758-471b-ac98-76b412ec3a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:56.151065 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1071/2128] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:56.167143 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1058/2129] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:55 2022] PUT /identity/v3/projects/9c8cc5b7223b4cb3ba8c1763c44fa5b0/users/a659d51e02d8443c942e3ff164eb9683/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:56.185099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.185938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.186248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.223187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] MFA Rules not processed for user `a659d51e02d8443c942e3ff164eb9683`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:56.224919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:56.237299 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:56.310013 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1072/2130] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:56.315077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:56.439089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d91d-7a6c-4397-b9e4-4ccfa0564d1a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:56.462063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:56.465871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:56.479660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:56.485001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.485001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.485001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.488954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:56.491203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:56.609314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5295ec6-4437-497b-a6e8-20699f8dd0b7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:56.634449 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1059/2131] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:11:56 2022] POST /identity/v3/projects => generated 411 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:56.636018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:56.638284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:56.639420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.639705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.639981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.648855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:56.738863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83eca-5d95-4661-885d-8a5683e5b3d6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:56.743726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:56.744348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.746427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.746427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.746427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:56.747450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:56.779989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:56.787516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:56.799080 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1073/2132] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:56.854566 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1060/2133] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:11:56 2022] POST /identity/v3/users => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:11:56.858922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:56.878965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd46666-18bd-4549-a706-b8757c563ea3 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:56.885026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:56.885692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.885994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.886296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.887595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:56.890431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:56.906883 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1074/2134] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:56.907986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:56.920920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57d5c1-cb08-49b3-9f37-c3937d1fb2a4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:56.926526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:56.927180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:56.927456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:56.927738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] PATH_INFO: `/v3/projects/c8e27bec0ea44871a1c86a185ed7f47c/users/cf75a43b594f43a7b38760992401c266/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:56.945474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e27bec0ea44871a1c86a185ed7f47c, user_id=cf75a43b594f43a7b38760992401c266, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:56.948217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:57.012985 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1061/2135] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:56 2022] PUT /identity/v3/projects/c8e27bec0ea44871a1c86a185ed7f47c/users/cf75a43b594f43a7b38760992401c266/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:57.017067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:57.027670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f6365-4bdf-45a4-9f33-33d5ed27b088 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:57.095399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1719687-caec-4f3d-9db9-fa16df1e451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:57.096501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1719687-caec-4f3d-9db9-fa16df1e451b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:57.097008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1719687-caec-4f3d-9db9-fa16df1e451b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:57.097407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1719687-caec-4f3d-9db9-fa16df1e451b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:57.099024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1719687-caec-4f3d-9db9-fa16df1e451b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:57.103207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1719687-caec-4f3d-9db9-fa16df1e451b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:57.124559 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1075/2136] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:11:57.128521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:57.144174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e952-66ae-43d3-b62d-75016070a442 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:57.150787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:57.151583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:57.151857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:57.152159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] PATH_INFO: `/v3/projects/c8e27bec0ea44871a1c86a185ed7f47c/users/cf75a43b594f43a7b38760992401c266/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:57.154917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e27bec0ea44871a1c86a185ed7f47c, user_id=cf75a43b594f43a7b38760992401c266, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:57.157702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:57.171656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1062/2137] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:11:57 2022] PUT /identity/v3/projects/c8e27bec0ea44871a1c86a185ed7f47c/users/cf75a43b594f43a7b38760992401c266/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:57.181753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba1d5-f606-49e7-b0b6-a0b9b712d421 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:57.182074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba1d5-f606-49e7-b0b6-a0b9b712d421 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:57.182276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba1d5-f606-49e7-b0b6-a0b9b712d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:57.224119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6f3ba1d5-f606-49e7-b0b6-a0b9b712d421 None None] MFA Rules not processed for user `cf75a43b594f43a7b38760992401c266`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:57.225476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6f3ba1d5-f606-49e7-b0b6-a0b9b712d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:57.332714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1076/2138] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:57.395610 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:57.560433 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:58.195060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:58.196937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:58.352553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23d77-a9b0-4c31-90cd-cfbc16dd6ca9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:58.372724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:58.374817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:58.378112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:58.378427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:58.398664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:58.401091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:58.413087 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1063/2139] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:58 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:58.463679 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:58.568674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba1d5-f606-49e7-b0b6-a0b9b712d421 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:58.584366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba1d5-f606-49e7-b0b6-a0b9b712d421 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:58.592325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a334ce-868b-4901-8043-fb32f1c3a876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:58.593023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a334ce-868b-4901-8043-fb32f1c3a876 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:58.593360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a334ce-868b-4901-8043-fb32f1c3a876 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:58.593690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a334ce-868b-4901-8043-fb32f1c3a876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:58.686172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a334ce-868b-4901-8043-fb32f1c3a876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:58.689344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a334ce-868b-4901-8043-fb32f1c3a876 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:58.701078 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1077/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:58 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:11:58.885207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:58.894660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fda6-79e7-48d1-a736-b5cf86481456 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:58.894947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fda6-79e7-48d1-a736-b5cf86481456 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:58.895219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fda6-79e7-48d1-a736-b5cf86481456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:58.925274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5885fda6-79e7-48d1-a736-b5cf86481456 None None] MFA Rules not processed for user `1c2310cbc3574eb29a6ca6291ba7808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:58.927752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5885fda6-79e7-48d1-a736-b5cf86481456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:58.987866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe4b86-3ffc-44c3-882b-8ef6c8158e3c service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:58.993330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:58.993961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:58.994265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:58.994561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] PATH_INFO: `/v3/users/a659d51e02d8443c942e3ff164eb9683` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:58.995740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a659d51e02d8443c942e3ff164eb9683)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:58.997640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:59.015166 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1078/2141] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:59.111679 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:59.167337 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:11:59.270195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a659d51e02d8443c942e3ff164eb9683'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:59.287946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a659d51e02d8443c942e3ff164eb9683'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:59.289416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a659d51e02d8443c942e3ff164eb9683'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:59.398257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a659d51e02d8443c942e3ff164eb9683'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:59.401718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a659d51e02d8443c942e3ff164eb9683'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:11:59.437589 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1064/2142] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:11:58 2022] DELETE /identity/v3/users/a659d51e02d8443c942e3ff164eb9683 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:11:59.442894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3eeb-2b5d-40e7-9c57-172d1babdae1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:59.443981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3eeb-2b5d-40e7-9c57-172d1babdae1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:59.444441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3eeb-2b5d-40e7-9c57-172d1babdae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:59.473549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f36d3eeb-2b5d-40e7-9c57-172d1babdae1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:59.475658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f36d3eeb-2b5d-40e7-9c57-172d1babdae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:59.599325 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1079/2143] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:11:59.604237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:11:59.613875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:59.682349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6030c4-e169-464d-85db-280209cff38c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:59.682921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6030c4-e169-464d-85db-280209cff38c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:59.686930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6030c4-e169-464d-85db-280209cff38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:59.732793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4a6030c4-e169-464d-85db-280209cff38c None None] MFA Rules not processed for user `76739eabf8804ec2af41abc4c1e6fd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:11:59.735834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a6030c4-e169-464d-85db-280209cff38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:11:59.797540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd12bd-7e2d-4809-b69e-b925b6183819 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:11:59.806521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:11:59.810017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:11:59.810017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:11:59.810017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:11:59.830247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:11:59.833379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:11:59.854443 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1080/2144] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:11:59.861942 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1065/2145] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:00.931537 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:01.065222 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:01.254740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6030c4-e169-464d-85db-280209cff38c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:01.256221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a6030c4-e169-464d-85db-280209cff38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:01.286755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6030c4-e169-464d-85db-280209cff38c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:01.294213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:01.295100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:01.295601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:01.296082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] PATH_INFO: `/v3/projects/9c8cc5b7223b4cb3ba8c1763c44fa5b0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:01.297429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8cc5b7223b4cb3ba8c1763c44fa5b0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:01.299573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:01.551768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8cc5b7223b4cb3ba8c1763c44fa5b0', 'request_id': 'req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:01.558613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8cc5b7223b4cb3ba8c1763c44fa5b0', 'request_id': 'req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:01.676841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8cc5b7223b4cb3ba8c1763c44fa5b0', 'request_id': 'req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:01.705184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] The token cache is being invalidate because project 9c8cc5b7223b4cb3ba8c1763c44fa5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:01.705421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:01.709661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:01.713223 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1081/2146] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:01 2022] DELETE /identity/v3/projects/9c8cc5b7223b4cb3ba8c1763c44fa5b0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:01.717889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:01.729569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6d1b-7bff-4b4a-9cd5-e54224f20d01 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:01.806007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:01.806670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:01.806954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:01.807263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] PATH_INFO: `/v3/users/cf75a43b594f43a7b38760992401c266` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:01.808959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf75a43b594f43a7b38760992401c266)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:01.810953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:02.025193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf75a43b594f43a7b38760992401c266'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:02.033150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf75a43b594f43a7b38760992401c266'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:02.034260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf75a43b594f43a7b38760992401c266'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:02.099256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf75a43b594f43a7b38760992401c266'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:02.099955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-305ccf93-d453-4cf4-b785-a345c1980bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf75a43b594f43a7b38760992401c266'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:02.118678 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1066/2147] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:12:01 2022] DELETE /identity/v3/users/cf75a43b594f43a7b38760992401c266 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:02.638295 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:03.009495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:03.011518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:03.044471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6ec0-4f1b-4dd3-ab50-a54e5422417b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:03.108910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:03.109545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.109816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.110122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] PATH_INFO: `/v3/projects/c8e27bec0ea44871a1c86a185ed7f47c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.111358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e27bec0ea44871a1c86a185ed7f47c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:03.114291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:03.241500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e27bec0ea44871a1c86a185ed7f47c', 'request_id': 'req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:03.247790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e27bec0ea44871a1c86a185ed7f47c', 'request_id': 'req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:03.339482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e27bec0ea44871a1c86a185ed7f47c', 'request_id': 'req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:03.352855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] The token cache is being invalidate because project c8e27bec0ea44871a1c86a185ed7f47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:03.353144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:03.353806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a5b6a18-0c5f-40d4-a429-286d84ddd37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:03.358704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1082/2148] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:03 2022] DELETE /identity/v3/projects/c8e27bec0ea44871a1c86a185ed7f47c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:03.360980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b196-6d7a-4d46-bf08-6fec080710f7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.360980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b196-6d7a-4d46-bf08-6fec080710f7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.361553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3b196-6d7a-4d46-bf08-6fec080710f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.394608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f3f3b196-6d7a-4d46-bf08-6fec080710f7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:03.396322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f3f3b196-6d7a-4d46-bf08-6fec080710f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:03.475574 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1067/2149] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:03.484252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a30bb-cbbe-40cd-a7ea-b263ddd0934b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.484829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a30bb-cbbe-40cd-a7ea-b263ddd0934b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.485289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a30bb-cbbe-40cd-a7ea-b263ddd0934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.508685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b05a30bb-cbbe-40cd-a7ea-b263ddd0934b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:03.509899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b05a30bb-cbbe-40cd-a7ea-b263ddd0934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:03.519124 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1083/2150] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:03.523119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b196-6d7a-4d46-bf08-6fec080710f7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:03.536276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3b196-6d7a-4d46-bf08-6fec080710f7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:03.541816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:03.542527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.542805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.543070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.543717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:12:03.544018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:03.545609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:03.561811 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1068/2151] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:12:03.562713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a30bb-cbbe-40cd-a7ea-b263ddd0934b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:03.572826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a30bb-cbbe-40cd-a7ea-b263ddd0934b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:03.578259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:03.578868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.579147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.580091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.580091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:03.581919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:03.674523 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1084/2152] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:12:03 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:12:03.679203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:03.694991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbba4-b99e-461f-adfe-3e88feea2497 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:03.809463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:03.810126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.810402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.810670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.811313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:03.813231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:03.882394 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:03.909590 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1069/2153] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:12:03 2022] POST /identity/v3/users => generated 303 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:03.910903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:03.934713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c6c9a-bfb1-4987-af52-2ec122a71c87 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:03.942353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:03.942978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.943257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.943524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.944178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:03.945792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:03.957877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1085/2154] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:03.961839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:03.974446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4918-2fbb-4489-8aa7-839373a54839 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:03.979744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980258-3436-41c4-9341-16dad433d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:03.980544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980258-3436-41c4-9341-16dad433d13f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:03.981272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980258-3436-41c4-9341-16dad433d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:03.981272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980258-3436-41c4-9341-16dad433d13f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:03.981933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3980258-3436-41c4-9341-16dad433d13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:03.984413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3980258-3436-41c4-9341-16dad433d13f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:03.996520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1070/2155] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:12:04.002013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:04.023378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df42230-2cf5-4ece-a7be-b51b770e8180 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:04.036398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:04.037240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:04.038429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:04.040075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] PATH_INFO: `/v3/projects/b50714dd87a64061a967ebd8bed2008c/users/f2f0cd89c777406a80fd964902948318/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:04.071852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50714dd87a64061a967ebd8bed2008c, user_id=f2f0cd89c777406a80fd964902948318, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:04.075433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:04.162602 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1086/2156] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:03 2022] PUT /identity/v3/projects/b50714dd87a64061a967ebd8bed2008c/users/f2f0cd89c777406a80fd964902948318/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:04.168620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076852-f12d-4d05-bf55-bdc8e5ffce35 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:04.168909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076852-f12d-4d05-bf55-bdc8e5ffce35 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:04.169175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076852-f12d-4d05-bf55-bdc8e5ffce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:04.192977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-16076852-f12d-4d05-bf55-bdc8e5ffce35 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:04.194923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-16076852-f12d-4d05-bf55-bdc8e5ffce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:04.285962 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1071/2157] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:04.296232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:04.299137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:04.382849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4287f3c-1fb5-4f17-9997-3c63b1aa966f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:04.390628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196a3b4-2e19-408c-8cc5-a0da9de429ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:04.391256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196a3b4-2e19-408c-8cc5-a0da9de429ab service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:04.391995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196a3b4-2e19-408c-8cc5-a0da9de429ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:04.391995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196a3b4-2e19-408c-8cc5-a0da9de429ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:04.402013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196a3b4-2e19-408c-8cc5-a0da9de429ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:04.405540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196a3b4-2e19-408c-8cc5-a0da9de429ab service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:04.417837 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1087/2158] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:04.836829 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:05.368067 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:06.977350 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:07.308897 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:08.245930 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:08.734301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf5da-a758-48ac-a081-320ecea5b6f0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:08.734582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf5da-a758-48ac-a081-320ecea5b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:08.734921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf5da-a758-48ac-a081-320ecea5b6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:08.781378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-00ccf5da-a758-48ac-a081-320ecea5b6f0 None None] MFA Rules not processed for user `9e535f9274b24a9f800ea0c3d8faba5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:08.785405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-00ccf5da-a758-48ac-a081-320ecea5b6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:08.880605 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1072/2159] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:08.954346 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:09.477637 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:09.670696 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:10.617374 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:10.750354 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:11.893068 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:12.690666 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:12.850828 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:15.213754 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:15.320203 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:16.108904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d581d0c-761f-4f92-af4a-7fd10f274677 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:16.109532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d581d0c-761f-4f92-af4a-7fd10f274677 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:16.109814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d581d0c-761f-4f92-af4a-7fd10f274677 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:16.111200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1088/2160] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:12:16.151383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:16.151607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:16.151825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:16.201220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:16.203833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:16.331628 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1073/2161] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:16.384671 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:16.408521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d581d0c-761f-4f92-af4a-7fd10f274677 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:16.410365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2d581d0c-761f-4f92-af4a-7fd10f274677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:16.458135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d581d0c-761f-4f92-af4a-7fd10f274677 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:16.493812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207afecf-4db9-4efd-bc5e-9fce9b96efff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:16.496185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207afecf-4db9-4efd-bc5e-9fce9b96efff service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:16.496185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207afecf-4db9-4efd-bc5e-9fce9b96efff service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:16.496185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207afecf-4db9-4efd-bc5e-9fce9b96efff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:16.514044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207afecf-4db9-4efd-bc5e-9fce9b96efff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:16.515566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207afecf-4db9-4efd-bc5e-9fce9b96efff service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:16.535423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:16.537905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:16.554989 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1089/2162] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:16.565426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269400b7-f73e-44d6-830a-eed5b4830353 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:16.567199 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:16.573619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:16.579021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:16.579314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:16.579641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] PATH_INFO: `/v3/users/74c84b03f3f8431e9d3c0cbb792aeaf9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:16.584975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c84b03f3f8431e9d3c0cbb792aeaf9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:16.586987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:16.882670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c84b03f3f8431e9d3c0cbb792aeaf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:16.897454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c84b03f3f8431e9d3c0cbb792aeaf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:16.898534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c84b03f3f8431e9d3c0cbb792aeaf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:16.991389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c84b03f3f8431e9d3c0cbb792aeaf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:16.992076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c84b03f3f8431e9d3c0cbb792aeaf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:17.023051 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1074/2163] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:12:16 2022] DELETE /identity/v3/users/74c84b03f3f8431e9d3c0cbb792aeaf9 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:17.457812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01399d16-e12b-437f-bf9c-1d6b17b48dd1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:17.458750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01399d16-e12b-437f-bf9c-1d6b17b48dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:17.459086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01399d16-e12b-437f-bf9c-1d6b17b48dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:17.504259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-01399d16-e12b-437f-bf9c-1d6b17b48dd1 None None] MFA Rules not processed for user `275cdb98ca7a48f68441d6c934740df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:17.515947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-01399d16-e12b-437f-bf9c-1d6b17b48dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:17.596080 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1090/2164] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:12:17.746016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:17.747903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:17.836096 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:17.938354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb72b-9fbc-4f1c-8b3e-f7f1fb7f098c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:17.964979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:17.965678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:17.965899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:17.966191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] PATH_INFO: `/v3/projects/b7864a40d26e402d815d39ef0c0f91a1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:17.967717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7864a40d26e402d815d39ef0c0f91a1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:17.969761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:18.148932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7864a40d26e402d815d39ef0c0f91a1', 'request_id': 'req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:18.168189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7864a40d26e402d815d39ef0c0f91a1', 'request_id': 'req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:18.247405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7864a40d26e402d815d39ef0c0f91a1', 'request_id': 'req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:18.269863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] The token cache is being invalidate because project b7864a40d26e402d815d39ef0c0f91a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:18.270222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:18.271301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-07f3cbb3-c8cb-4097-885b-51a2839c9ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:18.276730 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1075/2165] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:17 2022] DELETE /identity/v3/projects/b7864a40d26e402d815d39ef0c0f91a1 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:18.281004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989b2ed-06f4-485a-9f77-72b0dc813d19 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:18.281523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989b2ed-06f4-485a-9f77-72b0dc813d19 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:18.282007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989b2ed-06f4-485a-9f77-72b0dc813d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:18.309829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e989b2ed-06f4-485a-9f77-72b0dc813d19 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:18.312289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e989b2ed-06f4-485a-9f77-72b0dc813d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:18.325429 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:18.431293 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1091/2166] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:18.440575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ce0c5-23cc-4d37-a37e-ef626efd4692 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:18.441087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ce0c5-23cc-4d37-a37e-ef626efd4692 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:18.441904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ce0c5-23cc-4d37-a37e-ef626efd4692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:18.502654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-150ce0c5-23cc-4d37-a37e-ef626efd4692 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:18.504089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-150ce0c5-23cc-4d37-a37e-ef626efd4692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:18.519660 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1076/2167] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:18.523150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989b2ed-06f4-485a-9f77-72b0dc813d19 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:18.552164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989b2ed-06f4-485a-9f77-72b0dc813d19 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:18.565161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:18.567348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:18.567837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:18.568096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:18.568976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:12:18.569435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:18.571864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:18.592262 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1092/2168] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:12:18.596254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ce0c5-23cc-4d37-a37e-ef626efd4692 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:18.608938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ce0c5-23cc-4d37-a37e-ef626efd4692 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:18.614692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:18.615325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:18.615747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:18.616027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:18.616680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:18.618632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:19.020741 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1077/2169] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:12:18 2022] POST /identity/v3/projects => generated 403 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:12:19.026737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:19.038730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b422c-64af-4cdc-a126-b377ed9815db admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:19.119042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:19.120235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.120515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.120783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.121680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:19.124112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:19.367378 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1093/2170] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:12:19 2022] POST /identity/v3/users => generated 302 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:12:19.371933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:19.382999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db866202-2ea3-47f0-9020-f7a47e60ab26 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:19.389886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:19.396230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.396230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.396230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.396230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:19.396230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:19.404482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1078/2171] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:19.408788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:19.438290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c3d5-def3-4edb-9d4e-09e8ede52019 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:19.443829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a9c2-d2ca-4b7d-b6a5-43af95a6fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:19.444446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a9c2-d2ca-4b7d-b6a5-43af95a6fb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.445079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a9c2-d2ca-4b7d-b6a5-43af95a6fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.445559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a9c2-d2ca-4b7d-b6a5-43af95a6fb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.446236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a9c2-d2ca-4b7d-b6a5-43af95a6fb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:19.448128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a9c2-d2ca-4b7d-b6a5-43af95a6fb09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:19.462316 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1094/2172] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:19.466449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:19.481639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4406-aa6b-4251-a2e4-735febbb5d5b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:19.491631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02ad57-3d51-4f70-b564-3f6c1a2b8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:19.492320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ad57-3d51-4f70-b564-3f6c1a2b8856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.492596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ad57-3d51-4f70-b564-3f6c1a2b8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.492869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ad57-3d51-4f70-b564-3f6c1a2b8856 admin admin] PATH_INFO: `/v3/projects/2f0500fdc4b14e1e89b5577611c223ce/users/8a33786fd18d48b489bc393242e455f3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.514094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02ad57-3d51-4f70-b564-3f6c1a2b8856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0500fdc4b14e1e89b5577611c223ce, user_id=8a33786fd18d48b489bc393242e455f3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:19.516821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02ad57-3d51-4f70-b564-3f6c1a2b8856 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:19.639957 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1079/2173] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:19 2022] PUT /identity/v3/projects/2f0500fdc4b14e1e89b5577611c223ce/users/8a33786fd18d48b489bc393242e455f3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:19.644912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.645421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.645526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.670045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:19.671256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:19.760780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1095/2174] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:19.761558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867804-0435-47ee-8421-e9107f853562 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.761558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867804-0435-47ee-8421-e9107f853562 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.761558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867804-0435-47ee-8421-e9107f853562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.768673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:19.785638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:19.805299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5c867804-0435-47ee-8421-e9107f853562 None None] MFA Rules not processed for user `f2f0cd89c777406a80fd964902948318`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:19.807561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c867804-0435-47ee-8421-e9107f853562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:19.834979 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:19.876585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ef6b-f1b9-4610-8e3a-0cddffaba953 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:19.880530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:19.881139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.881695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.882198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.897377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:19.899449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:19.906782 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1080/2175] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:19.913271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c867804-0435-47ee-8421-e9107f853562 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:19.914762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c867804-0435-47ee-8421-e9107f853562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:19.925007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1096/2176] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:19.933322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c867804-0435-47ee-8421-e9107f853562 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:19.940878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:19.941497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:19.941830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:19.942144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:19.942921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:19.945306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:20.051742 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1081/2177] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:12:19 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:20.055466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:20.065811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30a071-0e24-47b8-b4d5-d27d39be86e7 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:20.189605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:20.190264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:20.190766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:20.191046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:20.191688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:20.194002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:20.337383 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1097/2178] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:12:20 2022] POST /identity/v3/users => generated 309 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:20.341480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:20.367412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2acf-f096-4a17-a30b-e492dbcb3715 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:20.407329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:20.408084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:20.408247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:20.408519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:20.413412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:20.422521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:20.473345 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1082/2179] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:20.475776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:20.488559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f002f-c3c6-4a35-b06b-1b20be55683e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:20.496867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:20.496867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:20.496867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:20.500255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] PATH_INFO: `/v3/projects/d9c4e3906ddf43afa76f9a74367a01d6/users/1b0205975ea646ca841d76dec4e81414/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:20.522749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c4e3906ddf43afa76f9a74367a01d6, user_id=1b0205975ea646ca841d76dec4e81414, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:20.526833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:20.580341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:20.582545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:20.639886 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1098/2180] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:20 2022] PUT /identity/v3/projects/d9c4e3906ddf43afa76f9a74367a01d6/users/1b0205975ea646ca841d76dec4e81414/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:20.644295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:20.689216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be6ba6-8f01-4d7c-8828-260477a574f5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:20.725624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc726a-feff-47ff-b0b7-f3254e63fca9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:20.732437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:20.733963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:20.741849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:20.741849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:20.741849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:20.741849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:20.752363 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1099/2181] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:20.758541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:20.771089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a69b0-302c-480c-ba60-6cd62838603d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:20.776605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c9922-1c56-4ff2-8ee0-dba9d06c17ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:20.776788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc139-17a0-4db1-97c5-d92f0239ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:20.776901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9922-1c56-4ff2-8ee0-dba9d06c17ee service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:20.777174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9922-1c56-4ff2-8ee0-dba9d06c17ee service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:20.777378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc139-17a0-4db1-97c5-d92f0239ac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:20.777537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9922-1c56-4ff2-8ee0-dba9d06c17ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:20.778149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc139-17a0-4db1-97c5-d92f0239ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:20.778651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc139-17a0-4db1-97c5-d92f0239ac7e admin admin] PATH_INFO: `/v3/projects/d9c4e3906ddf43afa76f9a74367a01d6/users/1b0205975ea646ca841d76dec4e81414/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:20.779364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-218c9922-1c56-4ff2-8ee0-dba9d06c17ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:20.781359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc139-17a0-4db1-97c5-d92f0239ac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c4e3906ddf43afa76f9a74367a01d6, user_id=1b0205975ea646ca841d76dec4e81414, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:20.784155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc139-17a0-4db1-97c5-d92f0239ac7e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:20.797937 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1100/2182] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:20 2022] PUT /identity/v3/projects/d9c4e3906ddf43afa76f9a74367a01d6/users/1b0205975ea646ca841d76dec4e81414/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:20.831804 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:20.883511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c9922-1c56-4ff2-8ee0-dba9d06c17ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:20.886535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c9922-1c56-4ff2-8ee0-dba9d06c17ee service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:20.902211 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1083/2183] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:12:22.033529 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:23.584209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bc6c7-425e-40f4-9c80-0010783b7488 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:23.585116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bc6c7-425e-40f4-9c80-0010783b7488 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:23.585602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bc6c7-425e-40f4-9c80-0010783b7488 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:23.587617 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1101/2184] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:12:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:12:23.596762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bcbc8-4d62-42f1-b8f4-4fe08cf28d80 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:23.597339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bcbc8-4d62-42f1-b8f4-4fe08cf28d80 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:23.597437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bcbc8-4d62-42f1-b8f4-4fe08cf28d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:23.633665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d95bcbc8-4d62-42f1-b8f4-4fe08cf28d80 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:23.635613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d95bcbc8-4d62-42f1-b8f4-4fe08cf28d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:23.802798 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1084/2185] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:23.840774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bc6c7-425e-40f4-9c80-0010783b7488 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:23.842604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d71bc6c7-425e-40f4-9c80-0010783b7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:23.870997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bc6c7-425e-40f4-9c80-0010783b7488 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:23.888618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:23.889235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:23.889683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:23.890136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:23.909877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:23.911662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:23.927120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1102/2186] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:24.058457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34eb90-7ed9-42c5-a2d6-42d51350d5ad None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:24.058793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34eb90-7ed9-42c5-a2d6-42d51350d5ad None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:24.059029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34eb90-7ed9-42c5-a2d6-42d51350d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:24.091598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bd34eb90-7ed9-42c5-a2d6-42d51350d5ad None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:24.093107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd34eb90-7ed9-42c5-a2d6-42d51350d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:24.207757 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1085/2187] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:24.273853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:24.276654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:24.390742 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:24.436426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35107c4a-a5f9-4461-8103-6ec4da30c94e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:24.451499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539fdb3-3d7c-4189-b696-a39addd80abc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:24.451499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539fdb3-3d7c-4189-b696-a39addd80abc service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:24.451499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539fdb3-3d7c-4189-b696-a39addd80abc service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:24.451499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539fdb3-3d7c-4189-b696-a39addd80abc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:24.472156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539fdb3-3d7c-4189-b696-a39addd80abc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:24.478607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539fdb3-3d7c-4189-b696-a39addd80abc service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:24.501367 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1103/2188] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:12:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:12:24.567319 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:25.033728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f41af-bd83-4ff4-a351-14d708758817 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:25.033728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f41af-bd83-4ff4-a351-14d708758817 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:25.033728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f41af-bd83-4ff4-a351-14d708758817 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:25.034896 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1086/2189] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:12:25.048845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:25.049661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:25.050283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:25.093766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:25.099194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:25.305912 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1104/2190] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:25.341379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f41af-bd83-4ff4-a351-14d708758817 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:25.350055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f41af-bd83-4ff4-a351-14d708758817 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:25.370017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9854f-d80f-4517-8c52-2d2530efa10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:25.372453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9854f-d80f-4517-8c52-2d2530efa10e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:25.374792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9854f-d80f-4517-8c52-2d2530efa10e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:25.375236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9854f-d80f-4517-8c52-2d2530efa10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:25.415307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9854f-d80f-4517-8c52-2d2530efa10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:25.421371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9854f-d80f-4517-8c52-2d2530efa10e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:25.476418 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1087/2191] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:26.544777 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:27.402154 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:28.664812 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:29.292968 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:31.198765 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:32.030065 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:32.335349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:32.339930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:32.559114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a9994-09e6-4cee-a9af-ab9fc5e1a375 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:32.573859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:32.577429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:32.577757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:32.578153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] PATH_INFO: `/v3/users/76739eabf8804ec2af41abc4c1e6fd4b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:32.580506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] RBAC: Authorizing `identity:delete_user(user_id=76739eabf8804ec2af41abc4c1e6fd4b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:32.586853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:32.864427 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:32.912758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76739eabf8804ec2af41abc4c1e6fd4b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:32.947937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76739eabf8804ec2af41abc4c1e6fd4b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:32.950933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76739eabf8804ec2af41abc4c1e6fd4b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:33.049835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76739eabf8804ec2af41abc4c1e6fd4b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:33.050501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76739eabf8804ec2af41abc4c1e6fd4b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:33.083113 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1105/2192] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:12:32 2022] DELETE /identity/v3/users/76739eabf8804ec2af41abc4c1e6fd4b => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:33.088900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:33.092420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:33.092420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:33.133575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:33.147033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:33.339648 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:33.364829 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1088/2193] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:33.393496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:33.395239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:33.548331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348512d-5260-41a3-98cd-0e524d4323be admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:33.555082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:33.556731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:33.557339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:33.558288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:33.576157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:33.578148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:33.599225 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1106/2194] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:34.572482 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:34.948049 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:35.089505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:35.091824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:35.115223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0fdbb-53ef-4334-9c6e-e559d0f36631 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:35.127642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:35.128298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:35.132558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:35.132848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] PATH_INFO: `/v3/projects/23f22fb0ca7346c4ab225ce82d69118c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:35.135667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f22fb0ca7346c4ab225ce82d69118c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:35.144445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:35.338367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f22fb0ca7346c4ab225ce82d69118c', 'request_id': 'req-eb865b5e-026e-4b5f-9c27-70aa992ed176'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.356019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f22fb0ca7346c4ab225ce82d69118c', 'request_id': 'req-eb865b5e-026e-4b5f-9c27-70aa992ed176'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.497819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f22fb0ca7346c4ab225ce82d69118c', 'request_id': 'req-eb865b5e-026e-4b5f-9c27-70aa992ed176'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.515024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] The token cache is being invalidate because project 23f22fb0ca7346c4ab225ce82d69118c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:35.515334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.516116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eb865b5e-026e-4b5f-9c27-70aa992ed176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.522905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:35.529223 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1089/2195] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:35 2022] DELETE /identity/v3/projects/23f22fb0ca7346c4ab225ce82d69118c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:35.536153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea086ff-a5cd-4623-90af-55ee99ddd919 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:35.637203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:35.638731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:35.639197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:35.639702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] PATH_INFO: `/v3/users/9ab6e1b0016a4959958deda4467ef3e5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:35.644513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab6e1b0016a4959958deda4467ef3e5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:35.647476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:35.721291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:35.721945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:35.723932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:35.784442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] MFA Rules not processed for user `8a33786fd18d48b489bc393242e455f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:35.786877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:35.920465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab6e1b0016a4959958deda4467ef3e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.926352 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:35.938539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab6e1b0016a4959958deda4467ef3e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.940300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab6e1b0016a4959958deda4467ef3e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:35.986077 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1090/2196] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:12:36.060014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab6e1b0016a4959958deda4467ef3e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:36.060862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab6e1b0016a4959958deda4467ef3e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:36.143629 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1107/2197] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:12:35 2022] DELETE /identity/v3/users/9ab6e1b0016a4959958deda4467ef3e5 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:36.154761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:36.156425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:36.393595 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:36.402974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29998e8-10fa-47b3-9219-308bcd0e639c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:36.566900 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:36.654783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248ad08-c615-4217-a022-dfafe73fbff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:36.655503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248ad08-c615-4217-a022-dfafe73fbff7 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:36.655789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248ad08-c615-4217-a022-dfafe73fbff7 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:36.656059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248ad08-c615-4217-a022-dfafe73fbff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:36.667208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b248ad08-c615-4217-a022-dfafe73fbff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:36.794875 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:36.854286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248ad08-c615-4217-a022-dfafe73fbff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:36.863798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248ad08-c615-4217-a022-dfafe73fbff7 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:36.891185 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1091/2198] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:12:37.964682 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:38.104769 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:38.513933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:38.515871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:38.677278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355aa2a-48b1-48a2-ad8f-3482337c74cd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:38.693735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:38.716092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:38.716394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:38.716638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] PATH_INFO: `/v3/projects/cb3dfb94faab4c4eab8d74725c976780` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:38.718748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3dfb94faab4c4eab8d74725c976780)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:38.720977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:38.975077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3dfb94faab4c4eab8d74725c976780', 'request_id': 'req-171af645-c124-47cc-b74d-23f0bb489489'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:38.987158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3dfb94faab4c4eab8d74725c976780', 'request_id': 'req-171af645-c124-47cc-b74d-23f0bb489489'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:39.075981 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:39.076833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3dfb94faab4c4eab8d74725c976780', 'request_id': 'req-171af645-c124-47cc-b74d-23f0bb489489'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:39.094738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] The token cache is being invalidate because project cb3dfb94faab4c4eab8d74725c976780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:39.095017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:39.098593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-171af645-c124-47cc-b74d-23f0bb489489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:39.101662 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1108/2199] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:38 2022] DELETE /identity/v3/projects/cb3dfb94faab4c4eab8d74725c976780 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:39.106879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc77aa-68c9-485c-a294-87e4169c57db None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:39.107356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc77aa-68c9-485c-a294-87e4169c57db None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:39.107437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc77aa-68c9-485c-a294-87e4169c57db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:39.144407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-62fc77aa-68c9-485c-a294-87e4169c57db None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:39.146772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62fc77aa-68c9-485c-a294-87e4169c57db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:39.166826 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:39.182601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb98cf-1fd2-42ba-8cc8-4e31fd23e839 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:39.182918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb98cf-1fd2-42ba-8cc8-4e31fd23e839 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:39.183705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb98cf-1fd2-42ba-8cc8-4e31fd23e839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:39.248242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d8bb98cf-1fd2-42ba-8cc8-4e31fd23e839 None None] MFA Rules not processed for user `1b0205975ea646ca841d76dec4e81414`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:39.249478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d8bb98cf-1fd2-42ba-8cc8-4e31fd23e839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:39.293587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1092/2200] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:39.303264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1acb-41d1-4c17-adfc-39a9d2389f44 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:39.303691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1acb-41d1-4c17-adfc-39a9d2389f44 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:39.304490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1acb-41d1-4c17-adfc-39a9d2389f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:39.336394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a0ba1acb-41d1-4c17-adfc-39a9d2389f44 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:39.337907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a0ba1acb-41d1-4c17-adfc-39a9d2389f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:39.354286 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1093/2201] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:12:39.359275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1acb-41d1-4c17-adfc-39a9d2389f44 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:39.374550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1acb-41d1-4c17-adfc-39a9d2389f44 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:39.382193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:39.384635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:39.385140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:39.387919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:39.388951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:12:39.394896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:39.394896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:39.412325 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1094/2202] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:12:39.417120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:39.435643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf137-f545-4b52-ab76-3f393ec47932 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:39.450856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:39.452660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:39.454289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:39.454690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:39.456486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:39.462908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:39.477244 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1109/2203] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:12:39.524627 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:39.610695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1095/2204] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:12:39 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:39.614854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb98cf-1fd2-42ba-8cc8-4e31fd23e839 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:39.638100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb98cf-1fd2-42ba-8cc8-4e31fd23e839 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:39.869266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:39.870283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:39.870577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:39.870855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:39.871520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:39.873552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:40.006895 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1110/2205] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:12:39 2022] POST /identity/v3/users => generated 287 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:40.024809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:40.043547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517144e-cecd-48e0-a81e-05b135dd17e3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:40.069303 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:40.070776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:40.073139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:40.073424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:40.073696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:40.074426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:40.083558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:40.103714 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:40.110576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1096/2206] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:40.115193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:40.131650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620d028-e681-4742-b493-745554dcc694 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:40.146270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18535bbb-b83e-40f0-81b7-b58865c01c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:40.146989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18535bbb-b83e-40f0-81b7-b58865c01c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:40.147274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18535bbb-b83e-40f0-81b7-b58865c01c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:40.147554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18535bbb-b83e-40f0-81b7-b58865c01c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:40.149485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18535bbb-b83e-40f0-81b7-b58865c01c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:40.151161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18535bbb-b83e-40f0-81b7-b58865c01c81 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:40.185347 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1111/2207] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:40.187449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:40.206875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df2eda-da89-4c83-b21f-f8732d89f995 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:40.220873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:40.221596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:40.225410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:40.225702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] PATH_INFO: `/v3/projects/2c7dd098e2ef45a7991d5bcb874f9e7e/users/0c8aeb8490684140983d6d94c954e5dd/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:40.263437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7dd098e2ef45a7991d5bcb874f9e7e, user_id=0c8aeb8490684140983d6d94c954e5dd, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:40.269950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:40.359551 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1097/2208] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:40 2022] PUT /identity/v3/projects/2c7dd098e2ef45a7991d5bcb874f9e7e/users/0c8aeb8490684140983d6d94c954e5dd/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:40.370912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eeb20-a76c-4d4d-902c-8c80daa19b7f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:40.371194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eeb20-a76c-4d4d-902c-8c80daa19b7f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:40.371481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eeb20-a76c-4d4d-902c-8c80daa19b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:40.381645 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:40.446463 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:40.460054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3d3eeb20-a76c-4d4d-902c-8c80daa19b7f None None] MFA Rules not processed for user `0c8aeb8490684140983d6d94c954e5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:40.467618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d3eeb20-a76c-4d4d-902c-8c80daa19b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:40.681841 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1112/2209] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:40.686250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:40.748486 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:40.892478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8092cc-97ac-4723-8bf8-5b27ead60a44 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:40.905416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:40.906307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:40.906748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:40.907026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:40.909952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:40.927406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:41.086273 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1098/2210] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:12:40 2022] POST /identity/v3/projects => generated 375 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:41.089034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eeb20-a76c-4d4d-902c-8c80daa19b7f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:41.117555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eeb20-a76c-4d4d-902c-8c80daa19b7f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:41.264807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:41.265713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:41.266013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:41.266947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:41.267606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:41.269564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:41.282687 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:41.430484 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1113/2211] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:12:41 2022] POST /identity/v3/users => generated 294 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:41.437641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:41.450995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792c729-3442-4e3e-8434-f5fc240c7976 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:41.457960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:41.462895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:41.463228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:41.463521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:41.464390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:41.466302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:41.528536 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1099/2212] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:41.550182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:41.570468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa3ac-3443-43bd-a471-358640114ccc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:41.600128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:41.601167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:41.602528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:41.603674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] PATH_INFO: `/v3/projects/cd0af5fc11454dc2b99ef6ef00ee471c/users/db4c43f70ab740a2bc3e3fbaff27f888/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:41.676972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0af5fc11454dc2b99ef6ef00ee471c, user_id=db4c43f70ab740a2bc3e3fbaff27f888, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:41.683386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:42.216562 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1114/2213] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:41 2022] PUT /identity/v3/projects/cd0af5fc11454dc2b99ef6ef00ee471c/users/db4c43f70ab740a2bc3e3fbaff27f888/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:12:42.221319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:42.236556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7380345-62bb-4c75-abb6-555d5799cace admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:42.339954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f28eb-7fcc-4743-ba23-2bb3b2d8baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:42.340233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f28eb-7fcc-4743-ba23-2bb3b2d8baa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:42.340457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f28eb-7fcc-4743-ba23-2bb3b2d8baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:42.340708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f28eb-7fcc-4743-ba23-2bb3b2d8baa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:42.341355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f28eb-7fcc-4743-ba23-2bb3b2d8baa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:42.342977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f28eb-7fcc-4743-ba23-2bb3b2d8baa9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:42.360309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1100/2214] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:42.368013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:42.390520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139348a-f2f5-4067-94e8-aaf89e94449b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:42.396796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:42.400141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:42.400517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:42.400726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] PATH_INFO: `/v3/projects/cd0af5fc11454dc2b99ef6ef00ee471c/users/db4c43f70ab740a2bc3e3fbaff27f888/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:42.423126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0af5fc11454dc2b99ef6ef00ee471c, user_id=db4c43f70ab740a2bc3e3fbaff27f888, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:42.429878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:42.465104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1115/2215] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:42 2022] PUT /identity/v3/projects/cd0af5fc11454dc2b99ef6ef00ee471c/users/db4c43f70ab740a2bc3e3fbaff27f888/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:42.467698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12f93-13e7-4e22-aeec-c79b2f863441 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:42.468637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12f93-13e7-4e22-aeec-c79b2f863441 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:42.469194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12f93-13e7-4e22-aeec-c79b2f863441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:42.506300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0ea12f93-13e7-4e22-aeec-c79b2f863441 None None] MFA Rules not processed for user `db4c43f70ab740a2bc3e3fbaff27f888`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:42.507783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ea12f93-13e7-4e22-aeec-c79b2f863441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:42.715739 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1101/2216] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:42.814635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:42.817259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:42.823490 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:43.028644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e682c-e935-4f3f-a58f-66b555f2fec5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:43.050659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:43.051864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:43.054182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:43.055545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:43.088689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:43.091577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:43.122740 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1116/2217] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:43.217946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12f93-13e7-4e22-aeec-c79b2f863441 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:43.236180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12f93-13e7-4e22-aeec-c79b2f863441 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:43.245796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:43.246647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:43.247031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:43.247436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:43.361165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:43.363209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:43.392170 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1102/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:43.497805 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:43.880278 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:44.188693 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:44.632786 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:45.237292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:45.409215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1349-e3b0-47c1-9f3b-6a731a7d998f service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:45.423555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:45.424222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:45.424504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:45.424770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] PATH_INFO: `/v3/users/0c8aeb8490684140983d6d94c954e5dd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:45.426918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8aeb8490684140983d6d94c954e5dd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:45.429532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:45.605893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:45.627691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f9ace-f144-4bb2-b445-5d2b5ad5d9d9 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:45.658385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:45.659022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:45.659306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:45.661676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:45.673368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:45.728652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8aeb8490684140983d6d94c954e5dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:45.749506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8aeb8490684140983d6d94c954e5dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:45.751319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8aeb8490684140983d6d94c954e5dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:45.872535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8aeb8490684140983d6d94c954e5dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:45.873255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6c1f7e9-19d2-4231-a0a4-8d78f8afc301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8aeb8490684140983d6d94c954e5dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:45.911722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:45.913496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:45.918412 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1117/2219] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:12:45 2022] DELETE /identity/v3/users/0c8aeb8490684140983d6d94c954e5dd => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:45.920342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:45.920630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:45.920900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:45.929429 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1103/2220] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:45.965562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:45.969876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:45.999189 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:46.137956 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1118/2221] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:12:46.154044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:46.158949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:46.329600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb0a9-bb1f-40f9-bf5b-c0e5e1a88cdd service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:46.492670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:46.493516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:46.493799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:46.494179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:46.518181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:46.519683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:46.545582 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1104/2222] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:47.413722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:47.416978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:47.490270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e86614-fe2a-4306-9979-7e03cb89eece None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:47.497890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:47.499392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:47.499969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:47.500295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] PATH_INFO: `/v3/projects/2c7dd098e2ef45a7991d5bcb874f9e7e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:47.501592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7dd098e2ef45a7991d5bcb874f9e7e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:47.505259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:47.624449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7dd098e2ef45a7991d5bcb874f9e7e', 'request_id': 'req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:47.630790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7dd098e2ef45a7991d5bcb874f9e7e', 'request_id': 'req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:47.701427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7dd098e2ef45a7991d5bcb874f9e7e', 'request_id': 'req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:47.732784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] The token cache is being invalidate because project 2c7dd098e2ef45a7991d5bcb874f9e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:47.733095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:47.733800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:47.736118 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1119/2223] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:47 2022] DELETE /identity/v3/projects/2c7dd098e2ef45a7991d5bcb874f9e7e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:47.739878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:47.751333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622d4c9-ee82-48b8-b236-3c48c08199d9 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:47.822517 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:47.843739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:47.844754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:47.845254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:47.845758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] PATH_INFO: `/v3/users/db4c43f70ab740a2bc3e3fbaff27f888` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:47.851128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4c43f70ab740a2bc3e3fbaff27f888)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:47.869502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:48.129601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4c43f70ab740a2bc3e3fbaff27f888'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:48.139150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4c43f70ab740a2bc3e3fbaff27f888'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:48.142571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4c43f70ab740a2bc3e3fbaff27f888'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:48.255975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4c43f70ab740a2bc3e3fbaff27f888'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:48.256950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e52d8f23-0602-4077-b9b1-9af0acaf1601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4c43f70ab740a2bc3e3fbaff27f888'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:48.304329 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1105/2224] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:12:47 2022] DELETE /identity/v3/users/db4c43f70ab740a2bc3e3fbaff27f888 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:49.684580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:49.686056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:49.711693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e10107-1948-4bd6-a8d0-b4b23d89c56d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:49.881016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:49.881673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:49.895215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:49.895215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] PATH_INFO: `/v3/projects/cd0af5fc11454dc2b99ef6ef00ee471c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:49.896876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0af5fc11454dc2b99ef6ef00ee471c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:49.901028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:50.457810 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:50.461384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0af5fc11454dc2b99ef6ef00ee471c', 'request_id': 'req-257bdf70-1164-402c-8b67-884cc83e9cd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:50.468319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0af5fc11454dc2b99ef6ef00ee471c', 'request_id': 'req-257bdf70-1164-402c-8b67-884cc83e9cd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:50.671155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0af5fc11454dc2b99ef6ef00ee471c', 'request_id': 'req-257bdf70-1164-402c-8b67-884cc83e9cd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:50.687906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] The token cache is being invalidate because project cd0af5fc11454dc2b99ef6ef00ee471c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:50.690181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:50.691123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-257bdf70-1164-402c-8b67-884cc83e9cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:50.704835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1120/2225] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:49 2022] DELETE /identity/v3/projects/cd0af5fc11454dc2b99ef6ef00ee471c => generated 0 bytes in 1010 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:50.706837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ecedf-b24b-4ed6-a199-9b012f31cc81 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:50.706837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ecedf-b24b-4ed6-a199-9b012f31cc81 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:50.706837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ecedf-b24b-4ed6-a199-9b012f31cc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:50.737205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-620ecedf-b24b-4ed6-a199-9b012f31cc81 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:50.738796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-620ecedf-b24b-4ed6-a199-9b012f31cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:50.906147 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1106/2226] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:50.915349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6323a-270f-4bc0-89a1-31187ebd9be4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:50.916652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6323a-270f-4bc0-89a1-31187ebd9be4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:50.917005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6323a-270f-4bc0-89a1-31187ebd9be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:50.951005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e0f6323a-270f-4bc0-89a1-31187ebd9be4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:50.952428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0f6323a-270f-4bc0-89a1-31187ebd9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:50.967784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1121/2227] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:50.972020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ecedf-b24b-4ed6-a199-9b012f31cc81 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:50.983910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ecedf-b24b-4ed6-a199-9b012f31cc81 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:50.994158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:50.995106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:50.995553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:50.996096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:50.996894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:12:50.997357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:50.999131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:51.025384 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1107/2228] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:12:51.030951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6323a-270f-4bc0-89a1-31187ebd9be4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:51.042164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6323a-270f-4bc0-89a1-31187ebd9be4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:51.068334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:51.069275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.071357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.071797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.072899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:51.075756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:51.225275 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1122/2229] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:12:51 2022] POST /identity/v3/projects => generated 397 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:51.229564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:51.244255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072f17a-6bc8-49cb-9257-d805261c8765 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:51.347449 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:51.361726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:51.362531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.362843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.363599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.364624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:51.366901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:51.487075 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1108/2230] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:12:51 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:51.489176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:51.500543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841beff-aa61-478f-a1fd-09a8f9054d47 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:51.526493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:51.527636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.528143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.528677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.529932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:51.532372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:51.564098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1123/2231] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:51.566828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:51.577903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1edac3-1966-4df5-b245-65ec79a8c898 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:51.583078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fb18b-636d-45e0-97ac-59255de47b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:51.591207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fb18b-636d-45e0-97ac-59255de47b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.591207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fb18b-636d-45e0-97ac-59255de47b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.591207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fb18b-636d-45e0-97ac-59255de47b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.591207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fb18b-636d-45e0-97ac-59255de47b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:51.591207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fb18b-636d-45e0-97ac-59255de47b19 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:51.597567 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1109/2232] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:51.605237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:51.615903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52797-2b23-4bb3-9b67-c30a1a4a9106 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:51.621008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae23fe-34dd-4b78-9a41-090d374d2d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:51.621771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae23fe-34dd-4b78-9a41-090d374d2d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.621898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae23fe-34dd-4b78-9a41-090d374d2d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.622628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae23fe-34dd-4b78-9a41-090d374d2d2c admin admin] PATH_INFO: `/v3/projects/ccc52d9ecfdf43f58b665d06e1008b52/users/8a246c84d8f444d59c9d5becae78f75a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.638637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae23fe-34dd-4b78-9a41-090d374d2d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc52d9ecfdf43f58b665d06e1008b52, user_id=8a246c84d8f444d59c9d5becae78f75a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:51.641390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae23fe-34dd-4b78-9a41-090d374d2d2c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:51.794086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef845f-4370-4b09-824b-1372efb37181 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.794613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef845f-4370-4b09-824b-1372efb37181 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.794613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef845f-4370-4b09-824b-1372efb37181 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.796561 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1110/2233] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:12:51.821772 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1124/2234] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:51 2022] PUT /identity/v3/projects/ccc52d9ecfdf43f58b665d06e1008b52/users/8a246c84d8f444d59c9d5becae78f75a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:51.829764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.829764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.829764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.841471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:51.841751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:51.842278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:51.856026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:51.857296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:51.865279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:51.866597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:51.964246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1125/2235] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:51.966921 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1111/2236] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:51.979400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:51.981547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:51.989314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:51.991390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:52.011140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d8ab-752f-432f-9191-5a3b3bd13b73 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:52.018524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:52.019585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:52.020064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:52.020583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:52.033514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:52.036066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:52.048419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1112/2237] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:12:52.081308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6ceba-c369-406f-9b83-c3216f0e648a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:52.085216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:52.085829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:52.086668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:52.086935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:52.097430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:52.101346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:52.115613 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1126/2238] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:12:52.975862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:52.977339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:52.999551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6054596-4acb-4919-801a-24c78009bd42 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:53.005210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:53.006222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:53.011327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:53.011327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] PATH_INFO: `/v3/users/8a33786fd18d48b489bc393242e455f3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:53.011327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a33786fd18d48b489bc393242e455f3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:53.012848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:53.263616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a33786fd18d48b489bc393242e455f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:53.271632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a33786fd18d48b489bc393242e455f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:53.272697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a33786fd18d48b489bc393242e455f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:53.370118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a33786fd18d48b489bc393242e455f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:53.371002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ac899cf-ace4-4c70-a167-2f410602f01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a33786fd18d48b489bc393242e455f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:53.396105 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1113/2239] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:12:52 2022] DELETE /identity/v3/users/8a33786fd18d48b489bc393242e455f3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:53.760199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:53.774501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47acdb6-295f-408a-a89c-bd781c128af5 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:53.786746 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:53.859221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:53.860024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:53.860406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:53.860770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] PATH_INFO: `/v3/projects/2f0500fdc4b14e1e89b5577611c223ce` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:53.862261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0500fdc4b14e1e89b5577611c223ce)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:53.864369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:54.036347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0500fdc4b14e1e89b5577611c223ce', 'request_id': 'req-b9adc7a4-44b2-473a-9363-3465e0fc8364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:54.048142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0500fdc4b14e1e89b5577611c223ce', 'request_id': 'req-b9adc7a4-44b2-473a-9363-3465e0fc8364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:54.133699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0500fdc4b14e1e89b5577611c223ce', 'request_id': 'req-b9adc7a4-44b2-473a-9363-3465e0fc8364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:54.152807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] The token cache is being invalidate because project 2f0500fdc4b14e1e89b5577611c223ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:12:54.153245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:54.154096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9adc7a4-44b2-473a-9363-3465e0fc8364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:12:54.162387 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1127/2240] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:12:53 2022] DELETE /identity/v3/projects/2f0500fdc4b14e1e89b5577611c223ce => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:12:54.168154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2bed-c837-40d3-a8c5-56f5785a52a2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:54.168695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2bed-c837-40d3-a8c5-56f5785a52a2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:54.168695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e2bed-c837-40d3-a8c5-56f5785a52a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:54.193403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0b4e2bed-c837-40d3-a8c5-56f5785a52a2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:54.195040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0b4e2bed-c837-40d3-a8c5-56f5785a52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:54.259730 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:54.340294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a70c-2da0-4e52-8727-13db8e035656 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:54.340780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a70c-2da0-4e52-8727-13db8e035656 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:54.341206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a70c-2da0-4e52-8727-13db8e035656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:54.341425 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1114/2241] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:54.376305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1156a70c-2da0-4e52-8727-13db8e035656 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:54.379168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1156a70c-2da0-4e52-8727-13db8e035656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:54.389152 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1128/2242] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:54.394509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2bed-c837-40d3-a8c5-56f5785a52a2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:54.407855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e2bed-c837-40d3-a8c5-56f5785a52a2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:54.416575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:54.417439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:54.418048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:54.418507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:54.420361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:12:54.421186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:54.424020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:54.445620 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1115/2243] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:12:54.451041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156a70c-2da0-4e52-8727-13db8e035656 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:54.475721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156a70c-2da0-4e52-8727-13db8e035656 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:54.482611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:54.483353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:54.483700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:54.484074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:54.484823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:54.486908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:54.594621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:54.608243 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1129/2244] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:12:54 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:54.617684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79af2b-9be9-44e1-8a65-659e6d657dd1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:54.734014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:54.734014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:54.734014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:54.736907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:54.737612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:54.741817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:54.859168 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1116/2245] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:12:54 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:12:54.863049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:54.875647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef721-919d-497f-8e54-7e9ca83d15ac admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:54.884536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:54.885270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:54.885774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:54.887518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:54.888807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:54.891813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:54.926772 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1130/2246] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:54.931576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:54.978300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e955a8-5a75-4314-9c47-770c36d91c41 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:54.988582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a10af4-db9a-46d1-92b6-494bb3af6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:54.993587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10af4-db9a-46d1-92b6-494bb3af6b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:54.993587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10af4-db9a-46d1-92b6-494bb3af6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:54.993587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10af4-db9a-46d1-92b6-494bb3af6b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:54.993587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a10af4-db9a-46d1-92b6-494bb3af6b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:54.994724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a10af4-db9a-46d1-92b6-494bb3af6b09 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:55.022385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:55.024965 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1117/2247] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:12:55.034883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ecb0f-eef8-4fa7-9b8a-07df67efe79e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:55.056271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:55.057382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:55.057723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:55.058261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] PATH_INFO: `/v3/projects/abc8f8cefbf441c98d6bda76e99e3173/users/7262d5984b8c4775b86fae1c0d314718/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:55.097229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc8f8cefbf441c98d6bda76e99e3173, user_id=7262d5984b8c4775b86fae1c0d314718, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:55.101306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:55.207298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1131/2248] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:12:55 2022] PUT /identity/v3/projects/abc8f8cefbf441c98d6bda76e99e3173/users/7262d5984b8c4775b86fae1c0d314718/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:12:55.209314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:55.209770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:55.210014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:55.288361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:12:55.291204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:55.394464 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1118/2249] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:12:55.431466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:12:55.447553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:12:55.529901 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:12:55.555996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3e1b-7bfc-4111-a0fc-00c70158ff12 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:12:55.559862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:12:55.560526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:12:55.560911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:12:55.562327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:12:55.574536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:12:55.574963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:12:55.586677 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1132/2250] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:01.852869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:01.855292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:01.906114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5153d1-f642-46fb-86ad-8c70cafc6ef7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:01.922027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:01.923716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:01.923862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:01.924144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] PATH_INFO: `/v3/users/f2f0cd89c777406a80fd964902948318` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:01.929297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f0cd89c777406a80fd964902948318)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:01.931879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:02.142169 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:02.172779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f0cd89c777406a80fd964902948318'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:02.188062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f0cd89c777406a80fd964902948318'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:02.189301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f0cd89c777406a80fd964902948318'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:02.321230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f0cd89c777406a80fd964902948318'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:02.322399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9be70598-f716-42aa-824c-e30db3b584fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f0cd89c777406a80fd964902948318'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:02.397552 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1119/2251] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:01 2022] DELETE /identity/v3/users/f2f0cd89c777406a80fd964902948318 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:03.054391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:03.071860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31e36d-251b-4dd1-90ab-3a55eb491988 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:03.142996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:03.144157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:03.144600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:03.176110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:03.177351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:03.243585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:03.244747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:03.245259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:03.245720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] PATH_INFO: `/v3/projects/b50714dd87a64061a967ebd8bed2008c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:03.248864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50714dd87a64061a967ebd8bed2008c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:03.253091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:03.304448 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1120/2252] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:03.321260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:03.326936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:03.414964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50714dd87a64061a967ebd8bed2008c', 'request_id': 'req-cee61da1-579b-4440-a2f4-e55c6f084593'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:03.446585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50714dd87a64061a967ebd8bed2008c', 'request_id': 'req-cee61da1-579b-4440-a2f4-e55c6f084593'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:03.460161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05419e4-96ce-47a0-9752-93b8bb857932 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:03.515312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50714dd87a64061a967ebd8bed2008c', 'request_id': 'req-cee61da1-579b-4440-a2f4-e55c6f084593'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:03.540075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] The token cache is being invalidate because project b50714dd87a64061a967ebd8bed2008c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:13:03.540945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:03.543576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:03.550337 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1133/2253] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:13:03 2022] DELETE /identity/v3/projects/b50714dd87a64061a967ebd8bed2008c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:03.551092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10380e1d-76bf-4bdf-bb81-545c6baba3ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:03.552646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10380e1d-76bf-4bdf-bb81-545c6baba3ad service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:03.552646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10380e1d-76bf-4bdf-bb81-545c6baba3ad service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:03.552822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10380e1d-76bf-4bdf-bb81-545c6baba3ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:03.554848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-10380e1d-76bf-4bdf-bb81-545c6baba3ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:03.556928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:03.560755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:03.583933 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:03.655850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10380e1d-76bf-4bdf-bb81-545c6baba3ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:03.657476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10380e1d-76bf-4bdf-bb81-545c6baba3ad service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:03.671145 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1121/2254] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:03.739536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee61da1-579b-4440-a2f4-e55c6f084593 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:03.754881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:03.755162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:03.755440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:03.757240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:03.759004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:03.759595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:03.760350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] PATH_INFO: `/v3/users/1b0205975ea646ca841d76dec4e81414` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:03.762157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0205975ea646ca841d76dec4e81414)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:03.766845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:03.777091 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:03.794141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] MFA Rules not processed for user `8a246c84d8f444d59c9d5becae78f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:03.796570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:03.982553 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1122/2255] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:03.983515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:03.984368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0205975ea646ca841d76dec4e81414'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:03.985700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:04.016548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8b4a-4154-4aca-b682-a63b2f441123 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:04.019124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0205975ea646ca841d76dec4e81414'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:04.025170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0205975ea646ca841d76dec4e81414'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:04.030905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:04.031722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:04.032005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:04.032315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:04.033019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:04.035074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:04.097513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0205975ea646ca841d76dec4e81414'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:04.098230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0205975ea646ca841d76dec4e81414'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:04.146141 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1134/2256] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:03 2022] DELETE /identity/v3/users/1b0205975ea646ca841d76dec4e81414 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:04.180650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1123/2257] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:13:03 2022] POST /identity/v3/projects => generated 395 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:04.181807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:04.183324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:04.358649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea79c-ddba-4df6-86c2-fa952c48c952 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:04.496226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:04.497064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:04.497602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:04.497889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:04.498973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:04.502472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:04.615896 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1135/2258] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:13:04 2022] POST /identity/v3/users => generated 304 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:13:04.618153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:04.636246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22c4e-7e3e-483b-9399-9d3ca0c86a67 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:04.654221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:04.654857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:04.655132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:04.655402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:04.656226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:04.658255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:04.694914 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1124/2259] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:04.696254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:04.707175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29052-cb4a-47d0-be14-9b0cb817bb8c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:04.728870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:04.729601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:04.729872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:04.730169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] PATH_INFO: `/v3/projects/90adb0e31b8c49358db1ae0ca8ecc95b/users/ff85df41240b436c919d2ada7179e222/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:04.770556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90adb0e31b8c49358db1ae0ca8ecc95b, user_id=ff85df41240b436c919d2ada7179e222, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:04.778896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:04.855057 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1136/2260] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:04 2022] PUT /identity/v3/projects/90adb0e31b8c49358db1ae0ca8ecc95b/users/ff85df41240b436c919d2ada7179e222/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:13:04.859647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:04.888660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7cc8-626c-4cc3-95b9-e98ad2b894b1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:04.937581 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:05.047333 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:05.088164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd1a8f-e6bb-41c3-bc15-ad273f209e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:05.088945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd1a8f-e6bb-41c3-bc15-ad273f209e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:05.089465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd1a8f-e6bb-41c3-bc15-ad273f209e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:05.089716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd1a8f-e6bb-41c3-bc15-ad273f209e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:05.090491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd1a8f-e6bb-41c3-bc15-ad273f209e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:05.092644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd1a8f-e6bb-41c3-bc15-ad273f209e6e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:05.113583 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1125/2261] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:05.114640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:05.132293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb9844-87bb-43ea-8fb4-af3e64460917 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:05.140088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:05.159367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:05.161549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:05.161853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] PATH_INFO: `/v3/projects/90adb0e31b8c49358db1ae0ca8ecc95b/users/ff85df41240b436c919d2ada7179e222/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:05.173097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90adb0e31b8c49358db1ae0ca8ecc95b, user_id=ff85df41240b436c919d2ada7179e222, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:05.182242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:05.207945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1137/2262] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:05 2022] PUT /identity/v3/projects/90adb0e31b8c49358db1ae0ca8ecc95b/users/ff85df41240b436c919d2ada7179e222/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:05.680528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52817-cf25-4642-bb5c-c45b1a571e14 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:05.681232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52817-cf25-4642-bb5c-c45b1a571e14 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:05.681232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52817-cf25-4642-bb5c-c45b1a571e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:05.732025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c6f52817-cf25-4642-bb5c-c45b1a571e14 None None] MFA Rules not processed for user `1c2310cbc3574eb29a6ca6291ba7808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:05.734695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c6f52817-cf25-4642-bb5c-c45b1a571e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:05.883016 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1126/2263] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:06.196962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:06.199490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:06.372213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635836-e06e-4134-b8ae-f661d02efca3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:06.383871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:06.387492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:06.388057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:06.389058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] PATH_INFO: `/v3/projects/d9c4e3906ddf43afa76f9a74367a01d6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:06.395279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c4e3906ddf43afa76f9a74367a01d6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:06.412048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:06.580901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c4e3906ddf43afa76f9a74367a01d6', 'request_id': 'req-2218abd6-844a-48d2-b205-acadf3e7dbbd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:06.610617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c4e3906ddf43afa76f9a74367a01d6', 'request_id': 'req-2218abd6-844a-48d2-b205-acadf3e7dbbd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:06.735908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c4e3906ddf43afa76f9a74367a01d6', 'request_id': 'req-2218abd6-844a-48d2-b205-acadf3e7dbbd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:06.754500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] The token cache is being invalidate because project d9c4e3906ddf43afa76f9a74367a01d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:13:06.756011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:06.757198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2218abd6-844a-48d2-b205-acadf3e7dbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:06.760242 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1138/2264] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:13:06 2022] DELETE /identity/v3/projects/d9c4e3906ddf43afa76f9a74367a01d6 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:06.765826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c773a7-ae81-4c1c-a220-dbd1e0467186 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:06.766695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c773a7-ae81-4c1c-a220-dbd1e0467186 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:06.767561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c773a7-ae81-4c1c-a220-dbd1e0467186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:06.789214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d7c773a7-ae81-4c1c-a220-dbd1e0467186 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:06.790800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d7c773a7-ae81-4c1c-a220-dbd1e0467186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:06.922107 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1127/2265] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:06.929105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068298-349f-4e10-8c94-829463d6d071 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:06.929683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068298-349f-4e10-8c94-829463d6d071 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:06.930678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068298-349f-4e10-8c94-829463d6d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:07.001691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9d068298-349f-4e10-8c94-829463d6d071 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:07.007188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d068298-349f-4e10-8c94-829463d6d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:07.030422 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1139/2266] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:07.031634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c773a7-ae81-4c1c-a220-dbd1e0467186 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:07.052276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c773a7-ae81-4c1c-a220-dbd1e0467186 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:07.074934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:07.079434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:07.086433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:07.086433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:07.086433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:13:07.086433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:07.092248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:07.141285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1128/2267] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:13:07.142843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d068298-349f-4e10-8c94-829463d6d071 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:07.157353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d068298-349f-4e10-8c94-829463d6d071 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:07.168049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:07.168683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:07.168982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:07.169251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:07.171726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:07.173746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:07.334027 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1140/2268] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:13:07 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:07.338747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:07.352993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c814-6f06-4f44-be30-c93d0a0959e2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:07.597962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:07.598941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:07.599334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:07.599703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:07.600475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:07.606826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:07.819444 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1129/2269] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:13:07 2022] POST /identity/v3/users => generated 294 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:07.856197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:07.880721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719e74-6139-4582-b53c-135ca80e6ae6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:07.896693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:07.897603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:07.897966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:07.902649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:07.906077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:07.908356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:07.942349 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1141/2270] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:07.947540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:07.980781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f8d7c-c7b1-4b8e-815d-fe73872ee258 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:08.043231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c8936-5694-493a-9ff1-42ae03013732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:08.043231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8936-5694-493a-9ff1-42ae03013732 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:08.043231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8936-5694-493a-9ff1-42ae03013732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:08.043231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8936-5694-493a-9ff1-42ae03013732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:08.044341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c8936-5694-493a-9ff1-42ae03013732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:08.052775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c8936-5694-493a-9ff1-42ae03013732 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:08.089028 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:08.108494 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1130/2271] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:08.112028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:08.128478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc1933-1bf3-4bac-9fe5-90fb3eddc95e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:08.152565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:08.153669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:08.154432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:08.156014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] PATH_INFO: `/v3/projects/98cba9747c2f4101a61915d903529edc/users/4b752c07f9564289978eba0eee47615f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:08.213773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cba9747c2f4101a61915d903529edc, user_id=4b752c07f9564289978eba0eee47615f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:08.221365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:08.504066 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1142/2272] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:08 2022] PUT /identity/v3/projects/98cba9747c2f4101a61915d903529edc/users/4b752c07f9564289978eba0eee47615f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:08.515199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ff6b6-9912-4e8f-adf5-38b7d04fd01a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:08.515848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ff6b6-9912-4e8f-adf5-38b7d04fd01a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:08.516298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ff6b6-9912-4e8f-adf5-38b7d04fd01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:08.584695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c25ff6b6-9912-4e8f-adf5-38b7d04fd01a None None] MFA Rules not processed for user `4b752c07f9564289978eba0eee47615f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:08.589486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c25ff6b6-9912-4e8f-adf5-38b7d04fd01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:08.696522 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1131/2273] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:08.697778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:08.729327 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:09.031977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0809ec-53f7-4ef7-a178-10fee6815e60 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:09.071865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:09.076559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:09.076559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:09.081541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:09.082400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:09.085373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:09.311923 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1143/2274] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:13:08 2022] POST /identity/v3/projects => generated 385 bytes in 615 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:09.318135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ff6b6-9912-4e8f-adf5-38b7d04fd01a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:09.338984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ff6b6-9912-4e8f-adf5-38b7d04fd01a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:09.647948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:09.649484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:09.649906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:09.650360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:09.651195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:09.655690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:09.827290 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1132/2275] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:13:09 2022] POST /identity/v3/users => generated 299 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:09.828389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:09.868626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdbb64-332d-449a-9df4-440f489f3183 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:09.907561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:09.911147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:09.913022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:09.913475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:09.914460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:09.919883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:09.996229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1144/2276] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:09.998749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:10.043714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc621e-afb5-44d4-8fb7-41b775509bc6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:10.102721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:10.103557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:10.103839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:10.104138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] PATH_INFO: `/v3/projects/8b1267350fc647ebbefc11913e32f3f4/users/3ba202d5faa34c2fadbffa10f6d26fde/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:10.199537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1267350fc647ebbefc11913e32f3f4, user_id=3ba202d5faa34c2fadbffa10f6d26fde, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:10.211732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:10.409483 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1133/2277] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:09 2022] PUT /identity/v3/projects/8b1267350fc647ebbefc11913e32f3f4/users/3ba202d5faa34c2fadbffa10f6d26fde/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:10.413285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:10.459600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118eb8-e485-4e0a-bd8e-e15090fda6a9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:10.650781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4743c16-711a-439f-9680-08555f2170f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:10.651515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4743c16-711a-439f-9680-08555f2170f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:10.651794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4743c16-711a-439f-9680-08555f2170f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:10.652172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4743c16-711a-439f-9680-08555f2170f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:10.652997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4743c16-711a-439f-9680-08555f2170f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:10.655367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4743c16-711a-439f-9680-08555f2170f3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:10.729200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1145/2278] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:10.732094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:10.749195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3355f-9b1f-47b6-bc18-baf04b0eabaa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:10.768484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:10.770374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:10.770898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:10.774749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] PATH_INFO: `/v3/projects/8b1267350fc647ebbefc11913e32f3f4/users/3ba202d5faa34c2fadbffa10f6d26fde/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:10.779293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1267350fc647ebbefc11913e32f3f4, user_id=3ba202d5faa34c2fadbffa10f6d26fde, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:10.785872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:10.826993 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1134/2279] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:10 2022] PUT /identity/v3/projects/8b1267350fc647ebbefc11913e32f3f4/users/3ba202d5faa34c2fadbffa10f6d26fde/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:10.837799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046be2-15f5-4d6d-b7a7-88c2888add3c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:10.838354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046be2-15f5-4d6d-b7a7-88c2888add3c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:10.840193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046be2-15f5-4d6d-b7a7-88c2888add3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:10.939104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-86046be2-15f5-4d6d-b7a7-88c2888add3c None None] MFA Rules not processed for user `3ba202d5faa34c2fadbffa10f6d26fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:10.940964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86046be2-15f5-4d6d-b7a7-88c2888add3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:11.252798 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1146/2280] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:11.677470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:11.682926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:11.891099 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:11.979581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c97dd-b9e2-4af0-b946-324f3cea50fb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:11.995188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05c47-5a1f-487e-a8e2-f929137c7f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:11.996633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05c47-5a1f-487e-a8e2-f929137c7f8e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:11.997086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05c47-5a1f-487e-a8e2-f929137c7f8e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:11.997549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05c47-5a1f-487e-a8e2-f929137c7f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:12.009885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05c47-5a1f-487e-a8e2-f929137c7f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:12.012077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05c47-5a1f-487e-a8e2-f929137c7f8e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:12.062551 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1135/2281] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:13.670397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:13.671007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:13.671007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:13.709285 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:13.725602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] MFA Rules not processed for user `547aed83a7e44becb9c89dc6bae62255`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:13.727092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:13.852856 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1147/2282] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:14.635741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131047-c923-4132-9a34-a062002c1b97 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:14.636282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131047-c923-4132-9a34-a062002c1b97 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:14.636851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131047-c923-4132-9a34-a062002c1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:14.730532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d0131047-c923-4132-9a34-a062002c1b97 None None] MFA Rules not processed for user `7262d5984b8c4775b86fae1c0d314718`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:14.731713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d0131047-c923-4132-9a34-a062002c1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:14.896938 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1136/2283] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:14.903566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:14.905995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:15.075238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11ea1-474e-4f53-a8c3-f907d4050a51 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:15.085802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa7c89-56b9-4540-8818-859ac2128d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:15.088592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7c89-56b9-4540-8818-859ac2128d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:15.089102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7c89-56b9-4540-8818-859ac2128d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:15.089453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7c89-56b9-4540-8818-859ac2128d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:15.115175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa7c89-56b9-4540-8818-859ac2128d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:15.118897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa7c89-56b9-4540-8818-859ac2128d3b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:15.142615 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1148/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:16.712009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0131047-c923-4132-9a34-a062002c1b97 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:16.974013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0131047-c923-4132-9a34-a062002c1b97 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:16.983651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:16.984473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:16.986628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:16.987167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] PATH_INFO: `/v3/users/4b752c07f9564289978eba0eee47615f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:16.988599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b752c07f9564289978eba0eee47615f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:16.991565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:17.225916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b752c07f9564289978eba0eee47615f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:17.269121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b752c07f9564289978eba0eee47615f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:17.270033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b752c07f9564289978eba0eee47615f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:17.281854 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:17.406140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b752c07f9564289978eba0eee47615f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:17.407335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b752c07f9564289978eba0eee47615f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:17.477738 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1137/2285] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:16 2022] DELETE /identity/v3/users/4b752c07f9564289978eba0eee47615f => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:17.491385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:17.495276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:17.495276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:17.551163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:17.552723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:17.715276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1149/2286] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:17.748339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:17.750474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:18.063527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38668f-540b-4ffe-8b14-7c993ed3a487 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:18.079009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:18.079712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:18.080058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:18.080260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:18.119797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:18.121304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:18.174358 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1138/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:21.240718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:21.241226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:21.269589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a824-3991-4c52-9d1f-0bd823885d78 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:21.277131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:21.277785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:21.280049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:21.280338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] PATH_INFO: `/v3/projects/98cba9747c2f4101a61915d903529edc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:21.282696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cba9747c2f4101a61915d903529edc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:21.286691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:21.556748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cba9747c2f4101a61915d903529edc', 'request_id': 'req-aa66738c-59e0-4327-81eb-188f81791424'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:21.558604 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:21.564175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cba9747c2f4101a61915d903529edc', 'request_id': 'req-aa66738c-59e0-4327-81eb-188f81791424'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:21.676419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cba9747c2f4101a61915d903529edc', 'request_id': 'req-aa66738c-59e0-4327-81eb-188f81791424'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:21.690433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] The token cache is being invalidate because project 98cba9747c2f4101a61915d903529edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:13:21.690726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:21.691394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:21.695788 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1150/2288] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:13:21 2022] DELETE /identity/v3/projects/98cba9747c2f4101a61915d903529edc => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:21.697039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:21.708938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f1704-1af2-424b-9825-f0b8474f6598 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:21.868020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:21.869078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:21.870443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:21.870905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] PATH_INFO: `/v3/users/3ba202d5faa34c2fadbffa10f6d26fde` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:21.873086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba202d5faa34c2fadbffa10f6d26fde)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:21.882283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:22.172301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba202d5faa34c2fadbffa10f6d26fde'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:22.185789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba202d5faa34c2fadbffa10f6d26fde'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:22.186813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba202d5faa34c2fadbffa10f6d26fde'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:22.269159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba202d5faa34c2fadbffa10f6d26fde'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:22.270223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0790ec1a-4694-4398-bc60-6b0bd4784c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba202d5faa34c2fadbffa10f6d26fde'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:22.290797 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:22.299054 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1139/2289] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:21 2022] DELETE /identity/v3/users/3ba202d5faa34c2fadbffa10f6d26fde => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:23.522449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:23.528277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:23.546275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66738c-59e0-4327-81eb-188f81791424 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:23.707073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:23.708427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:23.708709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:23.709063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] PATH_INFO: `/v3/projects/8b1267350fc647ebbefc11913e32f3f4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:23.712250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1267350fc647ebbefc11913e32f3f4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:23.716348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:23.924582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1267350fc647ebbefc11913e32f3f4', 'request_id': 'req-64ae0861-b05e-40fd-8e10-d527470ac79d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:23.925078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87793040-659d-49f2-bf32-886230f7fa6c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:23.925881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87793040-659d-49f2-bf32-886230f7fa6c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:23.926449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87793040-659d-49f2-bf32-886230f7fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:23.931706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1267350fc647ebbefc11913e32f3f4', 'request_id': 'req-64ae0861-b05e-40fd-8e10-d527470ac79d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:23.980279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-87793040-659d-49f2-bf32-886230f7fa6c None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:23.980936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-87793040-659d-49f2-bf32-886230f7fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:24.034553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1267350fc647ebbefc11913e32f3f4', 'request_id': 'req-64ae0861-b05e-40fd-8e10-d527470ac79d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:24.063394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] The token cache is being invalidate because project 8b1267350fc647ebbefc11913e32f3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:13:24.063760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:24.066420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64ae0861-b05e-40fd-8e10-d527470ac79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:24.076763 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1151/2290] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:13:23 2022] DELETE /identity/v3/projects/8b1267350fc647ebbefc11913e32f3f4 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:24.078714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.083750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.085808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.188424 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1140/2291] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:24.190363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d7788-5fa8-40c0-ac72-ee0c846e48d9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.194015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d7788-5fa8-40c0-ac72-ee0c846e48d9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.194015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d7788-5fa8-40c0-ac72-ee0c846e48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.207739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] MFA Rules not processed for user `ff85df41240b436c919d2ada7179e222`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:24.209307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:24.222457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-632d7788-5fa8-40c0-ac72-ee0c846e48d9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:24.258803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-632d7788-5fa8-40c0-ac72-ee0c846e48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:24.405800 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:24.430908 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1152/2292] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:24.432033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:24.435220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:24.486776 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1141/2293] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:24.489325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251115-f06a-47d5-b942-ee63f108b97e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.489616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251115-f06a-47d5-b942-ee63f108b97e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.489889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251115-f06a-47d5-b942-ee63f108b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.548421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-95251115-f06a-47d5-b942-ee63f108b97e None None] MFA Rules not processed for user `7262d5984b8c4775b86fae1c0d314718`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:24.549592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-95251115-f06a-47d5-b942-ee63f108b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:24.656134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f95b92-b41e-4425-bac7-8fffdb1d946e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:24.667476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab9e0e-11e8-4cb0-9203-720c6c64ed2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:24.668838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab9e0e-11e8-4cb0-9203-720c6c64ed2a service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.669554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab9e0e-11e8-4cb0-9203-720c6c64ed2a service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.670119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab9e0e-11e8-4cb0-9203-720c6c64ed2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.693997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab9e0e-11e8-4cb0-9203-720c6c64ed2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:24.698582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab9e0e-11e8-4cb0-9203-720c6c64ed2a service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:24.717330 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1153/2294] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:13:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:24.722917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb622a7-6ad5-4c3e-83ea-aa8465d3a76e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.722917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb622a7-6ad5-4c3e-83ea-aa8465d3a76e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.722917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb622a7-6ad5-4c3e-83ea-aa8465d3a76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.734199 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1142/2295] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:24.735467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b3c2-80b7-439d-aafd-7ecdc463e912 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.735750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b3c2-80b7-439d-aafd-7ecdc463e912 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.736019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b3c2-80b7-439d-aafd-7ecdc463e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.754835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4fb622a7-6ad5-4c3e-83ea-aa8465d3a76e None None] MFA Rules not processed for user `8a246c84d8f444d59c9d5becae78f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:24.755979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4fb622a7-6ad5-4c3e-83ea-aa8465d3a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:24.778940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fc69b3c2-80b7-439d-aafd-7ecdc463e912 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:24.780186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc69b3c2-80b7-439d-aafd-7ecdc463e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:24.823707 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1143/2296] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:24.827824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69b3c2-80b7-439d-aafd-7ecdc463e912 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:24.847194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69b3c2-80b7-439d-aafd-7ecdc463e912 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:24.857768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:24.867005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.867911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.868187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.868943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:13:24.869195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:24.870825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:24.888782 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1154/2297] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:24.904907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1144/2298] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:13:24.909509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb622a7-6ad5-4c3e-83ea-aa8465d3a76e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:24.924426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb622a7-6ad5-4c3e-83ea-aa8465d3a76e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:24.959518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:24.959518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:24.959518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:24.959518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:24.959834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:24.963159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:25.040364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:25.042517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:25.094245 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:25.129468 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1155/2299] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:13:24 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:25.136630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:25.212248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cfd80-288f-42e4-bfe1-5153bb7ab3f4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:25.327708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e907c8-3867-4580-911a-b64ea3599c4d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:25.340762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:25.342470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:25.347902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:25.347902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:25.347902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:25.349656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:25.353296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:25.354997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:25.355592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:25.357461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:25.386062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:25.494442 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1156/2300] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:13:25 2022] POST /identity/v3/users => generated 290 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:25.495529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:25.539895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9a480-c68a-441f-9e23-01d438ddc550 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:25.556680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:25.559626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:25.560301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:25.561206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:25.561548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:25.564064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:25.564901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:25.567058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:25.593708 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1145/2301] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:13:25.632467 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1157/2302] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:25.637620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:25.664820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa645b-ed23-4711-8129-f88b75d72cc5 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:25.679433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf365c-9eed-4742-ac5f-3802048255ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:25.680240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf365c-9eed-4742-ac5f-3802048255ba admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:25.680522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf365c-9eed-4742-ac5f-3802048255ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:25.681662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf365c-9eed-4742-ac5f-3802048255ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:25.681662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf365c-9eed-4742-ac5f-3802048255ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:25.686072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf365c-9eed-4742-ac5f-3802048255ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:25.702306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1146/2303] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:25.705617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:25.724388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989da15-1921-41fc-bde1-1f14b1f7071c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:25.741528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:25.741528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:25.741528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:25.741528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] PATH_INFO: `/v3/projects/f93208696d0e4e889faa9d77b1d23cf5/users/772564f5e45247069e691521cb96a868/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:25.810426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93208696d0e4e889faa9d77b1d23cf5, user_id=772564f5e45247069e691521cb96a868, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:25.819698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:25.930353 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1158/2304] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:25 2022] PUT /identity/v3/projects/f93208696d0e4e889faa9d77b1d23cf5/users/772564f5e45247069e691521cb96a868/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:25.931476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547dcf2-0ae9-4461-aee8-ec0dd700b7fe None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:25.931760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547dcf2-0ae9-4461-aee8-ec0dd700b7fe None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:25.932035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547dcf2-0ae9-4461-aee8-ec0dd700b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:25.995236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b547dcf2-0ae9-4461-aee8-ec0dd700b7fe None None] MFA Rules not processed for user `772564f5e45247069e691521cb96a868`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:25.996643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b547dcf2-0ae9-4461-aee8-ec0dd700b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:26.103778 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:26.123496 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:26.188983 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1147/2305] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:27.996366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:27.996366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:28.205453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223faa3-70c3-4f9f-9c25-02c490a1df3f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:28.218118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:28.218751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:28.219032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:28.219306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:28.230077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:28.232364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:28.264467 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1159/2306] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:28.796469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec50f9-55a5-404e-8154-377f900af9e5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:28.796978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec50f9-55a5-404e-8154-377f900af9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:28.797089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec50f9-55a5-404e-8154-377f900af9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:28.851399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6dec50f9-55a5-404e-8154-377f900af9e5 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:28.855344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6dec50f9-55a5-404e-8154-377f900af9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:28.982339 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1148/2307] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:29.001855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:29.177016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f658eb-bdda-4fd5-abfe-351f08ab8ea7 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:29.199650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32ef00-cdbc-4aa2-afe2-1bcf19b334d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:29.199650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ef00-cdbc-4aa2-afe2-1bcf19b334d5 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:29.199650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ef00-cdbc-4aa2-afe2-1bcf19b334d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:29.199650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ef00-cdbc-4aa2-afe2-1bcf19b334d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:29.228120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32ef00-cdbc-4aa2-afe2-1bcf19b334d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:29.230005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32ef00-cdbc-4aa2-afe2-1bcf19b334d5 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:29.248787 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1160/2308] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:13:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:29.787264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02b30c-5219-48b6-9359-460f643f2753 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:29.787924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02b30c-5219-48b6-9359-460f643f2753 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:29.788373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02b30c-5219-48b6-9359-460f643f2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:29.833833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dc02b30c-5219-48b6-9359-460f643f2753 None None] MFA Rules not processed for user `772564f5e45247069e691521cb96a868`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:29.835234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc02b30c-5219-48b6-9359-460f643f2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:29.855604 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1149/2309] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:30.646893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19f2b-1f94-4e0c-b151-0b0776a7f4d6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:30.648445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19f2b-1f94-4e0c-b151-0b0776a7f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:30.649854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19f2b-1f94-4e0c-b151-0b0776a7f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:30.701015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2cf19f2b-1f94-4e0c-b151-0b0776a7f4d6 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:30.704104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2cf19f2b-1f94-4e0c-b151-0b0776a7f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:30.740725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02b30c-5219-48b6-9359-460f643f2753 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:30.752368 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1161/2310] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:30.759276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02b30c-5219-48b6-9359-460f643f2753 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:30.767113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd7c0c-19b4-4aa6-b6c2-f6b9f80f110b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:30.767778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7c0c-19b4-4aa6-b6c2-f6b9f80f110b service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:30.768245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7c0c-19b4-4aa6-b6c2-f6b9f80f110b service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:30.768697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7c0c-19b4-4aa6-b6c2-f6b9f80f110b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:30.779693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd7c0c-19b4-4aa6-b6c2-f6b9f80f110b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:30.794325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd7c0c-19b4-4aa6-b6c2-f6b9f80f110b service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:30.829323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1150/2311] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:13:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:31.373101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19f2b-1f94-4e0c-b151-0b0776a7f4d6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:31.464138 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:31.539691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19f2b-1f94-4e0c-b151-0b0776a7f4d6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:31.567272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:31.574166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:31.574842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:31.575121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] PATH_INFO: `/v3/users/772564f5e45247069e691521cb96a868` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:31.576680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=772564f5e45247069e691521cb96a868)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:31.579784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:31.829170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772564f5e45247069e691521cb96a868'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:31.836665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772564f5e45247069e691521cb96a868'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:31.837338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772564f5e45247069e691521cb96a868'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:31.931942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772564f5e45247069e691521cb96a868'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:31.932573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772564f5e45247069e691521cb96a868'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:31.951315 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1162/2312] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:31 2022] DELETE /identity/v3/users/772564f5e45247069e691521cb96a868 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:31.955776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:31.956339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:31.956339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:31.980781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:31.982027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:32.102681 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1151/2313] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:32.112992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:32.114859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:32.198819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd8e3-27ad-4a45-9668-241220c715ab admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:32.204679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f38ca-7e8d-46c5-83dd-2a9513aea063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:32.205507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f38ca-7e8d-46c5-83dd-2a9513aea063 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:32.211093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f38ca-7e8d-46c5-83dd-2a9513aea063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:32.211093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f38ca-7e8d-46c5-83dd-2a9513aea063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:32.236937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f38ca-7e8d-46c5-83dd-2a9513aea063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:32.238792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f38ca-7e8d-46c5-83dd-2a9513aea063 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:32.260730 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1163/2314] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:13:33.496230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:33.500474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:33.512891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e394b0-c7bf-45c1-9fd7-a996cd94dcbc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:33.525940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:33.530151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:33.530151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:33.530151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] PATH_INFO: `/v3/projects/f93208696d0e4e889faa9d77b1d23cf5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:33.530151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93208696d0e4e889faa9d77b1d23cf5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:33.531526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:33.680343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93208696d0e4e889faa9d77b1d23cf5', 'request_id': 'req-019fea80-3870-48dd-9ab4-b8abaf6e59b4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:33.689111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93208696d0e4e889faa9d77b1d23cf5', 'request_id': 'req-019fea80-3870-48dd-9ab4-b8abaf6e59b4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:33.694397 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:33.772776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93208696d0e4e889faa9d77b1d23cf5', 'request_id': 'req-019fea80-3870-48dd-9ab4-b8abaf6e59b4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:33.793796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] The token cache is being invalidate because project f93208696d0e4e889faa9d77b1d23cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:13:33.794704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:33.795483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-019fea80-3870-48dd-9ab4-b8abaf6e59b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:33.801372 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1152/2315] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:13:33 2022] DELETE /identity/v3/projects/f93208696d0e4e889faa9d77b1d23cf5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:33.803510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1329ca-ec80-496b-91fb-3697b9bb9e25 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:33.804331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1329ca-ec80-496b-91fb-3697b9bb9e25 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:33.804635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1329ca-ec80-496b-91fb-3697b9bb9e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:33.839690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8d1329ca-ec80-496b-91fb-3697b9bb9e25 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:33.842158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8d1329ca-ec80-496b-91fb-3697b9bb9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:33.923331 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:33.944446 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1164/2316] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:33.953963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762d73-6da6-4223-bda5-389abd4a5434 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:33.954627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762d73-6da6-4223-bda5-389abd4a5434 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:33.955108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762d73-6da6-4223-bda5-389abd4a5434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:33.981758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ba762d73-6da6-4223-bda5-389abd4a5434 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:33.984702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba762d73-6da6-4223-bda5-389abd4a5434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:34.004921 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1153/2317] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:34.005817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1329ca-ec80-496b-91fb-3697b9bb9e25 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:34.019587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1329ca-ec80-496b-91fb-3697b9bb9e25 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:34.027677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:34.028693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:34.029411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:34.029825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:34.030709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:13:34.031113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:34.033156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:34.052612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762d73-6da6-4223-bda5-389abd4a5434 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:34.058139 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1165/2318] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:13:34.063741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762d73-6da6-4223-bda5-389abd4a5434 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:34.075832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:34.077062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:34.077677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:34.078197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:34.079815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:34.084457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:34.206547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:34.227716 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1154/2319] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:13:34 2022] POST /identity/v3/projects => generated 389 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:34.238221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d61c73-b78d-4610-86f7-331eb32c9954 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:34.315697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:34.316349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:34.317081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:34.317081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:34.317684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:34.319851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:34.466393 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1166/2320] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:13:34 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:34.470682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:34.491348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534d03-a00f-4494-a1e9-cc8bd6d7fe06 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:34.496569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:34.497923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:34.498359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:34.498848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:34.499956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:34.501789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:34.527269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:34.536532 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1155/2321] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:34.544904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e6425-dc89-44a0-b169-74a60833c5f0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:34.554276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac52f-a122-4024-bd59-324fbbd0ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:34.555188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac52f-a122-4024-bd59-324fbbd0ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:34.555292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac52f-a122-4024-bd59-324fbbd0ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:34.555499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac52f-a122-4024-bd59-324fbbd0ccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:34.556163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac52f-a122-4024-bd59-324fbbd0ccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:34.557791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac52f-a122-4024-bd59-324fbbd0ccb7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:34.582877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1167/2322] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:34.584373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:34.600418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe328-e226-4e51-ace1-b9f77fdf670e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:34.611878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:34.615372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:34.615883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:34.616986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] PATH_INFO: `/v3/projects/2ad6b5ca34db4733aad82c3b2c1daed2/users/571f9656cbdd469896bdf80dc87fb54c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:34.639375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad6b5ca34db4733aad82c3b2c1daed2, user_id=571f9656cbdd469896bdf80dc87fb54c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:34.643802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:34.749078 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1156/2323] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:34 2022] PUT /identity/v3/projects/2ad6b5ca34db4733aad82c3b2c1daed2/users/571f9656cbdd469896bdf80dc87fb54c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:34.769409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:34.769696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:34.774504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:34.799509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:34.801267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:34.898591 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1168/2324] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:34.909068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:34.910897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:35.020348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe9c5-979c-4c11-a03c-736687551e75 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:35.025622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:35.026411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:35.026790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:35.027654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:35.073271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:35.075517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:35.108737 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1157/2325] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:42.026271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:42.027743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:42.124892 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:42.174610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646cfb-f69b-41b4-b27b-321f21af3909 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:42.181017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:42.182117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:42.182593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:42.183083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:42.185164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:42.204552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:42.206876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:42.258975 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1169/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:45.098735 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:46.385115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:46.388541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:46.505444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9886a7-467d-4782-ba0e-d38958dffa2d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:46.505444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:46.505444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:46.505444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:46.505894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:46.507159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:46.656028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:46.658204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:46.676634 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1158/2327] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:47.379054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:47.386610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:47.411572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a86eb-155e-4ac8-a272-98c87f97964b service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:47.422259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:47.423037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:47.423393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:47.423835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] PATH_INFO: `/v3/users/9e535f9274b24a9f800ea0c3d8faba5a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:47.429362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e535f9274b24a9f800ea0c3d8faba5a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:47.432499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:47.637096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e535f9274b24a9f800ea0c3d8faba5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:47.648181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e535f9274b24a9f800ea0c3d8faba5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:47.649062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e535f9274b24a9f800ea0c3d8faba5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:47.720613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e535f9274b24a9f800ea0c3d8faba5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:47.721280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e535f9274b24a9f800ea0c3d8faba5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:47.740191 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1170/2328] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:47 2022] DELETE /identity/v3/users/9e535f9274b24a9f800ea0c3d8faba5a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:47.998048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:48.042098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a341d6-bf21-4253-b1a9-93eaf261c096 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:48.128661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:48.129591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:48.130054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:48.130464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] PATH_INFO: `/v3/projects/08b8e89ba0a14188bac8e28b66b5a197` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:48.132368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b8e89ba0a14188bac8e28b66b5a197)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:48.134565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:48.274416 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:48.287823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b8e89ba0a14188bac8e28b66b5a197', 'request_id': 'req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.300125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b8e89ba0a14188bac8e28b66b5a197', 'request_id': 'req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.370629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b8e89ba0a14188bac8e28b66b5a197', 'request_id': 'req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.387649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] The token cache is being invalidate because project 08b8e89ba0a14188bac8e28b66b5a197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:13:48.387904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.391568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-235c9dec-7cc0-4cd1-b852-e5ce832f6f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.396466 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1159/2329] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:13:47 2022] DELETE /identity/v3/projects/08b8e89ba0a14188bac8e28b66b5a197 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:48.397652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:48.401510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:48.420219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac04d-b8cc-4f72-b196-8b312eac0c17 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:48.509500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:48.510512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:48.510784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:48.511055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] PATH_INFO: `/v3/users/5067f5be07754742b075ada65db2dfcc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:48.512201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5067f5be07754742b075ada65db2dfcc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:48.514367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:48.755738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5067f5be07754742b075ada65db2dfcc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.765524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5067f5be07754742b075ada65db2dfcc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.766326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5067f5be07754742b075ada65db2dfcc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.779802 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:48.840719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5067f5be07754742b075ada65db2dfcc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.841843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5067f5be07754742b075ada65db2dfcc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:48.863266 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1171/2330] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:48 2022] DELETE /identity/v3/users/5067f5be07754742b075ada65db2dfcc => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:49.135560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:49.148617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:49.148617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:49.172323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:49.173784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:49.177320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] MFA Rules not processed for user `571f9656cbdd469896bdf80dc87fb54c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:49.178622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:49.285769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc84062-291e-42ad-805b-5084acc7f2a3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:49.288443 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1160/2331] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:49.295042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:49.295686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:49.296006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:49.296285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] PATH_INFO: `/v3/projects/4fae1c4c88a241a3bf75ee0848fe9827` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:49.298143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fae1c4c88a241a3bf75ee0848fe9827)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:49.300926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:49.390912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:49.392495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:49.466872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fae1c4c88a241a3bf75ee0848fe9827', 'request_id': 'req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:49.474733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fae1c4c88a241a3bf75ee0848fe9827', 'request_id': 'req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:49.491833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0f9ae-5b8e-4113-87a8-a1ec48b0690b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:49.546286 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:49.549790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fae1c4c88a241a3bf75ee0848fe9827', 'request_id': 'req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:49.566907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] The token cache is being invalidate because project 4fae1c4c88a241a3bf75ee0848fe9827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:13:49.568835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:49.568951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab5137-aa19-4dcd-a046-c17d71cf58d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:49.569070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe7e08cb-4765-4905-bd83-dfe19bf2cf1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:13:49.569173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab5137-aa19-4dcd-a046-c17d71cf58d3 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:49.569451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab5137-aa19-4dcd-a046-c17d71cf58d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:49.569714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab5137-aa19-4dcd-a046-c17d71cf58d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:49.574588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a7ab5137-aa19-4dcd-a046-c17d71cf58d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:49.575066 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1172/2332] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:13:49 2022] DELETE /identity/v3/projects/4fae1c4c88a241a3bf75ee0848fe9827 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:13:49.576759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da760e-5cb8-4142-b8df-86c06da52068 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:49.577113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da760e-5cb8-4142-b8df-86c06da52068 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:49.577554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da760e-5cb8-4142-b8df-86c06da52068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:49.606433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-93da760e-5cb8-4142-b8df-86c06da52068 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:49.607658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-93da760e-5cb8-4142-b8df-86c06da52068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:49.657682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab5137-aa19-4dcd-a046-c17d71cf58d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:49.660079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab5137-aa19-4dcd-a046-c17d71cf58d3 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:49.675781 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1161/2333] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:49.703360 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1173/2334] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:49.705203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e742f0-9487-4ab9-ab1a-2c74ad911d7a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:49.705515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e742f0-9487-4ab9-ab1a-2c74ad911d7a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:49.705792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e742f0-9487-4ab9-ab1a-2c74ad911d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:49.739433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-82e742f0-9487-4ab9-ab1a-2c74ad911d7a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:49.740692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-82e742f0-9487-4ab9-ab1a-2c74ad911d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:49.750506 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1162/2335] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:49.754766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da760e-5cb8-4142-b8df-86c06da52068 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:49.765435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da760e-5cb8-4142-b8df-86c06da52068 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:49.771309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:49.772093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:49.772522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:49.772814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:49.774065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:13:49.774657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:49.776254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:49.779492 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:49.793745 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1174/2336] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:13:49.798029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e742f0-9487-4ab9-ab1a-2c74ad911d7a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:49.809575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e742f0-9487-4ab9-ab1a-2c74ad911d7a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:49.818365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:49.819303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:49.819867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:49.820358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:49.821174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:49.825142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:49.926627 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1163/2337] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:13:49 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:49.930012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:49.946013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da014bf-45d2-4eea-871c-f5b0271f8169 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.019181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.019801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.020174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.020562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.021235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:50.023349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:50.133426 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1175/2338] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:13:49 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:50.138134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.162451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af5d29-66ec-47bf-9a7d-e884a9f2147a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.168009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.169062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.169547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.169817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.170593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:50.172349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:50.191602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.192016 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1164/2339] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:50.203328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc839e-464e-4725-9c19-d0972362d04c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.208518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd396ea-982d-487b-86f3-c32e20150dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.209256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd396ea-982d-487b-86f3-c32e20150dce admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.209492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd396ea-982d-487b-86f3-c32e20150dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.209790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd396ea-982d-487b-86f3-c32e20150dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.210479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd396ea-982d-487b-86f3-c32e20150dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:50.212100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd396ea-982d-487b-86f3-c32e20150dce admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:50.225472 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1176/2340] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:50.229923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.240302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fb9be-e34a-4b6f-ae5b-3305862895a7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.249788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.250517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.251195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.251195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] PATH_INFO: `/v3/projects/8056b64dc6424bd59f98f0aad9c5e45c/users/70e24625e3a548278b932597fc1d0e16/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.270749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8056b64dc6424bd59f98f0aad9c5e45c, user_id=70e24625e3a548278b932597fc1d0e16, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:50.274149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:50.350312 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1165/2341] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:50 2022] PUT /identity/v3/projects/8056b64dc6424bd59f98f0aad9c5e45c/users/70e24625e3a548278b932597fc1d0e16/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:50.361434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd3e6-d310-4d9b-b248-d96edfe3e1e5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.361716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd3e6-d310-4d9b-b248-d96edfe3e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.362003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd3e6-d310-4d9b-b248-d96edfe3e1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.391289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-297fd3e6-d310-4d9b-b248-d96edfe3e1e5 None None] MFA Rules not processed for user `70e24625e3a548278b932597fc1d0e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:50.392506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-297fd3e6-d310-4d9b-b248-d96edfe3e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:50.485717 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1177/2342] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:50.492719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.593244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8eb69-1d72-4875-9460-e13940cc80bf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.598020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77072b84-646d-4882-98dc-328fb18e03ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.599181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77072b84-646d-4882-98dc-328fb18e03ba admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.599181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77072b84-646d-4882-98dc-328fb18e03ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.599181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77072b84-646d-4882-98dc-328fb18e03ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.600436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77072b84-646d-4882-98dc-328fb18e03ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:50.604108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77072b84-646d-4882-98dc-328fb18e03ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:50.702453 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1166/2343] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:13:50 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:13:50.706536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd3e6-d310-4d9b-b248-d96edfe3e1e5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.721142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd3e6-d310-4d9b-b248-d96edfe3e1e5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.788181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.788515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.788730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.795428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.796399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.798297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.798297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.798297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:50.800825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:50.814671 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:50.826532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:50.828227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:50.833249 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:50.904718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1167/2344] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:50.922929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1178/2345] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:13:50 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:13:50.931613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.931751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.931751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:50.938510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b977c-adbb-4e6a-a641-80a2abf4508b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.944399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.945735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.946164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.946548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:50.947345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:50.949263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:50.970448 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1179/2346] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:50.971461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:50.981953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888c57c-2195-4224-9129-f07fb8edf901 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:50.987018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:50.987809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:50.988193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:50.988570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] PATH_INFO: `/v3/projects/2b34c9047e9747f099c715b5106a10a6/users/337f88a0a14f45038da0ec66d4fd5283/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:51.006257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b34c9047e9747f099c715b5106a10a6, user_id=337f88a0a14f45038da0ec66d4fd5283, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:51.009587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:51.015272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10f1b-55c3-4463-a3f9-572d58cc70cf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:51.019496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:51.020144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:51.020421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:51.020944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:51.034559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:51.042283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:51.067744 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1168/2347] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:51.098492 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1180/2348] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:50 2022] PUT /identity/v3/projects/2b34c9047e9747f099c715b5106a10a6/users/337f88a0a14f45038da0ec66d4fd5283/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:51.108399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:51.123947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a0d9-8571-4f99-a1eb-0f9daf20eb6c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:51.263815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffab3d-d2e1-4e1d-a036-199c38c8c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:51.264543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffab3d-d2e1-4e1d-a036-199c38c8c5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:51.264720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffab3d-d2e1-4e1d-a036-199c38c8c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:51.264994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffab3d-d2e1-4e1d-a036-199c38c8c5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:51.265647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffab3d-d2e1-4e1d-a036-199c38c8c5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:51.267278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffab3d-d2e1-4e1d-a036-199c38c8c5b3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:51.300559 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1169/2349] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:13:51.301129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:51.314004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef09e2-ddbd-4c1d-829b-52b411899499 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:51.327259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:51.328385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:51.328385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:51.328612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] PATH_INFO: `/v3/projects/2b34c9047e9747f099c715b5106a10a6/users/337f88a0a14f45038da0ec66d4fd5283/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:51.332464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b34c9047e9747f099c715b5106a10a6, user_id=337f88a0a14f45038da0ec66d4fd5283, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:51.337339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:51.360517 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1181/2350] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:13:51 2022] PUT /identity/v3/projects/2b34c9047e9747f099c715b5106a10a6/users/337f88a0a14f45038da0ec66d4fd5283/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:13:51.372885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973064c1-8569-4b3d-a828-3b8165001141 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:51.373218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973064c1-8569-4b3d-a828-3b8165001141 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:51.373493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973064c1-8569-4b3d-a828-3b8165001141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:51.420551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-973064c1-8569-4b3d-a828-3b8165001141 None None] MFA Rules not processed for user `337f88a0a14f45038da0ec66d4fd5283`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:51.420551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-973064c1-8569-4b3d-a828-3b8165001141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:51.487579 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:51.553478 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1170/2351] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:13:51.966547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:51.969345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:52.081907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53c6d1-63ca-4fb8-9dab-ea1dfc29bb68 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:52.094305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:52.095548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:52.095548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:52.095548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:52.115790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:52.119667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:52.134352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1182/2352] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:54.262497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:54.263033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:54.263258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:54.303632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:13:54.308605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:54.494862 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1171/2353] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:13:54.512537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:54.515167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:54.631717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a226a47-9204-4090-88cc-b0beb3da329e service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:54.638839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:54.639612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:54.640062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:54.640888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:54.653138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:54.655285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:54.675414 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1183/2354] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:13:56.447845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:56.449852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:56.492296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec402a04-9a8c-4316-8d92-791212d4c5e7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:56.519069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:56.520331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:56.520843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:56.521340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:56.628778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:56.631068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:13:56.646667 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1172/2355] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:13:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:13:59.386343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:13:59.389863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:13:59.486819 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:13:59.587253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c67f51-2c52-4d65-abe0-b01e4e3bc1e7 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:13:59.595464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:13:59.596474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:13:59.597044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:13:59.597490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] PATH_INFO: `/v3/users/571f9656cbdd469896bdf80dc87fb54c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:13:59.599487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571f9656cbdd469896bdf80dc87fb54c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:13:59.602395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:00.062520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571f9656cbdd469896bdf80dc87fb54c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:00.087105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571f9656cbdd469896bdf80dc87fb54c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:00.088024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571f9656cbdd469896bdf80dc87fb54c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:00.156884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571f9656cbdd469896bdf80dc87fb54c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:00.158020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-06a63ebd-8397-4aae-922f-e723e331efc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571f9656cbdd469896bdf80dc87fb54c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:00.198607 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1184/2356] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:13:59 2022] DELETE /identity/v3/users/571f9656cbdd469896bdf80dc87fb54c => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:00.997839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:01.014917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d14e-765c-4bf7-98df-ca42cf9c3948 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:01.146302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:01.147347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.148069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.148891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] PATH_INFO: `/v3/projects/2ad6b5ca34db4733aad82c3b2c1daed2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:01.151253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad6b5ca34db4733aad82c3b2c1daed2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:01.155759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:01.168897 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:01.330375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad6b5ca34db4733aad82c3b2c1daed2', 'request_id': 'req-f5f60189-5918-4402-881f-f1a7ce1d191f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.338094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad6b5ca34db4733aad82c3b2c1daed2', 'request_id': 'req-f5f60189-5918-4402-881f-f1a7ce1d191f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.414355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad6b5ca34db4733aad82c3b2c1daed2', 'request_id': 'req-f5f60189-5918-4402-881f-f1a7ce1d191f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.434875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] The token cache is being invalidate because project 2ad6b5ca34db4733aad82c3b2c1daed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:01.437801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.440836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.444454 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1173/2357] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:00 2022] DELETE /identity/v3/projects/2ad6b5ca34db4733aad82c3b2c1daed2 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:01.449679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc316dd-aaa8-49e3-916b-737bc36d3671 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.450245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc316dd-aaa8-49e3-916b-737bc36d3671 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.450245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc316dd-aaa8-49e3-916b-737bc36d3671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:01.497298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:01.500288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:01.504578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1fc316dd-aaa8-49e3-916b-737bc36d3671 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:01.505798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1fc316dd-aaa8-49e3-916b-737bc36d3671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:01.587306 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1185/2358] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:01.597305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36860ec7-1a2d-48ce-89d9-85a50b2f3aa4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.597584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36860ec7-1a2d-48ce-89d9-85a50b2f3aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.597883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36860ec7-1a2d-48ce-89d9-85a50b2f3aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:01.599637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60189-5918-4402-881f-f1a7ce1d191f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:01.608047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:01.609082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.609897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.610663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] PATH_INFO: `/v3/users/70e24625e3a548278b932597fc1d0e16` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:01.613451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e24625e3a548278b932597fc1d0e16)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:01.618718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:01.633845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-36860ec7-1a2d-48ce-89d9-85a50b2f3aa4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:01.635264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-36860ec7-1a2d-48ce-89d9-85a50b2f3aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:01.647595 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1186/2359] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:01.657838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36860ec7-1a2d-48ce-89d9-85a50b2f3aa4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:01.668235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36860ec7-1a2d-48ce-89d9-85a50b2f3aa4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:01.674982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:01.675709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.676041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.676364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:01.677074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:14:01.685274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:01.685274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:01.703536 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1187/2360] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:14:01.704768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:01.718846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb808bd-e72a-4b94-a670-80c944cb5008 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:01.725532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:01.726816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.727302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.727627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:01.728267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:01.730214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:01.861815 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:01.863968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e24625e3a548278b932597fc1d0e16'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.874922 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1188/2361] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:01 2022] POST /identity/v3/projects => generated 391 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:01.876211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:01.877311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e24625e3a548278b932597fc1d0e16'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.878074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e24625e3a548278b932597fc1d0e16'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.949452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e24625e3a548278b932597fc1d0e16'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.950181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53de7f1c-9359-4a44-a887-07a135c071f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e24625e3a548278b932597fc1d0e16'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:01.957164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0c60-fa6b-46ce-a04c-86048fd0a722 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:01.969148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:01.969753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.970061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.970419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:01.971059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:01.974387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:01.984610 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1174/2362] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:01 2022] DELETE /identity/v3/users/70e24625e3a548278b932597fc1d0e16 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:01.989455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:01.990089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:01.990480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:02.042856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:02.046408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:02.074927 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1189/2363] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:01 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:02.078647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:02.087323 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:02.087437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:02.107143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d523d9-1e26-478e-8b87-e8a5cf6184da admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:02.153780 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1175/2364] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:02.165916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:02.167738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:02.199309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:02.199924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:02.200203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:02.202001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:02.202282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:02.204321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:02.222040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1190/2365] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:02.230207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:02.243750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b49b-c693-443e-ba9d-34af756eb7f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:02.249248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:02.249950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:02.250370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:02.250858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:02.251520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:02.253191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:02.256378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324c4e5-41b9-474c-87d0-5d40de843110 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:02.265094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbaa2d-ab30-484f-9f51-0b9bcc37a496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:02.265094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbaa2d-ab30-484f-9f51-0b9bcc37a496 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:02.265094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbaa2d-ab30-484f-9f51-0b9bcc37a496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:02.265094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbaa2d-ab30-484f-9f51-0b9bcc37a496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:02.268026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1191/2366] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:02.271892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:02.277407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbaa2d-ab30-484f-9f51-0b9bcc37a496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:02.279114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbaa2d-ab30-484f-9f51-0b9bcc37a496 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:02.291509 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1176/2367] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:14:02.296466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11262-15cd-4c89-9b02-76760b07aef9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:02.302103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:02.302783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:02.303190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:02.303608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] PATH_INFO: `/v3/projects/68465df0a3cd4f3da1e5ba8956f16c3d/users/f3c51a6267f14872b639612a6df38ac7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:02.324848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68465df0a3cd4f3da1e5ba8956f16c3d, user_id=f3c51a6267f14872b639612a6df38ac7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:02.327610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:02.425418 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1192/2368] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:02 2022] PUT /identity/v3/projects/68465df0a3cd4f3da1e5ba8956f16c3d/users/f3c51a6267f14872b639612a6df38ac7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:02.437208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:02.437505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:02.437780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:02.482315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] MFA Rules not processed for user `f3c51a6267f14872b639612a6df38ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:02.483704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:02.624092 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1177/2369] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:02.870116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:02.872110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:02.989772 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:03.029903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:03.031405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:03.042226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab75b7-50a4-411f-8475-fa3c868f40a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:03.062754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:03.063388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:03.063665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:03.063936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:03.087794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:03.090120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:03.123043 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1193/2370] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:03.129762 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:03.147102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a45ec-1a3e-403c-8a8c-f38b03737aaa None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:03.152434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:03.153211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:03.153734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:03.154252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] PATH_INFO: `/v3/projects/8056b64dc6424bd59f98f0aad9c5e45c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:03.156996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8056b64dc6424bd59f98f0aad9c5e45c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:03.157863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:03.297961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8056b64dc6424bd59f98f0aad9c5e45c', 'request_id': 'req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.303576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8056b64dc6424bd59f98f0aad9c5e45c', 'request_id': 'req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.431390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8056b64dc6424bd59f98f0aad9c5e45c', 'request_id': 'req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.456290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] The token cache is being invalidate because project 8056b64dc6424bd59f98f0aad9c5e45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:03.456585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.463330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.465096 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1178/2371] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:03 2022] DELETE /identity/v3/projects/8056b64dc6424bd59f98f0aad9c5e45c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:03.475115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:03.491849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649f8cb-baf0-499d-9a02-73e00abb14b7 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:03.626474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:03.627873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:03.630723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:03.631534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:03.632108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:03.632541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] PATH_INFO: `/v3/users/337f88a0a14f45038da0ec66d4fd5283` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:03.634289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337f88a0a14f45038da0ec66d4fd5283)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:03.636183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:03.644005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdcc7a-ac4d-4c31-92d6-164fa3136dbc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:03.649006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:03.649644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:03.650051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:03.650328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] PATH_INFO: `/v3/users/f3c51a6267f14872b639612a6df38ac7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:03.651545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c51a6267f14872b639612a6df38ac7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:03.653444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:03.848027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337f88a0a14f45038da0ec66d4fd5283'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.862464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c51a6267f14872b639612a6df38ac7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.863291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337f88a0a14f45038da0ec66d4fd5283'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.864862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337f88a0a14f45038da0ec66d4fd5283'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.872347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c51a6267f14872b639612a6df38ac7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.873713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c51a6267f14872b639612a6df38ac7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.920310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337f88a0a14f45038da0ec66d4fd5283'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.921040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26f5a3da-fb6c-4c49-a367-2cb1c9e57fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337f88a0a14f45038da0ec66d4fd5283'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:03.957997 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1194/2372] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:03 2022] DELETE /identity/v3/users/337f88a0a14f45038da0ec66d4fd5283 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:14:04.004642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c51a6267f14872b639612a6df38ac7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:04.005513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c51a6267f14872b639612a6df38ac7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:04.036118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1179/2373] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:03 2022] DELETE /identity/v3/users/f3c51a6267f14872b639612a6df38ac7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:04.041250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:04.041537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:04.046046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:04.076142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:04.080030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:04.202845 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:04.218810 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1195/2374] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:14:04.271945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:04.273659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:04.618967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9324-64c2-41b2-b6ac-bea93523cf5b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:04.618967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89606aca-e038-411d-a8e7-fdacc66c02f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:04.618967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606aca-e038-411d-a8e7-fdacc66c02f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:04.618967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606aca-e038-411d-a8e7-fdacc66c02f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:04.620135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606aca-e038-411d-a8e7-fdacc66c02f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:04.620135 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:04.620135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89606aca-e038-411d-a8e7-fdacc66c02f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:04.620135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89606aca-e038-411d-a8e7-fdacc66c02f2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:04.620135 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1180/2375] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:04.894859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:04.897578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:04.944145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1f54-546d-4e5a-a177-86bb035a5e9f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:04.952200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:04.953291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:04.953773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:04.954348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] PATH_INFO: `/v3/projects/2b34c9047e9747f099c715b5106a10a6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:04.955759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b34c9047e9747f099c715b5106a10a6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:04.963645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:05.152096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b34c9047e9747f099c715b5106a10a6', 'request_id': 'req-280608d8-48cb-4575-b772-6a927f7d197a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:05.159805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b34c9047e9747f099c715b5106a10a6', 'request_id': 'req-280608d8-48cb-4575-b772-6a927f7d197a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:05.236289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b34c9047e9747f099c715b5106a10a6', 'request_id': 'req-280608d8-48cb-4575-b772-6a927f7d197a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:05.265163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] The token cache is being invalidate because project 2b34c9047e9747f099c715b5106a10a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:05.265715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:05.266789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-280608d8-48cb-4575-b772-6a927f7d197a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:05.268624 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1196/2376] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:04 2022] DELETE /identity/v3/projects/2b34c9047e9747f099c715b5106a10a6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:05.275637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6191db5-3bb8-4a5f-8916-6b80c51e0407 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:05.276157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6191db5-3bb8-4a5f-8916-6b80c51e0407 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:05.277831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6191db5-3bb8-4a5f-8916-6b80c51e0407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:05.313471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f6191db5-3bb8-4a5f-8916-6b80c51e0407 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:05.315299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6191db5-3bb8-4a5f-8916-6b80c51e0407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:05.411615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1181/2377] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:05.419461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa40c-d1d5-443c-a3d3-4cde9dff7f10 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:05.420479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa40c-d1d5-443c-a3d3-4cde9dff7f10 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:05.420975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa40c-d1d5-443c-a3d3-4cde9dff7f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:05.454644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-842aa40c-d1d5-443c-a3d3-4cde9dff7f10 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:05.456731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-842aa40c-d1d5-443c-a3d3-4cde9dff7f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:05.477031 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1197/2378] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:05.488541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6191db5-3bb8-4a5f-8916-6b80c51e0407 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:05.519434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6191db5-3bb8-4a5f-8916-6b80c51e0407 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:05.526387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:05.528624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:05.529065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:05.529504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:05.530344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:14:05.530796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:05.533906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:05.556228 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1182/2379] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:14:05.560518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa40c-d1d5-443c-a3d3-4cde9dff7f10 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:05.573105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa40c-d1d5-443c-a3d3-4cde9dff7f10 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:05.591076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:05.592101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:05.593499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:05.593924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:05.594760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:05.599262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:05.761474 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1198/2380] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:05 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:05.764128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:05.792009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea340-76e5-45cd-b2e7-3cccdb9cd56d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:05.882051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:05.884332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:06.046924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.049284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.049683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.050150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.051547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.054247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:06.085045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e8580-b648-4b91-bd19-656c908dfa3d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.091689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.092315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.092594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.092859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] PATH_INFO: `/v3/projects/68465df0a3cd4f3da1e5ba8956f16c3d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.094045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68465df0a3cd4f3da1e5ba8956f16c3d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.097967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:06.171208 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1183/2381] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:05 2022] POST /identity/v3/users => generated 289 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:06.175244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:06.219731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb98c6d-3304-4541-a332-11f6cfb05c88 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.226811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.227522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.228091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.228493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.229261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.231153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:06.247527 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1184/2382] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:06.252573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:06.266533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f32f1-20fb-4837-a990-f82c588484ef admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.328974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68465df0a3cd4f3da1e5ba8956f16c3d', 'request_id': 'req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:06.330546 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:06.338608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68465df0a3cd4f3da1e5ba8956f16c3d', 'request_id': 'req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:06.418387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68465df0a3cd4f3da1e5ba8956f16c3d', 'request_id': 'req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:06.427843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.429115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.430104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.430525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.431350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.433545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:06.437341 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:06.446573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] The token cache is being invalidate because project 68465df0a3cd4f3da1e5ba8956f16c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:06.447061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:06.454094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-981d38b2-8b1a-46a1-93c0-6a9a60e0820e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:06.454094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1199/2383] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:05 2022] DELETE /identity/v3/projects/68465df0a3cd4f3da1e5ba8956f16c3d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:06.455155 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1185/2384] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:06.456074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321262b-bd5a-45b4-a37c-a1a10983bf96 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.456719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321262b-bd5a-45b4-a37c-a1a10983bf96 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.457105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321262b-bd5a-45b4-a37c-a1a10983bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.466631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:06.474046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:06.487101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0321262b-bd5a-45b4-a37c-a1a10983bf96 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:06.493786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0321262b-bd5a-45b4-a37c-a1a10983bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:06.499221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a1af-3148-4451-b63f-017b8bd7858d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.506027 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1200/2385] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:06.510621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cc930-4255-4dfc-be72-9a43d68c584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.511792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc930-4255-4dfc-be72-9a43d68c584d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.512419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc930-4255-4dfc-be72-9a43d68c584d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.517110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e04a-d788-4dda-b5f2-430a49271196 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.517110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e04a-d788-4dda-b5f2-430a49271196 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.517323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc930-4255-4dfc-be72-9a43d68c584d admin admin] PATH_INFO: `/v3/projects/a7f8618ec61641c3b971d537b58399b2/users/aeb2f98c12b1488f956049a42510bcb5/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.517418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e04a-d788-4dda-b5f2-430a49271196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.538715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cc930-4255-4dfc-be72-9a43d68c584d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f8618ec61641c3b971d537b58399b2, user_id=aeb2f98c12b1488f956049a42510bcb5, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.544744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cc930-4255-4dfc-be72-9a43d68c584d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:06.545263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-72d9e04a-d788-4dda-b5f2-430a49271196 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:06.547474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-72d9e04a-d788-4dda-b5f2-430a49271196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:06.562021 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1201/2386] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:06.565067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e04a-d788-4dda-b5f2-430a49271196 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:06.577466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e04a-d788-4dda-b5f2-430a49271196 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.583317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.584180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.584531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.584948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.585708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:14:06.586124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.588036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:06.606073 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1202/2387] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:14:06.610612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:06.628683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e6a7c-637d-4bfb-861f-9839fcef3806 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.631582 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1186/2388] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:06 2022] PUT /identity/v3/projects/a7f8618ec61641c3b971d537b58399b2/users/aeb2f98c12b1488f956049a42510bcb5/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:06.652985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7a9f6-f1ac-4378-8145-6dee9258c548 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.656493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7a9f6-f1ac-4378-8145-6dee9258c548 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.656493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7a9f6-f1ac-4378-8145-6dee9258c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.713618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c9c7a9f6-f1ac-4378-8145-6dee9258c548 None None] MFA Rules not processed for user `aeb2f98c12b1488f956049a42510bcb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:06.715598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c9c7a9f6-f1ac-4378-8145-6dee9258c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:06.731541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.732323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.732888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.733275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.734397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.737250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:06.832925 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1187/2389] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:06.837544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7a9f6-f1ac-4378-8145-6dee9258c548 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:06.863739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7a9f6-f1ac-4378-8145-6dee9258c548 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.865658 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1203/2390] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:06 2022] POST /identity/v3/projects => generated 381 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:06.866575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:06.978520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691000f2-94d2-44c9-bf58-012704895db5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:06.985703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:06.986913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:06.987955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:06.988298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:06.988999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:06.990991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.035252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.035944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.041426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.041426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.041426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.041426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.095849 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1204/2391] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:06 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:07.100961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.111937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2d6d5-36cf-4f0a-8364-b46d4b1ca49f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.136733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.139166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.140069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.140223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.140825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.147357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.152079 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1188/2392] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:06 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:14:07.156298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.184766 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1205/2393] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:14:07.187847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.205046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c47-8ce9-4106-8008-2870b7b446a6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.242436 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:07.247645 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:07.263856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7816d4-07fa-4426-b226-197a61c0b266 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.269303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.270195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.270546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.270830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.271538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.273882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.321042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.321042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.321344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.321619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.322357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.323989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.342039 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1206/2394] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:07.347887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.362051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f4f6-db7b-4a17-8c5d-809618bead08 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.368382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c149-cb86-40db-8dde-1c3bf8020dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.369750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c149-cb86-40db-8dde-1c3bf8020dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.370002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c149-cb86-40db-8dde-1c3bf8020dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.370344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c149-cb86-40db-8dde-1c3bf8020dbd admin admin] PATH_INFO: `/v3/projects/0d2182cae228436ba5c9fc59edb00274/users/870da6eeeb684fa380bf48b41f27b984/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.399858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4c149-cb86-40db-8dde-1c3bf8020dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2182cae228436ba5c9fc59edb00274, user_id=870da6eeeb684fa380bf48b41f27b984, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.408351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4c149-cb86-40db-8dde-1c3bf8020dbd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.431516 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1189/2395] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:07 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:07.435357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.452749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d2ed7-7136-447d-8233-c09d94b94fa9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.462579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.463215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.463506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.463758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.464407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.466059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.489447 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1190/2396] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:14:07.493810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.504539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b0130-a567-484f-b894-9a3a0200ff92 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.510158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.511063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.511419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.511757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] PATH_INFO: `/v3/projects/bba378b2a71e41819a33c165c98b522d/users/dadb7a977a7648128d97e4d657384ada/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.528551 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1207/2397] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:07 2022] PUT /identity/v3/projects/0d2182cae228436ba5c9fc59edb00274/users/870da6eeeb684fa380bf48b41f27b984/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:07.531473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba378b2a71e41819a33c165c98b522d, user_id=dadb7a977a7648128d97e4d657384ada, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.533844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.534156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.534438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.535137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.560288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:07.561775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:07.643047 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1191/2398] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:07 2022] PUT /identity/v3/projects/bba378b2a71e41819a33c165c98b522d/users/dadb7a977a7648128d97e4d657384ada/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:14:07.646309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.681487 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1208/2399] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:07.692120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.693691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:07.763876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee746-89dc-4123-8fa5-85cac64bae7c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.780234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.780935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.781285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.781616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.782394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.784066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.798579 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1192/2400] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:14:07.803686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:07.807978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebe8f9-7197-4fa7-8e7f-5072741c5aa8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.820678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2faac-b24c-44bd-9175-f15e5a02bce8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:07.825808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a8a9-c68b-44d5-a803-e3ff22a57cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.826590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a8a9-c68b-44d5-a803-e3ff22a57cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.835775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a8a9-c68b-44d5-a803-e3ff22a57cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.835775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a8a9-c68b-44d5-a803-e3ff22a57cf6 admin admin] PATH_INFO: `/v3/projects/bba378b2a71e41819a33c165c98b522d/users/dadb7a977a7648128d97e4d657384ada/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.835775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a8a9-c68b-44d5-a803-e3ff22a57cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba378b2a71e41819a33c165c98b522d, user_id=dadb7a977a7648128d97e4d657384ada, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.835775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a8a9-c68b-44d5-a803-e3ff22a57cf6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.860611 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1193/2401] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:07 2022] PUT /identity/v3/projects/bba378b2a71e41819a33c165c98b522d/users/dadb7a977a7648128d97e4d657384ada/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:07.862419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8b3f-1c99-4f6b-ae22-b59c6d23b747 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.862881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8b3f-1c99-4f6b-ae22-b59c6d23b747 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.863309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8b3f-1c99-4f6b-ae22-b59c6d23b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.884376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:07.885470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:07.885947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:07.887078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:07.899566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:07.900438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:07.920084 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:07.927290 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1209/2402] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:14:07.944610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-181e8b3f-1c99-4f6b-ae22-b59c6d23b747 None None] MFA Rules not processed for user `dadb7a977a7648128d97e4d657384ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:07.946196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-181e8b3f-1c99-4f6b-ae22-b59c6d23b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:08.074900 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1194/2403] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:08.155562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:08.157005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:08.280566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066511c-5bba-46df-95ca-121f8105267f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:08.388675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d324b3-1d92-478f-b6cc-b753eff4ece4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:08.390212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d324b3-1d92-478f-b6cc-b753eff4ece4 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:08.390681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d324b3-1d92-478f-b6cc-b753eff4ece4 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:08.391140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d324b3-1d92-478f-b6cc-b753eff4ece4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:08.407751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d324b3-1d92-478f-b6cc-b753eff4ece4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:08.409714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d324b3-1d92-478f-b6cc-b753eff4ece4 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:08.422958 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1210/2404] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:08.559842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d8c2-c7fa-4ab5-b1cd-d2e5a6568940 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:08.560373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d8c2-c7fa-4ab5-b1cd-d2e5a6568940 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:08.560373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d8c2-c7fa-4ab5-b1cd-d2e5a6568940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:08.567640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b172-047a-4049-bca3-ea04958b3094 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:08.568007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b172-047a-4049-bca3-ea04958b3094 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:08.568241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b172-047a-4049-bca3-ea04958b3094 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:08.569818 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1211/2405] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:14:08.579615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3b172-047a-4049-bca3-ea04958b3094 None None] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:14:08.603924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f314d8c2-c7fa-4ab5-b1cd-d2e5a6568940 None None] MFA Rules not processed for user `8a246c84d8f444d59c9d5becae78f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:08.605013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f314d8c2-c7fa-4ab5-b1cd-d2e5a6568940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:08.616134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3b172-047a-4049-bca3-ea04958b3094 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:08.617673 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:08.641094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3b172-047a-4049-bca3-ea04958b3094 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:08.652157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dadb7a977a7648128d97e4d657384ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bba378b2a71e41819a33c165c98b522d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:08.652803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:08.653091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:08.653364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] PATH_INFO: `/v3/projects/a7f8618ec61641c3b971d537b58399b2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:08.655802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] RBAC: Authorizing `identity:get_project(project_id=a7f8618ec61641c3b971d537b58399b2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:08.658044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:08.660453 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1212/2406] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:14:08 2022] GET /identity/v3/projects/a7f8618ec61641c3b971d537b58399b2 => generated 377 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:14:08.705614 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1195/2407] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:09.740674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:09.743178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:09.815185 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:09.820425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dbe74-74a2-46c3-9499-a4c946f89ba9 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:09.825804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbee43-df69-4e32-af83-bdd12bc3416a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:09.826514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbee43-df69-4e32-af83-bdd12bc3416a service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:09.826827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbee43-df69-4e32-af83-bdd12bc3416a service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:09.827118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbee43-df69-4e32-af83-bdd12bc3416a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:09.828959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1dbbee43-df69-4e32-af83-bdd12bc3416a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:09.841429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbee43-df69-4e32-af83-bdd12bc3416a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:09.843176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbee43-df69-4e32-af83-bdd12bc3416a service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:09.854478 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1213/2408] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:10.194478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d8c2-c7fa-4ab5-b1cd-d2e5a6568940 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:10.194478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d8c2-c7fa-4ab5-b1cd-d2e5a6568940 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:10.204486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:10.205477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:10.205943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:10.207710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:10.417177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:10.418951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:10.453304 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1196/2409] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:10.906808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099da7e-7d7e-4474-aacf-06104819f356 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:10.907392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099da7e-7d7e-4474-aacf-06104819f356 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:10.907392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099da7e-7d7e-4474-aacf-06104819f356 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:10.909120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1214/2410] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:14:10.917394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:14:10.920451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:10.949549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:10.995387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580775ec-7e91-47e3-9ffc-47f447991831 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:11.009018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c34d3-3153-4f7a-a723-436062e4bdb1 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dadb7a977a7648128d97e4d657384ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bba378b2a71e41819a33c165c98b522d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:11.011212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c34d3-3153-4f7a-a723-436062e4bdb1 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:11.011729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c34d3-3153-4f7a-a723-436062e4bdb1 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:11.012835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c34d3-3153-4f7a-a723-436062e4bdb1 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] PATH_INFO: `/v3/projects/a7f8618ec61641c3b971d537b58399b2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:11.015948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c34d3-3153-4f7a-a723-436062e4bdb1 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] RBAC: Authorizing `identity:get_project(project_id=a7f8618ec61641c3b971d537b58399b2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:11.019457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c34d3-3153-4f7a-a723-436062e4bdb1 tempest-FlavorsAccessTestJSON-86283018 tempest-FlavorsAccessTestJSON-86283018-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:11.050070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1197/2411] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:14:10 2022] GET /identity/v3/projects/a7f8618ec61641c3b971d537b58399b2 => generated 377 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:14:13.007837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099da7e-7d7e-4474-aacf-06104819f356 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:13.121276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099da7e-7d7e-4474-aacf-06104819f356 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:13.126894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:13.127937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:13.128536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:13.129192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] PATH_INFO: `/v3/users/aeb2f98c12b1488f956049a42510bcb5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:13.130767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb2f98c12b1488f956049a42510bcb5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:13.133680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:13.381923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb2f98c12b1488f956049a42510bcb5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:13.404501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb2f98c12b1488f956049a42510bcb5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:13.405909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb2f98c12b1488f956049a42510bcb5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:13.493710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb2f98c12b1488f956049a42510bcb5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:13.494665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb2f98c12b1488f956049a42510bcb5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:13.545213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1215/2412] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:13 2022] DELETE /identity/v3/users/aeb2f98c12b1488f956049a42510bcb5 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:13.547146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:13.547653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:13.547751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:13.594759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:13.598962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:13.739802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1198/2413] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:13.758164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:13.762202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:13.969226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1425d-02bc-4e1a-b53d-d9118179098b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:13.975249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:13.977229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:13.977549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:13.991497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:14.016564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:14.016564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:14.051349 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1216/2414] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:14.912237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:14.914302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:14.927643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dc9d9-7bf6-40e8-949c-79bad948e463 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:14.933314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:14.933579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:14.933665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:14.933951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] PATH_INFO: `/v3/projects/a7f8618ec61641c3b971d537b58399b2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:14.935584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f8618ec61641c3b971d537b58399b2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:14.937677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:15.044134 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:15.050626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f8618ec61641c3b971d537b58399b2', 'request_id': 'req-c5b997ca-b428-47d0-88f2-977f03fe7211'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.057348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f8618ec61641c3b971d537b58399b2', 'request_id': 'req-c5b997ca-b428-47d0-88f2-977f03fe7211'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.097857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f8618ec61641c3b971d537b58399b2', 'request_id': 'req-c5b997ca-b428-47d0-88f2-977f03fe7211'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.111736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] The token cache is being invalidate because project a7f8618ec61641c3b971d537b58399b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:15.112326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.113225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.115457 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1199/2415] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:14 2022] DELETE /identity/v3/projects/a7f8618ec61641c3b971d537b58399b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:15.120238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:15.132033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179929a-446e-47a3-abf5-75cc41581d61 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:15.148190 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:15.235326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:15.236251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:15.236679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:15.237102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] PATH_INFO: `/v3/users/dadb7a977a7648128d97e4d657384ada` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:15.238706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadb7a977a7648128d97e4d657384ada)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:15.241680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:15.488462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadb7a977a7648128d97e4d657384ada'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.508558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadb7a977a7648128d97e4d657384ada'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.514434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadb7a977a7648128d97e4d657384ada'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.590238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadb7a977a7648128d97e4d657384ada'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.591377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadb7a977a7648128d97e4d657384ada'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:15.615876 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1217/2416] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:15 2022] DELETE /identity/v3/users/dadb7a977a7648128d97e4d657384ada => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:16.843221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:16.844700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:16.872341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b997ca-b428-47d0-88f2-977f03fe7211 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:17.010718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:17.011516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:17.011966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:17.012600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] PATH_INFO: `/v3/projects/bba378b2a71e41819a33c165c98b522d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:17.014092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba378b2a71e41819a33c165c98b522d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:17.016323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:17.151274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba378b2a71e41819a33c165c98b522d', 'request_id': 'req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:17.165055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba378b2a71e41819a33c165c98b522d', 'request_id': 'req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:17.275944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba378b2a71e41819a33c165c98b522d', 'request_id': 'req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:17.303632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] The token cache is being invalidate because project bba378b2a71e41819a33c165c98b522d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:17.303934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:17.306535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:17.307102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-55fa9709-f8b9-4f39-ae94-9ca784a6f3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:17.308383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:17.319453 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1200/2417] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:16 2022] DELETE /identity/v3/projects/bba378b2a71e41819a33c165c98b522d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:17.329968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d287-7666-4695-8169-3b9b3e0f5d85 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:17.329968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d287-7666-4695-8169-3b9b3e0f5d85 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:17.329968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d287-7666-4695-8169-3b9b3e0f5d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:17.348668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb90241-544a-4f69-8ef2-ef488f93c0ca admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:17.400436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3385d287-7666-4695-8169-3b9b3e0f5d85 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:17.401514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3385d287-7666-4695-8169-3b9b3e0f5d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:17.578234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:17.580278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:17.581487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:17.582075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] PATH_INFO: `/v3/users/275cdb98ca7a48f68441d6c934740df0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:17.584664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=275cdb98ca7a48f68441d6c934740df0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:17.588463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:17.593243 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:17.656773 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1201/2418] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:17.667758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db5b40-e760-429c-ad18-d73cd5fef681 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:17.668182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db5b40-e760-429c-ad18-d73cd5fef681 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:17.668476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db5b40-e760-429c-ad18-d73cd5fef681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:17.731685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-68db5b40-e760-429c-ad18-d73cd5fef681 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:17.733285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-68db5b40-e760-429c-ad18-d73cd5fef681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:17.748857 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1202/2419] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:17.753202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db5b40-e760-429c-ad18-d73cd5fef681 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:17.764635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db5b40-e760-429c-ad18-d73cd5fef681 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:17.775933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:17.776874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:17.777443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:17.777930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:17.778850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:14:17.779362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:17.782146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:17.800701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1203/2420] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:14:17.802020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:17.825268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e42fc0-227b-426b-a71e-5a218ed41a7a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:17.831718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:17.834794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:17.834794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:17.834794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:17.834794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:17.836956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:17.934058 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:17.955403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275cdb98ca7a48f68441d6c934740df0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:17.977752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275cdb98ca7a48f68441d6c934740df0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:17.982184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275cdb98ca7a48f68441d6c934740df0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:18.033727 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1204/2421] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:17 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:14:18.039754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:18.093047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275cdb98ca7a48f68441d6c934740df0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:18.093830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a730cd2-c055-423a-9c49-cb3115bb7d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275cdb98ca7a48f68441d6c934740df0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:18.162860 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1218/2422] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:17 2022] DELETE /identity/v3/users/275cdb98ca7a48f68441d6c934740df0 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:14:18.168940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.169225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.174376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:18.208085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:18.209907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:18.266388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b728-4beb-405c-ab8b-a0f659035682 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:18.325600 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1219/2423] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:18.387402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:18.388864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:18.436955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:18.437500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.437927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.438488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:18.439300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:18.441412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:18.533256 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1205/2424] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:18 2022] POST /identity/v3/users => generated 293 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:18.537217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:18.540461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adecc71-8051-4e0c-bcf7-87be9f4d2577 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:18.541008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:18.550462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:18.550910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.551981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.553817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:18.566906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47358d0-5995-4e6b-9e41-fff596477129 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:18.570363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:18.572047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:18.580474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:18.580889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.581252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.581526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:18.582212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:18.585112 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1220/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:14:18.587221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:18.614941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1206/2426] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:18.616496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:18.634478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8741e5-6a37-42c4-b8c3-e48a87221eaf service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:18.658174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84013831-921c-4275-b7fd-9a073b8ce9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:18.659658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013831-921c-4275-b7fd-9a073b8ce9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.660141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013831-921c-4275-b7fd-9a073b8ce9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.660993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013831-921c-4275-b7fd-9a073b8ce9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:18.662346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84013831-921c-4275-b7fd-9a073b8ce9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:18.664387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84013831-921c-4275-b7fd-9a073b8ce9c5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:18.679287 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1221/2427] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:18.684937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:18.701319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5766b7-5b92-4a72-a638-9c41add7782a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:18.706949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988fd83-8315-476b-823f-1ae1e6bfc25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:18.707920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988fd83-8315-476b-823f-1ae1e6bfc25d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.708522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988fd83-8315-476b-823f-1ae1e6bfc25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.709559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988fd83-8315-476b-823f-1ae1e6bfc25d admin admin] PATH_INFO: `/v3/projects/356a4b3819db457fb5caf68ded0212fa/users/80703c3d1dae419c9fd5ca103f3c28bf/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:18.733786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988fd83-8315-476b-823f-1ae1e6bfc25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=356a4b3819db457fb5caf68ded0212fa, user_id=80703c3d1dae419c9fd5ca103f3c28bf, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:18.736578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988fd83-8315-476b-823f-1ae1e6bfc25d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:18.863656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1207/2428] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:18 2022] PUT /identity/v3/projects/356a4b3819db457fb5caf68ded0212fa/users/80703c3d1dae419c9fd5ca103f3c28bf/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:18.885397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadefc31-c753-494d-ba3c-4040098e4061 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.886649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadefc31-c753-494d-ba3c-4040098e4061 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.887855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadefc31-c753-494d-ba3c-4040098e4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:18.943406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fadefc31-c753-494d-ba3c-4040098e4061 None None] MFA Rules not processed for user `80703c3d1dae419c9fd5ca103f3c28bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:18.948168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fadefc31-c753-494d-ba3c-4040098e4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:18.996602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ef17-a6f7-4cdd-9f3a-a9c808626a80 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:18.996602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ef17-a6f7-4cdd-9f3a-a9c808626a80 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:18.996807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ef17-a6f7-4cdd-9f3a-a9c808626a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:19.128168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d386ef17-a6f7-4cdd-9f3a-a9c808626a80 None None] MFA Rules not processed for user `870da6eeeb684fa380bf48b41f27b984`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:19.131982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d386ef17-a6f7-4cdd-9f3a-a9c808626a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:19.190743 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1222/2429] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:19.196588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadefc31-c753-494d-ba3c-4040098e4061 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:19.299503 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1208/2430] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:14:19.301163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3596d-0e15-49ed-a74a-ec285517e8de None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:19.301649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3596d-0e15-49ed-a74a-ec285517e8de None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:19.302126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3596d-0e15-49ed-a74a-ec285517e8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:19.302630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadefc31-c753-494d-ba3c-4040098e4061 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:19.311652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:19.312368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:19.312709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:19.313046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:19.313767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:19.316144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:19.341038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-41e3596d-0e15-49ed-a74a-ec285517e8de None None] MFA Rules not processed for user `870da6eeeb684fa380bf48b41f27b984`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:19.343004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-41e3596d-0e15-49ed-a74a-ec285517e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:19.388458 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1209/2431] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:19.434877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1223/2432] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:19 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:19.438924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3596d-0e15-49ed-a74a-ec285517e8de None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:19.457813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3596d-0e15-49ed-a74a-ec285517e8de None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:19.510207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:19.513676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:19.617123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:19.617778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:19.618090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:19.618356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:19.618988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:19.625404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:19.699840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95789862-4ebd-47b4-bb92-5b6fbf7485a9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:19.706024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:19.706802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:19.707079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:19.707352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:19.768826 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1210/2433] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:19 2022] POST /identity/v3/users => generated 300 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:19.772608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:19.794789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142c998-6438-43d0-8217-52eef9129b17 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:19.812977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:19.815051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:19.815051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:19.817441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:19.818218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:19.824283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:19.865755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:19.867669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:19.868270 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1211/2434] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:14:19.873554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:19.891593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501bde5-f3f1-4457-9ae5-f68cc6be9984 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:19.911517 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1224/2435] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:14:19.926858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:19.929042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:19.929469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:19.930225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] PATH_INFO: `/v3/projects/d2d01301d47b40c8bb2ab24042d092b1/users/1fd857a3b4cf4c97948ba349f8920fc6/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:19.977187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d01301d47b40c8bb2ab24042d092b1, user_id=1fd857a3b4cf4c97948ba349f8920fc6, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:19.981547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:20.065024 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1212/2436] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:19 2022] PUT /identity/v3/projects/d2d01301d47b40c8bb2ab24042d092b1/users/1fd857a3b4cf4c97948ba349f8920fc6/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:20.070780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:20.084121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a012-a0db-48ff-8779-00657da83bb3 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:20.229643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:20.230440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:20.230722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:20.238144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:20.238144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:20.238144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:20.258057 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1225/2437] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:20.259521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:20.272232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:20.277818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c5a84-3ae1-4c0f-a280-5bdbb3f190c9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:20.279374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:20.291787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb9bd9-3879-4519-a8db-6eb03a9b5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:20.293386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9bd9-3879-4519-a8db-6eb03a9b5430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:20.297253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9bd9-3879-4519-a8db-6eb03a9b5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:20.297253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9bd9-3879-4519-a8db-6eb03a9b5430 admin admin] PATH_INFO: `/v3/projects/d2d01301d47b40c8bb2ab24042d092b1/users/1fd857a3b4cf4c97948ba349f8920fc6/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:20.300811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb9bd9-3879-4519-a8db-6eb03a9b5430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d01301d47b40c8bb2ab24042d092b1, user_id=1fd857a3b4cf4c97948ba349f8920fc6, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:20.313279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb9bd9-3879-4519-a8db-6eb03a9b5430 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:20.319429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b0594-22dd-4862-b545-e2e2475a062f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:20.332079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:20.332934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:20.334274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:20.334755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] PATH_INFO: `/v3/projects/e6bf637f9ea9423cb3e4e2c74d0382a7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:20.338770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bf637f9ea9423cb3e4e2c74d0382a7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:20.347410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:20.347617 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:20.347617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1213/2438] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:20 2022] PUT /identity/v3/projects/d2d01301d47b40c8bb2ab24042d092b1/users/1fd857a3b4cf4c97948ba349f8920fc6/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:20.360151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ff82-2607-4c1c-acdf-e924d60d31bf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:20.360683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ff82-2607-4c1c-acdf-e924d60d31bf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:20.361156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ff82-2607-4c1c-acdf-e924d60d31bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:20.415914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6784ff82-2607-4c1c-acdf-e924d60d31bf None None] MFA Rules not processed for user `1fd857a3b4cf4c97948ba349f8920fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:20.432252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6784ff82-2607-4c1c-acdf-e924d60d31bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:20.528287 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:20.566483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'request_id': 'req-17871727-ea9d-4940-9b35-ec39168f7c42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:20.577793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'request_id': 'req-17871727-ea9d-4940-9b35-ec39168f7c42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:20.626535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1214/2439] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:20.645718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:20.646148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:20.646537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:20.676326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] MFA Rules not processed for user `80703c3d1dae419c9fd5ca103f3c28bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:20.678360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:20.715043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bf637f9ea9423cb3e4e2c74d0382a7', 'request_id': 'req-17871727-ea9d-4940-9b35-ec39168f7c42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:20.735997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] The token cache is being invalidate because project e6bf637f9ea9423cb3e4e2c74d0382a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:20.736520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:20.737682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:20.740216 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1226/2440] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:20 2022] DELETE /identity/v3/projects/e6bf637f9ea9423cb3e4e2c74d0382a7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:20.755453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:20.755835 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1215/2441] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:20.759352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:20.900142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871727-ea9d-4940-9b35-ec39168f7c42 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:20.906738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:20.907503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:20.907757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:20.913482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] PATH_INFO: `/v3/users/fc1e8bc8f2284be29d91692a273dcb54` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:20.913482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1e8bc8f2284be29d91692a273dcb54)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:20.913482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:21.025229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:21.026853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:21.170505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0e4b6-639c-4a7a-b695-3f3f9cc85bcb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:21.176449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1e8bc8f2284be29d91692a273dcb54'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:21.183562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:21.186819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:21.188040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:21.189181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:21.192024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1e8bc8f2284be29d91692a273dcb54'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:21.192295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:21.193427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1e8bc8f2284be29d91692a273dcb54'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:21.211561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:21.214067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:21.251840 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1216/2442] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:21.258287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1e8bc8f2284be29d91692a273dcb54'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:21.258914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fd40ea5e-0ca5-41c4-8d5e-1f5d9077ef6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1e8bc8f2284be29d91692a273dcb54'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:21.306485 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1227/2443] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:20 2022] DELETE /identity/v3/users/fc1e8bc8f2284be29d91692a273dcb54 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:22.189071 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:22.235258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:22.248509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b771b97-767f-4f15-9fc9-98ccb5765de0 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:22.365984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:22.367889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:22.368170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:22.368462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] PATH_INFO: `/v3/projects/9998de26f7ea47e781c1d05c2da2685f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:22.373038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9998de26f7ea47e781c1d05c2da2685f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:22.395230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:22.614333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9998de26f7ea47e781c1d05c2da2685f', 'request_id': 'req-2eb11ab6-0748-4075-83af-8b58e1660c4c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:22.638729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9998de26f7ea47e781c1d05c2da2685f', 'request_id': 'req-2eb11ab6-0748-4075-83af-8b58e1660c4c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:22.728574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9998de26f7ea47e781c1d05c2da2685f', 'request_id': 'req-2eb11ab6-0748-4075-83af-8b58e1660c4c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:22.751353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] The token cache is being invalidate because project 9998de26f7ea47e781c1d05c2da2685f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:22.751647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:22.752902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2eb11ab6-0748-4075-83af-8b58e1660c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:22.800533 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1217/2444] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:22 2022] DELETE /identity/v3/projects/9998de26f7ea47e781c1d05c2da2685f => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:22.805545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf804-25b0-45f4-a8fb-c2cc980d362f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:22.805968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf804-25b0-45f4-a8fb-c2cc980d362f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:22.805968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf804-25b0-45f4-a8fb-c2cc980d362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:22.837935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c42cf804-25b0-45f4-a8fb-c2cc980d362f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:22.840634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c42cf804-25b0-45f4-a8fb-c2cc980d362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:23.003682 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1228/2445] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:23.005726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6589-44a5-4c65-8db8-409808dc4b34 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.006391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6589-44a5-4c65-8db8-409808dc4b34 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.006771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6589-44a5-4c65-8db8-409808dc4b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.032160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-118f6589-44a5-4c65-8db8-409808dc4b34 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:23.033918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-118f6589-44a5-4c65-8db8-409808dc4b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:23.055607 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1218/2446] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:23.056145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf804-25b0-45f4-a8fb-c2cc980d362f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:23.069994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf804-25b0-45f4-a8fb-c2cc980d362f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:23.080649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.080931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.081207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.086765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:23.087684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.087967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.088249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.088897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:14:23.089199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:23.091317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:23.112850 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1229/2447] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:14:23.113994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:23.116479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:23.120131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:23.127258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f4a78-3c69-4406-a7d0-8f2f5df4e388 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:23.134842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:23.135605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.136129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.136541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.138731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:23.141889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:23.257242 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1219/2448] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:14:23.259177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:23.260786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:23.271308 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1230/2449] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:23 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:23.276083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:23.374085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18bae-5cfe-4d31-ae49-dd00082d35d0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:23.389954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6d03-c436-4f1a-b88c-204b4aaec5b7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:23.398925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:23.399561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.402693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.402693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.402693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:23.405668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:23.462189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:23.462977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.463392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.463636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.560720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:23.562416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:23.591154 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1220/2450] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:14:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:23.594786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1231/2451] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:23 2022] POST /identity/v3/users => generated 292 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:23.598892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:23.612532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb3cbe-25ad-4dc8-9f7c-3335177f8375 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:23.619182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:23.620203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.620843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.621317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.622281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:23.624164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:23.636712 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1221/2452] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:23.640775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:23.652764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ffb1e-d68e-4572-95c2-40d6b1a0e9e4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:23.661513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfbd0d-2ea7-4050-a66b-7b3b50ce7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:23.662167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfbd0d-2ea7-4050-a66b-7b3b50ce7871 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.662592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfbd0d-2ea7-4050-a66b-7b3b50ce7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.662875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfbd0d-2ea7-4050-a66b-7b3b50ce7871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.663545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfbd0d-2ea7-4050-a66b-7b3b50ce7871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:23.665833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfbd0d-2ea7-4050-a66b-7b3b50ce7871 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:23.678988 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1232/2453] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:14:23.683034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:23.704891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910bfa4-300d-4664-973a-fda25156ce0d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:23.711681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:23.712463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.712841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.713209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] PATH_INFO: `/v3/projects/47aadec780734d03a262d4021f48d625/users/519c893a1e094200b882cf23db7cae54/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.742725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aadec780734d03a262d4021f48d625, user_id=519c893a1e094200b882cf23db7cae54, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:23.759788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:23.871919 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1222/2454] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:23 2022] PUT /identity/v3/projects/47aadec780734d03a262d4021f48d625/users/519c893a1e094200b882cf23db7cae54/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:14:23.891670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529cd37-8a9c-47ab-ae31-f28946ce3b30 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:23.892229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529cd37-8a9c-47ab-ae31-f28946ce3b30 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:23.892229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529cd37-8a9c-47ab-ae31-f28946ce3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:23.963605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2529cd37-8a9c-47ab-ae31-f28946ce3b30 None None] MFA Rules not processed for user `519c893a1e094200b882cf23db7cae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:23.968231 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:23.971154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2529cd37-8a9c-47ab-ae31-f28946ce3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:24.137775 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1233/2455] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:24.146876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:24.376523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c3256-02f3-4033-8123-15243cc18817 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:24.393714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:24.394730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:24.395187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:24.395633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:24.397652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:24.405126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:24.614483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529cd37-8a9c-47ab-ae31-f28946ce3b30 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:24.623068 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1223/2456] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:24 2022] POST /identity/v3/projects => generated 381 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:24.636892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529cd37-8a9c-47ab-ae31-f28946ce3b30 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:24.795949 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:24.855216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:24.855847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:24.856126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:24.856550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:24.857198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:24.859211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:24.993377 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1234/2457] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:24 2022] POST /identity/v3/users => generated 297 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:24.997216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:25.039003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee76b93-a999-4f4b-87c9-1e1ecf78b7d0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:25.094013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:25.096964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:25.096964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:25.096964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:25.097548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:25.103560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:25.149168 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1224/2458] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:25.153097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:25.166215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c0b57-e359-4e60-a114-ef6e8b1f1a5e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:25.197574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:25.201489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:25.204930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:25.204930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] PATH_INFO: `/v3/projects/a58832764dfa4f259d9ef741802080f2/users/d9275a4981504d519e0e097fc3744673/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:25.247298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58832764dfa4f259d9ef741802080f2, user_id=d9275a4981504d519e0e097fc3744673, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:25.250228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:25.383128 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1235/2459] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:25 2022] PUT /identity/v3/projects/a58832764dfa4f259d9ef741802080f2/users/d9275a4981504d519e0e097fc3744673/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:25.383310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:25.385409 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:25.391258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5593-d756-434c-b364-e0ddc87d857e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:25.435746 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:25.523832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a56311-6930-41e9-a9a2-f44bd104994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:25.524773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a56311-6930-41e9-a9a2-f44bd104994d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:25.525210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a56311-6930-41e9-a9a2-f44bd104994d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:25.525637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a56311-6930-41e9-a9a2-f44bd104994d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:25.526490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a56311-6930-41e9-a9a2-f44bd104994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:25.528132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a56311-6930-41e9-a9a2-f44bd104994d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:25.568351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1225/2460] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:25.571026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:25.586678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4005e-7710-4393-a0d3-b3a3eb9e1fa6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:25.603230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449cbe7-09d3-42a8-a496-77b50be1fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:25.604291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449cbe7-09d3-42a8-a496-77b50be1fbec admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:25.604734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449cbe7-09d3-42a8-a496-77b50be1fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:25.605617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449cbe7-09d3-42a8-a496-77b50be1fbec admin admin] PATH_INFO: `/v3/projects/a58832764dfa4f259d9ef741802080f2/users/d9275a4981504d519e0e097fc3744673/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:25.615084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449cbe7-09d3-42a8-a496-77b50be1fbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58832764dfa4f259d9ef741802080f2, user_id=d9275a4981504d519e0e097fc3744673, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:25.620719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449cbe7-09d3-42a8-a496-77b50be1fbec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:25.639456 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1236/2461] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:25 2022] PUT /identity/v3/projects/a58832764dfa4f259d9ef741802080f2/users/d9275a4981504d519e0e097fc3744673/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:25.656981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:25.657259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:25.657731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:25.739946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] MFA Rules not processed for user `d9275a4981504d519e0e097fc3744673`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:25.741586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:25.906725 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1226/2462] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:25.915649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203d40-dab7-4ae8-9361-2a4545c0ac9a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:25.916301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203d40-dab7-4ae8-9361-2a4545c0ac9a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:25.916730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203d40-dab7-4ae8-9361-2a4545c0ac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:25.995130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c4203d40-dab7-4ae8-9361-2a4545c0ac9a None None] MFA Rules not processed for user `519c893a1e094200b882cf23db7cae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:25.997089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c4203d40-dab7-4ae8-9361-2a4545c0ac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:26.238971 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1237/2463] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:26.263219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:26.265007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:26.474881 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:26.511888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba955013-b9fb-41dd-a087-a48aec02762d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:26.531561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a045748-7e76-449f-b211-3a01e87f0ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:26.532444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045748-7e76-449f-b211-3a01e87f0ae5 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:26.532893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045748-7e76-449f-b211-3a01e87f0ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:26.533447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a045748-7e76-449f-b211-3a01e87f0ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:26.546614 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:26.556235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045748-7e76-449f-b211-3a01e87f0ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:26.562438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a045748-7e76-449f-b211-3a01e87f0ae5 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:26.595288 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1227/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:28.334329 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:29.571517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80253d00-9ee2-43c2-9701-6c44d00197a8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:29.572103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80253d00-9ee2-43c2-9701-6c44d00197a8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:29.572103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80253d00-9ee2-43c2-9701-6c44d00197a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:29.629273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-80253d00-9ee2-43c2-9701-6c44d00197a8 None None] MFA Rules not processed for user `547aed83a7e44becb9c89dc6bae62255`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:29.632415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-80253d00-9ee2-43c2-9701-6c44d00197a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:29.845479 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1238/2465] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:30.568531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444209-e4c1-4985-b96e-8116ff90ef7e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:30.569149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444209-e4c1-4985-b96e-8116ff90ef7e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:30.569149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8444209-e4c1-4985-b96e-8116ff90ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:30.620976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c8444209-e4c1-4985-b96e-8116ff90ef7e None None] MFA Rules not processed for user `7262d5984b8c4775b86fae1c0d314718`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:30.626683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c8444209-e4c1-4985-b96e-8116ff90ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:30.683328 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:30.841795 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1228/2466] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:39.825434 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=41 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:41.205475 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=17 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:42.643095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:42.643591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:42.643707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:42.665839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:42.667832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:42.761606 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1239/2467] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:42.789348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8444209-e4c1-4985-b96e-8116ff90ef7e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:42.902664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8444209-e4c1-4985-b96e-8116ff90ef7e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:42.908621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb37e4-848c-452a-b10a-487779932f0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:42.909492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb37e4-848c-452a-b10a-487779932f0f service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:42.909913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb37e4-848c-452a-b10a-487779932f0f service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:42.910391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb37e4-848c-452a-b10a-487779932f0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:42.921516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb37e4-848c-452a-b10a-487779932f0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:42.923619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb37e4-848c-452a-b10a-487779932f0f service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:42.946263 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1229/2468] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:14:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:14:50.946644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:50.948525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:51.072544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452f8e-fedb-43e0-b964-46b8efa2a678 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:51.078132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:51.079146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:51.079567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:51.079996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] PATH_INFO: `/v3/users/7b22ae04637942879cfd29edc41a5483` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:51.081688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b22ae04637942879cfd29edc41a5483)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:51.083822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:51.338793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b22ae04637942879cfd29edc41a5483'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:51.360104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b22ae04637942879cfd29edc41a5483'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:51.361909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b22ae04637942879cfd29edc41a5483'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:51.474488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b22ae04637942879cfd29edc41a5483'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:51.474488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b22ae04637942879cfd29edc41a5483'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:51.520132 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1240/2469] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:50 2022] DELETE /identity/v3/users/7b22ae04637942879cfd29edc41a5483 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:51.525346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:51.526634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:51.527500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:51.559025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:51.560884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:51.645680 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1230/2470] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:51.656982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:51.659095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:51.692843 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:51.729776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4eb58-1b2d-4209-bf33-133927524477 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:51.750195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:51.751011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:51.751390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:51.751868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:51.766566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:51.768694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:51.785416 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1241/2471] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:14:52.684164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:52.686335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:52.712311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a651d-efb4-4c51-ad40-6e6630daf423 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:52.719492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:52.720650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:52.721208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:52.721617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] PATH_INFO: `/v3/projects/936723f56dc549bd9b8e73c97297edf1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:52.723390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936723f56dc549bd9b8e73c97297edf1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:52.730082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:52.839852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936723f56dc549bd9b8e73c97297edf1', 'request_id': 'req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:52.847336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936723f56dc549bd9b8e73c97297edf1', 'request_id': 'req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:52.924067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936723f56dc549bd9b8e73c97297edf1', 'request_id': 'req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:52.957592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] The token cache is being invalidate because project 936723f56dc549bd9b8e73c97297edf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:52.958581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:52.960442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:52.983364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:52.993285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1231/2472] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:52 2022] DELETE /identity/v3/projects/936723f56dc549bd9b8e73c97297edf1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:53.003656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a6d41-0cbf-4f78-94ed-28ebe7a1bfde service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:53.203319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:53.204808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:53.205455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:53.205820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] PATH_INFO: `/v3/users/db217c0607e74fec95a6155a6cdeb5e9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:53.207933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=db217c0607e74fec95a6155a6cdeb5e9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:53.211719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:53.456026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db217c0607e74fec95a6155a6cdeb5e9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:53.463779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db217c0607e74fec95a6155a6cdeb5e9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:53.464473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db217c0607e74fec95a6155a6cdeb5e9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:53.556247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db217c0607e74fec95a6155a6cdeb5e9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:53.556990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a3e2009-a92f-4207-9cd9-686a9d5c4ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db217c0607e74fec95a6155a6cdeb5e9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:53.589105 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1242/2473] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:52 2022] DELETE /identity/v3/users/db217c0607e74fec95a6155a6cdeb5e9 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:54.102980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:54.105399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:54.125142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373f6a3-9f5c-4308-8f8d-994c8f296fa7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:54.142149 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:54.225647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:54.226986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:54.227263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:54.227536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] PATH_INFO: `/v3/projects/4c55f111971443bf81b406b2b3293dde` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:54.228883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c55f111971443bf81b406b2b3293dde)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:54.231088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:54.389284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c55f111971443bf81b406b2b3293dde', 'request_id': 'req-e3621af5-fb23-412d-ab48-ed74ea6babc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:54.396677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c55f111971443bf81b406b2b3293dde', 'request_id': 'req-e3621af5-fb23-412d-ab48-ed74ea6babc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:54.499052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c55f111971443bf81b406b2b3293dde', 'request_id': 'req-e3621af5-fb23-412d-ab48-ed74ea6babc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:54.518118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] The token cache is being invalidate because project 4c55f111971443bf81b406b2b3293dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:54.518589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:54.519356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3621af5-fb23-412d-ab48-ed74ea6babc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:54.523299 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1232/2474] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:54 2022] DELETE /identity/v3/projects/4c55f111971443bf81b406b2b3293dde => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:54.528754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edb4aa-38e6-4d66-8173-99ea41c31786 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:54.529856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edb4aa-38e6-4d66-8173-99ea41c31786 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:54.530415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edb4aa-38e6-4d66-8173-99ea41c31786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:54.561485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-88edb4aa-38e6-4d66-8173-99ea41c31786 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:54.562867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-88edb4aa-38e6-4d66-8173-99ea41c31786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:54.628622 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:54.654018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1243/2475] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:54.662172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9144-1806-4d7d-a613-3fc0fc147265 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:54.662465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9144-1806-4d7d-a613-3fc0fc147265 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:54.662740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9144-1806-4d7d-a613-3fc0fc147265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:54.685081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8bcd9144-1806-4d7d-a613-3fc0fc147265 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:54.686333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8bcd9144-1806-4d7d-a613-3fc0fc147265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:54.695586 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1233/2476] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:54.699739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edb4aa-38e6-4d66-8173-99ea41c31786 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:54.710999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edb4aa-38e6-4d66-8173-99ea41c31786 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:54.715858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:54.716590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:54.716724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:54.717142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:54.717799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:14:54.718145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:54.719778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:54.736594 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1244/2477] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:14:54.740607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd9144-1806-4d7d-a613-3fc0fc147265 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:54.750082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd9144-1806-4d7d-a613-3fc0fc147265 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:54.755830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:54.756651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:54.756930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:54.757723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:54.758197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:54.758396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:54.760101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:54.760274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:54.785084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec31a65-7e66-4070-81e2-e3e83395c3ee admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:54.791228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:54.792164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:54.792448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:54.793441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] PATH_INFO: `/v3/users/870da6eeeb684fa380bf48b41f27b984` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:54.793936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870da6eeeb684fa380bf48b41f27b984)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:54.796127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:54.851665 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1234/2478] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:54 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:54.852810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:54.923377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290c43-8a39-4c56-bc44-90c7561fe8dc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:54.928545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:54.929189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:54.929483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:54.929737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:54.930433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:54.932397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:54.997835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870da6eeeb684fa380bf48b41f27b984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.004800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870da6eeeb684fa380bf48b41f27b984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.005543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870da6eeeb684fa380bf48b41f27b984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.028670 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1235/2479] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:54 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:55.028670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.028670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.034817 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:55.071654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870da6eeeb684fa380bf48b41f27b984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.072610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870da6eeeb684fa380bf48b41f27b984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.101093 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1245/2480] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:14:54 2022] DELETE /identity/v3/users/870da6eeeb684fa380bf48b41f27b984 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:14:55.102121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.117741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.150635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1a139-4f26-4c70-88f5-b2fb548d744d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:55.256420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:55.257863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.258180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.259766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.260343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.263632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f4f9-0a7c-40e5-8ffb-94755eaf52d2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:55.268973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:55.269596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.269875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.270180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.270833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:55.272919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:55.285207 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1246/2481] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:55.288833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.303155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a1ebb-6073-4955-968d-3d94571160fa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:55.309669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:55.310323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.310600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.310868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.311509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:55.313103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:55.331229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1247/2482] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:55.338414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.350823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2f3c4-6c1d-47c3-8cc9-297ca5679887 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:55.353090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:55.354772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:55.356663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed2231-2790-4cd7-a8f9-3b5c4e66f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:55.357513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2231-2790-4cd7-a8f9-3b5c4e66f882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.358132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2231-2790-4cd7-a8f9-3b5c4e66f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.358589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2231-2790-4cd7-a8f9-3b5c4e66f882 admin admin] PATH_INFO: `/v3/projects/c3730de9c65d4add9f6f34aa7d5aa77e/users/937a26d78d07458eaadc68fc9828d738/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.365198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1236/2483] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:55.380460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed2231-2790-4cd7-a8f9-3b5c4e66f882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3730de9c65d4add9f6f34aa7d5aa77e, user_id=937a26d78d07458eaadc68fc9828d738, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:55.389118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed2231-2790-4cd7-a8f9-3b5c4e66f882 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:55.419329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.421396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.449651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26d270-69b7-4d1d-bea9-895b4d42f142 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:55.454555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:55.455338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.456059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.456059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] PATH_INFO: `/v3/projects/0d2182cae228436ba5c9fc59edb00274` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.457322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2182cae228436ba5c9fc59edb00274)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:55.459469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:55.474407 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1248/2484] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:55 2022] PUT /identity/v3/projects/c3730de9c65d4add9f6f34aa7d5aa77e/users/937a26d78d07458eaadc68fc9828d738/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:55.495917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bdeac-e513-4017-a30f-0db107bbcf16 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.496582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bdeac-e513-4017-a30f-0db107bbcf16 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.497146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bdeac-e513-4017-a30f-0db107bbcf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.523802 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:55.546921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a83bdeac-e513-4017-a30f-0db107bbcf16 None None] MFA Rules not processed for user `937a26d78d07458eaadc68fc9828d738`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:55.549654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a83bdeac-e513-4017-a30f-0db107bbcf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.631416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2182cae228436ba5c9fc59edb00274', 'request_id': 'req-1af6aac2-45e9-491b-a469-1cfe528b5f1f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.643060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2182cae228436ba5c9fc59edb00274', 'request_id': 'req-1af6aac2-45e9-491b-a469-1cfe528b5f1f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.656677 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1249/2485] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:14:55.660659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bdeac-e513-4017-a30f-0db107bbcf16 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.727220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bdeac-e513-4017-a30f-0db107bbcf16 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:55.785201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:55.785816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.786140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.786414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.787058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:55.789543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:55.801588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2182cae228436ba5c9fc59edb00274', 'request_id': 'req-1af6aac2-45e9-491b-a469-1cfe528b5f1f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.813826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] The token cache is being invalidate because project 0d2182cae228436ba5c9fc59edb00274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:14:55.814188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.814856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1af6aac2-45e9-491b-a469-1cfe528b5f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:14:55.816403 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1237/2486] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:14:55 2022] DELETE /identity/v3/projects/0d2182cae228436ba5c9fc59edb00274 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:14:55.821364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62eab2-6728-4fad-acf3-a0f342d1e1a2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.821726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62eab2-6728-4fad-acf3-a0f342d1e1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.822095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62eab2-6728-4fad-acf3-a0f342d1e1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.842245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6a62eab2-6728-4fad-acf3-a0f342d1e1a2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:55.843443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6a62eab2-6728-4fad-acf3-a0f342d1e1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.852175 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1238/2487] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:55.860546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0f61-2199-4d40-b89c-eee8b471ca11 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:55.860836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0f61-2199-4d40-b89c-eee8b471ca11 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:55.861115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0f61-2199-4d40-b89c-eee8b471ca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:55.872030 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:55.883025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-917f0f61-2199-4d40-b89c-eee8b471ca11 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:55.884373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-917f0f61-2199-4d40-b89c-eee8b471ca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.899546 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1250/2488] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:55 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:55.903807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.905941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1239/2489] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:14:55.910545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:55.911778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f0f61-2199-4d40-b89c-eee8b471ca11 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:55.928697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f0f61-2199-4d40-b89c-eee8b471ca11 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.013441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d001d31-7d0a-419f-9c0d-958b9edf6c21 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.018521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.019086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.019362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.019637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.020271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.022213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.043115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.043413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.043717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.043987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.046285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:14:56.046789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.048441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.071914 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1240/2490] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:14:56.076220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.088850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027252e7-eff2-4b20-b907-1e47e74388dc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.093652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.094322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.094597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.094886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.095545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.099583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.106018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1251/2491] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:55 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:56.109747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.121238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445af84-4593-43fa-ba79-71a44b392f01 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.128329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.128329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.128329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.128329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.129206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.131213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.147149 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1252/2492] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:14:56.148814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.158846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508226-9bf0-44cb-bd32-0ae0f7945c09 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.163519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.164161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.164435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.164726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] PATH_INFO: `/v3/projects/eb6b5abc93eb4fdfa4f86289629560a5/users/6b89b76bd1124b818469067e4b3b1625/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.179967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6b5abc93eb4fdfa4f86289629560a5, user_id=6b89b76bd1124b818469067e4b3b1625, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.182684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.260312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1253/2493] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:56 2022] PUT /identity/v3/projects/eb6b5abc93eb4fdfa4f86289629560a5/users/6b89b76bd1124b818469067e4b3b1625/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:56.262594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1241/2494] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:14:56 2022] POST /identity/v3/projects => generated 397 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:56.263655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.268817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.393878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271dcb6-df3c-4599-b6e7-23f0aae1143d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.403697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93cae-7af2-445f-b7a8-7e407d5091d1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.405005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.405738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.406065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.413442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.413442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.413442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.413812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.413812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.413812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.413812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.414203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.415073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.424891 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1254/2495] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:56.427445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.439560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54230dd-fac7-47f6-8a8d-8a1f8e2a9998 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.445509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdf2b6-36bc-4322-a4a5-b1b547ae2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.446273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf2b6-36bc-4322-a4a5-b1b547ae2350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.446630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf2b6-36bc-4322-a4a5-b1b547ae2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.446972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf2b6-36bc-4322-a4a5-b1b547ae2350 admin admin] PATH_INFO: `/v3/projects/eb6b5abc93eb4fdfa4f86289629560a5/users/6b89b76bd1124b818469067e4b3b1625/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.449269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdf2b6-36bc-4322-a4a5-b1b547ae2350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6b5abc93eb4fdfa4f86289629560a5, user_id=6b89b76bd1124b818469067e4b3b1625, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.452702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdf2b6-36bc-4322-a4a5-b1b547ae2350 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.465039 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1255/2496] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:56 2022] PUT /identity/v3/projects/eb6b5abc93eb4fdfa4f86289629560a5/users/6b89b76bd1124b818469067e4b3b1625/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:56.476752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa1e7-6847-4be9-96f7-d46ac0fb005f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.477035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa1e7-6847-4be9-96f7-d46ac0fb005f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.477301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa1e7-6847-4be9-96f7-d46ac0fb005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.516999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e49fa1e7-6847-4be9-96f7-d46ac0fb005f None None] MFA Rules not processed for user `6b89b76bd1124b818469067e4b3b1625`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:56.518449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e49fa1e7-6847-4be9-96f7-d46ac0fb005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:56.534413 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1242/2497] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:14:56 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:14:56.538745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.550783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7fb4-2412-4c7b-bb9b-fbe43239d6b8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.615997 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:56.624541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.625161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.625436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.625781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.626476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.628758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.647004 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1243/2498] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:56.647192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1256/2499] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:14:56.651859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.659531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c83f-de0e-4170-8139-88d2b9640e15 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.659802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c83f-de0e-4170-8139-88d2b9640e15 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.660085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4c83f-de0e-4170-8139-88d2b9640e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.665376 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:56.670506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a643dc-39b5-415a-a755-066e2268cf60 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.682592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.683346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.683726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.684504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.685568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.688025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.693113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8da4c83f-de0e-4170-8139-88d2b9640e15 None None] MFA Rules not processed for user `937a26d78d07458eaadc68fc9828d738`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:56.694265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8da4c83f-de0e-4170-8139-88d2b9640e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:56.702204 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1244/2500] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:14:56.706127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.708229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:56.766457 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1257/2501] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:56.767365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c83f-de0e-4170-8139-88d2b9640e15 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.778321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4c83f-de0e-4170-8139-88d2b9640e15 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.782824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d9305-64b7-45a1-81e3-1ca6e91d950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.783462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9305-64b7-45a1-81e3-1ca6e91d950e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.783738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9305-64b7-45a1-81e3-1ca6e91d950e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.784007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9305-64b7-45a1-81e3-1ca6e91d950e admin admin] PATH_INFO: `/v3/projects/1aa3395c4af3435eaa3a0f49e19167fe/users/690143905857471f949b1f4454ad2139/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.793500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc5046-d122-4125-9f1e-1d63930406af admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:56.799448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fce234-b050-4b7f-b82e-771a589adb50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:56.799754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d9305-64b7-45a1-81e3-1ca6e91d950e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa3395c4af3435eaa3a0f49e19167fe, user_id=690143905857471f949b1f4454ad2139, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.800053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fce234-b050-4b7f-b82e-771a589adb50 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.800328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fce234-b050-4b7f-b82e-771a589adb50 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.800591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fce234-b050-4b7f-b82e-771a589adb50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.802334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c0fce234-b050-4b7f-b82e-771a589adb50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:56.802534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d9305-64b7-45a1-81e3-1ca6e91d950e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.864685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fce234-b050-4b7f-b82e-771a589adb50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:56.866391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fce234-b050-4b7f-b82e-771a589adb50 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:56.886301 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1245/2502] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:56.888010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.888497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.888897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.902199 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1258/2503] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:14:56 2022] PUT /identity/v3/projects/1aa3395c4af3435eaa3a0f49e19167fe/users/690143905857471f949b1f4454ad2139/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:14:56.912363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] MFA Rules not processed for user `519c893a1e094200b882cf23db7cae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:56.913546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:56.916402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:56.916942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:56.917540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:56.940194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:56.941385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:56.986936 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1246/2504] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:56.988204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:56.992127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:57.012048 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1259/2505] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:57.023255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:57.025298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:57.070444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d002-4448-4d07-95c2-1fafc959556b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:57.076482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea10e0-ba2f-450c-a17b-5c757e5cbd60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:57.077370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea10e0-ba2f-450c-a17b-5c757e5cbd60 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:57.077723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea10e0-ba2f-450c-a17b-5c757e5cbd60 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:57.078223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea10e0-ba2f-450c-a17b-5c757e5cbd60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:57.080370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d0ea10e0-ba2f-450c-a17b-5c757e5cbd60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:57.087857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96bcf3-4ae1-449f-aa37-d757d569d253 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:57.092086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c8065-7f59-47a1-a230-9ff1663a09c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:57.092791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c8065-7f59-47a1-a230-9ff1663a09c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:57.093157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c8065-7f59-47a1-a230-9ff1663a09c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:57.093547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c8065-7f59-47a1-a230-9ff1663a09c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:57.103885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c8065-7f59-47a1-a230-9ff1663a09c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:57.105581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c8065-7f59-47a1-a230-9ff1663a09c8 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:57.115511 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1260/2506] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:14:57.142208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea10e0-ba2f-450c-a17b-5c757e5cbd60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:57.143843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea10e0-ba2f-450c-a17b-5c757e5cbd60 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:57.153737 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1247/2507] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:14:57.196449 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:57.539301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:57.626356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c594a5-b716-48f5-8a7b-0896b0d29e3c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:57.626356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c594a5-b716-48f5-8a7b-0896b0d29e3c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:57.626356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c594a5-b716-48f5-8a7b-0896b0d29e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:57.648995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-13c594a5-b716-48f5-8a7b-0896b0d29e3c None None] MFA Rules not processed for user `80703c3d1dae419c9fd5ca103f3c28bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:57.650211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-13c594a5-b716-48f5-8a7b-0896b0d29e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:57.760722 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1261/2508] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:58.171600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba9884-37dd-482b-ba66-5abb0744cb2a None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:58.171887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba9884-37dd-482b-ba66-5abb0744cb2a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:58.172165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba9884-37dd-482b-ba66-5abb0744cb2a None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:58.173520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1248/2509] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 23 01:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:14:58.183294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09a527-6bab-4d7c-86ea-9576996f1d21 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:58.183294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09a527-6bab-4d7c-86ea-9576996f1d21 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:58.183294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09a527-6bab-4d7c-86ea-9576996f1d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:58.203535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1a09a527-6bab-4d7c-86ea-9576996f1d21 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:14:58.205068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1a09a527-6bab-4d7c-86ea-9576996f1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:58.216280 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1262/2510] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:14:58.234701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba9884-37dd-482b-ba66-5abb0744cb2a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:14:58.236402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-91ba9884-37dd-482b-ba66-5abb0744cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:14:58.253782 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:14:58.257949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba9884-37dd-482b-ba66-5abb0744cb2a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:14:58.266436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb5aa-5762-42b0-a66e-51d671b1293c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:14:58.267065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb5aa-5762-42b0-a66e-51d671b1293c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:14:58.267350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb5aa-5762-42b0-a66e-51d671b1293c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:14:58.267701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb5aa-5762-42b0-a66e-51d671b1293c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:14:58.290443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fb5aa-5762-42b0-a66e-51d671b1293c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:14:58.291785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fb5aa-5762-42b0-a66e-51d671b1293c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:14:58.306426 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1249/2511] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:06.093416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed76d-aa3b-4145-95e7-7dbb4ba55c57 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:06.093945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed76d-aa3b-4145-95e7-7dbb4ba55c57 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:06.094106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed76d-aa3b-4145-95e7-7dbb4ba55c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:06.126035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-041ed76d-aa3b-4145-95e7-7dbb4ba55c57 None None] MFA Rules not processed for user `690143905857471f949b1f4454ad2139`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:06.127898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-041ed76d-aa3b-4145-95e7-7dbb4ba55c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:06.267661 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1263/2512] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:06.278416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1ee3-280c-4bfa-82a5-475fdf821878 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:06.278990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1ee3-280c-4bfa-82a5-475fdf821878 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:06.279091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1ee3-280c-4bfa-82a5-475fdf821878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:06.299733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-844c1ee3-280c-4bfa-82a5-475fdf821878 None None] MFA Rules not processed for user `690143905857471f949b1f4454ad2139`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:06.300953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-844c1ee3-280c-4bfa-82a5-475fdf821878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:06.312040 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1250/2513] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:06.324552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ed76d-aa3b-4145-95e7-7dbb4ba55c57 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:06.344455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ed76d-aa3b-4145-95e7-7dbb4ba55c57 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:06.351509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:06.352569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:06.352997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:06.353453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:06.363610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:06.366625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:06.378834 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1264/2514] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:16.294268 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=79 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:16.373577 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=59 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:18.506986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f025-f89c-47af-8f41-a2d92ec73524 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:18.507738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f025-f89c-47af-8f41-a2d92ec73524 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:18.508189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f025-f89c-47af-8f41-a2d92ec73524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:18.530603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c975f025-f89c-47af-8f41-a2d92ec73524 None None] MFA Rules not processed for user `8a246c84d8f444d59c9d5becae78f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:18.530603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c975f025-f89c-47af-8f41-a2d92ec73524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:18.590205 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1251/2515] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:20.646856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:20.666696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a5ba9-d651-454a-8e70-a1b49f9e2a30 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:20.685066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:20.687500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:20.688008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:20.688480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:20.779594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:20.781296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:20.793915 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1265/2516] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:25.670347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975f025-f89c-47af-8f41-a2d92ec73524 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:25.694000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975f025-f89c-47af-8f41-a2d92ec73524 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:25.716415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:25.717385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:25.718518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:25.719010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:25.721081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:25.737062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:25.738835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:25.761230 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1252/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:27.339277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:27.341156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:27.362455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2860222-9299-45af-91fc-a477a2a6788a service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:27.367848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:27.368529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:27.368806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:27.369316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] PATH_INFO: `/v3/users/7262d5984b8c4775b86fae1c0d314718` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:27.370405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7262d5984b8c4775b86fae1c0d314718)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:27.377808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:27.604353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7262d5984b8c4775b86fae1c0d314718'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:27.613547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7262d5984b8c4775b86fae1c0d314718'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:27.614342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7262d5984b8c4775b86fae1c0d314718'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:27.733255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7262d5984b8c4775b86fae1c0d314718'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:27.734458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7262d5984b8c4775b86fae1c0d314718'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:27.779345 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1266/2518] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:15:27 2022] DELETE /identity/v3/users/7262d5984b8c4775b86fae1c0d314718 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:28.150920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:28.168357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac6e9-d8ba-4a2c-bd66-cd9a6a898a06 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:28.236991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:28.237635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.237941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.238286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] PATH_INFO: `/v3/projects/abc8f8cefbf441c98d6bda76e99e3173` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.239952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc8f8cefbf441c98d6bda76e99e3173)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:28.241592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:28.319518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:28.319518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:28.351688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74525dcd-6c5c-4b35-b9a4-947dcce2dde1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:28.363420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:28.364651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.366323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.369149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] PATH_INFO: `/v3/users/937a26d78d07458eaadc68fc9828d738` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.370588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc8f8cefbf441c98d6bda76e99e3173', 'request_id': 'req-34f35744-50ff-4af6-918b-10567a968c8a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.371399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937a26d78d07458eaadc68fc9828d738)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:28.375430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:28.379382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc8f8cefbf441c98d6bda76e99e3173', 'request_id': 'req-34f35744-50ff-4af6-918b-10567a968c8a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.503904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc8f8cefbf441c98d6bda76e99e3173', 'request_id': 'req-34f35744-50ff-4af6-918b-10567a968c8a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.517865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] The token cache is being invalidate because project abc8f8cefbf441c98d6bda76e99e3173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:15:28.518381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.519341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34f35744-50ff-4af6-918b-10567a968c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.526108 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1253/2519] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:15:28 2022] DELETE /identity/v3/projects/abc8f8cefbf441c98d6bda76e99e3173 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:28.532316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c8c1-b78a-41dc-a0fa-b085ba7916ee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.532316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c8c1-b78a-41dc-a0fa-b085ba7916ee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.532316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91c8c1-b78a-41dc-a0fa-b085ba7916ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.557483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0e91c8c1-b78a-41dc-a0fa-b085ba7916ee None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:28.559111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e91c8c1-b78a-41dc-a0fa-b085ba7916ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:28.580183 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:28.624449 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1254/2520] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:28.632805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cce29-b7e5-4493-8dfc-fe1f1da6ac80 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.633106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cce29-b7e5-4493-8dfc-fe1f1da6ac80 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.633427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cce29-b7e5-4493-8dfc-fe1f1da6ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.655020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-795cce29-b7e5-4493-8dfc-fe1f1da6ac80 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:28.656236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-795cce29-b7e5-4493-8dfc-fe1f1da6ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:28.664597 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1255/2521] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:28.668805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cce29-b7e5-4493-8dfc-fe1f1da6ac80 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:28.678766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cce29-b7e5-4493-8dfc-fe1f1da6ac80 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:28.683876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:28.684517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.684794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.685094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.685889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:15:28.686227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:28.687861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:28.705590 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1256/2522] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:15:28.710601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:28.721302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b118d0-e126-46f2-99c8-924a2bc39b97 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:28.722112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937a26d78d07458eaadc68fc9828d738'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.727406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:28.728033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.728663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.728663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.729193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:28.730348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937a26d78d07458eaadc68fc9828d738'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.731077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937a26d78d07458eaadc68fc9828d738'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.731194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:28.736982 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:28.801887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937a26d78d07458eaadc68fc9828d738'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.802637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d40ac70-c67f-4543-9faa-941f3501a888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937a26d78d07458eaadc68fc9828d738'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:28.827784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1267/2523] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:15:28 2022] DELETE /identity/v3/users/937a26d78d07458eaadc68fc9828d738 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:15:28.829223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.829552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.829848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.831828 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1257/2524] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:15:28 2022] POST /identity/v3/projects => generated 395 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:15:28.832712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:28.834584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:28.851544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:28.852616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:28.913487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066abd7-d764-4275-82c9-c949ed2b647b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:28.919017 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1268/2525] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:28.923101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:28.923959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:28.924335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:28.924864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:28.925637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:28.943895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:28.944709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:28.944709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:29.035874 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1258/2526] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:15:28 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:15:29.041179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eecdb-4b6c-49d7-b23c-027e9e522312 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.041654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:29.049481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:29.052157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.053272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.053941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.063455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22674ae4-f25c-48a0-9c00-5faa90d97ff3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.077216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:29.078180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.078749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.081050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.081747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:29.083474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:29.085949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:29.087622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:29.107724 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1259/2527] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:15:29.112289 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1269/2528] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:29.112725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:29.123658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da000-b4b0-4b8e-b400-818289311af5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.128869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:29.129486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.129765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.130216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.130926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:29.133190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:29.134513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:29.136203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:29.151229 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1260/2529] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:15:29.152969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32aac-63f3-4a13-ad05-d3f9a736cbf0 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.153408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:29.165728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa48d4-f87f-4b61-bdde-0a54886c78a7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.165955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbaa1f-9862-4050-be1f-4de93f0ed6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:29.167408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbaa1f-9862-4050-be1f-4de93f0ed6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.167690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbaa1f-9862-4050-be1f-4de93f0ed6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.167989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbaa1f-9862-4050-be1f-4de93f0ed6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.170470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a8bbaa1f-9862-4050-be1f-4de93f0ed6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:29.172216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:29.173145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.173713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.174314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] PATH_INFO: `/v3/projects/891f5b08deb441c0b0a6bff7b9ddb953/users/9932e28d1de240f5a3b0dab50df11f31/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.207236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=891f5b08deb441c0b0a6bff7b9ddb953, user_id=9932e28d1de240f5a3b0dab50df11f31, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:29.210508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:29.300817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbaa1f-9862-4050-be1f-4de93f0ed6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:29.304344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbaa1f-9862-4050-be1f-4de93f0ed6b9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:29.319881 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1270/2530] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:29.342207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1261/2531] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:15:29 2022] PUT /identity/v3/projects/891f5b08deb441c0b0a6bff7b9ddb953/users/9932e28d1de240f5a3b0dab50df11f31/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:29.344200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.344592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.344985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.371958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:29.374859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:29.454001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1271/2532] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:29.465081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:29.528872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:29.533771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:29.565274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351d43-728f-4676-9c1c-e698dd26a45d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.578775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:29.581046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.581636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.583136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.584342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801dc1b-2d8a-437c-9495-a1370b8f5976 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.597898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:29.599524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:29.599805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:29.600122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] PATH_INFO: `/v3/projects/c3730de9c65d4add9f6f34aa7d5aa77e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:29.605294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3730de9c65d4add9f6f34aa7d5aa77e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:29.610541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:29.622688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:29.626526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:29.667823 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1262/2533] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:29.791574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'request_id': 'req-8b73fb20-debd-4e1e-9e23-96e50645dcbe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:29.798681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'request_id': 'req-8b73fb20-debd-4e1e-9e23-96e50645dcbe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:29.916174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3730de9c65d4add9f6f34aa7d5aa77e', 'request_id': 'req-8b73fb20-debd-4e1e-9e23-96e50645dcbe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:29.932711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] The token cache is being invalidate because project c3730de9c65d4add9f6f34aa7d5aa77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:15:29.933064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:29.933724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:29.939112 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1272/2534] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:15:29 2022] DELETE /identity/v3/projects/c3730de9c65d4add9f6f34aa7d5aa77e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:29.940297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:29.953612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb934e-0494-480b-888c-59d3666954d8 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:29.988994 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:30.052662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:30.054037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:30.054370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:30.054653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] PATH_INFO: `/v3/users/6b89b76bd1124b818469067e4b3b1625` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:30.058329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b89b76bd1124b818469067e4b3b1625)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:30.062554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:30.128325 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:30.393204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b89b76bd1124b818469067e4b3b1625'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:30.406562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b89b76bd1124b818469067e4b3b1625'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:30.407572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b89b76bd1124b818469067e4b3b1625'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:30.589404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b89b76bd1124b818469067e4b3b1625'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:30.590282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f32818de-6486-45c6-9a7d-0ba9e899b4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b89b76bd1124b818469067e4b3b1625'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:30.629573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1263/2535] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:15:29 2022] DELETE /identity/v3/users/6b89b76bd1124b818469067e4b3b1625 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:15:31.139733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:31.141271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:31.164722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73fb20-debd-4e1e-9e23-96e50645dcbe admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:31.276876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:31.277529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:31.277808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:31.278383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] PATH_INFO: `/v3/projects/eb6b5abc93eb4fdfa4f86289629560a5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:31.280663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6b5abc93eb4fdfa4f86289629560a5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:31.282902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:31.453776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6b5abc93eb4fdfa4f86289629560a5', 'request_id': 'req-9181b3c1-efbe-4fdf-a2c3-6b760122e487'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:31.460595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6b5abc93eb4fdfa4f86289629560a5', 'request_id': 'req-9181b3c1-efbe-4fdf-a2c3-6b760122e487'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:31.613096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6b5abc93eb4fdfa4f86289629560a5', 'request_id': 'req-9181b3c1-efbe-4fdf-a2c3-6b760122e487'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:31.626539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] The token cache is being invalidate because project eb6b5abc93eb4fdfa4f86289629560a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:15:31.627099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:31.627866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9181b3c1-efbe-4fdf-a2c3-6b760122e487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:31.629442 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1273/2536] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:15:31 2022] DELETE /identity/v3/projects/eb6b5abc93eb4fdfa4f86289629560a5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:15:31.636432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324aa661-ba34-4c38-8d98-06ecead4b077 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:31.640196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324aa661-ba34-4c38-8d98-06ecead4b077 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:31.640196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324aa661-ba34-4c38-8d98-06ecead4b077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:31.666990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-324aa661-ba34-4c38-8d98-06ecead4b077 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:31.668211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-324aa661-ba34-4c38-8d98-06ecead4b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:31.714644 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:31.731498 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1264/2537] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:31.743808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c00f-10bb-41f4-b799-34e7bf6a9658 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:31.744090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c00f-10bb-41f4-b799-34e7bf6a9658 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:31.744363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c00f-10bb-41f4-b799-34e7bf6a9658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:31.766282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d463c00f-10bb-41f4-b799-34e7bf6a9658 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:31.766282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d463c00f-10bb-41f4-b799-34e7bf6a9658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:31.774674 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1274/2538] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:31.779088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324aa661-ba34-4c38-8d98-06ecead4b077 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:31.790535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324aa661-ba34-4c38-8d98-06ecead4b077 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:31.795369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:31.795983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:31.796264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:31.796538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:31.797439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:15:31.797743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:31.799372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:31.823410 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1265/2539] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:15:31.824384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c00f-10bb-41f4-b799-34e7bf6a9658 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:31.832410 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:31.837144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c00f-10bb-41f4-b799-34e7bf6a9658 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:31.843402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:31.844022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:31.845317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:31.845317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:31.845527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:31.847712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:31.989023 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1275/2540] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:15:31 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:15:31.993757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:32.018698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5057c7b-a5f3-44f1-9a88-03b719cd3197 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:32.150660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:32.151545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:32.151982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:32.152405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:32.153615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:32.165577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:32.277802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1266/2541] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:15:31 2022] POST /identity/v3/users => generated 288 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:15:32.282197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:32.326476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f19295-f95d-43cc-9204-db9afc173ae2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:32.332418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:32.333372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:32.336748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:32.336748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:32.336748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:32.338438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:32.355119 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1276/2542] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:15:32.359691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:32.373269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8359-f0b8-40bf-bc70-2c9106931304 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:32.380839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbdc3e-1eb0-4dec-a654-af1a8b679ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:32.382204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbdc3e-1eb0-4dec-a654-af1a8b679ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:32.382584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbdc3e-1eb0-4dec-a654-af1a8b679ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:32.383924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbdc3e-1eb0-4dec-a654-af1a8b679ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:32.384854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbdc3e-1eb0-4dec-a654-af1a8b679ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:32.388846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbdc3e-1eb0-4dec-a654-af1a8b679ab8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:32.409537 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1267/2543] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:15:32.413178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:32.423629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078248d-1ebf-4a31-9233-b03ebd142f53 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:32.428543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:32.429220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:32.429499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:32.429776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] PATH_INFO: `/v3/projects/683d8787354c48a39cd481a4888f9190/users/0a7f934e65524239aa58bb015e67d047/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:32.451080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] RBAC: Authorizing `identity:create_grant(project_id=683d8787354c48a39cd481a4888f9190, user_id=0a7f934e65524239aa58bb015e67d047, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:32.454963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:32.572296 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1277/2544] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:15:32 2022] PUT /identity/v3/projects/683d8787354c48a39cd481a4888f9190/users/0a7f934e65524239aa58bb015e67d047/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:32.574075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8e6e-b90a-487b-a273-a3b7ac8bdd15 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:32.574358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8e6e-b90a-487b-a273-a3b7ac8bdd15 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:32.574637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8e6e-b90a-487b-a273-a3b7ac8bdd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:32.601007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-956c8e6e-b90a-487b-a273-a3b7ac8bdd15 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:32.601007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-956c8e6e-b90a-487b-a273-a3b7ac8bdd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:32.696121 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1268/2545] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:32.705197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:32.708362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:32.801432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc1552-8029-4cfe-91d2-de7998f2055b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:32.805835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:32.811981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:32.811981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:32.811981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:32.817450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:32.819217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:32.832156 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1278/2546] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:35.439948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:35.441203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:35.442387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:35.516472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] MFA Rules not processed for user `519c893a1e094200b882cf23db7cae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:35.520800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:35.644502 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:35.663593 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1269/2547] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:35.723517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:35.737546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2dbc-7dbc-4e8e-b29d-1431893dec56 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:35.749781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed25449-9068-41b0-86fd-98a2ee2c5e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:35.750786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25449-9068-41b0-86fd-98a2ee2c5e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:35.751273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25449-9068-41b0-86fd-98a2ee2c5e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:35.751922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25449-9068-41b0-86fd-98a2ee2c5e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:35.754264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bed25449-9068-41b0-86fd-98a2ee2c5e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:35.769428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed25449-9068-41b0-86fd-98a2ee2c5e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:35.773408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed25449-9068-41b0-86fd-98a2ee2c5e06 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:35.784039 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1279/2548] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:37.548686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:37.550678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:37.691056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79de54-e8ea-44de-aa64-b535570e62bb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:37.700168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:37.704376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:37.704376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:37.704376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:37.713586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:37.732341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:37.738727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:37.787539 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1270/2549] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:42.677799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7b154-4764-4f03-83ea-1ce6cd46bdfa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:42.679017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7b154-4764-4f03-83ea-1ce6cd46bdfa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:42.679670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7b154-4764-4f03-83ea-1ce6cd46bdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:42.723729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-37c7b154-4764-4f03-83ea-1ce6cd46bdfa None None] MFA Rules not processed for user `0a7f934e65524239aa58bb015e67d047`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:42.725347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-37c7b154-4764-4f03-83ea-1ce6cd46bdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:42.792991 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:42.848283 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1280/2550] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:43.322610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:43.324765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:43.436227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac65fa9-64d7-4a69-873b-e58d8ef0a3aa service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:43.443115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289769d8-3297-42d8-9ae2-52b445c0b820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:43.445472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289769d8-3297-42d8-9ae2-52b445c0b820 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:43.446482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289769d8-3297-42d8-9ae2-52b445c0b820 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:43.455508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289769d8-3297-42d8-9ae2-52b445c0b820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:43.457394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289769d8-3297-42d8-9ae2-52b445c0b820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:43.467615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289769d8-3297-42d8-9ae2-52b445c0b820 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:43.505774 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1271/2551] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:44.050504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:44.050504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:44.050504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:44.099588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] MFA Rules not processed for user `9932e28d1de240f5a3b0dab50df11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:44.101232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:44.196356 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1281/2552] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:44.265855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cce6a-84a2-4e2a-b6b2-8911627024e8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:44.266442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cce6a-84a2-4e2a-b6b2-8911627024e8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:44.266895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cce6a-84a2-4e2a-b6b2-8911627024e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:44.288975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9c4cce6a-84a2-4e2a-b6b2-8911627024e8 None None] MFA Rules not processed for user `9932e28d1de240f5a3b0dab50df11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:44.290278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c4cce6a-84a2-4e2a-b6b2-8911627024e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:44.298869 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1272/2553] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:46.015676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:46.017341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:46.050982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fafd2-685f-429a-8080-86368d947d27 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:46.067967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:46.068173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:46.069754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:46.070819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:46.093220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:46.097627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:46.118493 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1282/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:49.386562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cce6a-84a2-4e2a-b6b2-8911627024e8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:49.409263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cce6a-84a2-4e2a-b6b2-8911627024e8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:49.429688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31ba8-f24f-4e05-bc06-34b2ac723873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:49.430734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31ba8-f24f-4e05-bc06-34b2ac723873 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:49.431371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31ba8-f24f-4e05-bc06-34b2ac723873 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:49.431904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31ba8-f24f-4e05-bc06-34b2ac723873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:49.434171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fad31ba8-f24f-4e05-bc06-34b2ac723873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:49.454674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31ba8-f24f-4e05-bc06-34b2ac723873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:49.457118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31ba8-f24f-4e05-bc06-34b2ac723873 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:49.514656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1273/2555] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:51.981297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:51.983509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:52.000778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ea466-d82c-42f0-b416-897973625e7d service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:52.009803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:52.010564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:52.011051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:52.011403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] PATH_INFO: `/v3/users/80703c3d1dae419c9fd5ca103f3c28bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:52.012974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80703c3d1dae419c9fd5ca103f3c28bf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:52.016720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:52.231570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80703c3d1dae419c9fd5ca103f3c28bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:52.247711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80703c3d1dae419c9fd5ca103f3c28bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:52.250383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80703c3d1dae419c9fd5ca103f3c28bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:52.339784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80703c3d1dae419c9fd5ca103f3c28bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:52.340757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80703c3d1dae419c9fd5ca103f3c28bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:52.361547 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1283/2556] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:15:51 2022] DELETE /identity/v3/users/80703c3d1dae419c9fd5ca103f3c28bf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:52.366898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:52.367400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:52.367525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:52.388820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:52.390064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:52.440556 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:52.453942 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1274/2557] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:52.464941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:52.466498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:52.503897 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:52.534162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6455271-fdd7-4599-844f-4d02d9bd9335 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:52.538406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:52.539012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:52.539289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:52.539561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:52.549542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:52.550998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:52.564699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1284/2558] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:15:52.843330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:52.844792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:52.857349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eb093-8e94-4138-9062-a4f9b7912235 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:52.863863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:52.866219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:52.866219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:52.866219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] PATH_INFO: `/v3/projects/356a4b3819db457fb5caf68ded0212fa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:52.867849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356a4b3819db457fb5caf68ded0212fa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:52.870180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:52.999882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356a4b3819db457fb5caf68ded0212fa', 'request_id': 'req-45c50f02-1cb8-431b-a644-ae0e95923b30'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.007821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356a4b3819db457fb5caf68ded0212fa', 'request_id': 'req-45c50f02-1cb8-431b-a644-ae0e95923b30'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.138637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356a4b3819db457fb5caf68ded0212fa', 'request_id': 'req-45c50f02-1cb8-431b-a644-ae0e95923b30'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.153906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] The token cache is being invalidate because project 356a4b3819db457fb5caf68ded0212fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:15:53.154276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.155064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.163695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1275/2559] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:15:52 2022] DELETE /identity/v3/projects/356a4b3819db457fb5caf68ded0212fa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:53.165522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:53.192238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aae187-aece-4757-945b-a488e9450c6e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:53.284545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:53.285189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:53.285728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:53.286044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] PATH_INFO: `/v3/users/1fd857a3b4cf4c97948ba349f8920fc6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:53.288088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd857a3b4cf4c97948ba349f8920fc6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:53.290302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:53.519090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd857a3b4cf4c97948ba349f8920fc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.535889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd857a3b4cf4c97948ba349f8920fc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.537065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd857a3b4cf4c97948ba349f8920fc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.650639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd857a3b4cf4c97948ba349f8920fc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.651628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c57375f1-91ee-4138-adea-2105577c47e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd857a3b4cf4c97948ba349f8920fc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:53.672377 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1285/2560] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:15:53 2022] DELETE /identity/v3/users/1fd857a3b4cf4c97948ba349f8920fc6 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:55.250728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:55.252294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:55.275586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c50f02-1cb8-431b-a644-ae0e95923b30 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:55.403175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:55.403849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:55.404212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:55.404572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] PATH_INFO: `/v3/projects/d2d01301d47b40c8bb2ab24042d092b1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:55.407897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d01301d47b40c8bb2ab24042d092b1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:55.411359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:55.589617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d01301d47b40c8bb2ab24042d092b1', 'request_id': 'req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:55.597856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d01301d47b40c8bb2ab24042d092b1', 'request_id': 'req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:55.670804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d01301d47b40c8bb2ab24042d092b1', 'request_id': 'req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:55.694915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] The token cache is being invalidate because project d2d01301d47b40c8bb2ab24042d092b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:15:55.695879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:55.696802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147e3dc1-6c19-4ad5-abb8-9d7910bb54b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:15:55.701059 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1276/2561] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:15:55 2022] DELETE /identity/v3/projects/d2d01301d47b40c8bb2ab24042d092b1 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:55.706799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94b8e-446b-4704-b9cb-782220cdb449 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:55.707744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94b8e-446b-4704-b9cb-782220cdb449 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:55.710041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94b8e-446b-4704-b9cb-782220cdb449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:55.776219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0ca94b8e-446b-4704-b9cb-782220cdb449 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:55.777809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0ca94b8e-446b-4704-b9cb-782220cdb449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:55.884110 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:55.904715 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1286/2562] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:55.912909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e73c-fef8-4309-a35e-c699fd7edb0b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:55.913193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e73c-fef8-4309-a35e-c699fd7edb0b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:55.916723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e73c-fef8-4309-a35e-c699fd7edb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:55.930247 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:55.935804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7e41e73c-fef8-4309-a35e-c699fd7edb0b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:55.937069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7e41e73c-fef8-4309-a35e-c699fd7edb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:55.950153 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1277/2563] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:55.951309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94b8e-446b-4704-b9cb-782220cdb449 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:55.964291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94b8e-446b-4704-b9cb-782220cdb449 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:55.971023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:55.971912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:55.972341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:55.972817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:55.973673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:15:55.974188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:55.977024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:55.996351 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1287/2564] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:15:56.014342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41e73c-fef8-4309-a35e-c699fd7edb0b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:56.024273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41e73c-fef8-4309-a35e-c699fd7edb0b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:56.057537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:56.058083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:56.058367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:56.058639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:56.059287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:56.061223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:56.154438 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1278/2565] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:15:56 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:15:56.158417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:56.181129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b20fb1-02a6-4969-9980-c4aca0a45083 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:56.286449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:56.286995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:56.287817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:56.288112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:56.288788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:56.290840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:56.407165 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1288/2566] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:15:56 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:15:56.407755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:56.421589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd689f7-7b03-4883-bc77-1ccbfee1ffd8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:56.438312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:56.438912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:56.439425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:56.439705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:56.440428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:56.442258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:56.463821 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1279/2567] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:15:56.465127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:56.482021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214da2c-5da7-48ab-aa98-95362ba95d67 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:56.505848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78bc42-517b-4096-bb06-ad28a3d211af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:56.507308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78bc42-517b-4096-bb06-ad28a3d211af admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:56.507961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78bc42-517b-4096-bb06-ad28a3d211af admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:56.508623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78bc42-517b-4096-bb06-ad28a3d211af admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:56.510183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78bc42-517b-4096-bb06-ad28a3d211af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:56.513509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78bc42-517b-4096-bb06-ad28a3d211af admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:56.533036 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1289/2568] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:15:56.538986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:56.547453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57a29-189f-402b-bba2-743c0d63d2f6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:56.564384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:56.566016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:56.566545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:56.567870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] PATH_INFO: `/v3/projects/1b105ec88d554d3eb189c378512160f3/users/a89a160a587a4bdba77e96557543f6f9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:56.601218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b105ec88d554d3eb189c378512160f3, user_id=a89a160a587a4bdba77e96557543f6f9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:56.606151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:56.679846 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1280/2569] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:15:56 2022] PUT /identity/v3/projects/1b105ec88d554d3eb189c378512160f3/users/a89a160a587a4bdba77e96557543f6f9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:15:56.692034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd904-5587-4c4e-a019-883375ce11bb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:56.692500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd904-5587-4c4e-a019-883375ce11bb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:56.692946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd904-5587-4c4e-a019-883375ce11bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:56.738022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-619cd904-5587-4c4e-a019-883375ce11bb None None] MFA Rules not processed for user `a89a160a587a4bdba77e96557543f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:56.740556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-619cd904-5587-4c4e-a019-883375ce11bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:56.878854 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1290/2570] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:56.879097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:57.036295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f031-344c-47bc-96b2-8fc58e70bb7e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:57.047968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:57.048763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.049044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.049317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:57.049958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:57.052659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:57.102889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810c820-a6c0-455c-a8fe-cd3624d62fb0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.103176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810c820-a6c0-455c-a8fe-cd3624d62fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.103842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810c820-a6c0-455c-a8fe-cd3624d62fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:57.138602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4810c820-a6c0-455c-a8fe-cd3624d62fb0 None None] MFA Rules not processed for user `690143905857471f949b1f4454ad2139`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:57.141640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4810c820-a6c0-455c-a8fe-cd3624d62fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:57.207989 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:57.229447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1291/2571] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:57.249368 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1281/2572] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:15:56 2022] POST /identity/v3/projects => generated 383 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:15:57.253466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810c820-a6c0-455c-a8fe-cd3624d62fb0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:57.264954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810c820-a6c0-455c-a8fe-cd3624d62fb0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:57.421473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:57.423597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.423883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.424158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:57.424851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:57.427253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:57.545878 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1292/2573] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:15:57 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:15:57.551098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:57.570580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a76c-acaf-4d71-8c6f-8d6774f3d971 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:57.586454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:57.587085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.587364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.587633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:57.588287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:57.590033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:57.606617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1282/2574] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:15:57.607257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:57.619375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2303243-b35f-4374-8d75-949f486577fc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:57.624612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:57.625184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.625462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.625869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] PATH_INFO: `/v3/projects/69bf2807fe7d497d8dcb3bdf1a3e8874/users/9b21964b9a6a441f9ceb2faaddccc178/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:57.646012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bf2807fe7d497d8dcb3bdf1a3e8874, user_id=9b21964b9a6a441f9ceb2faaddccc178, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:57.649061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:57.763185 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1293/2575] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:15:57 2022] PUT /identity/v3/projects/69bf2807fe7d497d8dcb3bdf1a3e8874/users/9b21964b9a6a441f9ceb2faaddccc178/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:15:57.773630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:57.802677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fe945-8f0a-4076-9d72-5e6158b1a38d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:57.904698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44986adf-042a-4cbb-b46f-b19884553a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:57.912862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44986adf-042a-4cbb-b46f-b19884553a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.912862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44986adf-042a-4cbb-b46f-b19884553a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.912862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44986adf-042a-4cbb-b46f-b19884553a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:57.912862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44986adf-042a-4cbb-b46f-b19884553a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:57.912862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44986adf-042a-4cbb-b46f-b19884553a17 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:57.920907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1283/2576] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:15:57.925459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:57.936528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100e373-2dbe-45ce-8449-1b0d43e18590 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:57.949494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:57.950229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.951280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.951444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] PATH_INFO: `/v3/projects/69bf2807fe7d497d8dcb3bdf1a3e8874/users/9b21964b9a6a441f9ceb2faaddccc178/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:57.956127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bf2807fe7d497d8dcb3bdf1a3e8874, user_id=9b21964b9a6a441f9ceb2faaddccc178, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:57.960317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:57.982045 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1294/2577] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:15:57 2022] PUT /identity/v3/projects/69bf2807fe7d497d8dcb3bdf1a3e8874/users/9b21964b9a6a441f9ceb2faaddccc178/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:15:57.997951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:57.998241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:57.998548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:58.044664 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:15:58.049525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] MFA Rules not processed for user `9b21964b9a6a441f9ceb2faaddccc178`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:15:58.051330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:58.150042 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1284/2578] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:15:58.772373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:15:58.776631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:58.856455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d62d3a-745e-4896-b4ff-d44522e7a09a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:15:58.863124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73eafb-4061-45e0-9229-e88c5762bb9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:15:58.863819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73eafb-4061-45e0-9229-e88c5762bb9c service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:15:58.864095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73eafb-4061-45e0-9229-e88c5762bb9c service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:15:58.864364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73eafb-4061-45e0-9229-e88c5762bb9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:15:58.868175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e73eafb-4061-45e0-9229-e88c5762bb9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:15:58.881905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73eafb-4061-45e0-9229-e88c5762bb9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:15:58.883542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73eafb-4061-45e0-9229-e88c5762bb9c service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:15:58.898238 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1295/2579] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:00.070694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:00.075189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:00.107415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64738621-db79-4926-bddd-1ec972842ac1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:00.114143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:00.115158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:00.115158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:00.126525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:00.138537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:00.140873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:00.158036 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1285/2580] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:01.485957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6a40-4523-4b7b-9bb8-de24ada8ec4c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:01.486557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6a40-4523-4b7b-9bb8-de24ada8ec4c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:01.486557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6a40-4523-4b7b-9bb8-de24ada8ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:01.532485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e3cd6a40-4523-4b7b-9bb8-de24ada8ec4c None None] MFA Rules not processed for user `547aed83a7e44becb9c89dc6bae62255`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:01.533596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e3cd6a40-4523-4b7b-9bb8-de24ada8ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:01.567385 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:01.618990 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1296/2581] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:02.749741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:02.855077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78717784-fb8b-4ce5-92d0-2a5931878dd6 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:02.863040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:02.864469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:02.866165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:02.866653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] PATH_INFO: `/v3/users/a89a160a587a4bdba77e96557543f6f9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:02.868118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89a160a587a4bdba77e96557543f6f9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:02.870510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:03.151166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89a160a587a4bdba77e96557543f6f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:03.161793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89a160a587a4bdba77e96557543f6f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:03.162556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89a160a587a4bdba77e96557543f6f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:03.243421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89a160a587a4bdba77e96557543f6f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:03.246539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89a160a587a4bdba77e96557543f6f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:03.306452 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1286/2582] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:16:02 2022] DELETE /identity/v3/users/a89a160a587a4bdba77e96557543f6f9 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:03.308203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:03.308696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:03.309406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:03.394523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:03.399516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:03.612250 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1297/2583] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:03.632143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:03.634619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:03.645235 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:03.718986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200004-2679-448f-a0eb-972dd116ed39 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:03.723524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:03.724248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:03.724667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:03.724941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:03.750928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:03.752902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:03.785716 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1287/2584] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:04.526883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:04.528429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:04.546711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2bf93-d82e-4810-879b-0916e9de3241 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:04.557215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:04.558285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:04.558755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:04.561657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] PATH_INFO: `/v3/projects/1b105ec88d554d3eb189c378512160f3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:04.563094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b105ec88d554d3eb189c378512160f3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:04.566672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:04.721728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b105ec88d554d3eb189c378512160f3', 'request_id': 'req-614d6d77-c936-419e-9f4f-aca3616d7224'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:04.732932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b105ec88d554d3eb189c378512160f3', 'request_id': 'req-614d6d77-c936-419e-9f4f-aca3616d7224'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:04.813470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b105ec88d554d3eb189c378512160f3', 'request_id': 'req-614d6d77-c936-419e-9f4f-aca3616d7224'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:04.832198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] The token cache is being invalidate because project 1b105ec88d554d3eb189c378512160f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:16:04.832500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:04.833249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:04.838392 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1298/2585] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:04 2022] DELETE /identity/v3/projects/1b105ec88d554d3eb189c378512160f3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:04.842143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:04.854466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b27f-0cd8-43fb-8bad-b8012f34291b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:04.981175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:04.981759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:04.982244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:04.982704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] PATH_INFO: `/v3/users/9b21964b9a6a441f9ceb2faaddccc178` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:04.984112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b21964b9a6a441f9ceb2faaddccc178)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:04.986474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:05.276775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b21964b9a6a441f9ceb2faaddccc178'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:05.309359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b21964b9a6a441f9ceb2faaddccc178'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:05.310821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b21964b9a6a441f9ceb2faaddccc178'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:05.436087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b21964b9a6a441f9ceb2faaddccc178'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:05.436594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b21964b9a6a441f9ceb2faaddccc178'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:05.461354 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1288/2586] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:16:04 2022] DELETE /identity/v3/users/9b21964b9a6a441f9ceb2faaddccc178 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:07.137802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:07.137802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:07.165376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d6d77-c936-419e-9f4f-aca3616d7224 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:07.279902 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:07.308076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:07.309308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:07.310327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:07.310789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] PATH_INFO: `/v3/projects/69bf2807fe7d497d8dcb3bdf1a3e8874` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:07.312584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bf2807fe7d497d8dcb3bdf1a3e8874)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:07.314735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:07.378655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:07.381770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:07.472974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bf2807fe7d497d8dcb3bdf1a3e8874', 'request_id': 'req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:07.488342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bf2807fe7d497d8dcb3bdf1a3e8874', 'request_id': 'req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:07.495370 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:07.541785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923c4cc-0821-4ebc-be51-86e2c016af0a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:07.578910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bf2807fe7d497d8dcb3bdf1a3e8874', 'request_id': 'req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:07.604362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] The token cache is being invalidate because project 69bf2807fe7d497d8dcb3bdf1a3e8874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:16:07.604989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:07.605848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3a2e3fb-d681-4c1b-9bd5-b55d59111bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:07.607604 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1299/2587] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:07 2022] DELETE /identity/v3/projects/69bf2807fe7d497d8dcb3bdf1a3e8874 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:07.612485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ef88d-a017-41ba-8203-17333caec234 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:07.612983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ef88d-a017-41ba-8203-17333caec234 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:07.613444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ef88d-a017-41ba-8203-17333caec234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:07.626725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bd832-2f0e-4fde-bb5b-da27c133bd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:07.634932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd832-2f0e-4fde-bb5b-da27c133bd3c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:07.634932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd832-2f0e-4fde-bb5b-da27c133bd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:07.634932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd832-2f0e-4fde-bb5b-da27c133bd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:07.634932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-332bd832-2f0e-4fde-bb5b-da27c133bd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:07.644244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4a2ef88d-a017-41ba-8203-17333caec234 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:07.645469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a2ef88d-a017-41ba-8203-17333caec234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:07.650409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bd832-2f0e-4fde-bb5b-da27c133bd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:07.654118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bd832-2f0e-4fde-bb5b-da27c133bd3c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:07.681957 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1289/2588] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:07.759440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1300/2589] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:07.844465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffced636-7f99-479e-93de-92b9c7881ddc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:07.844465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffced636-7f99-479e-93de-92b9c7881ddc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:07.844465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffced636-7f99-479e-93de-92b9c7881ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:07.898931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ffced636-7f99-479e-93de-92b9c7881ddc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:07.900509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ffced636-7f99-479e-93de-92b9c7881ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:07.915540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1290/2590] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:07.920202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ef88d-a017-41ba-8203-17333caec234 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:07.944130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ef88d-a017-41ba-8203-17333caec234 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:07.956272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:07.958644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:07.958644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:07.958644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:07.958644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:16:07.958644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:07.960105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:07.987525 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1301/2591] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:16:07.992456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffced636-7f99-479e-93de-92b9c7881ddc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:08.014518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffced636-7f99-479e-93de-92b9c7881ddc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:08.020460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:08.021342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:08.021815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:08.022282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:08.023287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:08.031698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:08.172695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1291/2592] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:16:07 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:16:08.177544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:08.190885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83c805-9daa-4e8d-8926-6500dce2698b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:08.270135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4259cc-383f-4dea-aff0-37a98bd79e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:08.271269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4259cc-383f-4dea-aff0-37a98bd79e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:08.271887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4259cc-383f-4dea-aff0-37a98bd79e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:08.272361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4259cc-383f-4dea-aff0-37a98bd79e99 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:08.273211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4259cc-383f-4dea-aff0-37a98bd79e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:08.275685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4259cc-383f-4dea-aff0-37a98bd79e99 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:08.407452 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:08.428840 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1302/2593] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:16:08 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:16:08.433135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:08.475892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6656-93a5-4a7b-aaa7-71a5f8e0e12e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:08.479999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:08.480706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:08.480990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:08.481257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:08.481921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:08.484848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:08.489526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2328d-1651-4f62-a9cf-7ea6a7e54c9e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:08.489815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2328d-1651-4f62-a9cf-7ea6a7e54c9e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:08.490152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2328d-1651-4f62-a9cf-7ea6a7e54c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:08.534096 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1292/2594] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:08.535250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:08.542358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6fe2328d-1651-4f62-a9cf-7ea6a7e54c9e None None] MFA Rules not processed for user `9932e28d1de240f5a3b0dab50df11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:08.542358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6fe2328d-1651-4f62-a9cf-7ea6a7e54c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:08.562777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be1d93-a976-421f-abc9-e87d18b2965a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:08.581479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:08.582097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:08.582380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:08.582652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:08.583392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:08.590600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:08.615002 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1293/2595] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:08.620085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:08.640328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd1418-6b87-42d9-8946-d9cf8f446a75 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:08.651983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:08.653016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:08.655817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:08.656298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] PATH_INFO: `/v3/projects/780cea0ca2664348ac1c34e60376d9b5/users/40d76932a8dc436289c5fe1727f8d1d0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:08.685418 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1303/2596] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:08.695270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780cea0ca2664348ac1c34e60376d9b5, user_id=40d76932a8dc436289c5fe1727f8d1d0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:08.698287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:08.773793 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1294/2597] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:16:08 2022] PUT /identity/v3/projects/780cea0ca2664348ac1c34e60376d9b5/users/40d76932a8dc436289c5fe1727f8d1d0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:08.784940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe50b-fd21-4919-a39b-ada21dcb4cd1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:08.785222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe50b-fd21-4919-a39b-ada21dcb4cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:08.785797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe50b-fd21-4919-a39b-ada21dcb4cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:08.837481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-724fe50b-fd21-4919-a39b-ada21dcb4cd1 None None] MFA Rules not processed for user `40d76932a8dc436289c5fe1727f8d1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:08.839865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-724fe50b-fd21-4919-a39b-ada21dcb4cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:08.946633 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1304/2598] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:09.086387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:09.086387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:09.231860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d9a60-1c21-41ae-a633-8c732268b8a0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:09.242640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5f23a-2c4f-408b-b58a-48da4f253e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:09.243621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5f23a-2c4f-408b-b58a-48da4f253e4c service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:09.244109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5f23a-2c4f-408b-b58a-48da4f253e4c service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:09.244707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5f23a-2c4f-408b-b58a-48da4f253e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:09.257534 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:09.267755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5f23a-2c4f-408b-b58a-48da4f253e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:09.269488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5f23a-2c4f-408b-b58a-48da4f253e4c service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:09.288597 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1295/2599] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:09.428882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7f0f-f2dc-42d7-a935-c87733a6897f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:09.429455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7f0f-f2dc-42d7-a935-c87733a6897f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:09.429455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7f0f-f2dc-42d7-a935-c87733a6897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:09.469664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-864b7f0f-f2dc-42d7-a935-c87733a6897f None None] MFA Rules not processed for user `9932e28d1de240f5a3b0dab50df11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:09.470974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-864b7f0f-f2dc-42d7-a935-c87733a6897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:09.683303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1305/2600] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:09.820261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:09.820735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:09.820834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:09.851166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c802b0-b30d-45a8-8672-af68a94b74d0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:09.851598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c802b0-b30d-45a8-8672-af68a94b74d0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:09.851752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c802b0-b30d-45a8-8672-af68a94b74d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:09.907191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] MFA Rules not processed for user `519c893a1e094200b882cf23db7cae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:09.908702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:09.916121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-31c802b0-b30d-45a8-8672-af68a94b74d0 None None] MFA Rules not processed for user `9932e28d1de240f5a3b0dab50df11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:09.917314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-31c802b0-b30d-45a8-8672-af68a94b74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:09.941251 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1306/2601] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:09.998981 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1296/2602] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:10.014228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc46fe-0f1d-4ce5-8c4d-bf1001ce2aa5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:10.015321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc46fe-0f1d-4ce5-8c4d-bf1001ce2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:10.015628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc46fe-0f1d-4ce5-8c4d-bf1001ce2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:10.056264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-77cc46fe-0f1d-4ce5-8c4d-bf1001ce2aa5 None None] MFA Rules not processed for user `9932e28d1de240f5a3b0dab50df11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:10.069058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-77cc46fe-0f1d-4ce5-8c4d-bf1001ce2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:10.080714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1307/2603] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:10.283188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:10.284967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:10.390401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92517494-33cf-4163-bc76-d5b80cade75c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:10.400548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:10.400548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:10.400548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:10.400548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] PATH_INFO: `/v3/users/0a7f934e65524239aa58bb015e67d047` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:10.401081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7f934e65524239aa58bb015e67d047)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:10.403086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:10.651962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7f934e65524239aa58bb015e67d047'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:10.659651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7f934e65524239aa58bb015e67d047'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:10.660453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7f934e65524239aa58bb015e67d047'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:10.734684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7f934e65524239aa58bb015e67d047'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:10.735379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-749c6a77-bdcb-4f8b-b344-078f84a2d924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7f934e65524239aa58bb015e67d047'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:10.780816 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1297/2604] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:16:10 2022] DELETE /identity/v3/users/0a7f934e65524239aa58bb015e67d047 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:10.806155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:10.806685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:10.806685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:10.842506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] MFA Rules not processed for user `9932e28d1de240f5a3b0dab50df11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:10.844548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:10.910247 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:11.024581 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1308/2605] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:11.025095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:11.025095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:11.025095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:11.067320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] MFA Rules not processed for user `1c2310cbc3574eb29a6ca6291ba7808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:11.071376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:11.112536 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:11.196639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1298/2606] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:11.480060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:11.482858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:11.569268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97925-823d-4336-8905-0efb5eeba59a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:11.575067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:11.575707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:11.575978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:11.576472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] PATH_INFO: `/v3/projects/683d8787354c48a39cd481a4888f9190` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:11.578548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=683d8787354c48a39cd481a4888f9190)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:11.582464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:11.675801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:11.677476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:11.697601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ecf8d-3cd3-4bcd-b66f-d091d8d75b87 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:11.706430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:11.707088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:11.708239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:11.708622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] PATH_INFO: `/v3/users/40d76932a8dc436289c5fe1727f8d1d0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:11.711280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d76932a8dc436289c5fe1727f8d1d0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:11.713369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:11.731363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683d8787354c48a39cd481a4888f9190', 'request_id': 'req-34ee9710-a5ae-462a-b20b-6b5654a47c6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.738508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683d8787354c48a39cd481a4888f9190', 'request_id': 'req-34ee9710-a5ae-462a-b20b-6b5654a47c6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.830313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683d8787354c48a39cd481a4888f9190', 'request_id': 'req-34ee9710-a5ae-462a-b20b-6b5654a47c6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.846203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] The token cache is being invalidate because project 683d8787354c48a39cd481a4888f9190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:16:11.846499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.847975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34ee9710-a5ae-462a-b20b-6b5654a47c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.851753 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1309/2607] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:11 2022] DELETE /identity/v3/projects/683d8787354c48a39cd481a4888f9190 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:11.857395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc082-a34a-4807-bf2f-b3bcbb76337c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:11.857784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc082-a34a-4807-bf2f-b3bcbb76337c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:11.858387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc082-a34a-4807-bf2f-b3bcbb76337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:11.883361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c40cc082-a34a-4807-bf2f-b3bcbb76337c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:11.884677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c40cc082-a34a-4807-bf2f-b3bcbb76337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:11.954743 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1310/2608] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:11.961586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d76932a8dc436289c5fe1727f8d1d0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.963573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05c745-0646-4289-96b6-f11705b3c028 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:11.963926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05c745-0646-4289-96b6-f11705b3c028 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:11.964197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05c745-0646-4289-96b6-f11705b3c028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:11.969229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d76932a8dc436289c5fe1727f8d1d0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.969889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d76932a8dc436289c5fe1727f8d1d0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:11.973183 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:11.985058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2a05c745-0646-4289-96b6-f11705b3c028 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:11.986276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2a05c745-0646-4289-96b6-f11705b3c028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:11.994093 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1311/2609] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:11.998284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05c745-0646-4289-96b6-f11705b3c028 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.007408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05c745-0646-4289-96b6-f11705b3c028 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.012063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.012633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.012910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.013184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.013813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:16:12.014143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.015712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.027513 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1312/2610] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:16:12.031448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.042020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47475480-4acc-449f-9580-c10e4cf05149 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.052903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd6232-7d59-46dd-ade3-c7dcd84f61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.052903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd6232-7d59-46dd-ade3-c7dcd84f61a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.052903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd6232-7d59-46dd-ade3-c7dcd84f61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.052903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd6232-7d59-46dd-ade3-c7dcd84f61a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.053284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd6232-7d59-46dd-ade3-c7dcd84f61a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.053284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd6232-7d59-46dd-ade3-c7dcd84f61a0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.059245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d76932a8dc436289c5fe1727f8d1d0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:12.072951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d76932a8dc436289c5fe1727f8d1d0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:12.079772 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1299/2611] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:16:11 2022] DELETE /identity/v3/users/40d76932a8dc436289c5fe1727f8d1d0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:12.080737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.082078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:12.167352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1313/2612] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:16:12 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:16:12.167484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb293c-1b30-4d3c-ab9c-482472cca4e5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.167588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.167588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.167588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.187638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:12.188844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:12.224284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.228503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.228503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.228503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.229569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:12.254775 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1314/2613] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:12.256414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.257673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:12.269228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb401-323c-4bb1-abe6-1301bf5ee46a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.275499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.279897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.279897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.279897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.279897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.279897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.298253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.302480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.314246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1300/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:12.315410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.317016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:12.376472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a56b2f-1344-4157-952f-57fce0826c82 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.380266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.381498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.381773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.382074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.391203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.392617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.401842 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1301/2615] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:12.463564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1315/2616] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:16:12 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:16:12.467994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.481578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4349c-840a-46a7-a6c7-35f3ad6d2b1d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.498309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.499794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.500146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.501008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.501800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.504019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.522715 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1302/2617] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:12.526585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.540548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f75a7-bc44-4323-8e0d-9739c766e171 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.542692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc167a7-da1b-4b11-9c97-1ea51789f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.543313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc167a7-da1b-4b11-9c97-1ea51789f76e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.543647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc167a7-da1b-4b11-9c97-1ea51789f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.543924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc167a7-da1b-4b11-9c97-1ea51789f76e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.544593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc167a7-da1b-4b11-9c97-1ea51789f76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.546208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc167a7-da1b-4b11-9c97-1ea51789f76e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.559594 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1316/2618] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:12.563814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.575740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8042-22a8-4ba3-8e3c-719ea54c3632 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:12.581757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:12.586552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.586552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.586552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] PATH_INFO: `/v3/projects/cd4dff948dba451c86b7ba29927a8b45/users/1e5066f2717f4d7bbde5347fc4903927/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.601811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4dff948dba451c86b7ba29927a8b45, user_id=1e5066f2717f4d7bbde5347fc4903927, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:12.604401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:12.731394 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1303/2619] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:16:12 2022] PUT /identity/v3/projects/cd4dff948dba451c86b7ba29927a8b45/users/1e5066f2717f4d7bbde5347fc4903927/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:16:12.743577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:12.743868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:12.744132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:12.784663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] MFA Rules not processed for user `1e5066f2717f4d7bbde5347fc4903927`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:12.786014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:12.888054 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:12.899883 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1317/2620] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:12.911364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:12.917729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:13.012030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedbfae-b086-4da4-82a2-2a1ceeb7de14 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:13.017440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da51f5c-00e4-4df7-9684-72626fd019fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:13.022043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da51f5c-00e4-4df7-9684-72626fd019fa service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.028793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da51f5c-00e4-4df7-9684-72626fd019fa service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.029080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da51f5c-00e4-4df7-9684-72626fd019fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.045135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da51f5c-00e4-4df7-9684-72626fd019fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:13.046868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da51f5c-00e4-4df7-9684-72626fd019fa service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:13.058686 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1304/2621] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:13.160249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:13.162729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:13.332174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f791489-74c0-4c5e-99cc-9bc1b57eebef None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:13.338159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:13.340145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.340570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.340970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] PATH_INFO: `/v3/projects/780cea0ca2664348ac1c34e60376d9b5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.342195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780cea0ca2664348ac1c34e60376d9b5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:13.344886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:13.538382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780cea0ca2664348ac1c34e60376d9b5', 'request_id': 'req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:13.540230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284ffb3-54b2-428c-9428-74c36d1b3812 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.541022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284ffb3-54b2-428c-9428-74c36d1b3812 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.541476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284ffb3-54b2-428c-9428-74c36d1b3812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.550061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780cea0ca2664348ac1c34e60376d9b5', 'request_id': 'req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:13.570085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a284ffb3-54b2-428c-9428-74c36d1b3812 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:13.571433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a284ffb3-54b2-428c-9428-74c36d1b3812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:13.613195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780cea0ca2664348ac1c34e60376d9b5', 'request_id': 'req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:13.625947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] The token cache is being invalidate because project 780cea0ca2664348ac1c34e60376d9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:16:13.626403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:13.627186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd8b7c7e-6d6a-4d9b-8709-1090fbd36358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:13.628951 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1318/2622] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:13 2022] DELETE /identity/v3/projects/780cea0ca2664348ac1c34e60376d9b5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:13.635391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68430-bc30-4eb0-9cd4-c390cdea9240 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.635675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68430-bc30-4eb0-9cd4-c390cdea9240 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.639855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68430-bc30-4eb0-9cd4-c390cdea9240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.639997 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1305/2623] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:13.661018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-78a68430-bc30-4eb0-9cd4-c390cdea9240 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:13.662553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78a68430-bc30-4eb0-9cd4-c390cdea9240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:13.691755 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:13.736295 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1319/2624] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:13.744294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.744577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.744909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.769028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:13.770271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:13.781466 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1306/2625] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:13.785495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68430-bc30-4eb0-9cd4-c390cdea9240 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:13.797510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68430-bc30-4eb0-9cd4-c390cdea9240 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:13.800513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:13.802091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:13.809063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:13.811171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.811515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.812539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.816808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:16:13.817447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:13.819740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:13.834011 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1320/2626] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:16:13.837529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:13.848508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bbaaa-cc85-4cc0-9886-eca6470c5719 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:13.854899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:13.855709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.855994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.856325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.856966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:13.858985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:13.886710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba212a-22cb-43f4-9da1-c4c5ca16c85f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:13.894422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:13.895050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:13.895334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:13.895600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:13.905724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:13.907308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:13.915749 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1307/2627] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:16:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:16:13.934158 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1321/2628] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:16:13 2022] POST /identity/v3/projects => generated 395 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:16:13.938900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:13.956073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ea56-564f-4760-af15-557d737eebfd service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:14.029150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:14.029773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:14.030079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:14.030400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:14.030994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:14.033358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:14.065867 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:14.144491 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1308/2629] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:16:13 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:16:14.145944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:14.158631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494bda8-d4bb-42ec-9079-d348dd974288 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:14.180015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:14.181656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:14.182094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:14.182869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:14.185295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:14.187672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:14.203111 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1322/2630] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:14.208831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:14.225442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6ccd6-2699-4413-9971-14dd9db9229a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:14.235174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dcfef-b204-475b-871c-5e9a12792d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:14.235795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dcfef-b204-475b-871c-5e9a12792d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:14.236071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dcfef-b204-475b-871c-5e9a12792d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:14.236341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dcfef-b204-475b-871c-5e9a12792d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:14.237022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dcfef-b204-475b-871c-5e9a12792d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:14.239379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dcfef-b204-475b-871c-5e9a12792d6d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:14.252275 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1309/2631] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:14.256456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:14.269764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2459c5-b5da-4bb9-aa6f-9bde4bbc7831 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:14.276838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:14.278184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:14.278625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:14.279909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] PATH_INFO: `/v3/projects/386d20bba06b48be9a7e51162dc4d814/users/c9681db3595440a88dacc40393e2e1dc/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:14.309505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386d20bba06b48be9a7e51162dc4d814, user_id=c9681db3595440a88dacc40393e2e1dc, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:14.313794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:14.333569 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:14.398659 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1323/2632] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:16:14 2022] PUT /identity/v3/projects/386d20bba06b48be9a7e51162dc4d814/users/c9681db3595440a88dacc40393e2e1dc/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:14.403652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda38f5-1648-45e8-ae11-402cd595d3f4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:14.404284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda38f5-1648-45e8-ae11-402cd595d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:14.404660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda38f5-1648-45e8-ae11-402cd595d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:14.448618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ceda38f5-1648-45e8-ae11-402cd595d3f4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:14.452629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ceda38f5-1648-45e8-ae11-402cd595d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:14.649394 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1310/2633] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:14.684440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:14.686806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:14.840669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff635f9-2776-4bad-babb-c54509df3521 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:14.846155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:14.847027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:14.847312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:14.847582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:14.861398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:14.862880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:14.877403 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1324/2634] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:15.133272 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:24.034271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a144b-75e8-474e-86a0-ceebb6d7d88b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:24.035037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a144b-75e8-474e-86a0-ceebb6d7d88b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:24.035037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a144b-75e8-474e-86a0-ceebb6d7d88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:24.076090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-909a144b-75e8-474e-86a0-ceebb6d7d88b None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:24.077752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-909a144b-75e8-474e-86a0-ceebb6d7d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:24.221799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1311/2635] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:24.229303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:24.380921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02259f1c-21d3-41c3-b5b7-9230ba5907a7 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:24.427120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:24.427120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:24.427120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:24.427120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:24.428604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:24.428604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:24.459936 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1325/2636] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:16:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:16:24.954945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c24b1-ff07-4417-bea2-4a65dae3ab3f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:24.955272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c24b1-ff07-4417-bea2-4a65dae3ab3f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:24.955638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c24b1-ff07-4417-bea2-4a65dae3ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:25.036241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f85c24b1-ff07-4417-bea2-4a65dae3ab3f None None] MFA Rules not processed for user `c9681db3595440a88dacc40393e2e1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:25.037707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f85c24b1-ff07-4417-bea2-4a65dae3ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:25.067445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:25.067445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:25.085236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164395-7c20-4fbc-b150-55137040a132 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:25.091443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:25.096167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:25.096167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:25.096167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] PATH_INFO: `/v3/users/1e5066f2717f4d7bbde5347fc4903927` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:25.096167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5066f2717f4d7bbde5347fc4903927)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:25.098559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:25.229281 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1312/2637] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:25.231941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:25.232458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:25.232895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:25.274989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] MFA Rules not processed for user `c9681db3595440a88dacc40393e2e1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:25.279115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:25.308303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1313/2638] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:25.399147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5066f2717f4d7bbde5347fc4903927'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:25.419786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5066f2717f4d7bbde5347fc4903927'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:25.422128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5066f2717f4d7bbde5347fc4903927'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:25.527728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5066f2717f4d7bbde5347fc4903927'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:25.533325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a622a42-6bdf-4e42-b52a-0365b63fec39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5066f2717f4d7bbde5347fc4903927'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:25.537859 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:25.549799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:25.558479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:25.610865 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1326/2639] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:16:25 2022] DELETE /identity/v3/users/1e5066f2717f4d7bbde5347fc4903927 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:25.610865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:25.610865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:25.610865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:25.664886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:25.664886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:25.687446 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:25.801180 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1327/2640] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:25.812519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:25.814787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d684a5-83a9-45f0-84f4-6d07bae10877 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:25.823299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:25.970911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:25.972479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:25.978837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:25.978837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:25.978837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:25.979886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df2fd7-80e4-43db-afb8-fe9119b19110 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:25.996941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:25.999454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:26.000935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:26.001330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:26.024589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:26.027267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:26.055635 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1328/2641] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:26.143430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:26.148250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:26.182080 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1314/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:25 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:26.973476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:26.975759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:27.007922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bc506-e402-4931-93cb-165e584a37c7 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:27.020389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e056e3-c9ff-431d-8f08-ffbf8fb55e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:27.022099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e056e3-c9ff-431d-8f08-ffbf8fb55e52 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:27.022407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e056e3-c9ff-431d-8f08-ffbf8fb55e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:27.022775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e056e3-c9ff-431d-8f08-ffbf8fb55e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:27.024804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f0e056e3-c9ff-431d-8f08-ffbf8fb55e52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:27.054705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e056e3-c9ff-431d-8f08-ffbf8fb55e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:27.059920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e056e3-c9ff-431d-8f08-ffbf8fb55e52 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:27.084903 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1329/2643] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:27.109792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:27.111410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:27.138145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74506f8d-8a3b-4af1-b874-782397fea419 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:27.149723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:27.153806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:27.153806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:27.153806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] PATH_INFO: `/v3/projects/cd4dff948dba451c86b7ba29927a8b45` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:27.153806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4dff948dba451c86b7ba29927a8b45)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:27.156534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:27.319476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4dff948dba451c86b7ba29927a8b45', 'request_id': 'req-2080d085-785a-42b7-ab78-36bca9fddc02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:27.330335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4dff948dba451c86b7ba29927a8b45', 'request_id': 'req-2080d085-785a-42b7-ab78-36bca9fddc02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:27.337821 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:27.407061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4dff948dba451c86b7ba29927a8b45', 'request_id': 'req-2080d085-785a-42b7-ab78-36bca9fddc02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:27.425250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] The token cache is being invalidate because project cd4dff948dba451c86b7ba29927a8b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:16:27.426364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:27.428312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2080d085-785a-42b7-ab78-36bca9fddc02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:27.440544 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1315/2644] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:27 2022] DELETE /identity/v3/projects/cd4dff948dba451c86b7ba29927a8b45 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:27.442758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101f243-1bb6-41ce-853c-10fcc8091918 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:27.443757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101f243-1bb6-41ce-853c-10fcc8091918 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:27.447080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101f243-1bb6-41ce-853c-10fcc8091918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:27.513570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7101f243-1bb6-41ce-853c-10fcc8091918 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:27.516380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7101f243-1bb6-41ce-853c-10fcc8091918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:27.659159 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1330/2645] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:27.667022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:27.667307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:27.667586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:27.693797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:27.693797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:27.712700 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1316/2646] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:27.719870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101f243-1bb6-41ce-853c-10fcc8091918 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:27.729247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101f243-1bb6-41ce-853c-10fcc8091918 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:27.730964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:27.733134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:27.755927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:27.756572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:27.756842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:27.757114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:27.765050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:16:27.765375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:27.778157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:27.847906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1331/2647] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:16:27.848870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:27.875725 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:27.881803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76914d-ff6d-45fe-91d9-83849410b0d9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:27.893873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:27.894515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:27.894805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:27.895079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:27.895738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:27.897859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:28.074893 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1332/2648] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:16:27 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:16:28.075730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1073263-fe5e-44d2-9c34-41fa28dba8d2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:28.075826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:28.317130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2995a0-9731-4b64-8f71-78c9db369571 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:28.338175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:28.338826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:28.339099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:28.339365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:28.341509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:28.347147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:28.434426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:28.435099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:28.435394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:28.435798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:28.441951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:28.462896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:28.464652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:28.484152 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1317/2649] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:28.517313 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1333/2650] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:16:28 2022] POST /identity/v3/users => generated 283 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:16:28.518010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:28.535025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806c66-d63a-46cf-847a-b10d0cc2c7de service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:28.550026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:28.550776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:28.551171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:28.551505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:28.552339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:28.554669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:28.581396 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1318/2651] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:28.585021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:28.610258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567070ca-8a86-4a43-8453-ba6bfb60be6e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:28.632935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214c64-e518-4f26-9417-8b50c8bb62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:28.635865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214c64-e518-4f26-9417-8b50c8bb62c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:28.636149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214c64-e518-4f26-9417-8b50c8bb62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:28.638618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214c64-e518-4f26-9417-8b50c8bb62c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:28.642486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92214c64-e518-4f26-9417-8b50c8bb62c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:28.649525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92214c64-e518-4f26-9417-8b50c8bb62c6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:28.702158 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1334/2652] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:28.703115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:28.716635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb645-c967-4c9d-ab22-ff69f1acbbb4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:28.752719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:28.758100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:28.758100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:28.758756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] PATH_INFO: `/v3/projects/50bd4c137b6a42488f39d173d46520dd/users/ecb97fa679eb4bf8a41862d3c248a217/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:28.819541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bd4c137b6a42488f39d173d46520dd, user_id=ecb97fa679eb4bf8a41862d3c248a217, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:28.822921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:28.929990 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1319/2653] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:16:28 2022] PUT /identity/v3/projects/50bd4c137b6a42488f39d173d46520dd/users/ecb97fa679eb4bf8a41862d3c248a217/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:28.935210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:28.935410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:28.935520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:28.981950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:28.991399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:29.220301 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1335/2654] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:29.272615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:29.277824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:29.382302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:29.384552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:29.405628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c7e48-3eac-4647-b92a-30facbebb51b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:29.412654 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:29.440210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2c8ed-7af1-4295-ba63-7c3488282960 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:29.444711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:29.453844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:29.458185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:29.459355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] PATH_INFO: `/v3/users/9932e28d1de240f5a3b0dab50df11f31` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:29.465112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:29.465760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:29.466243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9932e28d1de240f5a3b0dab50df11f31)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:29.472965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:29.477635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:29.480626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:29.524069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:29.529382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:29.564041 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1320/2655] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:29.845022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9932e28d1de240f5a3b0dab50df11f31'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:29.866422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9932e28d1de240f5a3b0dab50df11f31'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:29.869332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9932e28d1de240f5a3b0dab50df11f31'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:29.873651 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:29.981146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9932e28d1de240f5a3b0dab50df11f31'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:29.984526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-92c7cfd5-7025-493b-b4a0-cdb8c3de2d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9932e28d1de240f5a3b0dab50df11f31'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:30.019735 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1336/2656] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:16:29 2022] DELETE /identity/v3/users/9932e28d1de240f5a3b0dab50df11f31 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:16:30.670128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:30.689969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15651a-b15c-4760-8b3d-a82d401d1200 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:30.864055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:30.864746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:30.865022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:30.865291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] PATH_INFO: `/v3/projects/891f5b08deb441c0b0a6bff7b9ddb953` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:30.867562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891f5b08deb441c0b0a6bff7b9ddb953)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:30.869617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:31.079241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891f5b08deb441c0b0a6bff7b9ddb953', 'request_id': 'req-314bff4d-571e-40e1-ada0-0fe891b2ae37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:31.085827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891f5b08deb441c0b0a6bff7b9ddb953', 'request_id': 'req-314bff4d-571e-40e1-ada0-0fe891b2ae37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:31.167626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891f5b08deb441c0b0a6bff7b9ddb953', 'request_id': 'req-314bff4d-571e-40e1-ada0-0fe891b2ae37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:31.194217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] The token cache is being invalidate because project 891f5b08deb441c0b0a6bff7b9ddb953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:16:31.194217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:31.194217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-314bff4d-571e-40e1-ada0-0fe891b2ae37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:16:31.194217 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1321/2657] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:16:30 2022] DELETE /identity/v3/projects/891f5b08deb441c0b0a6bff7b9ddb953 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:31.198396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7f31d-66ee-4eb9-a245-3e40316e489f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:31.199291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7f31d-66ee-4eb9-a245-3e40316e489f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:31.199571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7f31d-66ee-4eb9-a245-3e40316e489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:31.225253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-54b7f31d-66ee-4eb9-a245-3e40316e489f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:31.226510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-54b7f31d-66ee-4eb9-a245-3e40316e489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:31.349699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1337/2658] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:31.358876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307732c-d8e2-48af-b361-bc4e37481aa7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:31.359159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307732c-d8e2-48af-b361-bc4e37481aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:31.359460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307732c-d8e2-48af-b361-bc4e37481aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:31.439602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7307732c-d8e2-48af-b361-bc4e37481aa7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:31.455946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7307732c-d8e2-48af-b361-bc4e37481aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:31.496228 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1322/2659] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:31.500601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7f31d-66ee-4eb9-a245-3e40316e489f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:31.515868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7f31d-66ee-4eb9-a245-3e40316e489f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:31.533238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:31.534173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:31.534837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:31.535301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:31.536123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:16:31.537213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:31.539056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:31.578514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1338/2660] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:16:31.583549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307732c-d8e2-48af-b361-bc4e37481aa7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:31.598335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307732c-d8e2-48af-b361-bc4e37481aa7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:31.612786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:31.613432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:31.613967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:31.614349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:31.616898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:31.619079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:31.818611 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1323/2661] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:16:31 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:16:31.822993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:31.838634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b82d0-0a76-4737-99fb-98b3b263fc64 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:32.037424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:32.038408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:32.038786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:32.039161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:32.040856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:32.044884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:32.177112 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1339/2662] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:16:31 2022] POST /identity/v3/users => generated 286 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:16:32.181651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:32.195070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7fa2d-248a-4882-b84b-0a7861403585 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:32.209602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:32.211185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:32.213634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:32.214170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:32.215020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:32.220320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:32.250143 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1324/2663] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:32.251363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:32.274970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f56608-1dca-4b4e-aa79-c95b347e4455 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:32.299031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30875d5c-9a3a-4106-9b5c-e2244b89039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:32.299698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875d5c-9a3a-4106-9b5c-e2244b89039b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:32.303080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875d5c-9a3a-4106-9b5c-e2244b89039b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:32.303361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30875d5c-9a3a-4106-9b5c-e2244b89039b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:32.305652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30875d5c-9a3a-4106-9b5c-e2244b89039b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:32.310176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30875d5c-9a3a-4106-9b5c-e2244b89039b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:32.365929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1340/2664] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:16:32.367242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:32.385626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31423-2dfa-4863-ad9c-ed891ca02c03 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:32.398411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb82c8-3008-48b0-9633-cc4694640aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:32.399529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb82c8-3008-48b0-9633-cc4694640aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:32.400034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb82c8-3008-48b0-9633-cc4694640aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:32.400539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb82c8-3008-48b0-9633-cc4694640aa3 admin admin] PATH_INFO: `/v3/projects/5474182023f5424c84fbe3a41bd47dd9/users/7811b4427fd54e14956eae6faee795d7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:32.423302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb82c8-3008-48b0-9633-cc4694640aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5474182023f5424c84fbe3a41bd47dd9, user_id=7811b4427fd54e14956eae6faee795d7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:32.426876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb82c8-3008-48b0-9633-cc4694640aa3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:32.592519 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1325/2665] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:16:32 2022] PUT /identity/v3/projects/5474182023f5424c84fbe3a41bd47dd9/users/7811b4427fd54e14956eae6faee795d7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:16:32.594283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:32.594846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:32.594964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:32.663543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] MFA Rules not processed for user `7811b4427fd54e14956eae6faee795d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:32.665602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:32.756422 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:32.873202 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1341/2666] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:32.873787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:32.874334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:32.874440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:32.905150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] MFA Rules not processed for user `7811b4427fd54e14956eae6faee795d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:32.908574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:32.934349 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1326/2667] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:32.941477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:32.944030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:33.112658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38a08f-9491-495f-b3cb-442650fb737b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:33.145213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6fb33-fe90-423b-b9f1-c10684f60cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:33.148687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6fb33-fe90-423b-b9f1-c10684f60cce service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:33.149132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6fb33-fe90-423b-b9f1-c10684f60cce service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:33.150672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6fb33-fe90-423b-b9f1-c10684f60cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:33.175211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6fb33-fe90-423b-b9f1-c10684f60cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:33.194223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6fb33-fe90-423b-b9f1-c10684f60cce service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:33.212809 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1342/2668] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:34.217384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:34.217384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:34.217384 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:34.217384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14196-5a26-49bd-9aa5-cb0333c79d44 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:34.221124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc8c4e-d6e0-4b88-b635-095994c49503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:34.221124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8c4e-d6e0-4b88-b635-095994c49503 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:34.221124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8c4e-d6e0-4b88-b635-095994c49503 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:34.221124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8c4e-d6e0-4b88-b635-095994c49503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:34.222287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ecc8c4e-d6e0-4b88-b635-095994c49503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:34.247634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc8c4e-d6e0-4b88-b635-095994c49503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:34.248889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc8c4e-d6e0-4b88-b635-095994c49503 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:34.266047 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1327/2669] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:34.870166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:34.871593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:34.871593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:34.897039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] MFA Rules not processed for user `519c893a1e094200b882cf23db7cae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:34.898636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:34.992170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1343/2670] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:16:38.509094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324851-fb65-40c7-a45d-32e1dbc2184d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:38.510370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324851-fb65-40c7-a45d-32e1dbc2184d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:38.510811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324851-fb65-40c7-a45d-32e1dbc2184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:38.564998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-eb324851-fb65-40c7-a45d-32e1dbc2184d None None] MFA Rules not processed for user `690143905857471f949b1f4454ad2139`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:38.566431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb324851-fb65-40c7-a45d-32e1dbc2184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:38.698424 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1328/2671] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:39.539093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:39.540560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:39.643884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b70f95-44db-4292-9130-0b1f4b2d3407 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:39.657216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1aca-56ab-400d-add7-2d92c6b092b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:39.664127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1aca-56ab-400d-add7-2d92c6b092b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:39.664657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1aca-56ab-400d-add7-2d92c6b092b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:39.665089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1aca-56ab-400d-add7-2d92c6b092b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:39.674631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-989e1aca-56ab-400d-add7-2d92c6b092b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:39.717697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1aca-56ab-400d-add7-2d92c6b092b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:39.726322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1aca-56ab-400d-add7-2d92c6b092b0 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:39.758706 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1344/2672] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:43.031771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6167e5-a90a-4614-9de2-fb4a9a1ee871 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:43.032664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6167e5-a90a-4614-9de2-fb4a9a1ee871 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:43.033154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6167e5-a90a-4614-9de2-fb4a9a1ee871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:43.118683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4a6167e5-a90a-4614-9de2-fb4a9a1ee871 None None] MFA Rules not processed for user `ecb97fa679eb4bf8a41862d3c248a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:43.122460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a6167e5-a90a-4614-9de2-fb4a9a1ee871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:43.316131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1329/2673] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:43.332162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7287f-795f-4c1a-984e-09e0f8b33ab7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:43.332758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7287f-795f-4c1a-984e-09e0f8b33ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:43.332758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7287f-795f-4c1a-984e-09e0f8b33ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:43.341199 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:43.391384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-78f7287f-795f-4c1a-984e-09e0f8b33ab7 None None] MFA Rules not processed for user `ecb97fa679eb4bf8a41862d3c248a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:43.395064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78f7287f-795f-4c1a-984e-09e0f8b33ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:43.413684 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1345/2674] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:43.543162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6167e5-a90a-4614-9de2-fb4a9a1ee871 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:43.568801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6167e5-a90a-4614-9de2-fb4a9a1ee871 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:43.579624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7d15b-897d-4647-b2c5-9e55142f78e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:43.587673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d15b-897d-4647-b2c5-9e55142f78e2 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:43.587673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d15b-897d-4647-b2c5-9e55142f78e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:43.587673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d15b-897d-4647-b2c5-9e55142f78e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:43.608009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7d15b-897d-4647-b2c5-9e55142f78e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:43.611498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7d15b-897d-4647-b2c5-9e55142f78e2 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:43.657633 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1330/2675] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:53.642197 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=67 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:53.933472 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:16:55.081503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89df3e-68f8-454a-92ec-c77538030893 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:55.082182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89df3e-68f8-454a-92ec-c77538030893 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:55.082182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89df3e-68f8-454a-92ec-c77538030893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:55.106483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ec89df3e-68f8-454a-92ec-c77538030893 None None] MFA Rules not processed for user `c9681db3595440a88dacc40393e2e1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:55.107835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ec89df3e-68f8-454a-92ec-c77538030893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:55.170788 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1346/2676] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:55.350281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:55.350943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:55.351232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:55.377381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] MFA Rules not processed for user `519c893a1e094200b882cf23db7cae54`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:16:55.377381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:55.385756 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1331/2677] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:16:57.953532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89df3e-68f8-454a-92ec-c77538030893 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:57.967572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89df3e-68f8-454a-92ec-c77538030893 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:57.973280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:57.974010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:57.974290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:57.974558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:57.976274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:58.036966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:58.038714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:58.053119 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1347/2678] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:16:58.804987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:16:58.806824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:58.889549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bb8e3-c581-4efe-90fd-eee84a027b77 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:16:58.894773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:16:58.895942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:16:58.896217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:16:58.896486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:16:58.898237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:16:58.910270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:16:58.912443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:16:58.928261 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1332/2679] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:00.738109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:00.750864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191a58-6acc-4940-8f4a-32e60e1cde4c service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:00.755650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938aeb31-d3ca-449e-b8aa-73631cced91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:00.756523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aeb31-d3ca-449e-b8aa-73631cced91d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:00.757066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aeb31-d3ca-449e-b8aa-73631cced91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:00.757564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aeb31-d3ca-449e-b8aa-73631cced91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:00.759557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-938aeb31-d3ca-449e-b8aa-73631cced91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:00.774699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938aeb31-d3ca-449e-b8aa-73631cced91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:00.776729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938aeb31-d3ca-449e-b8aa-73631cced91d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:00.788870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1348/2680] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:00.816401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:00.843011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d57fb-a1d5-40e0-9580-898f78c792f9 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:00.843011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:00.843011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:00.843011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:00.843530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:00.844472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:00.856664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:00.858466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:00.869329 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1333/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:10.784213 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=59 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:10.863794 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=41 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:11.276873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:11.277206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:11.277547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:11.308334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:11.308334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:11.419141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:11.419695 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1349/2682] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:11.422234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:11.561448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd54e4d-0ee5-4df2-8afa-71b2db35fa05 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:11.569602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:11.570810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:11.571328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:11.571876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:11.582601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:11.585093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:11.595640 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1334/2683] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:20.528370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:20.529926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:20.680744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:20.687838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125851b7-0ece-4ed6-ac2f-4d0fef545b5c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:20.696937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:20.697493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3dc97-89c3-4dac-8898-864c4fd4dd11 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:20.698383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:20.698838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:20.699277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] PATH_INFO: `/v3/users/690143905857471f949b1f4454ad2139` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:20.701471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690143905857471f949b1f4454ad2139)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:20.712471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:20.712795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:20.714344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:20.715143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:20.715647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:20.718967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:20.814239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:20.816606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:20.846197 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1335/2684] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:20.907990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690143905857471f949b1f4454ad2139'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:20.918065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690143905857471f949b1f4454ad2139'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:20.918798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690143905857471f949b1f4454ad2139'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.018606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690143905857471f949b1f4454ad2139'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.019233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a21da41f-beb5-40f2-8c50-a7345c6bd665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690143905857471f949b1f4454ad2139'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.044986 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1350/2685] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:17:20 2022] DELETE /identity/v3/users/690143905857471f949b1f4454ad2139 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:21.565323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:21.585430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714506-06e8-4ab3-8bf0-faa4d1585266 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:21.678270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:21.678914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:21.679193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:21.679463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] PATH_INFO: `/v3/projects/1aa3395c4af3435eaa3a0f49e19167fe` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:21.680645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa3395c4af3435eaa3a0f49e19167fe)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:21.682614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:21.798339 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:21.824412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa3395c4af3435eaa3a0f49e19167fe', 'request_id': 'req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.838095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa3395c4af3435eaa3a0f49e19167fe', 'request_id': 'req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.898931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa3395c4af3435eaa3a0f49e19167fe', 'request_id': 'req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.919228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] The token cache is being invalidate because project 1aa3395c4af3435eaa3a0f49e19167fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:17:21.919549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.920694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a8fc0d83-45d6-40b8-862e-d6bddbaa5ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:21.923657 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1336/2686] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:21 2022] DELETE /identity/v3/projects/1aa3395c4af3435eaa3a0f49e19167fe => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:21.928978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfe6f-6766-46c4-99bb-c32998fb65e5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:21.929999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfe6f-6766-46c4-99bb-c32998fb65e5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:21.943911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfe6f-6766-46c4-99bb-c32998fb65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:21.981392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-144dfe6f-6766-46c4-99bb-c32998fb65e5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:21.981392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-144dfe6f-6766-46c4-99bb-c32998fb65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:22.014060 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:22.089460 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1351/2687] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:22.099119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e1ed-1c39-44bf-80f9-c280f7fbf427 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:22.099533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e1ed-1c39-44bf-80f9-c280f7fbf427 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:22.099897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e1ed-1c39-44bf-80f9-c280f7fbf427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:22.124968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ab12e1ed-1c39-44bf-80f9-c280f7fbf427 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:22.126489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab12e1ed-1c39-44bf-80f9-c280f7fbf427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:22.142308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dfe6f-6766-46c4-99bb-c32998fb65e5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:22.150101 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1337/2688] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:22.156505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dfe6f-6766-46c4-99bb-c32998fb65e5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:22.162006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:22.162728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:22.163073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:22.163421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:22.164147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:17:22.164519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:22.166309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:22.186030 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1352/2689] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:17:22.189087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e1ed-1c39-44bf-80f9-c280f7fbf427 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:22.199158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e1ed-1c39-44bf-80f9-c280f7fbf427 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:22.208504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:22.209088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:22.209434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:22.209771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:22.210628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:22.212604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:22.344870 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1338/2690] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:17:22 2022] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:17:22.346674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:22.363262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f03df-fb82-4f20-a1ad-025608c82a52 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:22.447854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:22.448744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:22.449183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:22.449461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:22.450323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:22.452343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:22.546507 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1353/2691] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:17:22 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:17:22.551263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:22.563703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9d1d-20bc-42b6-9d68-8609b17ee2b8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:22.579601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:22.580332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:22.580661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:22.584904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:22.584904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:22.586346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:22.617118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1339/2692] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:17:22.618142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:22.632727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49620890-2d73-4d50-96d6-b3b7cf0c17c3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:22.638103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e177aec-2b52-4024-a2ef-b9819bade9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:22.638743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177aec-2b52-4024-a2ef-b9819bade9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:22.640204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177aec-2b52-4024-a2ef-b9819bade9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:22.640509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177aec-2b52-4024-a2ef-b9819bade9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:22.641218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e177aec-2b52-4024-a2ef-b9819bade9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:22.642898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e177aec-2b52-4024-a2ef-b9819bade9d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:22.656615 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1354/2693] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:17:22.667202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:22.681233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7151d-f64e-4311-9a43-8fb72058fa0a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:22.688354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:22.689194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:22.689839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:22.690311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] PATH_INFO: `/v3/projects/78462d3300c74b5fbcc1c29ec0182305/users/1a6e6863d7c24324b6361e9e1aab435e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:22.715959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=78462d3300c74b5fbcc1c29ec0182305, user_id=1a6e6863d7c24324b6361e9e1aab435e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:22.719777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:23.054681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27691b92-445f-4631-b991-0c9410264142 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:23.055264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27691b92-445f-4631-b991-0c9410264142 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:23.055264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27691b92-445f-4631-b991-0c9410264142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:23.058336 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1340/2694] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:17:22 2022] PUT /identity/v3/projects/78462d3300c74b5fbcc1c29ec0182305/users/1a6e6863d7c24324b6361e9e1aab435e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:23.094693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-27691b92-445f-4631-b991-0c9410264142 None None] MFA Rules not processed for user `1a6e6863d7c24324b6361e9e1aab435e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:23.096246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-27691b92-445f-4631-b991-0c9410264142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:23.181590 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1355/2695] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:23.502899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:23.506321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:23.694420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4706be-6266-4d5a-a48b-78b917cfb8cf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:23.700538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dc9be-fc4e-42d4-b2c7-49e342978295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:23.701911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc9be-fc4e-42d4-b2c7-49e342978295 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:23.702517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc9be-fc4e-42d4-b2c7-49e342978295 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:23.702953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dc9be-fc4e-42d4-b2c7-49e342978295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:23.715061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dc9be-fc4e-42d4-b2c7-49e342978295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:23.717753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dc9be-fc4e-42d4-b2c7-49e342978295 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:23.733073 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1341/2696] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:23.799598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27691b92-445f-4631-b991-0c9410264142 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:23.831954 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:23.905435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27691b92-445f-4631-b991-0c9410264142 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:23.911409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:23.912650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:23.913040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:23.913310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] PATH_INFO: `/v3/users/1a6e6863d7c24324b6361e9e1aab435e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:23.916764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6e6863d7c24324b6361e9e1aab435e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:23.920624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:24.178368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6e6863d7c24324b6361e9e1aab435e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:24.200153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6e6863d7c24324b6361e9e1aab435e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:24.205088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6e6863d7c24324b6361e9e1aab435e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:24.289162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6e6863d7c24324b6361e9e1aab435e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:24.290119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6e6863d7c24324b6361e9e1aab435e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:24.356990 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1356/2697] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:17:23 2022] DELETE /identity/v3/users/1a6e6863d7c24324b6361e9e1aab435e => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:24.358923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:24.359473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:24.360021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:24.400609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:24.402264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:24.478030 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:24.542841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1342/2698] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:24.554552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:24.556470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:24.668652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35b6d-0cce-4dbd-8e9c-b6e9ccffd102 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:24.679617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e9dee-f898-409f-980d-1db849dab347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:24.680526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e9dee-f898-409f-980d-1db849dab347 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:24.681589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e9dee-f898-409f-980d-1db849dab347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:24.682627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e9dee-f898-409f-980d-1db849dab347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:24.701742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e9dee-f898-409f-980d-1db849dab347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:24.704006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e9dee-f898-409f-980d-1db849dab347 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:24.737187 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1357/2699] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:25.720403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:25.723874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:25.764247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aebb8d-9dac-4744-ac5b-6012ef8cfcd2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:25.794805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:25.794805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:25.794805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:25.794805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] PATH_INFO: `/v3/projects/78462d3300c74b5fbcc1c29ec0182305` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:25.796029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78462d3300c74b5fbcc1c29ec0182305)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:25.798852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:25.938918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78462d3300c74b5fbcc1c29ec0182305', 'request_id': 'req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:25.955946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78462d3300c74b5fbcc1c29ec0182305', 'request_id': 'req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:26.036004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78462d3300c74b5fbcc1c29ec0182305', 'request_id': 'req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:26.057454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] The token cache is being invalidate because project 78462d3300c74b5fbcc1c29ec0182305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:17:26.060354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:26.060354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-824ee73d-f494-4cc4-b3f1-ae17f8ff3470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:26.062083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1343/2700] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:25 2022] DELETE /identity/v3/projects/78462d3300c74b5fbcc1c29ec0182305 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:26.067436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882121-6a6d-415b-8996-ae15a6510e58 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.068321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882121-6a6d-415b-8996-ae15a6510e58 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.068803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43882121-6a6d-415b-8996-ae15a6510e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.096765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-43882121-6a6d-415b-8996-ae15a6510e58 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:26.098613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-43882121-6a6d-415b-8996-ae15a6510e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:26.145866 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:26.173509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1358/2701] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:26.183798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c60c5-c24d-4b73-a7bf-de7745205eab None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.184661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c60c5-c24d-4b73-a7bf-de7745205eab None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.185305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c60c5-c24d-4b73-a7bf-de7745205eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.207859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-284c60c5-c24d-4b73-a7bf-de7745205eab None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:26.211589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-284c60c5-c24d-4b73-a7bf-de7745205eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:26.220907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1344/2702] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:26.225284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43882121-6a6d-415b-8996-ae15a6510e58 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:26.237123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43882121-6a6d-415b-8996-ae15a6510e58 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:26.245024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:26.245737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.246246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.246612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.247347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:17:26.247735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:26.251621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:26.290470 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1359/2703] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:17:26.294909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c60c5-c24d-4b73-a7bf-de7745205eab None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:26.319512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c60c5-c24d-4b73-a7bf-de7745205eab None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:26.331697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:26.333109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.333460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.333744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.334430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:26.336614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:26.458189 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1345/2704] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:17:26 2022] POST /identity/v3/projects => generated 397 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:17:26.462524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:26.475435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb56b-b029-41c0-b80a-318675a415ed admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:26.612171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:26.612666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.612946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.613219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.613898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:26.615887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:26.692104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1360/2705] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:17:26 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:17:26.692741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:26.711736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b73f-3a3d-4b08-91ef-4fccf8a317be admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:26.733782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:26.735173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.735649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.735924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.736579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:26.738446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:26.758104 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1346/2706] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:17:26.760640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:26.774893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b46dcc-2f0f-4272-b60f-5fee35204a51 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:26.780582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaed5e-62d3-4952-9e4f-46def00c9105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:26.781199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaed5e-62d3-4952-9e4f-46def00c9105 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.781473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaed5e-62d3-4952-9e4f-46def00c9105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.781743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaed5e-62d3-4952-9e4f-46def00c9105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.782498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaed5e-62d3-4952-9e4f-46def00c9105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:26.784174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaed5e-62d3-4952-9e4f-46def00c9105 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:26.804556 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1361/2707] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:17:26.805752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:26.825075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd29fb-51df-4e55-9ecc-c836ec9864c0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:26.834892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:26.835876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.836341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.836801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] PATH_INFO: `/v3/projects/1e823abcab484d2fb32ac12e846e95f0/users/7b260d3a773e47a990fad3262ccc2e4f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.864770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e823abcab484d2fb32ac12e846e95f0, user_id=7b260d3a773e47a990fad3262ccc2e4f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:26.867718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:26.956349 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1347/2708] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:17:26 2022] PUT /identity/v3/projects/1e823abcab484d2fb32ac12e846e95f0/users/7b260d3a773e47a990fad3262ccc2e4f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:26.962359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc92e-ca75-4a30-b18f-95481a2dd0ca None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:26.962642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc92e-ca75-4a30-b18f-95481a2dd0ca None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:26.963016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc92e-ca75-4a30-b18f-95481a2dd0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:26.985430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a5abc92e-ca75-4a30-b18f-95481a2dd0ca None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:26.986680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a5abc92e-ca75-4a30-b18f-95481a2dd0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:27.099350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1362/2709] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:27.134365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:27.136254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:27.243579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd8d6-7806-4a90-9cc7-8615578a2a2d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:27.260316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:27.262878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:27.263534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:27.263534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:27.296648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:27.299101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:27.307902 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:27.322525 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1348/2710] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:33.045090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61980-191a-4864-8f7e-fb996ed15f21 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:33.045592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61980-191a-4864-8f7e-fb996ed15f21 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:33.045874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e61980-191a-4864-8f7e-fb996ed15f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:33.073559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d9e61980-191a-4864-8f7e-fb996ed15f21 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:33.075104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d9e61980-191a-4864-8f7e-fb996ed15f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:33.142247 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:33.155181 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1363/2711] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:17:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:33.171143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:33.172952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:33.313039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cd78d-18cb-4c89-8310-edb07436b669 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:33.322773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2c4f1-4a59-4b00-8125-17385e8844d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:33.323453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2c4f1-4a59-4b00-8125-17385e8844d7 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:33.323728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2c4f1-4a59-4b00-8125-17385e8844d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:33.324072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2c4f1-4a59-4b00-8125-17385e8844d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:33.342856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2c4f1-4a59-4b00-8125-17385e8844d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:33.344706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2c4f1-4a59-4b00-8125-17385e8844d7 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:33.356335 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1349/2712] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:17:36.388813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:36.389342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:36.389342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:36.434173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] MFA Rules not processed for user `ecb97fa679eb4bf8a41862d3c248a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:36.439363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:36.556461 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1364/2713] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:37.748413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e36b54-8e09-4ae3-93d6-895fbd3610ee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:37.748919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e36b54-8e09-4ae3-93d6-895fbd3610ee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:37.749125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e36b54-8e09-4ae3-93d6-895fbd3610ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:37.781175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-83e36b54-8e09-4ae3-93d6-895fbd3610ee None None] MFA Rules not processed for user `7b260d3a773e47a990fad3262ccc2e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:37.782540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-83e36b54-8e09-4ae3-93d6-895fbd3610ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:37.866320 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1350/2714] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:37.921738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:37.923998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:37.948920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821d723-7188-402c-b7bd-0a480cb46128 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:37.959632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:37.963473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:37.964379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:37.964882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] PATH_INFO: `/v3/users/7811b4427fd54e14956eae6faee795d7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:37.966967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7811b4427fd54e14956eae6faee795d7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:37.969861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:38.188326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7811b4427fd54e14956eae6faee795d7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:38.213418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7811b4427fd54e14956eae6faee795d7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:38.214874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7811b4427fd54e14956eae6faee795d7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:38.312188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7811b4427fd54e14956eae6faee795d7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:38.312188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7811b4427fd54e14956eae6faee795d7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:38.419781 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1365/2715] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:17:37 2022] DELETE /identity/v3/users/7811b4427fd54e14956eae6faee795d7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:38.421835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:38.422141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:38.422593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:38.463812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:38.465435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:38.632316 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1351/2716] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:38.643334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:38.647157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:38.765206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ef46-bdc7-4fef-a24d-85b259d98a95 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:38.771027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:38.771743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:38.772086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:38.772428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:38.788176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:38.789679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:38.809456 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1366/2717] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:39.963855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:39.966029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:39.993710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860ec83-a30a-449a-88d1-4de63fbc1594 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:40.013581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:40.016966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:40.016966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:40.022469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] PATH_INFO: `/v3/projects/5474182023f5424c84fbe3a41bd47dd9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:40.025554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5474182023f5424c84fbe3a41bd47dd9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:40.027831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:40.088639 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:40.268983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5474182023f5424c84fbe3a41bd47dd9', 'request_id': 'req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:40.285541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5474182023f5424c84fbe3a41bd47dd9', 'request_id': 'req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:40.344869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:40.346551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:40.383893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5474182023f5424c84fbe3a41bd47dd9', 'request_id': 'req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:40.413813 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:40.419562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] The token cache is being invalidate because project 5474182023f5424c84fbe3a41bd47dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:17:40.423399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:40.427132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acce76ca-6847-41f4-be2b-4b77b8ab7e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:40.435674 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1352/2718] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:17:39 2022] DELETE /identity/v3/projects/5474182023f5424c84fbe3a41bd47dd9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:40.441646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592ae1-7924-4b72-9847-a0e9f9282750 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:40.441939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592ae1-7924-4b72-9847-a0e9f9282750 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:40.442261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592ae1-7924-4b72-9847-a0e9f9282750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:40.497000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9c592ae1-7924-4b72-9847-a0e9f9282750 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:40.498415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c592ae1-7924-4b72-9847-a0e9f9282750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:40.602572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bfa4a-8716-4d83-9019-2da4bd9e8c0d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:40.646201 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1353/2719] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:40.654298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fed22-bcd1-4473-aa4e-9c854acf7e9b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:40.660570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fed22-bcd1-4473-aa4e-9c854acf7e9b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:40.660570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fed22-bcd1-4473-aa4e-9c854acf7e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:40.691395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c80fed22-bcd1-4473-aa4e-9c854acf7e9b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:40.696539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c80fed22-bcd1-4473-aa4e-9c854acf7e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:40.719738 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1354/2720] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:17:40.724668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fed22-bcd1-4473-aa4e-9c854acf7e9b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:40.739996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fed22-bcd1-4473-aa4e-9c854acf7e9b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:40.754293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:40.755047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:40.755507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:40.762226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:40.762226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:17:40.762226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:40.762226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:40.775024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:40.775648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:40.775927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:40.776198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:40.790861 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1355/2721] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:17:40.795079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:40.798450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:40.814303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a4bcb-40b2-4d04-8ce0-15d94d487fa6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:40.828466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:40.829095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:40.829369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:40.829686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:40.833058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:40.838243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:40.974838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:40.976485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:40.998270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1367/2722] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:41.028142 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1356/2723] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:17:40 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:17:41.029527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:41.047298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c965c26-1365-488b-8b32-5a6410044d79 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:41.161327 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:41.223113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:41.223968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:41.224428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:41.224856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:41.225650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:41.228784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:41.350747 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1368/2724] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:17:41 2022] POST /identity/v3/users => generated 290 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:17:41.351900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:41.368833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34cae-0a70-4ac3-8a82-a8e4ac906d29 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:41.388245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:41.388915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:41.391173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:41.391489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:41.392169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:41.403791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:41.444965 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1357/2725] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:17:41.446632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:41.459866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1e57-998d-4d0e-bd90-196ceba30a90 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:41.477087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db70396-de92-47ff-9d7f-73476040ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:41.478332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db70396-de92-47ff-9d7f-73476040ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:41.478780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db70396-de92-47ff-9d7f-73476040ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:41.480508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db70396-de92-47ff-9d7f-73476040ca66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:41.483347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db70396-de92-47ff-9d7f-73476040ca66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:41.485004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db70396-de92-47ff-9d7f-73476040ca66 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:41.518257 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1369/2726] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:17:41.522564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:41.539250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc582cb-6f4e-43d9-b838-3976dd6ac9f4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:41.565721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:41.567433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:41.567877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:41.568324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] PATH_INFO: `/v3/projects/1c099cb4056b438a9c9dead75e7eb797/users/cd6a6c5240f94ace91e1f0ed3e53fa7c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:41.591740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c099cb4056b438a9c9dead75e7eb797, user_id=cd6a6c5240f94ace91e1f0ed3e53fa7c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:41.595789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:41.703137 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1358/2727] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:17:41 2022] PUT /identity/v3/projects/1c099cb4056b438a9c9dead75e7eb797/users/cd6a6c5240f94ace91e1f0ed3e53fa7c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:17:41.707660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:41.708959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:41.708959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:41.729842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:41.731086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:41.841912 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1370/2728] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:41.843316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:41.851036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:41.917590 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:41.999390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9926-d06b-4acc-9563-cecb33613c9f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:42.004208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a45b0-5c5d-4381-8e6e-0308dbff78a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:42.005031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a45b0-5c5d-4381-8e6e-0308dbff78a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:42.005575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a45b0-5c5d-4381-8e6e-0308dbff78a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:42.006073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a45b0-5c5d-4381-8e6e-0308dbff78a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:42.016797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a45b0-5c5d-4381-8e6e-0308dbff78a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:42.019604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a45b0-5c5d-4381-8e6e-0308dbff78a3 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:42.030935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1359/2729] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:45.779976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:45.782448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:45.930038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b3e33-6e8e-452c-a7f3-e4c67d0aa552 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:45.955485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d04992-9af9-49ad-a6f4-03e043080ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:45.955485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d04992-9af9-49ad-a6f4-03e043080ecf service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:45.955854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d04992-9af9-49ad-a6f4-03e043080ecf service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:45.955947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d04992-9af9-49ad-a6f4-03e043080ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:45.960989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c4d04992-9af9-49ad-a6f4-03e043080ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:46.088318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d04992-9af9-49ad-a6f4-03e043080ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:46.093052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d04992-9af9-49ad-a6f4-03e043080ecf service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:46.101602 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:46.121856 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1371/2730] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:52.333534 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=15 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:17:56.231274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed3df-8dd0-4e36-8bc2-ac07a37f7f85 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:56.231880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed3df-8dd0-4e36-8bc2-ac07a37f7f85 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:56.231880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed3df-8dd0-4e36-8bc2-ac07a37f7f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:56.333657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9b6ed3df-8dd0-4e36-8bc2-ac07a37f7f85 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:56.336509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b6ed3df-8dd0-4e36-8bc2-ac07a37f7f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:56.510523 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1360/2731] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:56.522572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:56.522572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:56.523141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:56.553204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:17:56.555175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:56.574978 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1372/2732] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:17:57.283171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ed3df-8dd0-4e36-8bc2-ac07a37f7f85 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:57.305939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ed3df-8dd0-4e36-8bc2-ac07a37f7f85 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:57.312969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:57.313898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:57.314394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:57.314952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:57.333729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:57.335475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:57.348217 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1361/2733] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:58.766898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:58.772916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:58.962496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda002ba-319c-4138-89af-d58e9007e0f9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:58.971143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:17:58.973312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:58.974393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:58.975781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:58.976076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:58.976352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:58.983360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:17:59.007293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25dfb0-6fb8-4111-82f8-44ae1389b37d service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:17:59.016714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:17:59.017374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:17:59.017654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:17:59.017928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] PATH_INFO: `/v3/users/7b260d3a773e47a990fad3262ccc2e4f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:17:59.019821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b260d3a773e47a990fad3262ccc2e4f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:59.021742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:59.023968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:17:59.025553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:17:59.051977 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1373/2734] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:17:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:17:59.263463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b260d3a773e47a990fad3262ccc2e4f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:59.275954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b260d3a773e47a990fad3262ccc2e4f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:59.278331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b260d3a773e47a990fad3262ccc2e4f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:59.407532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b260d3a773e47a990fad3262ccc2e4f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:59.408438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bd999f2-fae9-4100-9a9a-e25c5d8bca48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b260d3a773e47a990fad3262ccc2e4f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:17:59.458166 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1362/2735] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:17:58 2022] DELETE /identity/v3/users/7b260d3a773e47a990fad3262ccc2e4f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:00.025242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:00.039576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff381bd-a2d0-4031-9e68-aae49b4370c3 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:00.199920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:00.200648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:00.200931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:00.201195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] PATH_INFO: `/v3/projects/1e823abcab484d2fb32ac12e846e95f0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:00.202637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e823abcab484d2fb32ac12e846e95f0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:00.208319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:00.395113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e823abcab484d2fb32ac12e846e95f0', 'request_id': 'req-f1426d6d-f06f-4eee-87af-9f7842fde57b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:00.409863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e823abcab484d2fb32ac12e846e95f0', 'request_id': 'req-f1426d6d-f06f-4eee-87af-9f7842fde57b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:00.505933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e823abcab484d2fb32ac12e846e95f0', 'request_id': 'req-f1426d6d-f06f-4eee-87af-9f7842fde57b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:00.555287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] The token cache is being invalidate because project 1e823abcab484d2fb32ac12e846e95f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:00.557561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:00.557561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1426d6d-f06f-4eee-87af-9f7842fde57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:00.562429 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1374/2736] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:00 2022] DELETE /identity/v3/projects/1e823abcab484d2fb32ac12e846e95f0 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:00.564108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18e9e4-c2c3-4cc6-8dd6-21853a141fc5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:00.564960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18e9e4-c2c3-4cc6-8dd6-21853a141fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:00.565383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18e9e4-c2c3-4cc6-8dd6-21853a141fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:00.611236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9c18e9e4-c2c3-4cc6-8dd6-21853a141fc5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:00.614844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c18e9e4-c2c3-4cc6-8dd6-21853a141fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:00.709061 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:00.750123 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1363/2737] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:00.753872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f0a1-065f-4198-9dc2-0331eb18fe68 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:00.754203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f0a1-065f-4198-9dc2-0331eb18fe68 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:00.755136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f0a1-065f-4198-9dc2-0331eb18fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:00.787275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8e57f0a1-065f-4198-9dc2-0331eb18fe68 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:00.787412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e57f0a1-065f-4198-9dc2-0331eb18fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:00.802077 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1375/2738] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:00.804364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18e9e4-c2c3-4cc6-8dd6-21853a141fc5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:00.827790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18e9e4-c2c3-4cc6-8dd6-21853a141fc5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:00.834909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:00.835879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:00.836411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:00.837177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:00.838108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:00.838653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:00.840425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:00.856975 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1364/2739] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:18:00.858175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f0a1-065f-4198-9dc2-0331eb18fe68 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:00.868489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f0a1-065f-4198-9dc2-0331eb18fe68 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:00.873257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:00.873889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:00.878821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:00.878821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:00.878821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:00.878821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:00.881853 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:00.965057 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1376/2740] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:00 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:18:00.969523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:00.981154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35122-abf0-4253-af71-d1e6ec81fd62 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:01.083526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:01.084178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:01.084462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:01.084746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:01.085830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:01.089397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:01.225014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1365/2741] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:00 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:01.229342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:01.243664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e51bf-a176-418c-a310-f086acce699e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:01.248821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:01.249695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:01.250183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:01.250617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:01.265752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:01.267495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:01.283627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1377/2742] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:01.288172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:01.304227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf53471-9bc9-4f4b-846b-88c1c3284e26 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:01.310881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece30fc-815e-4616-9baf-a9cdf54a1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:01.312205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece30fc-815e-4616-9baf-a9cdf54a1acd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:01.312671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece30fc-815e-4616-9baf-a9cdf54a1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:01.313113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece30fc-815e-4616-9baf-a9cdf54a1acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:01.314058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece30fc-815e-4616-9baf-a9cdf54a1acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:01.316543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece30fc-815e-4616-9baf-a9cdf54a1acd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:01.330897 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1366/2743] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:01.335290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:01.352987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d09eb-2d8d-47d1-9838-abebb66d6e4f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:01.358541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:01.359793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:01.360243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:01.361467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] PATH_INFO: `/v3/projects/a0556c0544d446a2aa3d54e00b16bab1/users/18ea2d1dfc7441d2a2bb7b22c6065605/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:01.392444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0556c0544d446a2aa3d54e00b16bab1, user_id=18ea2d1dfc7441d2a2bb7b22c6065605, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:01.400621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:01.500592 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1378/2744] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:01 2022] PUT /identity/v3/projects/a0556c0544d446a2aa3d54e00b16bab1/users/18ea2d1dfc7441d2a2bb7b22c6065605/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:01.506621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076c8b-8fae-4a45-a541-25de230991f0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:01.506898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076c8b-8fae-4a45-a541-25de230991f0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:01.507169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076c8b-8fae-4a45-a541-25de230991f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:01.574404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6c076c8b-8fae-4a45-a541-25de230991f0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:01.575636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6c076c8b-8fae-4a45-a541-25de230991f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:01.681243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1367/2745] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:01.686070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:01.686070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:01.810340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd097-70bc-4315-b7f1-221ed3c39f74 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:01.814559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:01.815185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:01.815461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:01.816302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:01.826603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:01.828047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:01.854495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1379/2746] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:05.931629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49ccad-9dd2-4366-a99c-d5eb558818ba None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:05.934786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49ccad-9dd2-4366-a99c-d5eb558818ba None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:05.935334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49ccad-9dd2-4366-a99c-d5eb558818ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:05.999229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8c49ccad-9dd2-4366-a99c-d5eb558818ba None None] MFA Rules not processed for user `8a246c84d8f444d59c9d5becae78f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:06.001632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8c49ccad-9dd2-4366-a99c-d5eb558818ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:06.132928 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:06.154127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1368/2747] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:08.547724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:08.550124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:08.573883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6958a-ffb3-4033-8f9f-5a0330f3948e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:08.585710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:08.586704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:08.589678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:08.590174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] PATH_INFO: `/v3/users/547aed83a7e44becb9c89dc6bae62255` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:08.592348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547aed83a7e44becb9c89dc6bae62255)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:08.595812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:08.873152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547aed83a7e44becb9c89dc6bae62255'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:08.888522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547aed83a7e44becb9c89dc6bae62255'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:08.889281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547aed83a7e44becb9c89dc6bae62255'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:08.956617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547aed83a7e44becb9c89dc6bae62255'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:08.961609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547aed83a7e44becb9c89dc6bae62255'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:09.008463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1380/2748] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:08 2022] DELETE /identity/v3/users/547aed83a7e44becb9c89dc6bae62255 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:09.012758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:09.013279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:09.013279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:09.070551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:09.074587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:09.273207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1369/2749] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:09.332870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:09.334519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:09.417351 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:09.547201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b814f5-f639-4bad-8ff0-9ae6187ac784 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:09.555195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:09.555856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:09.556093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:09.556581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:09.575689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:09.580170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:09.600642 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1381/2750] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:10.577075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:10.581673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:10.615279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7615cd3-0aee-46a9-beb4-6752196692cd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:10.618530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:10.619236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:10.619789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:10.620066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] PATH_INFO: `/v3/projects/eb058785345d4e58a5820445efe09bee` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:10.621508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb058785345d4e58a5820445efe09bee)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:10.623539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:10.794936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb058785345d4e58a5820445efe09bee', 'request_id': 'req-d2262c61-1798-4fb4-a7fc-723964418c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:10.827971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb058785345d4e58a5820445efe09bee', 'request_id': 'req-d2262c61-1798-4fb4-a7fc-723964418c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:10.921550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb058785345d4e58a5820445efe09bee', 'request_id': 'req-d2262c61-1798-4fb4-a7fc-723964418c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:10.944565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] The token cache is being invalidate because project eb058785345d4e58a5820445efe09bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:10.946108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:10.948239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:10.954469 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1370/2751] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:10 2022] DELETE /identity/v3/projects/eb058785345d4e58a5820445efe09bee => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:10.955678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:10.988022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20676c-aa7d-4492-a053-6cdf59f8b992 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:11.264593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:11.268273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:11.269913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:11.269913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] PATH_INFO: `/v3/users/dce640e690324a588f758650bf3c4f9a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:11.270900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce640e690324a588f758650bf3c4f9a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:11.279065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:11.587774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce640e690324a588f758650bf3c4f9a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:11.599350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce640e690324a588f758650bf3c4f9a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:11.600369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce640e690324a588f758650bf3c4f9a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:11.701949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce640e690324a588f758650bf3c4f9a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:11.702592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7181eb07-1b7b-4d74-90c4-26cdc688c325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce640e690324a588f758650bf3c4f9a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:11.739284 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1382/2752] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:10 2022] DELETE /identity/v3/users/dce640e690324a588f758650bf3c4f9a => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:13.108630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:13.110449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:13.137214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262c61-1798-4fb4-a7fc-723964418c8c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:13.298989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:13.301637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:13.302168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:13.302624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] PATH_INFO: `/v3/projects/264d2f683757471183644d46da75d365` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:13.305101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264d2f683757471183644d46da75d365)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:13.310839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:13.449933 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:13.478111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264d2f683757471183644d46da75d365', 'request_id': 'req-5e3acd2a-f969-4885-8e85-1c99e3904c96'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:13.500624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264d2f683757471183644d46da75d365', 'request_id': 'req-5e3acd2a-f969-4885-8e85-1c99e3904c96'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:13.613816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264d2f683757471183644d46da75d365', 'request_id': 'req-5e3acd2a-f969-4885-8e85-1c99e3904c96'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:13.638374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] The token cache is being invalidate because project 264d2f683757471183644d46da75d365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:13.640522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:13.642005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e3acd2a-f969-4885-8e85-1c99e3904c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:13.644552 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1371/2753] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:13 2022] DELETE /identity/v3/projects/264d2f683757471183644d46da75d365 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:18:13.652150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4466a-b771-46b5-bee8-c144e17c725e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:13.653796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4466a-b771-46b5-bee8-c144e17c725e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:13.654390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4466a-b771-46b5-bee8-c144e17c725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:13.724388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f2f4466a-b771-46b5-bee8-c144e17c725e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:13.732735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f2f4466a-b771-46b5-bee8-c144e17c725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:13.922972 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:13.990586 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1383/2754] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:13.999164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0027d-ce8c-4810-8252-a5106ed71e31 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:13.999903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0027d-ce8c-4810-8252-a5106ed71e31 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:14.000608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0027d-ce8c-4810-8252-a5106ed71e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:14.042934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7bb0027d-ce8c-4810-8252-a5106ed71e31 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:14.044960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7bb0027d-ce8c-4810-8252-a5106ed71e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:14.070817 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1372/2755] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:14.075364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4466a-b771-46b5-bee8-c144e17c725e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:14.093701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4466a-b771-46b5-bee8-c144e17c725e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:14.106029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:14.106935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:14.107395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:14.108380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:14.109473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:14.110057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:14.114972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:14.149548 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1384/2756] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:14.153911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0027d-ce8c-4810-8252-a5106ed71e31 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:14.170747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0027d-ce8c-4810-8252-a5106ed71e31 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:14.191941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:14.194357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:14.194691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:14.195853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:14.196537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:14.208605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:14.365737 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1373/2757] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:14 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:14.368664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:14.386266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2d12a-6d00-4210-a33a-d7fc007e6c4b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:14.562793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:14.564989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:14.564989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:14.564989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:14.564989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:14.567591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:14.699358 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1385/2758] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:14 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:14.705036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:14.725525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b42677-e90c-4bc6-afc5-b8982fb24607 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:14.741822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:14.742544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:14.743936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:14.745830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:14.750129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:14.759242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:14.803844 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1374/2759] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:14.805875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:14.826860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10511a2-a282-4afb-b1a2-1704970fc47c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:14.844450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f842dd-5cfc-4c18-a92f-902075810388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:14.847079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f842dd-5cfc-4c18-a92f-902075810388 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:14.847440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f842dd-5cfc-4c18-a92f-902075810388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:14.853139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f842dd-5cfc-4c18-a92f-902075810388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:14.854798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f842dd-5cfc-4c18-a92f-902075810388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:14.862603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f842dd-5cfc-4c18-a92f-902075810388 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:14.922690 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1386/2760] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:18:14.931673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:14.950811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224aec8-c6bd-43db-a211-3099298a8e4d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:14.969073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:14.969947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:14.970292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:14.971159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] PATH_INFO: `/v3/projects/e537eeea5e374e60b73dfce900477dd1/users/0eda10c4f9a942fa928b4cfdeebc116c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:15.057525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e537eeea5e374e60b73dfce900477dd1, user_id=0eda10c4f9a942fa928b4cfdeebc116c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:15.060351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:15.220661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1375/2761] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:14 2022] PUT /identity/v3/projects/e537eeea5e374e60b73dfce900477dd1/users/0eda10c4f9a942fa928b4cfdeebc116c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:15.227125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdfce4-15bb-46c8-88aa-886bcbd86413 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:15.227407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdfce4-15bb-46c8-88aa-886bcbd86413 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:15.227679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdfce4-15bb-46c8-88aa-886bcbd86413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:15.293660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4efdfce4-15bb-46c8-88aa-886bcbd86413 None None] MFA Rules not processed for user `0eda10c4f9a942fa928b4cfdeebc116c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:15.295327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4efdfce4-15bb-46c8-88aa-886bcbd86413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:15.467424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:15.470522 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1387/2762] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:15.601327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17774459-e03e-4a25-845a-7552cbf2ea64 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:15.610634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:15.611267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:15.611761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:15.612728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:15.613547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:15.616751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:15.773851 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1376/2763] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:15 2022] POST /identity/v3/projects => generated 375 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:15.778183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdfce4-15bb-46c8-88aa-886bcbd86413 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:15.790923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdfce4-15bb-46c8-88aa-886bcbd86413 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:15.888803 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:15.914906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:15.916356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:15.917289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:15.917510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:15.918181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:15.921223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:16.052548 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1388/2764] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:15 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:16.056280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:16.074089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be464f-7edf-4330-a6c0-4a872db62c89 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:16.110565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:16.111571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:16.112558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:16.116363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:16.117513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:16.124057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:16.176013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:16.181771 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1377/2765] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:16.190805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bd9a1-f176-41de-91c0-824c70f09bcb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:16.197281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:16.198106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:16.198486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:16.198829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] PATH_INFO: `/v3/projects/776f4a9574cb403ab8a90b38610733ec/users/2f12bc3aa95945c2ae3cea33f5389a7c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:16.219740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776f4a9574cb403ab8a90b38610733ec, user_id=2f12bc3aa95945c2ae3cea33f5389a7c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:16.232989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:16.387325 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1389/2766] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:16 2022] PUT /identity/v3/projects/776f4a9574cb403ab8a90b38610733ec/users/2f12bc3aa95945c2ae3cea33f5389a7c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:18:16.396103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:16.416985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50db04a-272d-421b-afe6-def8c7f15f3b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:16.479961 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:16.551175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af2bf5-59d4-4583-b9d7-38934c3fa2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:16.551911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2bf5-59d4-4583-b9d7-38934c3fa2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:16.552373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2bf5-59d4-4583-b9d7-38934c3fa2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:16.552862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2bf5-59d4-4583-b9d7-38934c3fa2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:16.554083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af2bf5-59d4-4583-b9d7-38934c3fa2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:16.556638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af2bf5-59d4-4583-b9d7-38934c3fa2a7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:16.580228 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1378/2767] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:16.588235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:16.602068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4ea14-1112-45c6-9059-87c31fa8a0e5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:16.616899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:16.617774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:16.618093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:16.620343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] PATH_INFO: `/v3/projects/776f4a9574cb403ab8a90b38610733ec/users/2f12bc3aa95945c2ae3cea33f5389a7c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:16.621644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776f4a9574cb403ab8a90b38610733ec, user_id=2f12bc3aa95945c2ae3cea33f5389a7c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:16.624770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:16.641069 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1390/2768] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:16 2022] PUT /identity/v3/projects/776f4a9574cb403ab8a90b38610733ec/users/2f12bc3aa95945c2ae3cea33f5389a7c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:16.716637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45cea2-67e6-418b-9745-3a4faaa1bbce None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:16.716915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45cea2-67e6-418b-9745-3a4faaa1bbce None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:16.717190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45cea2-67e6-418b-9745-3a4faaa1bbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:16.751793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5c45cea2-67e6-418b-9745-3a4faaa1bbce None None] MFA Rules not processed for user `2f12bc3aa95945c2ae3cea33f5389a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:16.753133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c45cea2-67e6-418b-9745-3a4faaa1bbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:16.907231 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1379/2769] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:16.912343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:16.929271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc62a73-0110-4c66-a6c5-9e414e9ad638 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:16.939192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:16.941311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:16.944572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:16.944572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:16.944572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:16.944572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:16.949908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:16.982487 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1391/2770] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:16.996418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45cea2-67e6-418b-9745-3a4faaa1bbce None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:17.011986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45cea2-67e6-418b-9745-3a4faaa1bbce None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:17.018886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:17.020633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:17.023469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:17.023469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:17.023469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:17.024347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:17.152010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1380/2771] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:16 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:17.156289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:17.168106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f545d-745a-483f-8c90-c8e7ba0eddfe tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:17.242379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb8f80-4535-402a-a403-40cf11cf2746 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:17.243010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb8f80-4535-402a-a403-40cf11cf2746 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:17.243293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb8f80-4535-402a-a403-40cf11cf2746 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:17.243565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb8f80-4535-402a-a403-40cf11cf2746 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:17.244290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb8f80-4535-402a-a403-40cf11cf2746 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:17.244731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb8f80-4535-402a-a403-40cf11cf2746 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:17.246630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb8f80-4535-402a-a403-40cf11cf2746 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:17.263316 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1392/2772] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:17.286598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:17.288718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:17.448388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9d28-44ac-4ecd-b347-4e3b46b072d3 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:17.493518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:17.494602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:17.494884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:17.495150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:17.506608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:17.509831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:17.578798 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1381/2773] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:17.608713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e8e2c-6aee-4a95-a396-35c880c07da3 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:17.608992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e8e2c-6aee-4a95-a396-35c880c07da3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:17.609322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e8e2c-6aee-4a95-a396-35c880c07da3 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:17.611043 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1393/2774] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:18:17.628784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:18:17.647292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:17.662371 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:17.668024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaebd4-d78a-4eca-8feb-d5b958fdb472 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:17.680003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:17.682480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:17.683028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:17.684180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/projects/436a4880444e4effa3309044579198df` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:17.685922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:get_project(project_id=436a4880444e4effa3309044579198df)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:17.693154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:17.709447 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1382/2775] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:18:17 2022] GET /identity/v3/projects/436a4880444e4effa3309044579198df => generated 371 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:18.104371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3651a-6b92-4a9d-aeac-f7974ce7a2fc None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.104891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3651a-6b92-4a9d-aeac-f7974ce7a2fc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.104891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3651a-6b92-4a9d-aeac-f7974ce7a2fc None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.106853 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1394/2776] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:18:18.117504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:18:18.124854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:18.174883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:18.209636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedcc86-98c2-4339-a2f9-815f1e6b8063 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:18.223095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c2c4-3d14-4418-abc1-f886b64815fa tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:18.225961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c2c4-3d14-4418-abc1-f886b64815fa tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.226277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c2c4-3d14-4418-abc1-f886b64815fa tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.226549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c2c4-3d14-4418-abc1-f886b64815fa tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/projects/436a4880444e4effa3309044579198df` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.229301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c2c4-3d14-4418-abc1-f886b64815fa tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:get_project(project_id=436a4880444e4effa3309044579198df)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:18.231467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c2c4-3d14-4418-abc1-f886b64815fa tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:18.236262 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1383/2777] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:18:18 2022] GET /identity/v3/projects/436a4880444e4effa3309044579198df => generated 371 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:18.335358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3651a-6b92-4a9d-aeac-f7974ce7a2fc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:18.363160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3651a-6b92-4a9d-aeac-f7974ce7a2fc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:18.374394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:18.375194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.376363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.376363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.379183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:18.386648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:18.392647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:18.436189 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1395/2778] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:18.440072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e129f4-3025-4e1b-9a57-5675d5c622d3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.440921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e129f4-3025-4e1b-9a57-5675d5c622d3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.441194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e129f4-3025-4e1b-9a57-5675d5c622d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.444128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:18.458099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb23881-60b2-4dcf-86e2-91ca9a371e51 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:18.468185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:18.469217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.469847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.470432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.471374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:18.475090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:18.532035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d0e129f4-3025-4e1b-9a57-5675d5c622d3 None None] MFA Rules not processed for user `18ea2d1dfc7441d2a2bb7b22c6065605`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:18.533679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d0e129f4-3025-4e1b-9a57-5675d5c622d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:18.613612 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1384/2779] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:18.624671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225024c0-5392-455d-aa5f-4d58e5ad62d9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.625081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225024c0-5392-455d-aa5f-4d58e5ad62d9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.625420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225024c0-5392-455d-aa5f-4d58e5ad62d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.650888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-225024c0-5392-455d-aa5f-4d58e5ad62d9 None None] MFA Rules not processed for user `18ea2d1dfc7441d2a2bb7b22c6065605`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:18.651996 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1396/2780] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:18 2022] POST /identity/v3/users => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:18.653338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:18.657158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-225024c0-5392-455d-aa5f-4d58e5ad62d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:18.666012 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1385/2781] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:18.673800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48d74-d037-43a5-a51d-c6d2f293d546 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:18.679587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225024c0-5392-455d-aa5f-4d58e5ad62d9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:18.689178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365752e-6dff-4f1c-86ee-892a1403b4e9 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:18.691739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365752e-6dff-4f1c-86ee-892a1403b4e9 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.691739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365752e-6dff-4f1c-86ee-892a1403b4e9 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.691739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365752e-6dff-4f1c-86ee-892a1403b4e9 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.692551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365752e-6dff-4f1c-86ee-892a1403b4e9 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:18.692979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365752e-6dff-4f1c-86ee-892a1403b4e9 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:18.696607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365752e-6dff-4f1c-86ee-892a1403b4e9 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:18.716078 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1397/2782] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:18.728251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225024c0-5392-455d-aa5f-4d58e5ad62d9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:18.736362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d190ae-da57-4241-8c88-06948548c059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:18.737931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d190ae-da57-4241-8c88-06948548c059 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.738290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d190ae-da57-4241-8c88-06948548c059 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.738615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d190ae-da57-4241-8c88-06948548c059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.747210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8bda-23ed-4b6c-830a-beea3e967098 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.748096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8bda-23ed-4b6c-830a-beea3e967098 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.748439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8bda-23ed-4b6c-830a-beea3e967098 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.751164 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1398/2783] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:18:18.755935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d190ae-da57-4241-8c88-06948548c059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:18.756216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8bda-23ed-4b6c-830a-beea3e967098 None None] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:18:18.763767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d190ae-da57-4241-8c88-06948548c059 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:18.772669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8bda-23ed-4b6c-830a-beea3e967098 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:18.786127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8bda-23ed-4b6c-830a-beea3e967098 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:18.791700 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1386/2784] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:18.804333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:18.805103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:18.805378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:18.805654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/projects/436a4880444e4effa3309044579198df` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:18.807867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:get_project(project_id=436a4880444e4effa3309044579198df)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:18.810634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:18.828108 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1399/2785] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:18:18 2022] GET /identity/v3/projects/436a4880444e4effa3309044579198df => generated 371 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:18:19.568926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1f523-3827-401d-81fe-817f716fd20c None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:19.569752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1f523-3827-401d-81fe-817f716fd20c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:19.570234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1f523-3827-401d-81fe-817f716fd20c None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:19.572326 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1387/2786] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:18:19.578177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:18:19.593741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:19.612600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d84ef-2caf-439d-8af7-9762b919aeb0 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:19.618819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:19.619715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:19.620179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:19.620638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/projects/436a4880444e4effa3309044579198df` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:19.621942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:get_project(project_id=436a4880444e4effa3309044579198df)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:19.625818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:19.628639 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1400/2787] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:18:19 2022] GET /identity/v3/projects/436a4880444e4effa3309044579198df => generated 371 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:19.683893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1f523-3827-401d-81fe-817f716fd20c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:19.709697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1f523-3827-401d-81fe-817f716fd20c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:19.719700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:19.721078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:19.721731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:19.722251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/users/2b9869f8149c46f6ac3c707f18fe0c4a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:19.743151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:19.745117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:19.759826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b9869f8149c46f6ac3c707f18fe0c4a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:19.761396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:19.796178 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:19.920247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9869f8149c46f6ac3c707f18fe0c4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:19.936279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9869f8149c46f6ac3c707f18fe0c4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:19.938123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248b37-6e6f-442b-a3b5-e406367e2269 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:19.939342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9869f8149c46f6ac3c707f18fe0c4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:19.944624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:19.946161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:19.946667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:19.947275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] PATH_INFO: `/v3/users/c9681db3595440a88dacc40393e2e1dc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:19.951262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9681db3595440a88dacc40393e2e1dc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:19.957383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:20.075304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9869f8149c46f6ac3c707f18fe0c4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.076363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9869f8149c46f6ac3c707f18fe0c4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.119949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1388/2788] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:19 2022] DELETE /identity/v3/users/2b9869f8149c46f6ac3c707f18fe0c4a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:20.121045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:20.126903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:20.171475 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:20.219657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9681db3595440a88dacc40393e2e1dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.237917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9681db3595440a88dacc40393e2e1dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.240010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9681db3595440a88dacc40393e2e1dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.278867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed3ee-e227-4543-83af-dd46688720d6 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:20.291884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:20.291884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:20.291884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:20.291884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] PATH_INFO: `/v3/users/519c893a1e094200b882cf23db7cae54` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:20.292703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519c893a1e094200b882cf23db7cae54)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:20.292703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:20.386713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9681db3595440a88dacc40393e2e1dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.386713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9681db3595440a88dacc40393e2e1dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.418046 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1401/2789] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:19 2022] DELETE /identity/v3/users/c9681db3595440a88dacc40393e2e1dc => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:20.419171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:20.436791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:20.575402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd478ab7-1c5e-4c0f-a05a-0e98227e9ec9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:20.589744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f12bc3aa95945c2ae3cea33f5389a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '776f4a9574cb403ab8a90b38610733ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:20.590880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:20.591270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:20.591635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] PATH_INFO: `/v3/projects/436a4880444e4effa3309044579198df` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:20.595868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=436a4880444e4effa3309044579198df)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:20.599741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:20.665715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519c893a1e094200b882cf23db7cae54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.681183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519c893a1e094200b882cf23db7cae54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.684890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519c893a1e094200b882cf23db7cae54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.779804 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:20.789794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519c893a1e094200b882cf23db7cae54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.790597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519c893a1e094200b882cf23db7cae54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.808574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436a4880444e4effa3309044579198df', 'request_id': 'req-d8daa01b-df23-47c0-b74a-a6b575605a39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.829582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436a4880444e4effa3309044579198df', 'request_id': 'req-d8daa01b-df23-47c0-b74a-a6b575605a39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.892106 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1389/2790] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:20 2022] DELETE /identity/v3/users/519c893a1e094200b882cf23db7cae54 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:20.893823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:20.899950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:20.927293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436a4880444e4effa3309044579198df', 'request_id': 'req-d8daa01b-df23-47c0-b74a-a6b575605a39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.949498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] The token cache is being invalidate because project 436a4880444e4effa3309044579198df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:20.957265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.957265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8daa01b-df23-47c0-b74a-a6b575605a39 tempest-QuotasAdminTestV236-1801679605 tempest-QuotasAdminTestV236-1801679605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:20.957265 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1402/2791] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:20 2022] DELETE /identity/v3/projects/436a4880444e4effa3309044579198df => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:20.963951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:20.964577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:20.965791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:20.990440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:20.992065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.029247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f4b96-416d-4fb2-a31a-548d74432370 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:21.041605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:21.041605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.041605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.041605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] PATH_INFO: `/v3/projects/386d20bba06b48be9a7e51162dc4d814` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.042122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=386d20bba06b48be9a7e51162dc4d814)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:21.042122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:21.106788 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1403/2792] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:21.108140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:21.118255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.143901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0799fe-8a1d-4947-bf1d-182a5156aa33 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:21.167858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:21.167858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.167858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.167858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] PATH_INFO: `/v3/users/0eda10c4f9a942fa928b4cfdeebc116c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.168305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eda10c4f9a942fa928b4cfdeebc116c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:21.169532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:21.173680 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:21.180015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386d20bba06b48be9a7e51162dc4d814', 'request_id': 'req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.187116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386d20bba06b48be9a7e51162dc4d814', 'request_id': 'req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.241241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386d20bba06b48be9a7e51162dc4d814', 'request_id': 'req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.260200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] The token cache is being invalidate because project 386d20bba06b48be9a7e51162dc4d814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:21.260543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.261396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.266840 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1390/2793] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:20 2022] DELETE /identity/v3/projects/386d20bba06b48be9a7e51162dc4d814 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:21.266840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:21.266840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.379202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd179b-31c3-4215-a1f8-e48ddf4d95bb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:21.388374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef562c39-ec6d-407c-90ce-9341f144c588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:21.389540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562c39-ec6d-407c-90ce-9341f144c588 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.390925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562c39-ec6d-407c-90ce-9341f144c588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.397224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562c39-ec6d-407c-90ce-9341f144c588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.397224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ef562c39-ec6d-407c-90ce-9341f144c588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.498063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eda10c4f9a942fa928b4cfdeebc116c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.520492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eda10c4f9a942fa928b4cfdeebc116c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.521305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eda10c4f9a942fa928b4cfdeebc116c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.546947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef562c39-ec6d-407c-90ce-9341f144c588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:21.548660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef562c39-ec6d-407c-90ce-9341f144c588 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:21.562742 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1391/2794] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:21.573863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e64c-5e7d-4b85-b213-dc49a695b5fa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.574163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e64c-5e7d-4b85-b213-dc49a695b5fa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.574444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e64c-5e7d-4b85-b213-dc49a695b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.612945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eda10c4f9a942fa928b4cfdeebc116c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.614944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1122c38c-97ec-4517-8448-6cbf324c05e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eda10c4f9a942fa928b4cfdeebc116c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:21.629102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5119e64c-5e7d-4b85-b213-dc49a695b5fa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:21.630832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5119e64c-5e7d-4b85-b213-dc49a695b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.646070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1392/2795] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:21.648425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf57802-1d2c-4cdd-a636-4ceca342e278 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.651822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf57802-1d2c-4cdd-a636-4ceca342e278 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.656021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf57802-1d2c-4cdd-a636-4ceca342e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.675670 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1404/2796] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:21 2022] DELETE /identity/v3/users/0eda10c4f9a942fa928b4cfdeebc116c => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:21.683931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.684712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.685188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.689674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5bf57802-1d2c-4cdd-a636-4ceca342e278 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:21.691923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5bf57802-1d2c-4cdd-a636-4ceca342e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.727661 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:21.733374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:21.734737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.761429 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:21.822856 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1393/2797] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:21.824269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf57802-1d2c-4cdd-a636-4ceca342e278 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:21.836827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf57802-1d2c-4cdd-a636-4ceca342e278 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:21.842466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:21.843229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.843575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.843858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.844600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:21.845026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:21.847501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:21.878954 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1394/2798] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:18:21.880635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:21.899807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e863df-1daa-4a54-9e00-05ba7eb80ee9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:21.914645 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1405/2799] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:21.933747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:21.936960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:21.938276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:21.939101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:21.939570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:21.940500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:21.941911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:21.945134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:22.102552 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1395/2800] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:21 2022] POST /identity/v3/projects => generated 395 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:18:22.103904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:22.110207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:22.156154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a37b-7889-40fd-872d-377baebdb85f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:22.245287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:22.246532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:22.247023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:22.247585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:22.300415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca67a1-5da4-4e40-87f2-c64d0e230950 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:22.312837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:22.313791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:22.313928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:22.314129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] PATH_INFO: `/v3/projects/47aadec780734d03a262d4021f48d625` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:22.316549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] RBAC: Authorizing `identity:delete_project(project_id=47aadec780734d03a262d4021f48d625)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:22.331235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:22.433419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:22.434914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:22.449231 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1406/2801] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:22.450158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:22.480815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b3f0e-942a-44bb-80ba-0c4b9ada0e28 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:22.497174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:22.497956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:22.498277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:22.498780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:22.500174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:22.509711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:22.604544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47aadec780734d03a262d4021f48d625', 'request_id': 'req-91c43f0d-074b-46d6-a60d-577c2cbafdac'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:22.626107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47aadec780734d03a262d4021f48d625', 'request_id': 'req-91c43f0d-074b-46d6-a60d-577c2cbafdac'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:22.644214 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1407/2802] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:22 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:22.648985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:22.693355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b44d-af42-4486-8395-79da60a7537e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:22.715303 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:22.744287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47aadec780734d03a262d4021f48d625', 'request_id': 'req-91c43f0d-074b-46d6-a60d-577c2cbafdac'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:22.767276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] The token cache is being invalidate because project 47aadec780734d03a262d4021f48d625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:22.767715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:22.771049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:22.777415 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1396/2803] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:22 2022] DELETE /identity/v3/projects/47aadec780734d03a262d4021f48d625 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:22.778922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:22.780907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:22.870955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:22.874332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:22.877237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:22.878190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:22.882073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:22.889740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:22.900661 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:22.923156 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1408/2804] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:22.931039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:22.950247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:23.008497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e6cf9-cb2c-40eb-a8d3-5a4289bd4cc7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:23.014392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43f0d-074b-46d6-a60d-577c2cbafdac admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:23.019223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:23.020175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:23.021242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:23.021242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:23.022865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:23.024173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:23.025445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:23.025445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:23.025695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] PATH_INFO: `/v3/users/d9275a4981504d519e0e097fc3744673` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:23.030888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9275a4981504d519e0e097fc3744673)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:23.033585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:23.034304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:23.075476 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1409/2805] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:23.077740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:23.103752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca50f75-2692-43e5-b4bd-1804832ac809 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:23.113876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2932e2d-01df-44e2-8546-894b447d8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:23.125104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932e2d-01df-44e2-8546-894b447d8a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:23.125104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932e2d-01df-44e2-8546-894b447d8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:23.125104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932e2d-01df-44e2-8546-894b447d8a49 admin admin] PATH_INFO: `/v3/projects/b4193043521942fb82165e6542f7e1a0/users/1c586dd247c84eb79c0cbdd81b08ecfe/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:23.132058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2932e2d-01df-44e2-8546-894b447d8a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4193043521942fb82165e6542f7e1a0, user_id=1c586dd247c84eb79c0cbdd81b08ecfe, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:23.148412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2932e2d-01df-44e2-8546-894b447d8a49 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:23.266152 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1410/2806] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:23 2022] PUT /identity/v3/projects/b4193043521942fb82165e6542f7e1a0/users/1c586dd247c84eb79c0cbdd81b08ecfe/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:23.267242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7faa03-ee50-4b2c-9358-9e65b5c4bdf0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:23.267808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7faa03-ee50-4b2c-9358-9e65b5c4bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:23.268123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7faa03-ee50-4b2c-9358-9e65b5c4bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:23.302602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ab7faa03-ee50-4b2c-9358-9e65b5c4bdf0 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:23.303854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab7faa03-ee50-4b2c-9358-9e65b5c4bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:23.340035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9275a4981504d519e0e097fc3744673'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:23.356323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9275a4981504d519e0e097fc3744673'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:23.357741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9275a4981504d519e0e097fc3744673'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:23.379019 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1411/2807] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:23.380613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:23.380892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:23.381441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:23.437880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] MFA Rules not processed for user `1c586dd247c84eb79c0cbdd81b08ecfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:23.439352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:23.470273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9275a4981504d519e0e097fc3744673'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:23.471616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9275a4981504d519e0e097fc3744673'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:23.507237 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1397/2808] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:22 2022] DELETE /identity/v3/users/d9275a4981504d519e0e097fc3744673 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:23.572528 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1412/2809] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:24.094899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:24.097711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:24.129021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:24.132116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:24.165010 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:24.255799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417c47c-c9ce-46e3-a44e-d4278184d790 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:24.264508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:24.265784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:24.266315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:24.266880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:24.271663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1371e-7c99-4bed-a71d-64aa191bc9b3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:24.364199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:24.366724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:24.368775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:24.369425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:24.369703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:24.370098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] PATH_INFO: `/v3/projects/a58832764dfa4f259d9ef741802080f2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:24.371293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58832764dfa4f259d9ef741802080f2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:24.373225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:24.384337 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1398/2810] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:24.395992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:24.401945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:24.437592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa441250-eb52-4795-9033-9a1b10261e48 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:24.466296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:24.466296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:24.466296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:24.466296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] PATH_INFO: `/v3/projects/e537eeea5e374e60b73dfce900477dd1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:24.467879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e537eeea5e374e60b73dfce900477dd1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:24.467879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:24.608218 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:24.628792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58832764dfa4f259d9ef741802080f2', 'request_id': 'req-8610b4e3-3d27-43e1-977b-fec62f978795'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.632895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e537eeea5e374e60b73dfce900477dd1', 'request_id': 'req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.637330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58832764dfa4f259d9ef741802080f2', 'request_id': 'req-8610b4e3-3d27-43e1-977b-fec62f978795'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.644778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e537eeea5e374e60b73dfce900477dd1', 'request_id': 'req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.749944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58832764dfa4f259d9ef741802080f2', 'request_id': 'req-8610b4e3-3d27-43e1-977b-fec62f978795'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.766637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] The token cache is being invalidate because project a58832764dfa4f259d9ef741802080f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:24.766933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.778197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8610b4e3-3d27-43e1-977b-fec62f978795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.784687 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1413/2811] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:24 2022] DELETE /identity/v3/projects/a58832764dfa4f259d9ef741802080f2 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:18:24.787368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe557-9f75-4e18-ad4d-1a2d616dc588 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:24.788262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe557-9f75-4e18-ad4d-1a2d616dc588 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:24.790280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe557-9f75-4e18-ad4d-1a2d616dc588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:24.818587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f40fe557-9f75-4e18-ad4d-1a2d616dc588 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:24.819902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f40fe557-9f75-4e18-ad4d-1a2d616dc588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:24.840792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e537eeea5e374e60b73dfce900477dd1', 'request_id': 'req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.863659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] The token cache is being invalidate because project e537eeea5e374e60b73dfce900477dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:24.865030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.867801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:24.881523 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1399/2812] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:24 2022] DELETE /identity/v3/projects/e537eeea5e374e60b73dfce900477dd1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:24.887744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:24.894837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:25.040693 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1414/2813] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:25.040693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8e726-f0fa-4737-90ae-ade1be0a58dc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:25.041230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8e726-f0fa-4737-90ae-ade1be0a58dc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:25.041230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8e726-f0fa-4737-90ae-ade1be0a58dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:25.075858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-02b8e726-f0fa-4737-90ae-ade1be0a58dc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:25.079174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-02b8e726-f0fa-4737-90ae-ade1be0a58dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:25.098492 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1415/2814] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:25.098492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8e726-f0fa-4737-90ae-ade1be0a58dc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:25.109885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8e726-f0fa-4737-90ae-ade1be0a58dc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:25.112779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:25.113404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:25.113780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:25.114378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:25.115038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:25.115587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:25.117232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:25.126787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48eaa-f59f-4f8f-ae6c-a9a6101d7846 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:25.131374 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1416/2815] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:25.137887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:25.140835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:25.141829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:25.142329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:25.142697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] PATH_INFO: `/v3/users/2f12bc3aa95945c2ae3cea33f5389a7c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:25.148371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f12bc3aa95945c2ae3cea33f5389a7c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:25.157656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:25.162303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7440d6-35d9-4c85-a6a1-6540e0b706d9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:25.169882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:25.171609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:25.171893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:25.172184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:25.173923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:25.180651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:25.367293 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1417/2816] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:25 2022] POST /identity/v3/projects => generated 393 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:25.367293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:25.369693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:25.404213 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:25.428055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f12bc3aa95945c2ae3cea33f5389a7c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.441413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f12bc3aa95945c2ae3cea33f5389a7c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.442594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f12bc3aa95945c2ae3cea33f5389a7c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.469165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3510500-0f71-42eb-a56a-6882eacb5100 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:25.475218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:25.476137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:25.476604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:25.477059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] PATH_INFO: `/v3/users/1c586dd247c84eb79c0cbdd81b08ecfe` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:25.478673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c586dd247c84eb79c0cbdd81b08ecfe)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:25.480982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:25.538544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f12bc3aa95945c2ae3cea33f5389a7c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.539497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f12bc3aa95945c2ae3cea33f5389a7c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.567289 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1400/2817] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:24 2022] DELETE /identity/v3/users/2f12bc3aa95945c2ae3cea33f5389a7c => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:25.570377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:25.573193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:25.752857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86884-fd8a-47a9-982a-c47a2084df33 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:25.762101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:25.763308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:25.767580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:25.767580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:25.767580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:25.777242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:25.819711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c586dd247c84eb79c0cbdd81b08ecfe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.840268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c586dd247c84eb79c0cbdd81b08ecfe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.840268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c586dd247c84eb79c0cbdd81b08ecfe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.938452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c586dd247c84eb79c0cbdd81b08ecfe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.939229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c586dd247c84eb79c0cbdd81b08ecfe'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:25.968624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1401/2818] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:25 2022] POST /identity/v3/users => generated 297 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:25.972247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:25.978891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:25.994518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1418/2819] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:25 2022] DELETE /identity/v3/users/1c586dd247c84eb79c0cbdd81b08ecfe => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:25.994518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:25.994518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:26.140883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f911-f0cf-4b15-9e4f-458f5396935f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:26.146764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4ef7c-0755-44dc-a066-0c5d253cd4db admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:26.166105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4a4db-2342-40af-8f87-2ae054f3bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:26.173747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4a4db-2342-40af-8f87-2ae054f3bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.179736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4a4db-2342-40af-8f87-2ae054f3bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.180404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4a4db-2342-40af-8f87-2ae054f3bf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.182812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4a4db-2342-40af-8f87-2ae054f3bf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:26.185449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4a4db-2342-40af-8f87-2ae054f3bf2e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:26.240123 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1419/2820] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:26.240123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4804e1e-a5fe-46b7-a4e9-3d81de97a8ea None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.240123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4804e1e-a5fe-46b7-a4e9-3d81de97a8ea None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.240425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4804e1e-a5fe-46b7-a4e9-3d81de97a8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.276565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d4804e1e-a5fe-46b7-a4e9-3d81de97a8ea None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:26.278133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d4804e1e-a5fe-46b7-a4e9-3d81de97a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:26.292957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1420/2821] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:26.297043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4804e1e-a5fe-46b7-a4e9-3d81de97a8ea None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:26.305738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:26.305738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.305738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.305738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.309132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4804e1e-a5fe-46b7-a4e9-3d81de97a8ea None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:26.310615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:26.317802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:26.318798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.319353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.319631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.320295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:26.322736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:26.335650 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1421/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:26.336917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:26.339261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:26.420587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:26.422434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:26.442003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abae6-135d-4eb4-8eea-f286d7fc0cf8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:26.443572 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1402/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:26.444617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:26.464730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd306-4a44-4ba1-8f89-7fdfac597c3c service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:26.479601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:26.481116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0dcb3-fe95-495c-81b8-62dae008dd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:26.487664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0dcb3-fe95-495c-81b8-62dae008dd00 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.487884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.487884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.487884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] PATH_INFO: `/v3/projects/6039c024774e4b92a4765ffea4d77094/users/582a76898d8c4d8f87a81dba9ce12a15/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.488176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0dcb3-fe95-495c-81b8-62dae008dd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.488176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0dcb3-fe95-495c-81b8-62dae008dd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.508886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0dcb3-fe95-495c-81b8-62dae008dd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:26.512308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0dcb3-fe95-495c-81b8-62dae008dd00 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:26.534226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6039c024774e4b92a4765ffea4d77094, user_id=582a76898d8c4d8f87a81dba9ce12a15, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:26.539213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1422/2824] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:26.539558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:26.641043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1403/2825] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:26 2022] PUT /identity/v3/projects/6039c024774e4b92a4765ffea4d77094/users/582a76898d8c4d8f87a81dba9ce12a15/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:26.643639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea55c8-f2d8-4d9a-ace9-c63c52f2e35a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.643933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea55c8-f2d8-4d9a-ace9-c63c52f2e35a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.644210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea55c8-f2d8-4d9a-ace9-c63c52f2e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.709314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-faea55c8-f2d8-4d9a-ace9-c63c52f2e35a None None] MFA Rules not processed for user `582a76898d8c4d8f87a81dba9ce12a15`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:26.710785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-faea55c8-f2d8-4d9a-ace9-c63c52f2e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:26.724206 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:26.767358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:26.771228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:26.893799 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1423/2826] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:26.895023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0188ee-81b7-4c6c-bd44-27ff1ce2a0c6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:26.895023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:26.895023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.895023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.896322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] PATH_INFO: `/v3/projects/776f4a9574cb403ab8a90b38610733ec` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.896322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776f4a9574cb403ab8a90b38610733ec)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:26.896322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:26.897481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea55c8-f2d8-4d9a-ace9-c63c52f2e35a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:26.908888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea55c8-f2d8-4d9a-ace9-c63c52f2e35a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:26.914563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:26.915244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:26.915520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:26.915875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:26.916452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:26.918751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:27.921584 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1424/2827] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:26 2022] POST /identity/v3/projects => generated 393 bytes in 1027 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:27.927104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:27.945136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776f4a9574cb403ab8a90b38610733ec', 'request_id': 'req-66b136b0-b795-4b54-95db-ed88ec221525'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:27.959705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776f4a9574cb403ab8a90b38610733ec', 'request_id': 'req-66b136b0-b795-4b54-95db-ed88ec221525'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.043562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1aa4-18c6-4265-9bab-c917b18c287a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:28.076868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776f4a9574cb403ab8a90b38610733ec', 'request_id': 'req-66b136b0-b795-4b54-95db-ed88ec221525'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.113695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] The token cache is being invalidate because project 776f4a9574cb403ab8a90b38610733ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:28.114013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.116021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66b136b0-b795-4b54-95db-ed88ec221525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.127271 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1404/2828] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:26 2022] DELETE /identity/v3/projects/776f4a9574cb403ab8a90b38610733ec => generated 0 bytes in 1355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:18:28.132182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c9d1-ed7e-421c-9da6-03a2f9a32bcd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:28.132488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c9d1-ed7e-421c-9da6-03a2f9a32bcd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:28.132764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c9d1-ed7e-421c-9da6-03a2f9a32bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:28.188667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-82a5c9d1-ed7e-421c-9da6-03a2f9a32bcd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:28.195143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-82a5c9d1-ed7e-421c-9da6-03a2f9a32bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:28.226458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:28.230205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:28.230574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:28.230925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:28.231671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:28.238782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:28.339542 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1405/2829] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:28.348524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:28.349117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:28.349610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:28.360059 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1425/2830] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:27 2022] POST /identity/v3/users => generated 303 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:28.364003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:28.367358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:28.405522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:28.408613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:28.413353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b838f8-6596-413a-9f2a-35d7c44aac06 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:28.420146 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1406/2831] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:28.422783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:28.424565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:28.430388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:28.435314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:28.435314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:28.435314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:28.435314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:28.438482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:28.466209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7511e1-8b95-4d85-820f-c1f7d2575a7c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:28.466596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1426/2832] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:28.466596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:28.493685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:28.494924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:28.495671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:28.495671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] PATH_INFO: `/v3/projects/b4193043521942fb82165e6542f7e1a0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:28.499899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4193043521942fb82165e6542f7e1a0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:28.501839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:28.510652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc078-d943-4594-8f67-147435e5ff3c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:28.527933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:28.529565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:28.530036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:28.530485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:28.531550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:28.532060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:28.536880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:28.553601 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1427/2833] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:28.554590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:28.570135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955386-16b2-41dc-a6b9-5ad208040ac7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:28.576258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:28.577083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:28.577466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:28.577960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] PATH_INFO: `/v3/projects/a35fe7040e814522bad95df1c2072dba/users/199e1efcbb724f45b875b678e1be14d2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:28.606120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35fe7040e814522bad95df1c2072dba, user_id=199e1efcbb724f45b875b678e1be14d2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:28.610283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:28.724521 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1428/2834] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:28 2022] PUT /identity/v3/projects/a35fe7040e814522bad95df1c2072dba/users/199e1efcbb724f45b875b678e1be14d2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:28.725918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:28.755523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4193043521942fb82165e6542f7e1a0', 'request_id': 'req-0c02fbf1-97c4-4058-9f5c-6aded82541d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.774626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4193043521942fb82165e6542f7e1a0', 'request_id': 'req-0c02fbf1-97c4-4058-9f5c-6aded82541d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.833559 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:28.882185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549656-2072-4ebb-8a2b-d2feae0801e5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:28.892818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4193043521942fb82165e6542f7e1a0', 'request_id': 'req-0c02fbf1-97c4-4058-9f5c-6aded82541d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.915368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] The token cache is being invalidate because project b4193043521942fb82165e6542f7e1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:28.920492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.920492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:28.920492 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1407/2835] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:28 2022] DELETE /identity/v3/projects/b4193043521942fb82165e6542f7e1a0 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:28.920492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:28.925035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:29.032252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.036259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.037197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.037475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.038857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:29.042438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:29.090060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02fbf1-97c4-4058-9f5c-6aded82541d6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:29.105002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab284f-fab6-4df7-afb7-21aea71172cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.105675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab284f-fab6-4df7-afb7-21aea71172cd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.106173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab284f-fab6-4df7-afb7-21aea71172cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.106327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab284f-fab6-4df7-afb7-21aea71172cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.107018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab284f-fab6-4df7-afb7-21aea71172cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:29.108727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab284f-fab6-4df7-afb7-21aea71172cd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:29.147904 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1408/2836] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:29.149215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.149577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.150168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.203337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:29.236754 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1429/2837] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:28 2022] POST /identity/v3/projects => generated 391 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:29.255363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:29.256032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:29.378556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866797-a159-47b2-938f-5ee9ad354541 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:29.392327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96ed9c-b6a6-4c1d-8794-33ae1e9b7bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.405263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96ed9c-b6a6-4c1d-8794-33ae1e9b7bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.405263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96ed9c-b6a6-4c1d-8794-33ae1e9b7bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.405263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96ed9c-b6a6-4c1d-8794-33ae1e9b7bfa admin admin] PATH_INFO: `/v3/projects/a35fe7040e814522bad95df1c2072dba/users/199e1efcbb724f45b875b678e1be14d2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.411164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96ed9c-b6a6-4c1d-8794-33ae1e9b7bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35fe7040e814522bad95df1c2072dba, user_id=199e1efcbb724f45b875b678e1be14d2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:29.413962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96ed9c-b6a6-4c1d-8794-33ae1e9b7bfa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:29.420139 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1409/2838] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:29.430364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:29.433270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:29.436295 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1430/2839] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:29 2022] PUT /identity/v3/projects/a35fe7040e814522bad95df1c2072dba/users/199e1efcbb724f45b875b678e1be14d2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:29.438270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef0a9-0f11-40ec-ac78-07d4f61b71e3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.438571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef0a9-0f11-40ec-ac78-07d4f61b71e3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.438929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef0a9-0f11-40ec-ac78-07d4f61b71e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.460254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1924-1e80-40f9-be30-60abaafba838 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:29.467652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7d7ef0a9-0f11-40ec-ac78-07d4f61b71e3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:29.471555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d7ef0a9-0f11-40ec-ac78-07d4f61b71e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:29.606808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.608222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.609371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.609852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.610924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:29.615192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:29.617487 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1431/2840] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:29.618851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e22b-bea6-4d0d-8aa8-b4074e2ce25d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.619152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e22b-bea6-4d0d-8aa8-b4074e2ce25d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.619427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e22b-bea6-4d0d-8aa8-b4074e2ce25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.666309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1c36e22b-bea6-4d0d-8aa8-b4074e2ce25d None None] MFA Rules not processed for user `199e1efcbb724f45b875b678e1be14d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:29.668201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c36e22b-bea6-4d0d-8aa8-b4074e2ce25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:29.789706 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1410/2841] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:29 2022] POST /identity/v3/users => generated 296 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:29.790712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:29.814367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048bd7-e102-48c5-ba24-27ea87a1c2f5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:29.827255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.827895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.829393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.829674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.832638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:29.834705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:29.836501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:29.880629 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1411/2842] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:29.880629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:29.898656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89633f-78bb-443e-a910-bf2f83a436ba admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:29.905761 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1432/2843] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:29.912156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e22b-bea6-4d0d-8aa8-b4074e2ce25d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:29.921169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.921169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.921169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.921169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.921697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:29.923288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:29.933302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e22b-bea6-4d0d-8aa8-b4074e2ce25d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:29.946515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.948929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.954822 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1412/2844] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:29.956235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.956590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:29.957717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:29.960699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:29.965299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:29.982507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77093f-ac8d-4223-85e8-4cc2683ec54c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:29.998212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:29.999003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:29.999307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:29.999674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.000337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.001938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.026603 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:30.030540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1413/2845] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:30.031673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.045279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c2807-8879-4c97-b496-f31eb400e23d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.051620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.052394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.052660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.052931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] PATH_INFO: `/v3/projects/bcdabdb037d54103a656623e2c4c4a78/users/8417cd8a252c4d3c9f2059c42bc82aa0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.078088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdabdb037d54103a656623e2c4c4a78, user_id=8417cd8a252c4d3c9f2059c42bc82aa0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.080639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.144014 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1433/2846] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:29 2022] POST /identity/v3/projects => generated 371 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:30.148514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.166855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:30.305937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c018440-c13e-4ec2-be11-20283702f656 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.306525 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1414/2847] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:30 2022] PUT /identity/v3/projects/bcdabdb037d54103a656623e2c4c4a78/users/8417cd8a252c4d3c9f2059c42bc82aa0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:30.308142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.417077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430859d7-486c-4198-bccf-200af452ccd7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.427854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.431131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.431131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.431131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.431131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.434291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.450684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d16e0-2a43-4fdd-bec6-7491875699ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.451463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d16e0-2a43-4fdd-bec6-7491875699ba service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.451844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d16e0-2a43-4fdd-bec6-7491875699ba service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.452341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d16e0-2a43-4fdd-bec6-7491875699ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.536417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d16e0-2a43-4fdd-bec6-7491875699ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.538253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d16e0-2a43-4fdd-bec6-7491875699ba service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.551368 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1434/2848] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:30.554773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d973e-d5db-4217-a401-60d979db1401 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.554773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d973e-d5db-4217-a401-60d979db1401 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.554773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d973e-d5db-4217-a401-60d979db1401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.559600 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1415/2849] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:30 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:30.563574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.584770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253ec52-359f-4981-80f1-b0173f13227d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.589936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.590584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.590861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.591130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.591769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.593429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.621681 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1416/2850] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:18:30.621681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.637788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4f1d973e-d5db-4217-a401-60d979db1401 None None] MFA Rules not processed for user `8417cd8a252c4d3c9f2059c42bc82aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:30.638082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd1a14-940a-47f2-8a6e-46a3c0c58322 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.638217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f1d973e-d5db-4217-a401-60d979db1401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:30.639524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.640916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.641900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.642286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.643443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.644744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.662976 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1417/2851] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:30.663998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.667327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:30.689053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f0f2e-4816-49fe-ace9-255512503167 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.695808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.696639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.696926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.697276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.701674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:30.733900 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1435/2852] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:30.735771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d973e-d5db-4217-a401-60d979db1401 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.754322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d973e-d5db-4217-a401-60d979db1401 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.760754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.762511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.763495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.763827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] PATH_INFO: `/v3/projects/38e182b74ee248a691cce4f31d5d24a1/users/2ef087421d544ed1b56f73e64db80edb/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.797888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e182b74ee248a691cce4f31d5d24a1, user_id=2ef087421d544ed1b56f73e64db80edb, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.802577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.809031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.813792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:30.843062 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1418/2853] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:30.844575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.874228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1d245-d444-447c-a413-a834ca5f1a00 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:30.909073 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1436/2854] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:30 2022] PUT /identity/v3/projects/38e182b74ee248a691cce4f31d5d24a1/users/2ef087421d544ed1b56f73e64db80edb/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:30.910100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:30.915564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c2a1b-9326-4589-9be0-59e6d1d9883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:30.916452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c2a1b-9326-4589-9be0-59e6d1d9883a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:30.916803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c2a1b-9326-4589-9be0-59e6d1d9883a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:30.917666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c2a1b-9326-4589-9be0-59e6d1d9883a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:30.918205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c2a1b-9326-4589-9be0-59e6d1d9883a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:30.920885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c2a1b-9326-4589-9be0-59e6d1d9883a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:31.020428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf71c0-0855-47f6-91c1-1a6001d570a9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:31.027254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:31.029026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:31.030239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:31.030778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] PATH_INFO: `/v3/users/582a76898d8c4d8f87a81dba9ce12a15` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:31.032758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] RBAC: Authorizing `identity:delete_user(user_id=582a76898d8c4d8f87a81dba9ce12a15)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:31.034356 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1419/2855] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:30 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:31.037426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:31.040942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debee05-a489-478b-bbc0-13d3a684882f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:31.041547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debee05-a489-478b-bbc0-13d3a684882f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:31.041894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debee05-a489-478b-bbc0-13d3a684882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:31.086432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4debee05-a489-478b-bbc0-13d3a684882f None None] MFA Rules not processed for user `2ef087421d544ed1b56f73e64db80edb`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:31.090528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4debee05-a489-478b-bbc0-13d3a684882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:31.165767 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:31.307167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1420/2856] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:31.307167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debee05-a489-478b-bbc0-13d3a684882f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:31.443542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582a76898d8c4d8f87a81dba9ce12a15'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:31.448243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debee05-a489-478b-bbc0-13d3a684882f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:31.456116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582a76898d8c4d8f87a81dba9ce12a15'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:31.456842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582a76898d8c4d8f87a81dba9ce12a15'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:31.476097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:31.476741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:31.482934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:31.482934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:31.482934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:31.482934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:31.612219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582a76898d8c4d8f87a81dba9ce12a15'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:31.613682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582a76898d8c4d8f87a81dba9ce12a15'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:31.637549 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1421/2857] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:31 2022] POST /identity/v3/users => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:31.639566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:31.644137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:31.647924 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1437/2858] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:30 2022] DELETE /identity/v3/users/582a76898d8c4d8f87a81dba9ce12a15 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:31.648962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:31.651731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:31.788082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1fd9-11d3-48c7-a3e2-8e9ae223420e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:31.805500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0bc7d-256a-4e71-a6c0-b8c0ba7c59a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:31.808245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0bc7d-256a-4e71-a6c0-b8c0ba7c59a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:31.808245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0bc7d-256a-4e71-a6c0-b8c0ba7c59a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:31.808245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0bc7d-256a-4e71-a6c0-b8c0ba7c59a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:31.808245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0bc7d-256a-4e71-a6c0-b8c0ba7c59a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:31.809770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0bc7d-256a-4e71-a6c0-b8c0ba7c59a0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:31.810466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca246c8e-bf85-4b82-b844-486c5c897378 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:31.829824 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1438/2859] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:31.834028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de28cc-adea-4500-bec7-ee64d2087259 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:31.834536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de28cc-adea-4500-bec7-ee64d2087259 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:31.834987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de28cc-adea-4500-bec7-ee64d2087259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:31.881540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-80de28cc-adea-4500-bec7-ee64d2087259 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:31.882810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-80de28cc-adea-4500-bec7-ee64d2087259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:31.926690 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1439/2860] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:31.929140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de28cc-adea-4500-bec7-ee64d2087259 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:31.972280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de28cc-adea-4500-bec7-ee64d2087259 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:31.984325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:31.985395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:31.985685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:31.987087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] PATH_INFO: `/v3/projects/154b9d85a646422ea4978904144a7aff/users/1055f18673474d189a5605319bc301da/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:32.006265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:32.006265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:32.006265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:32.006265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:32.010638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:32.025538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154b9d85a646422ea4978904144a7aff, user_id=1055f18673474d189a5605319bc301da, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:32.028266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:32.089572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:32.091595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:32.114988 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1422/2861] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:32.119044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:32.119788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:32.165259 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1440/2862] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:31 2022] PUT /identity/v3/projects/154b9d85a646422ea4978904144a7aff/users/1055f18673474d189a5605319bc301da/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:32.166536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:32.209597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c7d7-5e68-4112-a024-f9c002606620 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:32.344330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c8c56-80b0-406c-8a01-a5ec120ba886 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:32.362860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:32.362860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:32.362860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:32.362860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:32.363418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:32.363418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:32.387097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b82a91-b035-4fca-aa1b-879d83d0100c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:32.387097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b82a91-b035-4fca-aa1b-879d83d0100c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:32.387097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b82a91-b035-4fca-aa1b-879d83d0100c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:32.387097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b82a91-b035-4fca-aa1b-879d83d0100c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:32.395589 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1441/2863] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:32.398926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:32.407345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b82a91-b035-4fca-aa1b-879d83d0100c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:32.410948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b82a91-b035-4fca-aa1b-879d83d0100c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:32.423585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd05c98-05c6-4fca-bd54-111d07fddfc3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:32.440775 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1423/2864] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:32.456070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037b39b-ae56-419d-a45c-3ee3ea75e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:32.461102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037b39b-ae56-419d-a45c-3ee3ea75e19a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:32.461102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037b39b-ae56-419d-a45c-3ee3ea75e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:32.461102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037b39b-ae56-419d-a45c-3ee3ea75e19a admin admin] PATH_INFO: `/v3/projects/154b9d85a646422ea4978904144a7aff/users/1055f18673474d189a5605319bc301da/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:32.469109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037b39b-ae56-419d-a45c-3ee3ea75e19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=154b9d85a646422ea4978904144a7aff, user_id=1055f18673474d189a5605319bc301da, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:32.471871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037b39b-ae56-419d-a45c-3ee3ea75e19a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:32.492616 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1442/2865] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:32 2022] PUT /identity/v3/projects/154b9d85a646422ea4978904144a7aff/users/1055f18673474d189a5605319bc301da/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:32.506646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60c0d2-b25c-43fe-bb77-f820ca7ede00 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:32.507019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60c0d2-b25c-43fe-bb77-f820ca7ede00 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:32.507248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60c0d2-b25c-43fe-bb77-f820ca7ede00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:32.563329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1b60c0d2-b25c-43fe-bb77-f820ca7ede00 None None] MFA Rules not processed for user `1055f18673474d189a5605319bc301da`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:32.567693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1b60c0d2-b25c-43fe-bb77-f820ca7ede00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:32.714423 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1424/2866] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:32.721711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:32.722266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:32.722706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:32.748786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] MFA Rules not processed for user `8417cd8a252c4d3c9f2059c42bc82aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:32.748786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:32.807703 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:32.840870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1443/2867] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:33.002696 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:33.171954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60c0d2-b25c-43fe-bb77-f820ca7ede00 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:33.254998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60c0d2-b25c-43fe-bb77-f820ca7ede00 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:33.262250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:33.268419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:33.268419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:33.268419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:33.268419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:33.279305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:33.281754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:33.308304 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1425/2868] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:34.105939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:34.108658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:34.245429 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:34.306519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18560cf1-bbf8-43c7-9b27-a18abe5788ec None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:34.320425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:34.321715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:34.322250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:34.322719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] PATH_INFO: `/v3/projects/6039c024774e4b92a4765ffea4d77094` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:34.325024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6039c024774e4b92a4765ffea4d77094)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:34.327940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:34.446809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6039c024774e4b92a4765ffea4d77094', 'request_id': 'req-9eecd343-88e4-4bdb-bc31-3065ea7013e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:34.453260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6039c024774e4b92a4765ffea4d77094', 'request_id': 'req-9eecd343-88e4-4bdb-bc31-3065ea7013e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:34.560269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6039c024774e4b92a4765ffea4d77094', 'request_id': 'req-9eecd343-88e4-4bdb-bc31-3065ea7013e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:34.576100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] The token cache is being invalidate because project 6039c024774e4b92a4765ffea4d77094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:34.577040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:34.577867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:34.582485 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1444/2869] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:34 2022] DELETE /identity/v3/projects/6039c024774e4b92a4765ffea4d77094 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:34.585212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:34.596608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890a007-88bd-45e9-beea-870e73a471ce service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:34.707053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:34.707687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:34.708207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:34.708695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] PATH_INFO: `/v3/users/199e1efcbb724f45b875b678e1be14d2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:34.710056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199e1efcbb724f45b875b678e1be14d2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:34.714327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:34.885764 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:35.121945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199e1efcbb724f45b875b678e1be14d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:35.130490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199e1efcbb724f45b875b678e1be14d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:35.131280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199e1efcbb724f45b875b678e1be14d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:35.315835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199e1efcbb724f45b875b678e1be14d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:35.316589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199e1efcbb724f45b875b678e1be14d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:35.344116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1426/2870] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:34 2022] DELETE /identity/v3/users/199e1efcbb724f45b875b678e1be14d2 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:36.149932 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:36.283726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:36.285511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:36.353099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd343-88e4-4bdb-bc31-3065ea7013e6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:36.533874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:36.534744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:36.535120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:36.535496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] PATH_INFO: `/v3/users/2ef087421d544ed1b56f73e64db80edb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:36.537520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef087421d544ed1b56f73e64db80edb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:36.539835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:36.651588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:36.653528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:36.684282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aa5e5-90b5-4070-ad4e-2a6218a1fc04 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:36.702849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:36.708929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:36.709371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:36.709735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] PATH_INFO: `/v3/projects/a35fe7040e814522bad95df1c2072dba` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:36.711284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35fe7040e814522bad95df1c2072dba)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:36.713498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:36.871096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef087421d544ed1b56f73e64db80edb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:36.881196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef087421d544ed1b56f73e64db80edb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:36.885081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef087421d544ed1b56f73e64db80edb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:36.969251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35fe7040e814522bad95df1c2072dba', 'request_id': 'req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:36.977877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef087421d544ed1b56f73e64db80edb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:36.983049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5435b08-ed3b-4a4a-aea9-53eb916b267d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef087421d544ed1b56f73e64db80edb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:36.983192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35fe7040e814522bad95df1c2072dba', 'request_id': 'req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:37.021699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1445/2871] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:36 2022] DELETE /identity/v3/users/2ef087421d544ed1b56f73e64db80edb => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:37.026538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:37.026831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:37.027109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:37.092445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:37.093683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:37.126957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35fe7040e814522bad95df1c2072dba', 'request_id': 'req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:37.148536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] The token cache is being invalidate because project a35fe7040e814522bad95df1c2072dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:37.150455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:37.151454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c3c9634-60b1-4b6d-98ca-295ef0d0f669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:37.160779 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1427/2872] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:36 2022] DELETE /identity/v3/projects/a35fe7040e814522bad95df1c2072dba => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:37.169150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3cb9-c9e4-4da1-b82b-6adafdc09ae1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:37.169150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3cb9-c9e4-4da1-b82b-6adafdc09ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:37.169150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3cb9-c9e4-4da1-b82b-6adafdc09ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:37.221480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-220d3cb9-c9e4-4da1-b82b-6adafdc09ae1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:37.226230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-220d3cb9-c9e4-4da1-b82b-6adafdc09ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:37.280940 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1446/2873] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:37.292841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:37.295684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:37.438520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1428/2874] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:37.452542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a35d2-ba23-473c-acff-0bedd81a987d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:37.452921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a35d2-ba23-473c-acff-0bedd81a987d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:37.453243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a35d2-ba23-473c-acff-0bedd81a987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:37.454669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5922d-5f0a-4d25-aab7-f33797c1ef31 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:37.465574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:37.466669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:37.467002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:37.473154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:37.508274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:37.513319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:37.528687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6e0a35d2-ba23-473c-acff-0bedd81a987d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:37.529398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1447/2875] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:37.530188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6e0a35d2-ba23-473c-acff-0bedd81a987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:37.544005 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1429/2876] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:37.548056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:37.558941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257639-c97f-4595-a372-e0d216dc81c6 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:37.564481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:37.566040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:37.566935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:37.567465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:37.568368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:37.568768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:37.570678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:37.590022 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1448/2877] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:18:37.592607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a35d2-ba23-473c-acff-0bedd81a987d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:37.606720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a35d2-ba23-473c-acff-0bedd81a987d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:37.613170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:37.613906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:37.614341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:37.614721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:37.615464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:37.618110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:37.770350 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1430/2878] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:37 2022] POST /identity/v3/projects => generated 397 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:18:37.774738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:37.785479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a191af-f61b-4b33-9a3e-e82132db65b5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:37.858943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:37.859964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:37.863313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:37.863926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:37.864817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:37.867154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:37.973749 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1449/2879] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:37 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:37.978458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:37.995492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f9314-ae41-4bd9-a0a6-0a63ee9cf62f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:38.001623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:38.004614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.005177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.006356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.007203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:38.008924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:38.019719 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1431/2880] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:38.024057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:38.035534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842545c-ca62-4cb0-be94-9a0da2a047d9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:38.040368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:38.041058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.041455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.041737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.042432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:38.044089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:38.058141 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1450/2881] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:38.070196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:38.081903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd29e-157c-44b3-948a-9cf401b29437 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:38.095306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e486-0b12-4b52-909d-a9cf35deb100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:38.096078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e486-0b12-4b52-909d-a9cf35deb100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.096405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e486-0b12-4b52-909d-a9cf35deb100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.096662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e486-0b12-4b52-909d-a9cf35deb100 admin admin] PATH_INFO: `/v3/projects/5474c468899142009da537662e2324ab/users/a5e9aba5c211461993a3ed53f2c88076/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.137270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e486-0b12-4b52-909d-a9cf35deb100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5474c468899142009da537662e2324ab, user_id=a5e9aba5c211461993a3ed53f2c88076, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:38.143576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e486-0b12-4b52-909d-a9cf35deb100 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:38.204600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:38.206704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:38.235189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca44eb-4201-4875-b176-fb5735427fd4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:38.242325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:38.243561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.244855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.245246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] PATH_INFO: `/v3/projects/38e182b74ee248a691cce4f31d5d24a1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.247343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e182b74ee248a691cce4f31d5d24a1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:38.250412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:38.290547 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1432/2882] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:38 2022] PUT /identity/v3/projects/5474c468899142009da537662e2324ab/users/a5e9aba5c211461993a3ed53f2c88076/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:38.294124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.294124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.294124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.333493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] MFA Rules not processed for user `a5e9aba5c211461993a3ed53f2c88076`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:38.335813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:38.417401 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1433/2883] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:38.433162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:38.434710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:38.529434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e182b74ee248a691cce4f31d5d24a1', 'request_id': 'req-5d859802-73f9-47ca-8e4c-3cb33c87b989'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:38.539552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e182b74ee248a691cce4f31d5d24a1', 'request_id': 'req-5d859802-73f9-47ca-8e4c-3cb33c87b989'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:38.544775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577ed53-bdb2-434d-9006-5f276fe96684 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:38.613268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85278e-27c0-467b-8aa7-42196ed3eb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:38.614011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85278e-27c0-467b-8aa7-42196ed3eb48 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.614423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85278e-27c0-467b-8aa7-42196ed3eb48 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.614600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85278e-27c0-467b-8aa7-42196ed3eb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.692896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e182b74ee248a691cce4f31d5d24a1', 'request_id': 'req-5d859802-73f9-47ca-8e4c-3cb33c87b989'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:38.693373 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:38.712578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] The token cache is being invalidate because project 38e182b74ee248a691cce4f31d5d24a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:38.714291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:38.716521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d859802-73f9-47ca-8e4c-3cb33c87b989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:38.720098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85278e-27c0-467b-8aa7-42196ed3eb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:38.722518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1451/2884] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:38 2022] DELETE /identity/v3/projects/38e182b74ee248a691cce4f31d5d24a1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:38.724081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85278e-27c0-467b-8aa7-42196ed3eb48 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:38.727606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8043066-300d-4ea5-86ef-c76715da1e5c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.728152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8043066-300d-4ea5-86ef-c76715da1e5c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.728762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8043066-300d-4ea5-86ef-c76715da1e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.737193 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1434/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:18:38.754160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d8043066-300d-4ea5-86ef-c76715da1e5c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:38.755388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d8043066-300d-4ea5-86ef-c76715da1e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:38.813689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ae63e-0845-436d-b975-bb008ac54ee1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.815390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ae63e-0845-436d-b975-bb008ac54ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.815879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ae63e-0845-436d-b975-bb008ac54ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.854228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8a5ae63e-0845-436d-b975-bb008ac54ee1 None None] MFA Rules not processed for user `a5e9aba5c211461993a3ed53f2c88076`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:38.854228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a5ae63e-0845-436d-b975-bb008ac54ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:38.858935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1435/2886] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:18:38.904350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1452/2887] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:38.914332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669080-4134-41d1-a903-b3fa66d480de None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:38.915231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669080-4134-41d1-a903-b3fa66d480de None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:38.915738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669080-4134-41d1-a903-b3fa66d480de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:38.967380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-32669080-4134-41d1-a903-b3fa66d480de None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:38.972437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-32669080-4134-41d1-a903-b3fa66d480de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:38.992101 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1436/2888] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:38.996788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8043066-300d-4ea5-86ef-c76715da1e5c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:39.020177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8043066-300d-4ea5-86ef-c76715da1e5c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:39.030248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:39.032441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:39.032620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:39.032908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:39.034186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:39.034495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:39.036144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:39.068856 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1453/2889] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:39.069557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669080-4134-41d1-a903-b3fa66d480de None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:39.079156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669080-4134-41d1-a903-b3fa66d480de None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:39.085221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:39.085846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:39.086152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:39.086433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:39.087188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:39.089111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:39.250880 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1437/2890] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:39 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:39.256769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:39.271483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044174c6-294a-4970-9d57-155912aa04d3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:39.365946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:39.366822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:39.368311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:39.368311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:39.368311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:39.378252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:39.532417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1454/2891] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:39 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:18:39.534032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:39.548287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d74e3f-e3b2-4c40-873b-bb05e033988e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:39.565951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:39.566679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:39.566976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:39.567286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:39.567948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:39.569694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:39.606308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1438/2892] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:39.607804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:39.629254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38e3ec-910c-4a3c-9c09-8a853ea3c9c2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:39.660109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:39.663144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:39.665890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:39.668383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:39.668992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:39.673237 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:39.673686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:39.675155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:39.678747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:39.697888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e3a2f-6936-4d3e-aed2-7f10c8b564f4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:39.707107 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1455/2893] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:39.708462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:39.732313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:39.733033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:39.733316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:39.733700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] PATH_INFO: `/v3/users/a5e9aba5c211461993a3ed53f2c88076` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:39.735680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e9aba5c211461993a3ed53f2c88076)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:39.735829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5323899-f4f4-4a99-987a-7822ebcd343e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:39.739326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:39.779274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cb471-c0e7-4a0e-aac1-1c0f0b8ed5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:39.780241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cb471-c0e7-4a0e-aac1-1c0f0b8ed5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:39.780719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cb471-c0e7-4a0e-aac1-1c0f0b8ed5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:39.780927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cb471-c0e7-4a0e-aac1-1c0f0b8ed5e1 admin admin] PATH_INFO: `/v3/projects/3d1b3354a10047758b81ad7ff50e39de/users/5afd08e7fa4f4de7ad5386562f536bd7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:39.843935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cb471-c0e7-4a0e-aac1-1c0f0b8ed5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1b3354a10047758b81ad7ff50e39de, user_id=5afd08e7fa4f4de7ad5386562f536bd7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:39.847421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cb471-c0e7-4a0e-aac1-1c0f0b8ed5e1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:40.054618 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1456/2894] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:39 2022] PUT /identity/v3/projects/3d1b3354a10047758b81ad7ff50e39de/users/5afd08e7fa4f4de7ad5386562f536bd7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:40.055881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4339d-c9c9-4cad-b741-1786f1eb8039 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:40.056167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4339d-c9c9-4cad-b741-1786f1eb8039 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:40.056439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4339d-c9c9-4cad-b741-1786f1eb8039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:40.091686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e0b4339d-c9c9-4cad-b741-1786f1eb8039 None None] MFA Rules not processed for user `5afd08e7fa4f4de7ad5386562f536bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:40.091686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0b4339d-c9c9-4cad-b741-1786f1eb8039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:40.143828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e9aba5c211461993a3ed53f2c88076'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:40.170144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e9aba5c211461993a3ed53f2c88076'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:40.173519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e9aba5c211461993a3ed53f2c88076'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:40.242499 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1457/2895] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:40.293358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e9aba5c211461993a3ed53f2c88076'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:40.294800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e9aba5c211461993a3ed53f2c88076'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:40.326020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1439/2896] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:39 2022] DELETE /identity/v3/users/a5e9aba5c211461993a3ed53f2c88076 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:40.333656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:40.333656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:40.333656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:40.357317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:40.358612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:40.431021 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1458/2897] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:40.456009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:40.457679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:40.566902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0894a-41b7-49e6-a7ed-2eddcba04bd5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:40.566902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:40.566902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:40.567431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:40.567819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:40.581957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:40.583592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:40.594755 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1440/2898] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:40.626173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:40.628348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:40.739154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eed7c9-ee17-4801-979f-4712b32af3da None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:40.748885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef562e-e90a-4ad4-9e2b-dd21e642145a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:40.750065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef562e-e90a-4ad4-9e2b-dd21e642145a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:40.750656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef562e-e90a-4ad4-9e2b-dd21e642145a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:40.751133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef562e-e90a-4ad4-9e2b-dd21e642145a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:40.754304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-60ef562e-e90a-4ad4-9e2b-dd21e642145a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:40.889858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef562e-e90a-4ad4-9e2b-dd21e642145a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:40.896240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef562e-e90a-4ad4-9e2b-dd21e642145a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:40.936976 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1459/2899] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:41.449420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:41.451195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:41.502903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351149-04d9-44f6-b74f-323e291c903a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:41.507881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:41.510806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:41.510806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:41.510806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] PATH_INFO: `/v3/projects/5474c468899142009da537662e2324ab` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:41.510806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5474c468899142009da537662e2324ab)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:41.512423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:41.691821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5474c468899142009da537662e2324ab', 'request_id': 'req-7495d89a-bf7b-4686-95d3-0d57c1673e61'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:41.699558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5474c468899142009da537662e2324ab', 'request_id': 'req-7495d89a-bf7b-4686-95d3-0d57c1673e61'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:41.844362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5474c468899142009da537662e2324ab', 'request_id': 'req-7495d89a-bf7b-4686-95d3-0d57c1673e61'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:41.871893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] The token cache is being invalidate because project 5474c468899142009da537662e2324ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:41.871893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:41.871893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7495d89a-bf7b-4686-95d3-0d57c1673e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:41.871893 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1441/2900] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:41 2022] DELETE /identity/v3/projects/5474c468899142009da537662e2324ab => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:41.882009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eaef4-2fcf-46d0-85de-c2521280a059 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:41.882009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eaef4-2fcf-46d0-85de-c2521280a059 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:41.882660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eaef4-2fcf-46d0-85de-c2521280a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:41.926100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2f6eaef4-2fcf-46d0-85de-c2521280a059 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:41.928852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f6eaef4-2fcf-46d0-85de-c2521280a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:42.050328 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1460/2901] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:42.054151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37676795-4472-4095-9d1d-4fe9154366e3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.054434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37676795-4472-4095-9d1d-4fe9154366e3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.054706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37676795-4472-4095-9d1d-4fe9154366e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.106067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-37676795-4472-4095-9d1d-4fe9154366e3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:42.107393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-37676795-4472-4095-9d1d-4fe9154366e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:42.117040 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1442/2902] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:42.120910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eaef4-2fcf-46d0-85de-c2521280a059 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:42.133448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eaef4-2fcf-46d0-85de-c2521280a059 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:42.139011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:42.139797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.140224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.140565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.141319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:42.141722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:42.143693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:42.166193 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1461/2903] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:42.167271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37676795-4472-4095-9d1d-4fe9154366e3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:42.180176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37676795-4472-4095-9d1d-4fe9154366e3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:42.200475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:42.201263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.201723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.202116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.202856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:42.204837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:42.333163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:42.337563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:42.362351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1443/2904] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:42 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:18:42.363457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:42.367484 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:42.390473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaab27-afc7-4cb6-95f2-1b37fafc8b13 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:42.509011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:42.520084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.520084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.520084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] PATH_INFO: `/v3/users/5afd08e7fa4f4de7ad5386562f536bd7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.520510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4fc84-23ac-4224-9fe8-29163b3c9612 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:42.520979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afd08e7fa4f4de7ad5386562f536bd7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:42.520979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:42.521181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:42.521714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.522322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.522860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.523773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:42.526628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:42.796670 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1444/2905] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:42 2022] POST /identity/v3/users => generated 289 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:42.796670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:42.811051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1da86-6455-47bd-a193-0a83be0af1d9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:42.819798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:42.820687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.821203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.821651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.822500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:42.826476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:42.860845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1445/2906] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:42.863165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afd08e7fa4f4de7ad5386562f536bd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:42.863347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:42.884032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afd08e7fa4f4de7ad5386562f536bd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:42.885655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afd08e7fa4f4de7ad5386562f536bd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:42.890439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcfe8e-399d-4120-8207-a0911ac85846 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:42.900790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:42.901425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.901717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.901996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.904815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:42.908460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:42.941624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1446/2907] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:42.942851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:42.954940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d5e0d-3178-4e61-b5c2-af6b07dabc36 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:42.972325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150b3b-bddc-487d-9f26-de4a96c20253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:42.973052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150b3b-bddc-487d-9f26-de4a96c20253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:42.973289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150b3b-bddc-487d-9f26-de4a96c20253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:42.973561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150b3b-bddc-487d-9f26-de4a96c20253 admin admin] PATH_INFO: `/v3/projects/ed372b4663a94ff1ba20abe32e2f9e77/users/3838dd33052740fa88b9cf2888c208ff/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:42.991279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0150b3b-bddc-487d-9f26-de4a96c20253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed372b4663a94ff1ba20abe32e2f9e77, user_id=3838dd33052740fa88b9cf2888c208ff, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:42.994260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0150b3b-bddc-487d-9f26-de4a96c20253 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:43.031282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afd08e7fa4f4de7ad5386562f536bd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:43.032459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-373f1b1f-9660-46f8-9efd-a8c90d79cab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afd08e7fa4f4de7ad5386562f536bd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:43.071378 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1462/2908] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:18:42 2022] DELETE /identity/v3/users/5afd08e7fa4f4de7ad5386562f536bd7 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:18:43.102649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:43.102923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:43.103451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:43.114473 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1447/2909] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:42 2022] PUT /identity/v3/projects/ed372b4663a94ff1ba20abe32e2f9e77/users/3838dd33052740fa88b9cf2888c208ff/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:43.116254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571e266-df1d-4c78-a29a-d7e47a179c10 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:43.116882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571e266-df1d-4c78-a29a-d7e47a179c10 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:43.117340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571e266-df1d-4c78-a29a-d7e47a179c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:43.216591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:43.218051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:43.219687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8571e266-df1d-4c78-a29a-d7e47a179c10 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:43.223278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8571e266-df1d-4c78-a29a-d7e47a179c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:43.329531 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1463/2910] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:43.336127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1448/2911] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:43.345669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:43.345669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:43.351141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6ad5e-cfc8-44ac-a4e6-1f0a639e2978 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:43.351512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6ad5e-cfc8-44ac-a4e6-1f0a639e2978 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:43.351834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6ad5e-cfc8-44ac-a4e6-1f0a639e2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:43.383992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-14e6ad5e-cfc8-44ac-a4e6-1f0a639e2978 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:43.385307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-14e6ad5e-cfc8-44ac-a4e6-1f0a639e2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:43.462045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c45f-a7a9-4173-9c8b-e753197a1a8c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:43.463626 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1449/2912] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:43.464705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6ad5e-cfc8-44ac-a4e6-1f0a639e2978 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:43.466528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:43.467170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:43.476602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:43.476602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:43.481528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:43.483196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:43.493240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6ad5e-cfc8-44ac-a4e6-1f0a639e2978 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:43.891804 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1464/2913] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:43.894732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:43.894732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:43.894732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:43.894732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:43.896332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:43.896332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:43.896332 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1450/2914] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:43.897648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:43.897648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:43.897648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acf2ce-6dcb-4784-ac43-b39ec1030fe8 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:43.898134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df394-8273-4547-9513-fef94c260d40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:43.898134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df394-8273-4547-9513-fef94c260d40 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:43.898134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df394-8273-4547-9513-fef94c260d40 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:43.898134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df394-8273-4547-9513-fef94c260d40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:43.913007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df394-8273-4547-9513-fef94c260d40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:43.913007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df394-8273-4547-9513-fef94c260d40 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:43.925996 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1465/2915] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:18:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:18:44.325348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:44.332312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:44.375317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3da13e-a02a-45bd-8cbe-cbb378d7c654 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:44.394909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:44.395800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:44.396285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:44.396726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] PATH_INFO: `/v3/projects/3d1b3354a10047758b81ad7ff50e39de` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:44.398250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1b3354a10047758b81ad7ff50e39de)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:44.402704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:44.572974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1b3354a10047758b81ad7ff50e39de', 'request_id': 'req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:44.589457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1b3354a10047758b81ad7ff50e39de', 'request_id': 'req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:44.755733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1b3354a10047758b81ad7ff50e39de', 'request_id': 'req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:44.771211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] The token cache is being invalidate because project 3d1b3354a10047758b81ad7ff50e39de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:18:44.771504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:44.772330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a9b17f2-d0cc-4fa2-a066-da32f2eb7f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:18:44.777510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1451/2916] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:18:44 2022] DELETE /identity/v3/projects/3d1b3354a10047758b81ad7ff50e39de => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:44.782517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62defe3-e5f1-46ae-82a9-5978055a4a97 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:44.782806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62defe3-e5f1-46ae-82a9-5978055a4a97 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:44.783280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62defe3-e5f1-46ae-82a9-5978055a4a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:44.916148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c62defe3-e5f1-46ae-82a9-5978055a4a97 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:44.917631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c62defe3-e5f1-46ae-82a9-5978055a4a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:45.071716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9ea6-9747-4aa8-bbe7-f072fe84a04e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:45.072768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9ea6-9747-4aa8-bbe7-f072fe84a04e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:45.072985 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1466/2917] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:45.074165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9ea6-9747-4aa8-bbe7-f072fe84a04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:45.112551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-211c9ea6-9747-4aa8-bbe7-f072fe84a04e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:45.114136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-211c9ea6-9747-4aa8-bbe7-f072fe84a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:45.133706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62defe3-e5f1-46ae-82a9-5978055a4a97 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:45.139935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1452/2918] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:45.145675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62defe3-e5f1-46ae-82a9-5978055a4a97 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:45.151422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:45.151861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:45.152491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:45.152851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:45.154072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:18:45.154469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:45.156158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:45.179531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c9ea6-9747-4aa8-bbe7-f072fe84a04e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:45.179820 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1467/2919] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:18:45.191167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c9ea6-9747-4aa8-bbe7-f072fe84a04e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:45.197067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:45.197732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:45.198035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:45.198310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:45.198948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:45.202529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:45.246886 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:45.346632 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1453/2920] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:18:45 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:45.361820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:45.388761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75ee5-cd99-413a-8041-35f51373e249 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:45.518409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:45.519190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:45.519470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:45.520483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:45.521184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:45.523090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:45.715643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1468/2921] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:18:45 2022] POST /identity/v3/users => generated 301 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:18:45.717954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:45.748341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bb6f0-b237-4d64-bd96-881caad4385e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:45.787521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:45.788344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:45.788852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:45.789332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:45.790233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:45.792085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:45.827843 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1454/2922] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:45.872057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:45.899845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782b5fe-6e05-4300-902f-714e0d69d134 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:46.078142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f027e-b8b2-4021-a90d-5d85e62d1e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:46.078142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f027e-b8b2-4021-a90d-5d85e62d1e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:46.078142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f027e-b8b2-4021-a90d-5d85e62d1e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:46.078142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f027e-b8b2-4021-a90d-5d85e62d1e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:46.081412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f027e-b8b2-4021-a90d-5d85e62d1e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:46.081412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f027e-b8b2-4021-a90d-5d85e62d1e0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:46.081412 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1469/2923] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:18:46.082356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:46.082356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acec59-7bb8-403c-868a-b33e9293ce3c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:46.082356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:46.082356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:46.083351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:46.083351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] PATH_INFO: `/v3/projects/64925bb905eb4ece9a6f193d2d02ffd5/users/2be11a97bc52448d8537ea47327aa008/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:46.083351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64925bb905eb4ece9a6f193d2d02ffd5, user_id=2be11a97bc52448d8537ea47327aa008, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:46.083351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:46.214778 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:46.229014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1455/2924] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:18:45 2022] PUT /identity/v3/projects/64925bb905eb4ece9a6f193d2d02ffd5/users/2be11a97bc52448d8537ea47327aa008/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:18:46.230518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:46.230871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:46.231366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:46.268717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:46.270141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:46.382471 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1470/2925] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:46.391051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:46.395915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:46.530062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822b04-012a-4664-a697-f04464fb0b72 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:46.534456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:46.535169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:46.535294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:46.535514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:46.560833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:46.569619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:46.584186 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1456/2926] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:48.288413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:48.290450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:48.538471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525765f-05c4-4873-b3f9-2a17b02451a0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:48.556510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a3d3-d5a6-4eb3-9031-1421f4f2bdae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:48.557295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a3d3-d5a6-4eb3-9031-1421f4f2bdae service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:48.559810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a3d3-d5a6-4eb3-9031-1421f4f2bdae service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:48.560238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a3d3-d5a6-4eb3-9031-1421f4f2bdae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:48.573404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e618a3d3-d5a6-4eb3-9031-1421f4f2bdae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:48.607193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a3d3-d5a6-4eb3-9031-1421f4f2bdae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:48.609080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a3d3-d5a6-4eb3-9031-1421f4f2bdae service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:48.631564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1471/2927] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:49.567721 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:50.151779 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:51.149580 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:51.157533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:51.160461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:51.507448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661c651-ae74-49ff-927b-1ebe701b4594 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:51.515050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2c590-ad29-497b-a795-30bc26c41b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:51.515930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2c590-ad29-497b-a795-30bc26c41b58 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:51.516975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2c590-ad29-497b-a795-30bc26c41b58 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:51.517943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2c590-ad29-497b-a795-30bc26c41b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:51.521117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2dd2c590-ad29-497b-a795-30bc26c41b58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:51.693848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2c590-ad29-497b-a795-30bc26c41b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:51.698355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2c590-ad29-497b-a795-30bc26c41b58 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:51.737608 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1457/2928] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:18:51.794252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92955bc-01c2-4f5a-886c-2a1f96968091 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:51.794763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92955bc-01c2-4f5a-886c-2a1f96968091 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:51.794858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92955bc-01c2-4f5a-886c-2a1f96968091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:51.866176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a92955bc-01c2-4f5a-886c-2a1f96968091 None None] MFA Rules not processed for user `8417cd8a252c4d3c9f2059c42bc82aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:51.867379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a92955bc-01c2-4f5a-886c-2a1f96968091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:52.050861 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1472/2929] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:52.406976 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:52.629841 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:52.873169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821660-5e0d-42a9-9580-c4108ea59594 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:52.873506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821660-5e0d-42a9-9580-c4108ea59594 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:52.873783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821660-5e0d-42a9-9580-c4108ea59594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:52.940588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a4821660-5e0d-42a9-9580-c4108ea59594 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:52.941862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4821660-5e0d-42a9-9580-c4108ea59594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:53.149829 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1458/2930] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:53.212808 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:53.287188 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:54.006934 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:54.553080 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:55.199423 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:55.334449 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:55.738795 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:55.887228 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:56.791638 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:57.132388 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:57.277667 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:18:59.288986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b2241-a184-4b6f-a681-0260086a025f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:59.289591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b2241-a184-4b6f-a681-0260086a025f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:59.291204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b2241-a184-4b6f-a681-0260086a025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:59.358440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7f9b2241-a184-4b6f-a681-0260086a025f None None] MFA Rules not processed for user `3838dd33052740fa88b9cf2888c208ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:59.359935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7f9b2241-a184-4b6f-a681-0260086a025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:59.606245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf195ba0-c3d9-48ac-9b8e-c5e4fb498b3f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:59.607754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf195ba0-c3d9-48ac-9b8e-c5e4fb498b3f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:59.608236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf195ba0-c3d9-48ac-9b8e-c5e4fb498b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:59.627637 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1473/2931] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:59.654740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cf195ba0-c3d9-48ac-9b8e-c5e4fb498b3f None None] MFA Rules not processed for user `3838dd33052740fa88b9cf2888c208ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:18:59.654740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf195ba0-c3d9-48ac-9b8e-c5e4fb498b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:18:59.687580 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1459/2932] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:18:59.694342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b2241-a184-4b6f-a681-0260086a025f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:18:59.723814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b2241-a184-4b6f-a681-0260086a025f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:18:59.742349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfc148-57d5-4b7a-9abe-6ad022e0b41b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:18:59.743241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfc148-57d5-4b7a-9abe-6ad022e0b41b service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:18:59.743702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfc148-57d5-4b7a-9abe-6ad022e0b41b service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:18:59.744272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfc148-57d5-4b7a-9abe-6ad022e0b41b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:18:59.760265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfc148-57d5-4b7a-9abe-6ad022e0b41b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:18:59.773668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfc148-57d5-4b7a-9abe-6ad022e0b41b service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:18:59.817292 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1474/2933] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:00.819573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04d69-c601-49ec-b79f-01d347aa1691 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:00.820397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04d69-c601-49ec-b79f-01d347aa1691 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:00.820827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04d69-c601-49ec-b79f-01d347aa1691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:00.850838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-83e04d69-c601-49ec-b79f-01d347aa1691 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:00.852088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-83e04d69-c601-49ec-b79f-01d347aa1691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:00.893905 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1460/2934] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:07.250940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34d80b-d839-484d-abcb-3bef82c678d1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:07.250940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34d80b-d839-484d-abcb-3bef82c678d1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:07.250940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34d80b-d839-484d-abcb-3bef82c678d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:07.331713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9d34d80b-d839-484d-abcb-3bef82c678d1 None None] MFA Rules not processed for user `2be11a97bc52448d8537ea47327aa008`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:07.333153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d34d80b-d839-484d-abcb-3bef82c678d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:07.431220 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:07.490313 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1475/2935] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:08.381469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04d69-c601-49ec-b79f-01d347aa1691 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:08.406394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04d69-c601-49ec-b79f-01d347aa1691 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:08.417851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c462-aa7e-4f43-a27c-d58a0f1d55dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:08.419285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c462-aa7e-4f43-a27c-d58a0f1d55dc service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:08.419572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c462-aa7e-4f43-a27c-d58a0f1d55dc service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:08.419848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c462-aa7e-4f43-a27c-d58a0f1d55dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:08.434636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c462-aa7e-4f43-a27c-d58a0f1d55dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:08.437285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c462-aa7e-4f43-a27c-d58a0f1d55dc service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:08.451166 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1461/2936] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:19:12.370534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089854-43ff-47f6-a522-f196ab169daf None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:12.371100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089854-43ff-47f6-a522-f196ab169daf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:12.371100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089854-43ff-47f6-a522-f196ab169daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:12.414477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-09089854-43ff-47f6-a522-f196ab169daf None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:12.416367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-09089854-43ff-47f6-a522-f196ab169daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:12.437514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1476/2937] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:14.860131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:14.860946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:14.861253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:14.886424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:14.888539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:14.897992 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1462/2938] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:19:15.533660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b20f-7ba0-4f2b-bd12-b984dfbb4f00 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:15.534197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b20f-7ba0-4f2b-bd12-b984dfbb4f00 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:15.534459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b20f-7ba0-4f2b-bd12-b984dfbb4f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:15.565420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-92f1b20f-7ba0-4f2b-bd12-b984dfbb4f00 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:15.572493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-92f1b20f-7ba0-4f2b-bd12-b984dfbb4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:15.634137 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1477/2939] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:15.645167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:15.646927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:15.730224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd9a94-89a9-469b-886b-47620ab68cc4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:15.735947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef0c63-8165-468e-90d4-bef5e4a41f2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:15.736564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef0c63-8165-468e-90d4-bef5e4a41f2b service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:15.736911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef0c63-8165-468e-90d4-bef5e4a41f2b service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:15.737239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef0c63-8165-468e-90d4-bef5e4a41f2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:15.745754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef0c63-8165-468e-90d4-bef5e4a41f2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:15.747597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef0c63-8165-468e-90d4-bef5e4a41f2b service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:15.756300 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1463/2940] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:19:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:19:16.326581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:16.327103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:16.327573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:16.358633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:16.360121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:16.367798 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1478/2941] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:17.498408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9347a-0d81-4e84-a700-8afe562514bc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:17.498871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9347a-0d81-4e84-a700-8afe562514bc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:17.499374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9347a-0d81-4e84-a700-8afe562514bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:17.523620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-37b9347a-0d81-4e84-a700-8afe562514bc None None] MFA Rules not processed for user `ecb97fa679eb4bf8a41862d3c248a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:17.525335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-37b9347a-0d81-4e84-a700-8afe562514bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:17.599085 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1464/2942] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:17.785307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:17.787677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:17.813880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244275-e9cd-4473-820a-6904e64bde66 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:17.816091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b183b5-e6c4-4196-a391-6bdea4e27bde None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:17.816343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b183b5-e6c4-4196-a391-6bdea4e27bde None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:17.816925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b183b5-e6c4-4196-a391-6bdea4e27bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:17.823391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d5163-4b9f-4539-920f-bc1bc189a11a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:17.824387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5163-4b9f-4539-920f-bc1bc189a11a service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:17.824851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5163-4b9f-4539-920f-bc1bc189a11a service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:17.826279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5163-4b9f-4539-920f-bc1bc189a11a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:17.833733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c52d5163-4b9f-4539-920f-bc1bc189a11a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:17.838774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-34b183b5-e6c4-4196-a391-6bdea4e27bde None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:17.840194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-34b183b5-e6c4-4196-a391-6bdea4e27bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:17.853856 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1465/2943] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:19:17.860748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d5163-4b9f-4539-920f-bc1bc189a11a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:17.863239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d5163-4b9f-4539-920f-bc1bc189a11a service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:17.877870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1479/2944] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:19.634769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1013a-bfba-4ff6-8707-275056d949fc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:19.635424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1013a-bfba-4ff6-8707-275056d949fc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:19.635858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1013a-bfba-4ff6-8707-275056d949fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:19.673211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4ad1013a-bfba-4ff6-8707-275056d949fc None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:19.686611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4ad1013a-bfba-4ff6-8707-275056d949fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:19.700209 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1466/2945] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:20.981853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4db2a-d62a-471f-86ae-33f846c0a9b3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:20.982354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4db2a-d62a-471f-86ae-33f846c0a9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:20.982465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4db2a-d62a-471f-86ae-33f846c0a9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:21.005169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-76e4db2a-d62a-471f-86ae-33f846c0a9b3 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:21.007094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-76e4db2a-d62a-471f-86ae-33f846c0a9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:21.015567 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1480/2946] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:22.023109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ce477-0056-4f00-836d-115459bc6864 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:22.023596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ce477-0056-4f00-836d-115459bc6864 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:22.023715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ce477-0056-4f00-836d-115459bc6864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:22.045814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b24ce477-0056-4f00-836d-115459bc6864 None None] MFA Rules not processed for user `18ea2d1dfc7441d2a2bb7b22c6065605`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:22.047324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b24ce477-0056-4f00-836d-115459bc6864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:22.057550 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:22.114348 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1467/2947] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:23.269670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85edd-cd17-480a-b258-131a584903bd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:23.270192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85edd-cd17-480a-b258-131a584903bd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:23.270296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85edd-cd17-480a-b258-131a584903bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:23.289729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c4e85edd-cd17-480a-b258-131a584903bd None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:23.291182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c4e85edd-cd17-480a-b258-131a584903bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:23.299222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1481/2948] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:25.972876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:25.973364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:25.973453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:26.019238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:26.020459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:26.034065 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1468/2949] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:28.361470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e85edd-cd17-480a-b258-131a584903bd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:28.389186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e85edd-cd17-480a-b258-131a584903bd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:28.394006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:28.394854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:28.395271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:28.395687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:28.398427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:28.417336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:28.419709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:28.437566 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1482/2950] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:29.123771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:29.125317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:29.161937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c4377-2c85-48f0-a785-9ffd2370a75a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:29.179796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:29.183376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:29.183935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:29.184490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:29.191813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:29.306705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:29.309578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:29.339342 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1469/2951] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:34.017711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:34.023396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:34.059962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab24cb-c99e-4e26-a47b-8dbb1bfa1f17 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:34.064750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:34.065709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:34.066190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:34.066683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:34.068691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:34.086243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:34.088437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:34.104961 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1483/2952] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:34.180359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:34.191827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03b172-f934-4584-8677-6612e0f277a2 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:34.202538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:34.203569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:34.204031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:34.205106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:34.208802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:34.221829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:34.223629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:34.235545 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1470/2953] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:34.537199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:34.549758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41cfc0-9ad6-43fe-b655-2b0e88dcdf9f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:34.555329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:34.556057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:34.556353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:34.556628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] PATH_INFO: `/v3/users/2be11a97bc52448d8537ea47327aa008` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:34.557748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be11a97bc52448d8537ea47327aa008)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:34.559715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:34.721581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be11a97bc52448d8537ea47327aa008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:34.728224 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:34.731516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be11a97bc52448d8537ea47327aa008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:34.732283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be11a97bc52448d8537ea47327aa008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:34.800187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be11a97bc52448d8537ea47327aa008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:34.801029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1e5b8f06-48a1-4186-a8b4-fc36294006f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be11a97bc52448d8537ea47327aa008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:34.825350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1484/2954] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:19:34 2022] DELETE /identity/v3/users/2be11a97bc52448d8537ea47327aa008 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:35.232632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:35.249636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee6fc1-2108-460a-b797-24c70efd6386 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:35.355354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:35.357225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:35.357662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:35.358111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] PATH_INFO: `/v3/projects/64925bb905eb4ece9a6f193d2d02ffd5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:35.359999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=64925bb905eb4ece9a6f193d2d02ffd5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:35.362932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:35.497455 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:35.509303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64925bb905eb4ece9a6f193d2d02ffd5', 'request_id': 'req-3afc57ab-efad-49f8-9c6c-ec4758f00cec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:35.518448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64925bb905eb4ece9a6f193d2d02ffd5', 'request_id': 'req-3afc57ab-efad-49f8-9c6c-ec4758f00cec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:35.653670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64925bb905eb4ece9a6f193d2d02ffd5', 'request_id': 'req-3afc57ab-efad-49f8-9c6c-ec4758f00cec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:35.692108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] The token cache is being invalidate because project 64925bb905eb4ece9a6f193d2d02ffd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:19:35.692635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:35.693666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3afc57ab-efad-49f8-9c6c-ec4758f00cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:35.696999 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1471/2955] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:35 2022] DELETE /identity/v3/projects/64925bb905eb4ece9a6f193d2d02ffd5 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:35.701903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc9c2-fde4-4fc1-a8a8-43209b3711ce None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:35.702401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc9c2-fde4-4fc1-a8a8-43209b3711ce None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:35.702474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc9c2-fde4-4fc1-a8a8-43209b3711ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:35.746869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c77cc9c2-fde4-4fc1-a8a8-43209b3711ce None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:35.750698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c77cc9c2-fde4-4fc1-a8a8-43209b3711ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:35.907221 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1485/2956] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:35.914992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78cc34-3561-422f-ac80-9b0c104c36e3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:35.915493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78cc34-3561-422f-ac80-9b0c104c36e3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:35.915910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78cc34-3561-422f-ac80-9b0c104c36e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:35.940083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-eb78cc34-3561-422f-ac80-9b0c104c36e3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:35.941639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb78cc34-3561-422f-ac80-9b0c104c36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:35.952852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1472/2957] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:35.957451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc9c2-fde4-4fc1-a8a8-43209b3711ce None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:35.969254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc9c2-fde4-4fc1-a8a8-43209b3711ce None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:35.974651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:35.975119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:35.975397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:35.975659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:35.977010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:19:35.977305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:35.979051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:35.997525 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1486/2958] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:19:35.998580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78cc34-3561-422f-ac80-9b0c104c36e3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:36.011568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78cc34-3561-422f-ac80-9b0c104c36e3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:36.024429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:36.025096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:36.025377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:36.026208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:36.026350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:36.028235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:36.144399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1473/2959] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:19:35 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:19:36.145169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:36.175350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68cf2b-a5fa-492a-a84a-f54b09700252 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:36.294990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:36.295610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:36.295891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:36.296166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:36.296810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:36.298888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:36.450778 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1487/2960] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:19:36 2022] POST /identity/v3/users => generated 292 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:19:36.455426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:36.501923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9026-9cd3-47ac-88bd-a2e3b000a44a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:36.509118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:36.510133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:36.510754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:36.511960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:36.519003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:36.519003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:36.550181 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1474/2961] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:36.551037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:36.573777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104785-5a89-4c5a-81b0-f8bee5f2d1fd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:36.577906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924be1f-8652-4ae3-96d6-575cfcef9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:36.579506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924be1f-8652-4ae3-96d6-575cfcef9de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:36.579903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924be1f-8652-4ae3-96d6-575cfcef9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:36.580399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924be1f-8652-4ae3-96d6-575cfcef9de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:36.581454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924be1f-8652-4ae3-96d6-575cfcef9de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:36.592163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924be1f-8652-4ae3-96d6-575cfcef9de1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:36.609788 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1488/2962] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:36.613996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:36.624796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79f5f9-2e40-4c7b-86a2-5e59cecb633c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:36.631893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5757e-ada9-483b-8d29-652d47264d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:36.638462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5757e-ada9-483b-8d29-652d47264d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:36.638462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5757e-ada9-483b-8d29-652d47264d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:36.638462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5757e-ada9-483b-8d29-652d47264d77 admin admin] PATH_INFO: `/v3/projects/d55fb3f415da42eeb5d5514410670b29/users/86eb8880d07649b08bfe76a68901d81c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:36.654331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5757e-ada9-483b-8d29-652d47264d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55fb3f415da42eeb5d5514410670b29, user_id=86eb8880d07649b08bfe76a68901d81c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:36.657117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5757e-ada9-483b-8d29-652d47264d77 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:36.726549 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1475/2963] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:19:36 2022] PUT /identity/v3/projects/d55fb3f415da42eeb5d5514410670b29/users/86eb8880d07649b08bfe76a68901d81c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:36.728333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:36.728784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:36.728872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:36.755451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:36.758800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:36.855847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76cf2-309b-4784-b987-ca796ffe62d8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:36.856131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76cf2-309b-4784-b987-ca796ffe62d8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:36.856401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76cf2-309b-4784-b987-ca796ffe62d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:36.887047 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:36.904358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-14a76cf2-309b-4784-b987-ca796ffe62d8 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:36.906237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-14a76cf2-309b-4784-b987-ca796ffe62d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:36.962141 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1489/2964] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:36.998240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:36.999664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:37.049615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1476/2965] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:37.147380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df3b67-bc9d-405c-96c7-9bff045d2bb0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:37.170887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:37.171765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:37.172216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:37.174079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:37.197951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:37.199530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:37.225374 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1490/2966] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:38.259416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565065f-ab74-4725-bfd5-352569997dee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:38.259952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565065f-ab74-4725-bfd5-352569997dee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:38.260162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565065f-ab74-4725-bfd5-352569997dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:38.294988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a565065f-ab74-4725-bfd5-352569997dee None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:38.296245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a565065f-ab74-4725-bfd5-352569997dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:38.321731 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1477/2967] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:39.330903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:39.332482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:39.370614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015b7f2-e00e-441c-97f1-e713481c25fa service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:39.395025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:39.395647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:39.395922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:39.396190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] PATH_INFO: `/v3/users/8417cd8a252c4d3c9f2059c42bc82aa0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:39.399367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8417cd8a252c4d3c9f2059c42bc82aa0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:39.401665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:39.628774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8417cd8a252c4d3c9f2059c42bc82aa0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:39.648372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8417cd8a252c4d3c9f2059c42bc82aa0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:39.649240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8417cd8a252c4d3c9f2059c42bc82aa0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:39.726345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8417cd8a252c4d3c9f2059c42bc82aa0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:39.727303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8417cd8a252c4d3c9f2059c42bc82aa0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:39.781856 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1491/2968] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:19:39 2022] DELETE /identity/v3/users/8417cd8a252c4d3c9f2059c42bc82aa0 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:39.786859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:39.788495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:39.788977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:39.839195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:39.840662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:39.963063 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:39.987973 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1478/2969] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:19:40.089386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:40.091573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:40.240906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c24fd-18fe-45fa-b2f5-c152ba27dc20 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:40.245037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:40.245650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:40.245924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:40.246224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:40.280243 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:40.283275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:40.284988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:40.298604 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1492/2970] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:41.298505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:41.305186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:41.377960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2487ed-bc22-4f2b-9ddf-cdf1ca54cc4b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:41.394513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:41.396748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:41.397449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:41.397897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] PATH_INFO: `/v3/projects/bcdabdb037d54103a656623e2c4c4a78` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:41.399533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdabdb037d54103a656623e2c4c4a78)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:41.402915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:41.741926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdabdb037d54103a656623e2c4c4a78', 'request_id': 'req-6e36db45-2dbe-47a6-8967-0d99b4666334'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:41.751222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdabdb037d54103a656623e2c4c4a78', 'request_id': 'req-6e36db45-2dbe-47a6-8967-0d99b4666334'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:41.829009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdabdb037d54103a656623e2c4c4a78', 'request_id': 'req-6e36db45-2dbe-47a6-8967-0d99b4666334'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:41.852983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] The token cache is being invalidate because project bcdabdb037d54103a656623e2c4c4a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:19:41.856849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:41.857784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:41.864535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1479/2971] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:41 2022] DELETE /identity/v3/projects/bcdabdb037d54103a656623e2c4c4a78 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:41.868915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:41.884704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccea07-3882-46dc-a3b4-98d97798a8cf service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:42.013380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:42.013938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:42.014505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:42.014505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] PATH_INFO: `/v3/users/1055f18673474d189a5605319bc301da` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:42.043686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1055f18673474d189a5605319bc301da)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:42.050626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:42.275972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1055f18673474d189a5605319bc301da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:42.293432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1055f18673474d189a5605319bc301da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:42.294731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1055f18673474d189a5605319bc301da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:42.383497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1055f18673474d189a5605319bc301da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:42.384380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae586cb0-7edc-4b3e-9840-36a5a27dc41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1055f18673474d189a5605319bc301da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:42.419104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1493/2972] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:19:41 2022] DELETE /identity/v3/users/1055f18673474d189a5605319bc301da => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:19:43.624708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:43.627036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:43.664666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36db45-2dbe-47a6-8967-0d99b4666334 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:43.831488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:43.843395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:43.850751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:43.850979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] PATH_INFO: `/v3/projects/154b9d85a646422ea4978904144a7aff` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:43.856699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=154b9d85a646422ea4978904144a7aff)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:43.858958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:44.101078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154b9d85a646422ea4978904144a7aff', 'request_id': 'req-1840ca12-5457-4b33-bd92-a989081c48a9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:44.110356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154b9d85a646422ea4978904144a7aff', 'request_id': 'req-1840ca12-5457-4b33-bd92-a989081c48a9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:44.223012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154b9d85a646422ea4978904144a7aff', 'request_id': 'req-1840ca12-5457-4b33-bd92-a989081c48a9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:44.239753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] The token cache is being invalidate because project 154b9d85a646422ea4978904144a7aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:19:44.240101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:44.244991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1840ca12-5457-4b33-bd92-a989081c48a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:44.257613 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1480/2973] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:43 2022] DELETE /identity/v3/projects/154b9d85a646422ea4978904144a7aff => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:44.258169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5290f3-37de-4c54-bd4f-670a13b8d082 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:44.258638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5290f3-37de-4c54-bd4f-670a13b8d082 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:44.258745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5290f3-37de-4c54-bd4f-670a13b8d082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:44.283807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ba5290f3-37de-4c54-bd4f-670a13b8d082 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:44.285640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ba5290f3-37de-4c54-bd4f-670a13b8d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:44.379197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1494/2974] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:44.388335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9416537-f200-4523-95f6-1594daf972f5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:44.388793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9416537-f200-4523-95f6-1594daf972f5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:44.388941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9416537-f200-4523-95f6-1594daf972f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:44.409679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b9416537-f200-4523-95f6-1594daf972f5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:44.410947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b9416537-f200-4523-95f6-1594daf972f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:44.425813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5290f3-37de-4c54-bd4f-670a13b8d082 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:44.432619 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1481/2975] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:44.437546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5290f3-37de-4c54-bd4f-670a13b8d082 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:44.455658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:44.455658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:44.455658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:44.455658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:44.456210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:19:44.456210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:44.456210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:44.470088 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1495/2976] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:19:44.471630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9416537-f200-4523-95f6-1594daf972f5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:44.497588 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:44.506813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9416537-f200-4523-95f6-1594daf972f5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:44.516533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:44.517343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:44.517779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:44.518231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:44.519049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:44.521319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:44.650260 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1482/2977] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:19:44 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:19:44.654098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:44.661363 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:44.670153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa4290-02bd-4981-a6f6-c83dc1895b36 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:44.752751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:44.753349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:44.753634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:44.753908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:44.754691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:44.757760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:44.873765 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1496/2978] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:19:44 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:19:44.878684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:44.897405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29280-437a-4962-b2fb-774595e9167e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:44.909876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:44.910645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:44.910799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:44.913154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:44.922103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:44.925832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:44.961043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1483/2979] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:44.965268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:44.981330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0cf3-65a4-4973-96af-bf075805cd03 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:44.988786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80ffe6-44ef-420b-8dc4-6cbe35395f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:44.989751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ffe6-44ef-420b-8dc4-6cbe35395f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:44.990236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ffe6-44ef-420b-8dc4-6cbe35395f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:44.990856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ffe6-44ef-420b-8dc4-6cbe35395f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:44.992714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80ffe6-44ef-420b-8dc4-6cbe35395f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:44.995499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80ffe6-44ef-420b-8dc4-6cbe35395f29 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:45.030688 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1497/2980] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:45.035047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:45.049773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024bb98-bbba-460a-8592-0309d03163bd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:45.058830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:45.060099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:45.060585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:45.061163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] PATH_INFO: `/v3/projects/bfc1e557a01744f0b288bf1f4bc9a296/users/07a970243bf74ceaa1124c9b804ad5a3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:45.082481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc1e557a01744f0b288bf1f4bc9a296, user_id=07a970243bf74ceaa1124c9b804ad5a3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:45.085931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:45.191695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1484/2981] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:19:45 2022] PUT /identity/v3/projects/bfc1e557a01744f0b288bf1f4bc9a296/users/07a970243bf74ceaa1124c9b804ad5a3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:45.201142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cac0f-1817-4f40-8c12-042400bda3b4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:45.201670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cac0f-1817-4f40-8c12-042400bda3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:45.202063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cac0f-1817-4f40-8c12-042400bda3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:45.265045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2e0cac0f-1817-4f40-8c12-042400bda3b4 None None] MFA Rules not processed for user `07a970243bf74ceaa1124c9b804ad5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:45.268118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e0cac0f-1817-4f40-8c12-042400bda3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:45.388990 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1498/2982] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:45.502826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:45.511670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:45.709962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd30c43-6aa8-421e-b172-43ef7668fc23 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:45.728745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511df9a1-726a-452c-9d31-c0b909a9c9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:45.730135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511df9a1-726a-452c-9d31-c0b909a9c9e0 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:45.735520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511df9a1-726a-452c-9d31-c0b909a9c9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:45.735520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511df9a1-726a-452c-9d31-c0b909a9c9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:45.742639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511df9a1-726a-452c-9d31-c0b909a9c9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:45.745474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511df9a1-726a-452c-9d31-c0b909a9c9e0 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:45.762051 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1485/2983] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:45.847364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cac0f-1817-4f40-8c12-042400bda3b4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:45.985404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cac0f-1817-4f40-8c12-042400bda3b4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:45.990755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:45.992570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:45.992853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:45.993288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] PATH_INFO: `/v3/users/07a970243bf74ceaa1124c9b804ad5a3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:45.997109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a970243bf74ceaa1124c9b804ad5a3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:46.000500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:46.023014 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:46.214417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a970243bf74ceaa1124c9b804ad5a3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:46.232258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a970243bf74ceaa1124c9b804ad5a3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:46.232814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a970243bf74ceaa1124c9b804ad5a3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:46.315763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a970243bf74ceaa1124c9b804ad5a3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:46.318368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bfb7644-3a44-44ac-b85d-c4432f0b531c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a970243bf74ceaa1124c9b804ad5a3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:46.356710 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1499/2984] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:19:45 2022] DELETE /identity/v3/users/07a970243bf74ceaa1124c9b804ad5a3 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:46.363411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:46.363696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:46.364044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:46.414473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:46.421000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:46.426515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:46.426959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:46.427778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:46.508557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:46.511370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:46.548700 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1486/2985] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:46.568419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:46.570251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:46.656209 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:46.660548 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1500/2986] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:46.688066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:46.689557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:46.708505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18c4c7-ed6f-47ba-9a13-8cdacb07a899 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:46.714485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:46.716212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:46.716716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:46.717187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:46.732328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:46.734201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:46.748076 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1487/2987] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:46.804107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52064b5b-81b2-40a4-932a-cdad0cf9eabc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:46.809343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e65977-55e3-4b78-8a0c-948f08c0ecff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:46.810094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65977-55e3-4b78-8a0c-948f08c0ecff service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:46.810373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65977-55e3-4b78-8a0c-948f08c0ecff service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:46.810644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65977-55e3-4b78-8a0c-948f08c0ecff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:46.820860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e65977-55e3-4b78-8a0c-948f08c0ecff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:46.822847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e65977-55e3-4b78-8a0c-948f08c0ecff service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:46.834095 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1501/2988] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:19:48.206744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:48.208105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:48.255382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a189d-4201-4ebe-951e-141592efcadf service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:48.271193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:48.272435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:48.274166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:48.274663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] PATH_INFO: `/v3/projects/bfc1e557a01744f0b288bf1f4bc9a296` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:48.276630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc1e557a01744f0b288bf1f4bc9a296)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:48.280709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:48.494653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc1e557a01744f0b288bf1f4bc9a296', 'request_id': 'req-e50a8c13-0022-45aa-8986-35e5b7748444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:48.504458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc1e557a01744f0b288bf1f4bc9a296', 'request_id': 'req-e50a8c13-0022-45aa-8986-35e5b7748444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:48.627826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc1e557a01744f0b288bf1f4bc9a296', 'request_id': 'req-e50a8c13-0022-45aa-8986-35e5b7748444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:48.658578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] The token cache is being invalidate because project bfc1e557a01744f0b288bf1f4bc9a296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:19:48.659197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:48.661199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:48.672302 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1488/2989] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:48 2022] DELETE /identity/v3/projects/bfc1e557a01744f0b288bf1f4bc9a296 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:48.673847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108827-721a-4027-a5e2-75d6b771aaf2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:48.674939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108827-721a-4027-a5e2-75d6b771aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:48.675379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108827-721a-4027-a5e2-75d6b771aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:48.713452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:48.715259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:48.735473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-17108827-721a-4027-a5e2-75d6b771aaf2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:48.740085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-17108827-721a-4027-a5e2-75d6b771aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:48.814944 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:48.901638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8c13-0022-45aa-8986-35e5b7748444 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:48.921569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:48.922258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:48.922533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:48.922988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] PATH_INFO: `/v3/users/1c2310cbc3574eb29a6ca6291ba7808e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:48.924371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2310cbc3574eb29a6ca6291ba7808e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:48.926572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:48.962327 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1502/2990] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:48.964737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4a8c-a737-448b-9b21-745c60d505ad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:48.965240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4a8c-a737-448b-9b21-745c60d505ad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:48.965688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4a8c-a737-448b-9b21-745c60d505ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:49.016402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-89fb4a8c-a737-448b-9b21-745c60d505ad None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:49.019600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-89fb4a8c-a737-448b-9b21-745c60d505ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:49.035933 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1503/2991] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:49.041159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4a8c-a737-448b-9b21-745c60d505ad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:49.068267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4a8c-a737-448b-9b21-745c60d505ad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:49.075076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:49.076538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:49.077308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:49.077643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:49.079140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:19:49.079140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:49.082427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:49.104814 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1504/2992] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:19:49.106576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:49.122053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b57d6-7371-4024-b440-ebf595e9ae95 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:49.134732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:49.135620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:49.135902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:49.136280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:49.136975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:49.139618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:49.173653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2310cbc3574eb29a6ca6291ba7808e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:49.202469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2310cbc3574eb29a6ca6291ba7808e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:49.203505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2310cbc3574eb29a6ca6291ba7808e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:49.209545 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:49.258281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2310cbc3574eb29a6ca6291ba7808e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:49.261946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2310cbc3574eb29a6ca6291ba7808e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:49.297580 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1489/2993] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:19:48 2022] DELETE /identity/v3/users/1c2310cbc3574eb29a6ca6291ba7808e => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:19:49.298584 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1505/2994] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:19:49 2022] POST /identity/v3/projects => generated 359 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:19:49.300712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:49.304295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:49.496116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75940e-6674-42f8-a9e1-9f489a627fd1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:49.507480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:49.508400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:49.508828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:49.509247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:49.514045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:49.517284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:49.618854 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1490/2995] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:19:49 2022] POST /identity/v3/users => generated 280 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:19:49.623277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:49.718620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738a1b-186b-4c0b-a392-e4080c2429b9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:49.732808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:49.733366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:49.733643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:49.733947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:49.734689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:49.736759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:49.756696 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1506/2996] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:49.761100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:49.775186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa933ed-19da-4133-addc-dbca02d40924 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:49.785235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03a5f-3419-4096-9aaf-59e9c4777852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:49.786155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03a5f-3419-4096-9aaf-59e9c4777852 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:49.786427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03a5f-3419-4096-9aaf-59e9c4777852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:49.786869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03a5f-3419-4096-9aaf-59e9c4777852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:49.787715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c03a5f-3419-4096-9aaf-59e9c4777852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:49.789682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c03a5f-3419-4096-9aaf-59e9c4777852 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:49.813769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:49.825492 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1491/2997] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:49.845158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018bd4d-b7c9-4e35-95cd-44ebc1c9a713 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:49.847391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:49.848175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:49.850277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:49.850611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] PATH_INFO: `/v3/projects/594b8a2e09ec435b9df056985f1f08e0/users/0e319ace07a642319afe83711d7f5381/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:49.911367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=594b8a2e09ec435b9df056985f1f08e0, user_id=0e319ace07a642319afe83711d7f5381, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:49.922878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:50.017146 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1507/2998] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:19:49 2022] PUT /identity/v3/projects/594b8a2e09ec435b9df056985f1f08e0/users/0e319ace07a642319afe83711d7f5381/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:19:50.027754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a6234-1e84-4c1e-b930-0eaa19d55e51 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:50.028036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a6234-1e84-4c1e-b930-0eaa19d55e51 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:50.028307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a6234-1e84-4c1e-b930-0eaa19d55e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:50.147878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a26a6234-1e84-4c1e-b930-0eaa19d55e51 None None] MFA Rules not processed for user `0e319ace07a642319afe83711d7f5381`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:50.152775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a26a6234-1e84-4c1e-b930-0eaa19d55e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:50.199299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:50.201666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:50.337284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1492/2999] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:50.372295 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:50.381099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafab68-fc6c-46b0-8100-73705080ffeb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:50.396807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:50.398465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:50.399135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:50.399653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] PATH_INFO: `/v3/projects/d46a7166e4144f55a102ea6335c5f820` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:50.401271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46a7166e4144f55a102ea6335c5f820)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:50.403421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:50.540774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:50.544224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:50.544224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:50.614032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] MFA Rules not processed for user `86eb8880d07649b08bfe76a68901d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:50.618409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:50.648696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46a7166e4144f55a102ea6335c5f820', 'request_id': 'req-87ab594e-5ed9-43f3-aec9-82190d3a6d95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:50.678578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46a7166e4144f55a102ea6335c5f820', 'request_id': 'req-87ab594e-5ed9-43f3-aec9-82190d3a6d95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:50.703617 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:50.745157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46a7166e4144f55a102ea6335c5f820', 'request_id': 'req-87ab594e-5ed9-43f3-aec9-82190d3a6d95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:50.761198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1493/3000] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:50.762421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:50.766988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:50.786156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] The token cache is being invalidate because project d46a7166e4144f55a102ea6335c5f820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:19:50.786365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:50.787193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-87ab594e-5ed9-43f3-aec9-82190d3a6d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:50.791877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1508/3001] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:50 2022] DELETE /identity/v3/projects/d46a7166e4144f55a102ea6335c5f820 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:50.792241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:50.792535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:50.797842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:50.840385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] MFA Rules not processed for user `86eb8880d07649b08bfe76a68901d81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:50.841747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:50.926094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687be6ba-9944-4680-bfce-e44ecb80b952 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:51.056682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:51.056682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:51.056682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:51.056682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:51.064377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:51.230336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:51.231949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:51.235889 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1509/3002] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:51.236851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:51.241901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:51.256502 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1494/3003] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:51.337246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:51.338939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:51.361047 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:51.441869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01827-72ed-4b3a-b1af-da70da0c400d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:51.460647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:51.461302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:51.461579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:51.461844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] PATH_INFO: `/v3/users/59827d8d8a744684b85ecef7bb489552` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:51.463369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59827d8d8a744684b85ecef7bb489552)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:51.465325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:51.497909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879753-1f77-41bb-b011-9a0f1b084050 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:51.507425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:51.508460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:51.509519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:51.510121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] PATH_INFO: `/v3/users/0e319ace07a642319afe83711d7f5381` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:51.511796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e319ace07a642319afe83711d7f5381)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:51.515022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:51.709194 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:51.728833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59827d8d8a744684b85ecef7bb489552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.737312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59827d8d8a744684b85ecef7bb489552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.740266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59827d8d8a744684b85ecef7bb489552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.836329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59827d8d8a744684b85ecef7bb489552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.837478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59827d8d8a744684b85ecef7bb489552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.841064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e319ace07a642319afe83711d7f5381'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.864114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e319ace07a642319afe83711d7f5381'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.866098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e319ace07a642319afe83711d7f5381'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.876708 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1510/3004] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:19:51 2022] DELETE /identity/v3/users/59827d8d8a744684b85ecef7bb489552 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:51.879747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:51.880910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:51.939044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e319ace07a642319afe83711d7f5381'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.939691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-792fef1c-63d8-46f5-9f7e-6fed4e60264c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e319ace07a642319afe83711d7f5381'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:51.980042 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1495/3005] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:19:51 2022] DELETE /identity/v3/users/0e319ace07a642319afe83711d7f5381 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:19:51.986189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:51.986473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:51.986878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:52.029430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1cc52-8471-4f8a-b85c-db1d138d2bc8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:52.066277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:52.067444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:52.176939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:52.178505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:52.178782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:52.179195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:52.182768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:52.282830 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:52.312083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:52.314349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:52.338398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1511/3006] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:52.345639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1496/3007] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:19:52.367843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:52.369459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:52.400847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:52.403390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:52.459173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ca0d9-0dfb-4c0f-9a09-d31ee45a83de None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:52.505268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:52.505899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:52.510357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:52.510760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] PATH_INFO: `/v3/projects/cf7cdd7334d24d00b9439b34644d1935` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:52.513784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7cdd7334d24d00b9439b34644d1935)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:52.517325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:52.680840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d59e8-8baf-466f-ac31-2cfaa66ed9f1 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:52.688854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbfee9-3279-4d1d-9b73-987d74e3721c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:52.690130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfee9-3279-4d1d-9b73-987d74e3721c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:52.690681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfee9-3279-4d1d-9b73-987d74e3721c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:52.691117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfee9-3279-4d1d-9b73-987d74e3721c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:52.699220 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:52.730258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbfee9-3279-4d1d-9b73-987d74e3721c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:52.732615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbfee9-3279-4d1d-9b73-987d74e3721c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:52.743623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7cdd7334d24d00b9439b34644d1935', 'request_id': 'req-84183805-4f87-47ad-8ed1-151a3f60a69d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:52.762916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7cdd7334d24d00b9439b34644d1935', 'request_id': 'req-84183805-4f87-47ad-8ed1-151a3f60a69d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:52.768483 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1512/3008] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:52.840094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7cdd7334d24d00b9439b34644d1935', 'request_id': 'req-84183805-4f87-47ad-8ed1-151a3f60a69d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:52.874314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] The token cache is being invalidate because project cf7cdd7334d24d00b9439b34644d1935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:19:52.875512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:52.880180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-84183805-4f87-47ad-8ed1-151a3f60a69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:52.885473 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1497/3009] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:52 2022] DELETE /identity/v3/projects/cf7cdd7334d24d00b9439b34644d1935 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:52.891574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6d66-4480-453d-80f6-fef771a15303 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:52.892491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6d66-4480-453d-80f6-fef771a15303 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:52.892968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6d66-4480-453d-80f6-fef771a15303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:52.952937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1f2b6d66-4480-453d-80f6-fef771a15303 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:52.960266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f2b6d66-4480-453d-80f6-fef771a15303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:53.083786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1513/3010] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:53.092805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d253-a094-4e92-bb6c-d7414f2612e0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:53.094103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d253-a094-4e92-bb6c-d7414f2612e0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:53.094566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d253-a094-4e92-bb6c-d7414f2612e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:53.157199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ed24d253-a094-4e92-bb6c-d7414f2612e0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:53.157199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed24d253-a094-4e92-bb6c-d7414f2612e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:53.190900 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1498/3011] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:53.196151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b6d66-4480-453d-80f6-fef771a15303 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:53.211617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b6d66-4480-453d-80f6-fef771a15303 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:53.226682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:53.227317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:53.227597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:53.227870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:53.228528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:19:53.228853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:53.231975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:53.270398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1514/3012] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:19:53.274569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d253-a094-4e92-bb6c-d7414f2612e0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:53.293779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d253-a094-4e92-bb6c-d7414f2612e0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:53.301875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:53.302795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:53.303046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:53.303418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:53.304060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:53.306640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:53.601612 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1499/3013] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:19:53 2022] POST /identity/v3/projects => generated 383 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:19:53.606296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:53.620487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f1846-3de0-4578-825f-4249ff470483 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:53.657772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:53.659566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:53.861399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:53.863320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:53.863667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:53.863947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:53.864589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:53.866557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:53.897462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367a4b-d9e4-4a9d-ad58-31c3483c5508 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:53.907981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:53.909135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:53.909536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:53.909880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] PATH_INFO: `/v3/projects/594b8a2e09ec435b9df056985f1f08e0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:53.911243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594b8a2e09ec435b9df056985f1f08e0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:53.914214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:53.999157 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1515/3014] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:19:53 2022] POST /identity/v3/users => generated 292 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:19:54.004539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.013577 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:54.022568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4459e0-6662-445c-85c1-497e57d00009 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:54.040599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:54.041313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.041665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.042037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.042765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:54.051697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:54.094120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1516/3015] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:54.095076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.104328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594b8a2e09ec435b9df056985f1f08e0', 'request_id': 'req-14e8d3f0-352b-4680-81d4-670c16a2fd60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:54.109598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d9b1-2ef7-4115-8645-c5ec513c6c35 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:54.126105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594b8a2e09ec435b9df056985f1f08e0', 'request_id': 'req-14e8d3f0-352b-4680-81d4-670c16a2fd60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:54.258610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594b8a2e09ec435b9df056985f1f08e0', 'request_id': 'req-14e8d3f0-352b-4680-81d4-670c16a2fd60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:54.286682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:54.288459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.288737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.289000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.289644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:54.298661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:54.326532 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1517/3016] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:19:54.332283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.350755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] The token cache is being invalidate because project 594b8a2e09ec435b9df056985f1f08e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:19:54.351361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:54.352246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd0bf-56b4-4abe-a76c-305daae53335 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:54.353013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14e8d3f0-352b-4680-81d4-670c16a2fd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:19:54.359353 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1500/3017] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:19:53 2022] DELETE /identity/v3/projects/594b8a2e09ec435b9df056985f1f08e0 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:54.365293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ae7e4-b4cf-46d1-a976-24b59857d646 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.365880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ae7e4-b4cf-46d1-a976-24b59857d646 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.366467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ae7e4-b4cf-46d1-a976-24b59857d646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.377081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf830-88dd-4d37-9eee-4007dd46b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:54.379049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf830-88dd-4d37-9eee-4007dd46b10e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.379330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf830-88dd-4d37-9eee-4007dd46b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.379655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf830-88dd-4d37-9eee-4007dd46b10e admin admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2/users/2696d3387fd44aa1aab450f31f51c364/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.401893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf830-88dd-4d37-9eee-4007dd46b10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9136074f0b46428cd4a61e68be10a2, user_id=2696d3387fd44aa1aab450f31f51c364, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:54.404807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf830-88dd-4d37-9eee-4007dd46b10e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:54.422864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9c8ae7e4-b4cf-46d1-a976-24b59857d646 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:54.430110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c8ae7e4-b4cf-46d1-a976-24b59857d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:54.440838 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1501/3018] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:54.448938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15eb6-cd5d-4fa9-a98c-71ab91c25624 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.449588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15eb6-cd5d-4fa9-a98c-71ab91c25624 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.450301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15eb6-cd5d-4fa9-a98c-71ab91c25624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.478298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-77b15eb6-cd5d-4fa9-a98c-71ab91c25624 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:54.479627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-77b15eb6-cd5d-4fa9-a98c-71ab91c25624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:54.494066 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1502/3019] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:19:54.494753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15eb6-cd5d-4fa9-a98c-71ab91c25624 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.506800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1518/3020] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:19:54 2022] PUT /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2/users/2696d3387fd44aa1aab450f31f51c364/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:54.511916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15eb6-cd5d-4fa9-a98c-71ab91c25624 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:54.516314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.517236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.517586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.526776 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:54.557121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] MFA Rules not processed for user `2696d3387fd44aa1aab450f31f51c364`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:54.558959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:54.611645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:54.612352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.612352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.613436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.613436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:19:54.613580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:54.615248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:54.639182 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1503/3021] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:19:54.643864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.658370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674f0f-8860-4c95-bf80-a62c29946d1b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:54.665102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:54.666026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.666330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.666650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.667355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:54.671386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:54.758798 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1519/3022] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:19:54.763039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.767206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:54.792879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc05e8-5185-4ca6-9c17-fc4a989c7fd3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:54.801296 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1504/3023] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:19:54 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:19:54.806627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.806797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:54.807953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:54.808336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:54.808847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:54.809682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:54.815942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:54.919098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1520/3024] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:19:54 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:19:54.925039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:54.985568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c652-2531-4c38-8a4c-ed11f9be412f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.024967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476847-ae88-4961-acf0-42d3cf2cdf6a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.040279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.041258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.042066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.042549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.043388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.046352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.130555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.131780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.132282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.132980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.133837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.136254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.208576 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1521/3025] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:19:54 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:19:55.215333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:55.261745 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1505/3026] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:19:54 2022] POST /identity/v3/users => generated 295 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:19:55.268808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:55.271854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc843e6-cb16-4909-b78d-e8f8ff3e8a4d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.281601 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:55.313142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.314197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.314526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.314896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.315715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.317483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.321927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2fde-b488-4235-b0fb-52ddad4f7a2a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.334714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1522/3027] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:55.337953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:55.361027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.361664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.362517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.362517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.362885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.364465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.380296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2268-3391-4260-af1f-dc6d0940bbe2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.394641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.396324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.397290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.397676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] PATH_INFO: `/v3/projects/723da4185863492e95e7f70a7c4ba13b/users/6c0ac819baf3456b89a3de3237f28d9b/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.406272 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1506/3028] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:55.409777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:55.451867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723da4185863492e95e7f70a7c4ba13b, user_id=6c0ac819baf3456b89a3de3237f28d9b, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.453359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74246d-8350-472f-8608-cdb1ac86c960 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.458732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.459619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.459891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.460218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.460632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.461710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.463587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.482402 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1507/3029] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:19:55.490822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:55.521034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678488f-e2a7-420e-99be-e81521a4fc38 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.544592 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1523/3030] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:19:55 2022] PUT /identity/v3/projects/723da4185863492e95e7f70a7c4ba13b/users/6c0ac819baf3456b89a3de3237f28d9b/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:55.549847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:55.557887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febee0c-4778-4aa9-a99e-8e8f44412b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.558626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febee0c-4778-4aa9-a99e-8e8f44412b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.559187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febee0c-4778-4aa9-a99e-8e8f44412b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.559475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febee0c-4778-4aa9-a99e-8e8f44412b10 admin admin] PATH_INFO: `/v3/projects/a1f4adec8a4749a2bec19e7af0863059/users/69bd8aff49524f19ae950f92d46bd44b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.600750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febee0c-4778-4aa9-a99e-8e8f44412b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f4adec8a4749a2bec19e7af0863059, user_id=69bd8aff49524f19ae950f92d46bd44b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.608712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febee0c-4778-4aa9-a99e-8e8f44412b10 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.653141 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:55.688429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16660a-7fed-4f5f-9a58-1004b1ebd957 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:55.690504 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1508/3031] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:19:55 2022] PUT /identity/v3/projects/a1f4adec8a4749a2bec19e7af0863059/users/69bd8aff49524f19ae950f92d46bd44b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:55.696621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735778-c59e-46a2-b6ba-21da3ea7119b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.696907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735778-c59e-46a2-b6ba-21da3ea7119b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.697355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735778-c59e-46a2-b6ba-21da3ea7119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.753889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-81735778-c59e-46a2-b6ba-21da3ea7119b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:55.758461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-81735778-c59e-46a2-b6ba-21da3ea7119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:55.903455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8e82-ecb6-4d8a-99c2-c6969123e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:55.903455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8e82-ecb6-4d8a-99c2-c6969123e3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.906412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8e82-ecb6-4d8a-99c2-c6969123e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.908820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8e82-ecb6-4d8a-99c2-c6969123e3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:55.911178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8e82-ecb6-4d8a-99c2-c6969123e3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:55.927543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8e82-ecb6-4d8a-99c2-c6969123e3b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:55.958416 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1524/3032] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:19:55.960499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43c79-56e5-449e-971f-67863f6462b9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:55.960499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43c79-56e5-449e-971f-67863f6462b9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:55.960907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43c79-56e5-449e-971f-67863f6462b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:56.007301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-91e43c79-56e5-449e-971f-67863f6462b9 None None] MFA Rules not processed for user `3838dd33052740fa88b9cf2888c208ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:56.008733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-91e43c79-56e5-449e-971f-67863f6462b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:56.022366 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1509/3033] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:56.024029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81735778-c59e-46a2-b6ba-21da3ea7119b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:56.064606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81735778-c59e-46a2-b6ba-21da3ea7119b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:56.071996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:56.072950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:56.073373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:56.073786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] PATH_INFO: `/v3/projects/723da4185863492e95e7f70a7c4ba13b/users/6c0ac819baf3456b89a3de3237f28d9b/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:56.076831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723da4185863492e95e7f70a7c4ba13b, user_id=6c0ac819baf3456b89a3de3237f28d9b, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:56.081353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:56.084863 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:56.109668 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1510/3034] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:19:56 2022] PUT /identity/v3/projects/723da4185863492e95e7f70a7c4ba13b/users/6c0ac819baf3456b89a3de3237f28d9b/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:19:56.111664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:56.123286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:56.151230 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1525/3035] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:56.151230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:56.151932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:56.161584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:56.265486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] MFA Rules not processed for user `6c0ac819baf3456b89a3de3237f28d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:56.267605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:56.305959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56b4de-e2af-4499-8fc6-d9678c7583f0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:56.316155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cff744-6b5b-4ec1-9ced-68fdc0c2a099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:56.316994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff744-6b5b-4ec1-9ced-68fdc0c2a099 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:56.317146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff744-6b5b-4ec1-9ced-68fdc0c2a099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:56.317289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff744-6b5b-4ec1-9ced-68fdc0c2a099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:56.454765 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1526/3036] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:56.525497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cff744-6b5b-4ec1-9ced-68fdc0c2a099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:56.532236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cff744-6b5b-4ec1-9ced-68fdc0c2a099 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:56.541221 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1511/3037] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:57.193798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:57.193798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:57.285644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada87238-a797-44dd-aee0-7f2ed953ac03 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:57.304225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:57.304959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:57.308722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:57.309747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:57.326897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:57.332971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:57.347780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1527/3038] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:19:57.381063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fad41-31e6-4b12-b9da-b7df38b5fc92 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:57.381530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fad41-31e6-4b12-b9da-b7df38b5fc92 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:57.381927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fad41-31e6-4b12-b9da-b7df38b5fc92 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:57.384002 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1512/3039] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:19:57.390036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:19:57.407802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:57.435042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b21a-ad81-4ffc-8db1-9910c3e31efe service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:57.447591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:57.450071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:57.451188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:57.452242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:57.455565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:57.460796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:57.466815 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1528/3040] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:19:57 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:19:57.984259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d784a1d-2e25-477c-8cf3-aabac41be9da None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:57.984645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d784a1d-2e25-477c-8cf3-aabac41be9da None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:57.985013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d784a1d-2e25-477c-8cf3-aabac41be9da None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:57.987659 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1513/3041] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:19:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:19:58.006456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:19:58.042991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:58.065096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1bae-63df-4821-8092-50b01eda68d0 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:58.071241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:58.071964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:58.072318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:58.072710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:58.073950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:58.080244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:58.080244 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1529/3042] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:19:58 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:19:58.274426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6746-fb32-4d79-9dae-ed20f236841a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:58.275218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6746-fb32-4d79-9dae-ed20f236841a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:58.275668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6746-fb32-4d79-9dae-ed20f236841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:58.286878 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:19:58.341473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a33c6746-fb32-4d79-9dae-ed20f236841a None None] MFA Rules not processed for user `2696d3387fd44aa1aab450f31f51c364`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:19:58.357330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a33c6746-fb32-4d79-9dae-ed20f236841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:58.565880 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1514/3043] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:19:58.635213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:19:58.638105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:19:58.690970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecff08-240f-4fc4-b6a0-0861d98a1abb tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:19:58.708649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:19:58.709272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:19:58.711935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:19:58.714353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:19:58.732297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:19:58.736182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:19:58.763772 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1530/3044] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:00.516300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add65a-e240-4990-b3ed-a3bbbb4ed688 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:00.516808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add65a-e240-4990-b3ed-a3bbbb4ed688 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:00.520482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add65a-e240-4990-b3ed-a3bbbb4ed688 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:00.520482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1515/3045] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:20:00.526412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:20:00.548136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:00.571820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0e3f4-63ce-429d-9125-59eabfb011b0 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:00.600804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:00.601547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:00.604962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:00.605317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:00.608399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:00.617128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:00.631243 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1531/3046] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:20:00 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:00.965804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df705e-6057-42fd-b1bd-42b4e4b4a2de None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:00.966084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df705e-6057-42fd-b1bd-42b4e4b4a2de None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:00.966326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df705e-6057-42fd-b1bd-42b4e4b4a2de None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:00.967679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1516/3047] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:20:00.979170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:20:01.000828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:01.014271 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:01.025495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0407b-cdea-4e06-904a-2074533bac84 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:01.036980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:01.038730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:01.039176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:01.039598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:01.041296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:01.044506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:01.048261 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1532/3048] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:20:00 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:01.165368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253fd4-3561-4a83-ad66-e5d35db5202b None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:01.165638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253fd4-3561-4a83-ad66-e5d35db5202b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:01.166119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253fd4-3561-4a83-ad66-e5d35db5202b None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:01.167624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1517/3049] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:20:01.188844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:20:01.208135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:01.237945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e107-5be7-4d50-aa19-2f5728da93bf tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:01.252864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddbd43-38d5-4797-b928-cea316563c33 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:01.253559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddbd43-38d5-4797-b928-cea316563c33 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:01.253845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddbd43-38d5-4797-b928-cea316563c33 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:01.256023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddbd43-38d5-4797-b928-cea316563c33 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:01.259027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddbd43-38d5-4797-b928-cea316563c33 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:01.262250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddbd43-38d5-4797-b928-cea316563c33 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:01.264392 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1533/3050] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:20:01 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:01.463288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af3a2-9a85-4ac5-ba8e-09f5a8011e38 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:01.463574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af3a2-9a85-4ac5-ba8e-09f5a8011e38 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:01.463838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af3a2-9a85-4ac5-ba8e-09f5a8011e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:01.510738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ae8af3a2-9a85-4ac5-ba8e-09f5a8011e38 None None] MFA Rules not processed for user `2696d3387fd44aa1aab450f31f51c364`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:01.520634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ae8af3a2-9a85-4ac5-ba8e-09f5a8011e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:01.555422 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1518/3051] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:01.707346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:01.708253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:01.708677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:01.739344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] MFA Rules not processed for user `cd6a6c5240f94ace91e1f0ed3e53fa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:01.742977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:01.867996 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1534/3052] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:03.155791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11123-bb48-4156-879e-642669ff02a0 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:03.156353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11123-bb48-4156-879e-642669ff02a0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:03.156632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11123-bb48-4156-879e-642669ff02a0 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:03.158594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1519/3053] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:20:03.164583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:20:03.200936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:03.239079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a99a5-99f2-4beb-8b91-3b10f25f6110 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:03.259020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:03.260668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:03.261253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:03.261750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:03.267817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:03.271576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:03.274076 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1535/3054] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:20:03 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:04.165961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fa498-09ab-44c7-a2a4-ff6b6225844e None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:04.166912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fa498-09ab-44c7-a2a4-ff6b6225844e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:04.170805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fa498-09ab-44c7-a2a4-ff6b6225844e None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:04.170805 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1520/3055] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:20:04.174228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:20:04.239762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:04.269155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9da874-346e-48b4-8559-b6bd556563be tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:04.290763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:04.291997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:04.292466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:04.292887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:04.298228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:04.300639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:04.305748 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1536/3056] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:20:04 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:05.039055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df886-3866-4c9c-9a81-6cf8bb50097a None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:05.039677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df886-3866-4c9c-9a81-6cf8bb50097a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:05.040145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df886-3866-4c9c-9a81-6cf8bb50097a None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:05.042568 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1521/3057] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:20:05.051104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:20:05.068688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:05.081888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474f056-1aeb-4759-9739-038122186d16 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:05.087425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ba039-658a-4dc8-90b4-b36b8284e882 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:05.088275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ba039-658a-4dc8-90b4-b36b8284e882 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:05.088959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ba039-658a-4dc8-90b4-b36b8284e882 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:05.089488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ba039-658a-4dc8-90b4-b36b8284e882 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:05.090999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ba039-658a-4dc8-90b4-b36b8284e882 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:05.093291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ba039-658a-4dc8-90b4-b36b8284e882 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:05.106059 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1537/3058] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:20:05 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:05.415562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:05.416086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:05.416086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:05.455089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] MFA Rules not processed for user `2696d3387fd44aa1aab450f31f51c364`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:05.456333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:05.477936 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1522/3059] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:07.418885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540a5c-7293-40cc-97fe-c1833c439397 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:07.419413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540a5c-7293-40cc-97fe-c1833c439397 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:07.419413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540a5c-7293-40cc-97fe-c1833c439397 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:07.421052 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1538/3060] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:20:07.454184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:20:07.478190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:07.503239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb895e9f-4bfa-491b-beae-c9032ac834bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:07.516408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1c6cf-9968-46c7-b904-f5ed0b63c3f9 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0ac819baf3456b89a3de3237f28d9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '723da4185863492e95e7f70a7c4ba13b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:07.517518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1c6cf-9968-46c7-b904-f5ed0b63c3f9 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:07.518429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1c6cf-9968-46c7-b904-f5ed0b63c3f9 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:07.518883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1c6cf-9968-46c7-b904-f5ed0b63c3f9 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:07.523583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1c6cf-9968-46c7-b904-f5ed0b63c3f9 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:07.526243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1c6cf-9968-46c7-b904-f5ed0b63c3f9 tempest-QuotasAdminNegativeTest-1936653522 tempest-QuotasAdminNegativeTest-1936653522-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:07.532662 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1523/3061] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:20:07 2022] GET /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 383 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:08.475699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540a5c-7293-40cc-97fe-c1833c439397 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:08.500261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540a5c-7293-40cc-97fe-c1833c439397 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:08.515115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:08.515744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:08.516022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:08.516296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] PATH_INFO: `/v3/users/2696d3387fd44aa1aab450f31f51c364` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:08.518652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2696d3387fd44aa1aab450f31f51c364)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:08.520798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:08.829372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2696d3387fd44aa1aab450f31f51c364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:08.846376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2696d3387fd44aa1aab450f31f51c364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:08.849951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2696d3387fd44aa1aab450f31f51c364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:08.949781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2696d3387fd44aa1aab450f31f51c364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:08.951312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2696d3387fd44aa1aab450f31f51c364'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:08.979446 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1539/3062] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:20:08 2022] DELETE /identity/v3/users/2696d3387fd44aa1aab450f31f51c364 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:08.984115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3025dd-b3e0-4852-a9cc-09efc7bf7788 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:08.984627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3025dd-b3e0-4852-a9cc-09efc7bf7788 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:08.984858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3025dd-b3e0-4852-a9cc-09efc7bf7788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:09.048874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0a3025dd-b3e0-4852-a9cc-09efc7bf7788 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:09.052213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0a3025dd-b3e0-4852-a9cc-09efc7bf7788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:09.164161 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1524/3063] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:20:09.255351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:09.261881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:09.380215 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:09.446853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3e74-2771-407e-a9a2-5af5ee6c7688 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:09.455187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:09.457397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:09.457901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:09.458534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:09.498569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:09.500764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:09.525625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1540/3064] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:10.107850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fe307-0261-42f5-a5bd-1f04969b3b79 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:10.108905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fe307-0261-42f5-a5bd-1f04969b3b79 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:10.109305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fe307-0261-42f5-a5bd-1f04969b3b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:10.181111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-621fe307-0261-42f5-a5bd-1f04969b3b79 None None] MFA Rules not processed for user `69bd8aff49524f19ae950f92d46bd44b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:10.182690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-621fe307-0261-42f5-a5bd-1f04969b3b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:10.363129 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1525/3065] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:10.367397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:10.368797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:10.391497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb6ab-053c-4cac-8185-1bfd62b61534 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:10.397570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:10.398221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:10.398495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:10.398757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:10.399398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:10.406257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:10.573293 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1541/3066] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:20:10 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:20:10.577932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fe307-0261-42f5-a5bd-1f04969b3b79 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:10.596859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fe307-0261-42f5-a5bd-1f04969b3b79 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:10.620296 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:10.739004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:10.739734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:10.740252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:10.740608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:10.741911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:10.745375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:10.843868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:10.846334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:10.878570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8a2d4-237a-4462-a9a4-8e3fb56277c7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:10.883637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:10.884339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:10.889918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:10.889918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] PATH_INFO: `/v3/projects/5b9136074f0b46428cd4a61e68be10a2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:10.889918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9136074f0b46428cd4a61e68be10a2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:10.889918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:10.895559 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1526/3067] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:20:10 2022] POST /identity/v3/users => generated 300 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:20:10.900278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:10.916006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f99588-4a1a-4cea-aa01-8dfdab84b19f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:10.942926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:10.943829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:10.944295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:10.944795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:10.945639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:10.947809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:10.964613 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1527/3068] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:10.968597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:10.985522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165617-f43d-4747-8470-88287f0b0a26 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:10.997531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa05fb5-8b71-4dce-b992-b175e1b8a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:10.998531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05fb5-8b71-4dce-b992-b175e1b8a238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:10.998910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05fb5-8b71-4dce-b992-b175e1b8a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:10.999830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05fb5-8b71-4dce-b992-b175e1b8a238 admin admin] PATH_INFO: `/v3/projects/bd5be4344a684d538353d3ed2c7bba00/users/1631e803fb0e45c18b12e5ed354f932a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:11.025840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa05fb5-8b71-4dce-b992-b175e1b8a238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5be4344a684d538353d3ed2c7bba00, user_id=1631e803fb0e45c18b12e5ed354f932a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:11.028654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa05fb5-8b71-4dce-b992-b175e1b8a238 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:11.117807 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1528/3069] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:20:10 2022] PUT /identity/v3/projects/bd5be4344a684d538353d3ed2c7bba00/users/1631e803fb0e45c18b12e5ed354f932a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:20:11.119152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04066689-3e78-4f70-aabc-ddf1818a4034 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:11.119500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04066689-3e78-4f70-aabc-ddf1818a4034 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:11.119777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04066689-3e78-4f70-aabc-ddf1818a4034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:11.130882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9136074f0b46428cd4a61e68be10a2', 'request_id': 'req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.137205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9136074f0b46428cd4a61e68be10a2', 'request_id': 'req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.162908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-04066689-3e78-4f70-aabc-ddf1818a4034 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:11.164512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-04066689-3e78-4f70-aabc-ddf1818a4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:11.222613 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1529/3070] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:11.223455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04066689-3e78-4f70-aabc-ddf1818a4034 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:11.235053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9136074f0b46428cd4a61e68be10a2', 'request_id': 'req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.252973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] The token cache is being invalidate because project 5b9136074f0b46428cd4a61e68be10a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:20:11.253530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.254427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.257902 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1542/3071] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:10 2022] DELETE /identity/v3/projects/5b9136074f0b46428cd4a61e68be10a2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:11.259382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:11.261546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:11.302618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04066689-3e78-4f70-aabc-ddf1818a4034 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:11.307459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:11.308347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:11.308695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:11.309033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:11.309778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:11.311616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:11.322417 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1530/3072] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:11.323527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:11.327430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:11.343375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d376-74eb-4e47-8532-ff7be805f53b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:11.352846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:11.353497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:11.354091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:11.354375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] PATH_INFO: `/v3/users/6c0ac819baf3456b89a3de3237f28d9b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:11.355576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0ac819baf3456b89a3de3237f28d9b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:11.357651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:11.359393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4ba64-cae5-4c67-8ad5-eb106ca2215e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:11.363041 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:11.367908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:11.367908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:11.367908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:11.367908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:11.374931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:11.400994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:11.402756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:11.411901 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1543/3073] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:20:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:20:11.412744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:11.415689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:11.437759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c17b-cfdf-4ca0-a875-4eec5956dc5c service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:11.449933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:11.450749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:11.452958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:11.454201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] PATH_INFO: `/v3/projects/bd5be4344a684d538353d3ed2c7bba00/users/1631e803fb0e45c18b12e5ed354f932a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:11.463974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5be4344a684d538353d3ed2c7bba00, user_id=1631e803fb0e45c18b12e5ed354f932a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:11.470847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:11.494709 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1544/3074] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:20:11 2022] PUT /identity/v3/projects/bd5be4344a684d538353d3ed2c7bba00/users/1631e803fb0e45c18b12e5ed354f932a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:11.574383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0ac819baf3456b89a3de3237f28d9b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.582143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0ac819baf3456b89a3de3237f28d9b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.583194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0ac819baf3456b89a3de3237f28d9b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.674592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0ac819baf3456b89a3de3237f28d9b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.675242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa6d7012-c363-4f48-aed9-d4d5bd06196a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0ac819baf3456b89a3de3237f28d9b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:11.699583 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1531/3075] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:20:11 2022] DELETE /identity/v3/users/6c0ac819baf3456b89a3de3237f28d9b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:12.464714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:12.471377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:12.516801 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:12.573897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27b665-8e84-424e-b761-05e51c46ccbd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:12.660284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:12.661025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:12.661389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:12.661734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] PATH_INFO: `/v3/projects/723da4185863492e95e7f70a7c4ba13b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:12.663222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723da4185863492e95e7f70a7c4ba13b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:12.666281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:12.810577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723da4185863492e95e7f70a7c4ba13b', 'request_id': 'req-5cce6e58-051f-4765-8a3f-40d206cdb8b2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:12.822041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723da4185863492e95e7f70a7c4ba13b', 'request_id': 'req-5cce6e58-051f-4765-8a3f-40d206cdb8b2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:12.920303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723da4185863492e95e7f70a7c4ba13b', 'request_id': 'req-5cce6e58-051f-4765-8a3f-40d206cdb8b2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:12.942312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] The token cache is being invalidate because project 723da4185863492e95e7f70a7c4ba13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:20:12.943941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:12.944799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cce6e58-051f-4765-8a3f-40d206cdb8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:12.949258 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1545/3076] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:12 2022] DELETE /identity/v3/projects/723da4185863492e95e7f70a7c4ba13b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:12.955832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d12fcd-b38c-4fea-99ed-bd8db4db4c6b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:12.956340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d12fcd-b38c-4fea-99ed-bd8db4db4c6b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:12.956426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d12fcd-b38c-4fea-99ed-bd8db4db4c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:12.988334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b4d12fcd-b38c-4fea-99ed-bd8db4db4c6b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:12.990672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b4d12fcd-b38c-4fea-99ed-bd8db4db4c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:13.119337 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1532/3077] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:13.128445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff09288-0405-41f2-b606-f6f4be5d37bf None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.128910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff09288-0405-41f2-b606-f6f4be5d37bf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.129191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff09288-0405-41f2-b606-f6f4be5d37bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.156513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1ff09288-0405-41f2-b606-f6f4be5d37bf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:13.157722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ff09288-0405-41f2-b606-f6f4be5d37bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:13.166167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1546/3078] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:13.170536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d12fcd-b38c-4fea-99ed-bd8db4db4c6b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:13.183837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d12fcd-b38c-4fea-99ed-bd8db4db4c6b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:13.190490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe16f5f-239c-4d0a-8c2d-aa9ed7e8844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:13.191117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe16f5f-239c-4d0a-8c2d-aa9ed7e8844b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.191397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe16f5f-239c-4d0a-8c2d-aa9ed7e8844b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.191799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe16f5f-239c-4d0a-8c2d-aa9ed7e8844b admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.192465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe16f5f-239c-4d0a-8c2d-aa9ed7e8844b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:20:13.192770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe16f5f-239c-4d0a-8c2d-aa9ed7e8844b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:13.194573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe16f5f-239c-4d0a-8c2d-aa9ed7e8844b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:13.207281 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1533/3079] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:13.212820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff09288-0405-41f2-b606-f6f4be5d37bf None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:13.224127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff09288-0405-41f2-b606-f6f4be5d37bf None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:13.231273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:13.232898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.234268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.234601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.235389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:13.237779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:13.301797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0bc6-ad0f-43f0-b34d-6043555d4415 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.302165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0bc6-ad0f-43f0-b34d-6043555d4415 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.302711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0bc6-ad0f-43f0-b34d-6043555d4415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.325201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c8da0bc6-ad0f-43f0-b34d-6043555d4415 None None] MFA Rules not processed for user `ecb97fa679eb4bf8a41862d3c248a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:13.326899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c8da0bc6-ad0f-43f0-b34d-6043555d4415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:13.343838 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1547/3080] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:20:13 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:20:13.345009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:13.420316 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1534/3081] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:13.440027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27167cb-fbf5-4fa9-b1af-e0503463af81 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:13.447334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:13.448032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.448437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.448776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.449507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:13.451932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:13.595358 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1548/3082] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:20:13 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:20:13.602028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0bc6-ad0f-43f0-b34d-6043555d4415 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:13.620239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0bc6-ad0f-43f0-b34d-6043555d4415 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:13.645296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:13.646770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.646770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.646770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.647737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:13.649720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:13.681578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1535/3083] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:13.682680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:13.706147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b68ca-30cc-4ef8-b5f1-33651dd5f5b8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:13.706147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c1d80-93cf-44d7-9c7f-9d0d4e19b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:13.706147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1d80-93cf-44d7-9c7f-9d0d4e19b9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.706147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1d80-93cf-44d7-9c7f-9d0d4e19b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.706701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1d80-93cf-44d7-9c7f-9d0d4e19b9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.706701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c1d80-93cf-44d7-9c7f-9d0d4e19b9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:13.711858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c1d80-93cf-44d7-9c7f-9d0d4e19b9f2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:13.730061 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1549/3084] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:13.732788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:13.740417 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:13.744586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e363-b59e-45a6-afbc-397dc6a67c0d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:13.754887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:13.754887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.754887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.754887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] PATH_INFO: `/v3/projects/f211c102b8d3427d8884e2790b264dae/users/e26043c04dc34c7299990c1c405c53a6/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:13.775303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f211c102b8d3427d8884e2790b264dae, user_id=e26043c04dc34c7299990c1c405c53a6, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:13.778467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:13.960127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1536/3085] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:20:13 2022] PUT /identity/v3/projects/f211c102b8d3427d8884e2790b264dae/users/e26043c04dc34c7299990c1c405c53a6/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:13.970401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a2203-4dc8-4bca-9837-0c1860e3049f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:13.970780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a2203-4dc8-4bca-9837-0c1860e3049f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:13.972265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a2203-4dc8-4bca-9837-0c1860e3049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:14.048781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9a0a2203-4dc8-4bca-9837-0c1860e3049f None None] MFA Rules not processed for user `e26043c04dc34c7299990c1c405c53a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:14.048781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9a0a2203-4dc8-4bca-9837-0c1860e3049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:14.130999 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1550/3086] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:14.146544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:14.239892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28748c35-dbc9-4c71-bc31-91d8c79e9b28 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:14.246105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:14.247283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:14.247569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:14.248448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:14.250438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:14.253290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:14.404632 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1537/3087] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:20:14 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:20:14.406903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a2203-4dc8-4bca-9837-0c1860e3049f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:14.422088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a2203-4dc8-4bca-9837-0c1860e3049f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:14.486010 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:14.539109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:14.540195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:14.540712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:14.541199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:14.542217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:14.544849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:14.635027 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1551/3088] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:20:14 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:20:14.638770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:14.652705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666398a-34a3-4d11-b436-e59c76826d2a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:14.667150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:14.667787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:14.668066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:14.668385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:14.669047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:14.670759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:14.692170 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1538/3089] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:14.696298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:14.713780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd682-4781-4b4b-a001-2edfbd96e21e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:14.729954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:14.735657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:14.735657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:14.735657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] PATH_INFO: `/v3/projects/d9363f56b2a94933b7fa59270e1e02e4/users/67d9cc0b646749c299669d9e6868fa8a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:14.785245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9363f56b2a94933b7fa59270e1e02e4, user_id=67d9cc0b646749c299669d9e6868fa8a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:14.795149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:14.870671 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1552/3090] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:20:14 2022] PUT /identity/v3/projects/d9363f56b2a94933b7fa59270e1e02e4/users/67d9cc0b646749c299669d9e6868fa8a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:14.876058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:14.894667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc644e2-c554-489f-98eb-fe47a0ffa623 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:15.083225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772db5d-d436-4c7c-9296-c728d21a2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:15.083916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772db5d-d436-4c7c-9296-c728d21a2d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:15.084116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772db5d-d436-4c7c-9296-c728d21a2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:15.087039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772db5d-d436-4c7c-9296-c728d21a2d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:15.088074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772db5d-d436-4c7c-9296-c728d21a2d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:15.091614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772db5d-d436-4c7c-9296-c728d21a2d7c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:15.106262 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1539/3091] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:15.110300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:15.121823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9f26-5361-4d1e-aaad-a76799e03fa9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:15.130849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed8655-3dc4-43ed-8b13-da5338397582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:15.131525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8655-3dc4-43ed-8b13-da5338397582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:15.131803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8655-3dc4-43ed-8b13-da5338397582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:15.132079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8655-3dc4-43ed-8b13-da5338397582 admin admin] PATH_INFO: `/v3/projects/d9363f56b2a94933b7fa59270e1e02e4/users/67d9cc0b646749c299669d9e6868fa8a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:15.135938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed8655-3dc4-43ed-8b13-da5338397582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9363f56b2a94933b7fa59270e1e02e4, user_id=67d9cc0b646749c299669d9e6868fa8a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:15.140631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed8655-3dc4-43ed-8b13-da5338397582 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:15.159748 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1553/3092] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:20:15 2022] PUT /identity/v3/projects/d9363f56b2a94933b7fa59270e1e02e4/users/67d9cc0b646749c299669d9e6868fa8a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:15.171683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:15.172226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:15.172665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:15.230328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] MFA Rules not processed for user `67d9cc0b646749c299669d9e6868fa8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:15.231552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:15.429268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cd80-2ad8-40a8-ae96-7c603e4e1d62 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:15.429435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cd80-2ad8-40a8-ae96-7c603e4e1d62 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:15.429685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3cd80-2ad8-40a8-ae96-7c603e4e1d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:15.433050 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1540/3093] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:15.488672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c3f3cd80-2ad8-40a8-ae96-7c603e4e1d62 None None] MFA Rules not processed for user `e26043c04dc34c7299990c1c405c53a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:15.490929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c3f3cd80-2ad8-40a8-ae96-7c603e4e1d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:15.679689 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1554/3094] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:15.697301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:15.840197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:15.841820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:16.001775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04210e-5ec4-42d5-9882-7df0c3f4345c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:16.015520 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:16.023719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:16.024703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:16.025198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:16.025767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:16.037968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:16.047655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:16.062408 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1541/3095] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:23.049134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9223-c4fd-452c-9435-42e98d6aa738 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:23.050399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9223-c4fd-452c-9435-42e98d6aa738 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:23.050883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9223-c4fd-452c-9435-42e98d6aa738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:23.133585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c9bc9223-c4fd-452c-9435-42e98d6aa738 None None] MFA Rules not processed for user `1631e803fb0e45c18b12e5ed354f932a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:23.137479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c9bc9223-c4fd-452c-9435-42e98d6aa738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:23.287840 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1555/3096] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:23.304652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:23.306284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:23.429864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53b60f-24ec-4524-9b40-3634c4a9226e service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:23.437460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:23.442381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:23.442381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:23.442381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:23.444843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:23.567891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:23.569351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:23.587419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1542/3097] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:20:25.453277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:25.453784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:25.453862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:25.549506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] MFA Rules not processed for user `18ea2d1dfc7441d2a2bb7b22c6065605`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:25.550769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:25.678634 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1556/3098] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:20:26.000229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:26.001967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:26.037022 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:26.140844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61da94-0023-49d6-91bd-ff8efdb1d15b service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:26.149546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f05804-aaa1-4d64-88ad-f52f4f284904 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:26.149546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05804-aaa1-4d64-88ad-f52f4f284904 service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:26.149546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05804-aaa1-4d64-88ad-f52f4f284904 service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:26.149546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05804-aaa1-4d64-88ad-f52f4f284904 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:26.152184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-23f05804-aaa1-4d64-88ad-f52f4f284904 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:26.174556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f05804-aaa1-4d64-88ad-f52f4f284904 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:26.176286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f05804-aaa1-4d64-88ad-f52f4f284904 service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:26.228823 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1543/3099] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:28.864509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:28.866681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:28.895620 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:28.986948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4171-2b4e-4f98-ba27-9daeace190f1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:29.004690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:29.005622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:29.006191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:29.006388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:29.023370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:29.077209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:29.081141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:29.133536 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1557/3100] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:30.301362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce6c5-503c-4d8f-80ff-f2f2efd2983f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:30.301362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce6c5-503c-4d8f-80ff-f2f2efd2983f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:30.301362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce6c5-503c-4d8f-80ff-f2f2efd2983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:30.343794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7b4ce6c5-503c-4d8f-80ff-f2f2efd2983f None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:30.345241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7b4ce6c5-503c-4d8f-80ff-f2f2efd2983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:30.527615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1544/3101] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:30.542614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:30.544868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:30.799731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db47f6-d907-4600-8268-e0599f3894f8 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:30.814814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:30.815580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:30.828889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:30.837109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:30.883451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:30.887614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:30.911378 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1558/3102] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:20:37.406915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce6c5-503c-4d8f-80ff-f2f2efd2983f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:37.414654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce6c5-503c-4d8f-80ff-f2f2efd2983f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:37.424929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:37.425851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:37.426378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:37.431339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:37.431339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:37.458496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:37.492898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:37.492898 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1545/3103] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:39.974438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:39.976670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:40.132612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae409070-2b12-4f3f-a298-4836aa1feafc service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:40.143256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:40.150991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:40.150991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:40.150991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] PATH_INFO: `/v3/users/86eb8880d07649b08bfe76a68901d81c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:40.150991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86eb8880d07649b08bfe76a68901d81c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:40.150991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:40.368153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86eb8880d07649b08bfe76a68901d81c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:40.370584 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:40.385385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86eb8880d07649b08bfe76a68901d81c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:40.387019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86eb8880d07649b08bfe76a68901d81c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:40.491924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86eb8880d07649b08bfe76a68901d81c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:40.493060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a513612b-446c-42ef-ac39-fea92fd781c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86eb8880d07649b08bfe76a68901d81c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:40.542665 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1559/3104] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:20:39 2022] DELETE /identity/v3/users/86eb8880d07649b08bfe76a68901d81c => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:41.111856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:41.130916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059cfcc-7a5e-458d-b644-052f7bf423d6 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:41.294549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:41.299233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:41.299757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:41.300181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] PATH_INFO: `/v3/projects/d55fb3f415da42eeb5d5514410670b29` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:41.301851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55fb3f415da42eeb5d5514410670b29)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:41.312737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:41.489621 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:41.494972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55fb3f415da42eeb5d5514410670b29', 'request_id': 'req-7a687d67-168e-42ce-99a1-6f50fd2ec513'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:41.502746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55fb3f415da42eeb5d5514410670b29', 'request_id': 'req-7a687d67-168e-42ce-99a1-6f50fd2ec513'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:41.610729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55fb3f415da42eeb5d5514410670b29', 'request_id': 'req-7a687d67-168e-42ce-99a1-6f50fd2ec513'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:41.640028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] The token cache is being invalidate because project d55fb3f415da42eeb5d5514410670b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:20:41.641281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:41.643008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a687d67-168e-42ce-99a1-6f50fd2ec513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:20:41.645925 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1546/3105] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:20:41 2022] DELETE /identity/v3/projects/d55fb3f415da42eeb5d5514410670b29 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:20:41.650967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7e6b-bbea-4fe8-a78f-12eee07bc447 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:41.651435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7e6b-bbea-4fe8-a78f-12eee07bc447 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:41.651899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e7e6b-bbea-4fe8-a78f-12eee07bc447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:41.700666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e56e7e6b-bbea-4fe8-a78f-12eee07bc447 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:41.706308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e56e7e6b-bbea-4fe8-a78f-12eee07bc447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:41.834906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1560/3106] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:41.847203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82b20-36d8-45f3-b6c0-08303a950732 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:41.847203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82b20-36d8-45f3-b6c0-08303a950732 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:41.847203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82b20-36d8-45f3-b6c0-08303a950732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:41.873770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d6c82b20-36d8-45f3-b6c0-08303a950732 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:41.875411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d6c82b20-36d8-45f3-b6c0-08303a950732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:41.893424 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1547/3107] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:41.897296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7e6b-bbea-4fe8-a78f-12eee07bc447 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:41.914545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e7e6b-bbea-4fe8-a78f-12eee07bc447 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:41.928807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:41.931355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:41.932305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:41.932603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:41.934019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:20:41.936463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:41.940524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:41.962493 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1561/3108] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:20:41.966903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82b20-36d8-45f3-b6c0-08303a950732 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:41.982325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82b20-36d8-45f3-b6c0-08303a950732 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:41.991087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:41.995921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:41.995921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:41.995921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:41.995921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:42.000009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:42.150566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:42.150806 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1548/3109] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:20:41 2022] POST /identity/v3/projects => generated 397 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:20:42.168049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660184f-534c-4078-9e7e-4394cac74396 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:42.321044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:42.322383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:42.323584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:42.324066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:42.325109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:42.332683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:42.451351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:42.457484 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1562/3110] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:20:42 2022] POST /identity/v3/users => generated 299 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:20:42.469286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2d48-0242-4c86-8c64-552e7a91f947 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:42.480976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:42.483755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:42.485169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:42.486238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:42.487052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:42.492719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:42.505644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1549/3111] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:42.509603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:42.532492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9cce3-c5b6-41ad-9dc6-84b8506653df admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:42.539779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a9e05-448f-4a5b-b94e-02186562a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:42.541172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9e05-448f-4a5b-b94e-02186562a904 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:42.541956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9e05-448f-4a5b-b94e-02186562a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:42.542507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9e05-448f-4a5b-b94e-02186562a904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:42.543705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a9e05-448f-4a5b-b94e-02186562a904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:42.546864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a9e05-448f-4a5b-b94e-02186562a904 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:42.565529 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1563/3112] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:20:42.569782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:42.596198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076590e5-27ec-44f9-ada1-119728e149be admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:42.601933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:42.602778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:42.603079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:42.603419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] PATH_INFO: `/v3/projects/fee2e22f48754a4aa47426a27bebf68b/users/b74cdbbd7765495db29eb0428fadc992/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:42.629250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee2e22f48754a4aa47426a27bebf68b, user_id=b74cdbbd7765495db29eb0428fadc992, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:42.632367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:42.762802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1550/3113] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:20:42 2022] PUT /identity/v3/projects/fee2e22f48754a4aa47426a27bebf68b/users/b74cdbbd7765495db29eb0428fadc992/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:20:42.767718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:42.768274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:42.768274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:42.804979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:42.806242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:42.853823 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:42.929104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1564/3114] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:42.939805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:42.941848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:43.026168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139bb3-6a2d-4e9b-ba3a-f333cf25a881 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:43.032025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b8226-dbdb-4611-be9b-7590375f6216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:43.033014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8226-dbdb-4611-be9b-7590375f6216 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:43.033389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8226-dbdb-4611-be9b-7590375f6216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:43.033853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8226-dbdb-4611-be9b-7590375f6216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:43.057209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b8226-dbdb-4611-be9b-7590375f6216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:43.064378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b8226-dbdb-4611-be9b-7590375f6216 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:43.091085 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1551/3115] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:52.627086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:52.628558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:52.865400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cda1f3-281a-4654-9bc0-70f3692e1c39 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:52.883450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391659e5-06aa-4fc1-bf6f-8d058889ecc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:52.884591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391659e5-06aa-4fc1-bf6f-8d058889ecc0 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:52.886343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391659e5-06aa-4fc1-bf6f-8d058889ecc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:52.888298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391659e5-06aa-4fc1-bf6f-8d058889ecc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:52.891331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-391659e5-06aa-4fc1-bf6f-8d058889ecc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:52.921447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391659e5-06aa-4fc1-bf6f-8d058889ecc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:52.923519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391659e5-06aa-4fc1-bf6f-8d058889ecc0 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:52.956091 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1565/3116] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:53.073660 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:53.785551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:53.785832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:53.786133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:53.904242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e0c1-bd94-44c7-9d18-5b6383b82c8e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:53.904698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e0c1-bd94-44c7-9d18-5b6383b82c8e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:53.904779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e0c1-bd94-44c7-9d18-5b6383b82c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:53.915793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:53.917128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:54.005410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-55d6e0c1-bd94-44c7-9d18-5b6383b82c8e None None] MFA Rules not processed for user `b74cdbbd7765495db29eb0428fadc992`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:54.006686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-55d6e0c1-bd94-44c7-9d18-5b6383b82c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:54.102349 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1552/3117] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:54.104296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:54.129084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:54.169866 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1566/3118] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:54.181231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:54.182550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:54.182550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:54.239261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] MFA Rules not processed for user `b74cdbbd7765495db29eb0428fadc992`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:20:54.245314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:54.279170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1567/3119] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:20:54.280005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:54.293773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:54.325719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c113a9-055f-4bc8-a6cf-7a6cf9944a1b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:54.332540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:54.333354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:54.333485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:54.333746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:54.337925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:54.384714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:54.386584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:54.404111 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1568/3120] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:54.406557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:54.408219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:54.429102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa978-743f-4f62-83ce-d055e7052640 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:54.438447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b2768-9903-4d2b-9657-4ac849664cba None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:54.439314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:54.440161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:54.440636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:54.441072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:54.452824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:54.453525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:54.453871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:54.454329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:54.455765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:54.457820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:54.476474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:54.478386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:54.493874 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1569/3121] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:20:54.500013 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1553/3122] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:20:56.043165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:20:56.046255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:56.096581 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:20:56.212957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99cc21-2285-4db3-9908-fd56b8f1d1d0 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:20:56.222159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:20:56.222824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:20:56.223101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:20:56.223370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:20:56.230407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:20:56.266475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:20:56.269432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:20:56.303797 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1570/3123] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:20:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:21:03.480751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:03.511202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032c861-b8cd-4884-934a-da730d9d23d9 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:03.520964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:03.522432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:03.523472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:03.526412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:03.530181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:03.550499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:03.561196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:03.596116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1554/3124] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:04.624181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:04.640934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb793a-cf27-460e-a995-8a4fe2c038f8 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:04.649958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:04.651242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:04.651752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:04.652244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:04.664889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:04.786338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:04.788685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:04.810786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1571/3125] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:07.548422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:07.560370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f62d87-139c-444a-8a60-27b8fa0e2e81 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:07.569038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:07.574273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:07.574273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:07.574273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:07.578649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:07.620046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:07.633775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:07.678428 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1555/3126] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:12.154044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:12.157401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:12.191903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83ff8e-0341-4105-b818-91327741446d service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:12.198946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:12.200020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:12.200560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:12.201136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] PATH_INFO: `/v3/users/8a246c84d8f444d59c9d5becae78f75a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:12.204402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a246c84d8f444d59c9d5becae78f75a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:12.208185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:12.452861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a246c84d8f444d59c9d5becae78f75a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:12.484753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a246c84d8f444d59c9d5becae78f75a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:12.485573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a246c84d8f444d59c9d5becae78f75a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:12.627824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a246c84d8f444d59c9d5becae78f75a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:12.628481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a246c84d8f444d59c9d5becae78f75a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:12.652510 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1572/3127] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:12 2022] DELETE /identity/v3/users/8a246c84d8f444d59c9d5becae78f75a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:13.036359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:13.058707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe8db2-8d37-4660-952b-b1233305e594 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:13.091113 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:13.153430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:13.154763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:13.155051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:13.155395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] PATH_INFO: `/v3/projects/ccc52d9ecfdf43f58b665d06e1008b52` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:13.157870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc52d9ecfdf43f58b665d06e1008b52)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:13.160283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:13.311221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc52d9ecfdf43f58b665d06e1008b52', 'request_id': 'req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.317967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc52d9ecfdf43f58b665d06e1008b52', 'request_id': 'req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.400562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc52d9ecfdf43f58b665d06e1008b52', 'request_id': 'req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.420024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] The token cache is being invalidate because project ccc52d9ecfdf43f58b665d06e1008b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:13.421378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.422146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.424695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1556/3128] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:13 2022] DELETE /identity/v3/projects/ccc52d9ecfdf43f58b665d06e1008b52 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:13.428721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:13.433063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:13.444449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff88a-4279-4269-920d-9a193331eaee admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:13.453034 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:13.525655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:13.526532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:13.526924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:13.528973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] PATH_INFO: `/v3/users/ff85df41240b436c919d2ada7179e222` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:13.530289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff85df41240b436c919d2ada7179e222)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:13.531670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:13.731789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff85df41240b436c919d2ada7179e222'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.755666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff85df41240b436c919d2ada7179e222'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.757758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff85df41240b436c919d2ada7179e222'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.818293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff85df41240b436c919d2ada7179e222'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.819232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52fe59d2-8e7e-4b07-9418-2a2ee5685b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff85df41240b436c919d2ada7179e222'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:13.845894 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1573/3129] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:13 2022] DELETE /identity/v3/users/ff85df41240b436c919d2ada7179e222 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:14.304283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:14.306089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:14.329048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb94f2-dbd1-4e9e-879a-62a2ffea1269 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:14.479754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:14.480791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:14.481269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:14.481647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] PATH_INFO: `/v3/projects/90adb0e31b8c49358db1ae0ca8ecc95b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:14.483181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90adb0e31b8c49358db1ae0ca8ecc95b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:14.485358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:14.671197 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:14.682230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90adb0e31b8c49358db1ae0ca8ecc95b', 'request_id': 'req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:14.693530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90adb0e31b8c49358db1ae0ca8ecc95b', 'request_id': 'req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:14.776600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90adb0e31b8c49358db1ae0ca8ecc95b', 'request_id': 'req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:14.794025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] The token cache is being invalidate because project 90adb0e31b8c49358db1ae0ca8ecc95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:14.796025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:14.799372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5127b9c-0c9e-42f4-a1e9-ab68a36d4b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:14.801442 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1557/3130] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:14 2022] DELETE /identity/v3/projects/90adb0e31b8c49358db1ae0ca8ecc95b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:14.806778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f423a5-8c7b-4ed7-a554-44218ed35fad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:14.807709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f423a5-8c7b-4ed7-a554-44218ed35fad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:14.808210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f423a5-8c7b-4ed7-a554-44218ed35fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:14.859161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-75f423a5-8c7b-4ed7-a554-44218ed35fad None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:14.863338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-75f423a5-8c7b-4ed7-a554-44218ed35fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:14.990420 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1574/3131] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:14.991289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b4d0-cc5e-4fd1-9e76-c8493c14ae05 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:14.991565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b4d0-cc5e-4fd1-9e76-c8493c14ae05 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:14.991836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b4d0-cc5e-4fd1-9e76-c8493c14ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:15.034093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9104b4d0-cc5e-4fd1-9e76-c8493c14ae05 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:15.037015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9104b4d0-cc5e-4fd1-9e76-c8493c14ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:15.054932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f423a5-8c7b-4ed7-a554-44218ed35fad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:15.065500 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1558/3132] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:15.071443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f423a5-8c7b-4ed7-a554-44218ed35fad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:15.078954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:15.079935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:15.080315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:15.080713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:15.081722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:21:15.082176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:15.085196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:15.123127 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1575/3133] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:21:15.127197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104b4d0-cc5e-4fd1-9e76-c8493c14ae05 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:15.141778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104b4d0-cc5e-4fd1-9e76-c8493c14ae05 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:15.149000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:15.150408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:15.151111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:15.151518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:15.152643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:15.154490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:15.534408 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1559/3134] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:15 2022] POST /identity/v3/projects => generated 393 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:15.539452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:15.552465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4b78-2fc5-4208-b58a-1574acccb445 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:15.598699 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:15.735523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:15.740149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:15.740149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:15.740149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:15.740149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:15.745185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:15.904955 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1576/3135] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:15 2022] POST /identity/v3/users => generated 297 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:15.910076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:15.920342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecefb8-07d1-44e7-a334-9bb2f205ad44 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:15.950861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:15.951697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:15.961785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:15.961785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:15.961785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:15.961785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:16.003782 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1560/3136] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:16.007729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:16.024235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff674-7a53-41fc-a0f0-6f3b47ec49d1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:16.046518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed089ff2-8a72-4793-bf9e-627178d2b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:16.047157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed089ff2-8a72-4793-bf9e-627178d2b024 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:16.047438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed089ff2-8a72-4793-bf9e-627178d2b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:16.047905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed089ff2-8a72-4793-bf9e-627178d2b024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:16.048721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed089ff2-8a72-4793-bf9e-627178d2b024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:16.051015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed089ff2-8a72-4793-bf9e-627178d2b024 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:16.077560 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1577/3137] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:16.082105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:16.101438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae1c71-32be-4be7-a1b5-e767ca398021 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:16.134077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:16.134077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:16.134077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:16.135161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] PATH_INFO: `/v3/projects/115b5540404d47e3b0aadea2ff403128/users/43261fcfdb974c57954dd7885c248c40/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:16.156144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115b5540404d47e3b0aadea2ff403128, user_id=43261fcfdb974c57954dd7885c248c40, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:16.160770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:16.243520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1561/3138] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:16 2022] PUT /identity/v3/projects/115b5540404d47e3b0aadea2ff403128/users/43261fcfdb974c57954dd7885c248c40/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:21:16.254576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a4f9-da60-427e-9861-d3c4921a090d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:16.255098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a4f9-da60-427e-9861-d3c4921a090d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:16.255876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a4f9-da60-427e-9861-d3c4921a090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:16.339514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7193a4f9-da60-427e-9861-d3c4921a090d None None] MFA Rules not processed for user `43261fcfdb974c57954dd7885c248c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:16.342740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7193a4f9-da60-427e-9861-d3c4921a090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:16.531783 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1578/3139] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:16.533082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:16.719702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedd243-f284-451a-ab67-56c214d4af37 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:16.729720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:16.732015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:16.743456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:16.748168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:16.748938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:16.754264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:16.831836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:16.832424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:16.832424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:16.873535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:16.874791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:16.893951 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1562/3140] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:16 2022] POST /identity/v3/projects => generated 395 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:16.899544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:16.990943 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1579/3141] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:17.008368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:17.010213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:17.077123 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:17.088237 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:17.096987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0706f-c7ef-44c4-8fa6-a43e57319a00 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:17.104562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:17.105312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.106730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.107825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.108851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:17.111508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:17.152446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583bb8c-8f71-4ae6-97e4-56dc6a169de1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:17.227757 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1563/3142] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:16 2022] POST /identity/v3/users => generated 304 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:17.231682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:17.248379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466e823-891b-463f-9ded-a7ccb89869e8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:17.258684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:17.258684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.259049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.259569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.269550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:17.270794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd633c-ddf6-4106-b11b-8f9ba82d6c45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:17.271645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd633c-ddf6-4106-b11b-8f9ba82d6c45 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.272142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd633c-ddf6-4106-b11b-8f9ba82d6c45 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.272466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:17.272848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd633c-ddf6-4106-b11b-8f9ba82d6c45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.286709 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1564/3143] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:17.292244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:17.311578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4298a-e2c6-42e8-93d2-ba215655e8e5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:17.320035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:17.321618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.322008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.322789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] PATH_INFO: `/v3/projects/0ed568fd64554344a623ab4aee0b54ee/users/33d98a63108246aa9919a1def91d9ca3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.360192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed568fd64554344a623ab4aee0b54ee, user_id=33d98a63108246aa9919a1def91d9ca3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:17.383218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:17.474873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd633c-ddf6-4106-b11b-8f9ba82d6c45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:17.474873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd633c-ddf6-4106-b11b-8f9ba82d6c45 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:17.482436 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1565/3144] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:17 2022] PUT /identity/v3/projects/0ed568fd64554344a623ab4aee0b54ee/users/33d98a63108246aa9919a1def91d9ca3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:17.489115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:17.525311 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1580/3145] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:21:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:17.597095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.597702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.598225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.668725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] MFA Rules not processed for user `ecb97fa679eb4bf8a41862d3c248a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:17.672209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8dd3c-187d-431d-b8a5-eae8ddc220f2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:17.673569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:17.691614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:17.691614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.691614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.699119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.699119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:17.701419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:17.743288 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1566/3146] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:21:17.748747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:17.773818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928873-5c88-4d7f-9bb8-048c0c3b9459 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:17.788412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7c2f6-12b2-4ee5-8133-717fe993c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:17.788412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7c2f6-12b2-4ee5-8133-717fe993c70a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.788710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7c2f6-12b2-4ee5-8133-717fe993c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.789801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7c2f6-12b2-4ee5-8133-717fe993c70a admin admin] PATH_INFO: `/v3/projects/0ed568fd64554344a623ab4aee0b54ee/users/33d98a63108246aa9919a1def91d9ca3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.796634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7c2f6-12b2-4ee5-8133-717fe993c70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed568fd64554344a623ab4aee0b54ee, user_id=33d98a63108246aa9919a1def91d9ca3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:17.805798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7c2f6-12b2-4ee5-8133-717fe993c70a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:17.830060 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1567/3147] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:17 2022] PUT /identity/v3/projects/0ed568fd64554344a623ab4aee0b54ee/users/33d98a63108246aa9919a1def91d9ca3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:17.838129 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1581/3148] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:17.842947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:17.842947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:17.842947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:17.919310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] MFA Rules not processed for user `33d98a63108246aa9919a1def91d9ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:17.920673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:18.019165 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1568/3149] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:18.226817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:18.228512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:18.256387 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:18.322982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873a4e1-1b60-48c0-b728-be9442a6d024 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:18.431789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:18.432881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:18.433358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:18.433803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:18.459194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:18.463311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:18.503586 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1582/3150] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:19.993193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:19.995305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:20.042048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f6299-56d5-4c12-8750-4d6f1fec7842 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:20.062779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:20.064242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:20.065327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:20.067142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:20.071274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:20.159181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:20.167167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:20.228730 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1569/3151] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:23.319317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:23.321284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:23.448296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b87a6-b010-4f22-b7aa-e7b4384972fc service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:23.460650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:23.462411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:23.462791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:23.475386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] PATH_INFO: `/v3/users/18ea2d1dfc7441d2a2bb7b22c6065605` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:23.490923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ea2d1dfc7441d2a2bb7b22c6065605)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:23.493810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:23.732058 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:23.735220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ea2d1dfc7441d2a2bb7b22c6065605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:23.751794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ea2d1dfc7441d2a2bb7b22c6065605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:23.752651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ea2d1dfc7441d2a2bb7b22c6065605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:23.821838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:23.838591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21481244-b79d-4ecf-a25d-4b42bb2214b3 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:23.849253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:23.850961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:23.851802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:23.852300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:23.866225 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:23.890994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ea2d1dfc7441d2a2bb7b22c6065605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:23.892083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ea2d1dfc7441d2a2bb7b22c6065605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:23.933376 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1583/3152] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:23 2022] DELETE /identity/v3/users/18ea2d1dfc7441d2a2bb7b22c6065605 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:23.998617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:24.000142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:24.024372 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1570/3153] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:21:24.070839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:24.072339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:24.313720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc5cdc-a45d-4dab-9478-969a16459f3a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:24.347285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:24.347994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:24.348210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:24.348482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] PATH_INFO: `/v3/users/43261fcfdb974c57954dd7885c248c40` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:24.352039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=43261fcfdb974c57954dd7885c248c40)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:24.367546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:24.697354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43261fcfdb974c57954dd7885c248c40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:24.708088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43261fcfdb974c57954dd7885c248c40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:24.708911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43261fcfdb974c57954dd7885c248c40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:24.837128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:24.850920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43261fcfdb974c57954dd7885c248c40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:24.852621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90e2aeed-b5c3-41bc-936d-1269d23f11ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43261fcfdb974c57954dd7885c248c40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:24.886529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab190-852b-4f74-a1eb-6020700ea37f service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:24.911839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:24.912509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:24.912779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:24.913052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] PATH_INFO: `/v3/projects/a0556c0544d446a2aa3d54e00b16bab1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:24.922893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0556c0544d446a2aa3d54e00b16bab1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:24.923589 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1584/3154] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:24 2022] DELETE /identity/v3/users/43261fcfdb974c57954dd7885c248c40 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:24.928243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:24.928534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:24.928805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:24.931079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:24.976968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:24.978356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:25.057609 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:25.151939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0556c0544d446a2aa3d54e00b16bab1', 'request_id': 'req-90d04339-2ff8-4915-9835-33097c870f92'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:25.181449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0556c0544d446a2aa3d54e00b16bab1', 'request_id': 'req-90d04339-2ff8-4915-9835-33097c870f92'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:25.181714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1585/3155] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:25.208416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:25.210587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:25.284304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0556c0544d446a2aa3d54e00b16bab1', 'request_id': 'req-90d04339-2ff8-4915-9835-33097c870f92'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:25.305648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] The token cache is being invalidate because project a0556c0544d446a2aa3d54e00b16bab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:25.307121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:25.310862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-90d04339-2ff8-4915-9835-33097c870f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:25.321780 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1571/3156] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:24 2022] DELETE /identity/v3/projects/a0556c0544d446a2aa3d54e00b16bab1 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:21:25.331282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db5cc-9117-466f-afe0-1ffe2087b64e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:25.331757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db5cc-9117-466f-afe0-1ffe2087b64e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:25.332312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db5cc-9117-466f-afe0-1ffe2087b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:25.365819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-554db5cc-9117-466f-afe0-1ffe2087b64e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:25.368401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-554db5cc-9117-466f-afe0-1ffe2087b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:25.432637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d6127-def3-4b5d-af56-f119d69b2769 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:25.556055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1572/3157] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:25.564998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552dcae-8996-464b-9678-8fe85aee47ac None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:25.565793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552dcae-8996-464b-9678-8fe85aee47ac None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:25.567278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552dcae-8996-464b-9678-8fe85aee47ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:25.651019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8552dcae-8996-464b-9678-8fe85aee47ac None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:25.652740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8552dcae-8996-464b-9678-8fe85aee47ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:25.658406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:25.659060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:25.659337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:25.659611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:25.663140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:25.674714 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1573/3158] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:25.691792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552dcae-8996-464b-9678-8fe85aee47ac None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:25.727038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:25.731061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:25.735974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552dcae-8996-464b-9678-8fe85aee47ac None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:25.754704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:25.757513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:25.757800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:25.758105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:25.758784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:21:25.759087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:25.765579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:25.766143 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1586/3159] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:21:25.817069 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1574/3160] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:21:25.817529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:25.829936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971ef45-4c8b-4e34-be66-f8902a03eec5 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:25.843378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:25.844090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:25.844426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:25.851908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:25.851908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:25.851908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:26.060967 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1587/3161] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:25 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:26.069627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:26.079453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45461ad-e766-46e0-9da4-0fef90f66581 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:26.094435 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:26.153164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:26.154088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.154511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.154972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.155855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:26.161331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:26.258897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:26.259121 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1575/3162] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:26 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:26.271803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227a7e-051e-4270-9ceb-899910e55357 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:26.282869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:26.282869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.282869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.282869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.283365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:26.283365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:26.295669 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1588/3163] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:21:26.299481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:26.313079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fe668-678c-456d-8cc5-3990afdde911 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:26.318455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dec8a-3b31-4f4c-ad5c-1198588ae0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:26.319222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dec8a-3b31-4f4c-ad5c-1198588ae0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.319685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dec8a-3b31-4f4c-ad5c-1198588ae0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.320004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dec8a-3b31-4f4c-ad5c-1198588ae0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.320760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dec8a-3b31-4f4c-ad5c-1198588ae0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:26.322630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dec8a-3b31-4f4c-ad5c-1198588ae0e2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:26.337052 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1576/3164] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:26.341602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:26.360450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f26b5c-f51f-4cab-b2fc-976635f320b4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:26.366336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:26.367874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.368250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.368621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] PATH_INFO: `/v3/projects/4ac1b744484c41c88314112b572ccac1/users/a3bede03a6c44c3cbe86f7a06601d115/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.388216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac1b744484c41c88314112b572ccac1, user_id=a3bede03a6c44c3cbe86f7a06601d115, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:26.391535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:26.483783 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1589/3165] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:26 2022] PUT /identity/v3/projects/4ac1b744484c41c88314112b572ccac1/users/a3bede03a6c44c3cbe86f7a06601d115/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:26.488819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.489388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.490159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.527566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:26.527566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:26.533442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:26.536135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:26.622608 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:26.642250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775aed5-c2af-47eb-89f3-1db4596930f3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:26.646566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:26.647244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.647543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.647810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] PATH_INFO: `/v3/projects/115b5540404d47e3b0aadea2ff403128` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.648961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115b5540404d47e3b0aadea2ff403128)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:26.650130 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1577/3166] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:26.650894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:26.654819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:26.656424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:26.717013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d551587-25f1-4215-a11f-fc4735d19e12 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:26.720875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:26.721536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.721837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.722126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.734969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:26.738565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:26.746750 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1578/3167] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:21:26.770181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115b5540404d47e3b0aadea2ff403128', 'request_id': 'req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:26.776290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115b5540404d47e3b0aadea2ff403128', 'request_id': 'req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:26.850367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115b5540404d47e3b0aadea2ff403128', 'request_id': 'req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:26.862647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] The token cache is being invalidate because project 115b5540404d47e3b0aadea2ff403128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:26.862994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:26.863655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c72cdb9-4e51-4e66-a5a8-65333891bfc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:26.865543 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1590/3168] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:26 2022] DELETE /identity/v3/projects/115b5540404d47e3b0aadea2ff403128 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:26.869424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:26.879680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924512d-1017-4ad5-a3d2-96ad3dd5cbe6 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:26.915797 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:26.944530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:26.945177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:26.945452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:26.945745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] PATH_INFO: `/v3/users/33d98a63108246aa9919a1def91d9ca3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:26.946919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d98a63108246aa9919a1def91d9ca3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:26.948821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:27.186027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d98a63108246aa9919a1def91d9ca3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:27.202388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d98a63108246aa9919a1def91d9ca3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:27.203274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d98a63108246aa9919a1def91d9ca3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:27.316874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d98a63108246aa9919a1def91d9ca3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:27.318500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f07d90-7542-4ea2-950a-2fadafcb5869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d98a63108246aa9919a1def91d9ca3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:27.347201 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1579/3169] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:26 2022] DELETE /identity/v3/users/33d98a63108246aa9919a1def91d9ca3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:27.428730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:27.429684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:27.430638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:27.479573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] MFA Rules not processed for user `69bd8aff49524f19ae950f92d46bd44b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:27.493989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:27.646626 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1591/3170] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:27.663671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e40c1-c528-4eb9-ae8a-d369dc6cfb90 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:27.663671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e40c1-c528-4eb9-ae8a-d369dc6cfb90 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:27.663671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e40c1-c528-4eb9-ae8a-d369dc6cfb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:27.702255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-417e40c1-c528-4eb9-ae8a-d369dc6cfb90 None None] MFA Rules not processed for user `69bd8aff49524f19ae950f92d46bd44b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:27.705307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-417e40c1-c528-4eb9-ae8a-d369dc6cfb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:27.725806 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1580/3171] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:28.180196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:28.181631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:28.302024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44ad4f-87ed-4ed9-9034-5e3bf6cf9921 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:28.325606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:28.327122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:28.327413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:28.327675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] PATH_INFO: `/v3/projects/0ed568fd64554344a623ab4aee0b54ee` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:28.333344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed568fd64554344a623ab4aee0b54ee)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:28.335490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:28.389231 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:28.503803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed568fd64554344a623ab4aee0b54ee', 'request_id': 'req-7a6d53fe-5728-4085-883c-aebf18f73b6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:28.522207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed568fd64554344a623ab4aee0b54ee', 'request_id': 'req-7a6d53fe-5728-4085-883c-aebf18f73b6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:28.587479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed568fd64554344a623ab4aee0b54ee', 'request_id': 'req-7a6d53fe-5728-4085-883c-aebf18f73b6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:28.606295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] The token cache is being invalidate because project 0ed568fd64554344a623ab4aee0b54ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:28.607102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:28.608922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a6d53fe-5728-4085-883c-aebf18f73b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:28.613447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1592/3172] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:28 2022] DELETE /identity/v3/projects/0ed568fd64554344a623ab4aee0b54ee => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:28.618265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919220-52dd-4339-b85a-6b29cbb729fb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:28.619165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919220-52dd-4339-b85a-6b29cbb729fb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:28.619601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919220-52dd-4339-b85a-6b29cbb729fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:28.666365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a2919220-52dd-4339-b85a-6b29cbb729fb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:28.670332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a2919220-52dd-4339-b85a-6b29cbb729fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:28.845861 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1581/3173] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:28.857568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea0a2-2c4d-4208-b4ac-0ec11db7c9bb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:28.860491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea0a2-2c4d-4208-b4ac-0ec11db7c9bb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:28.861174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aea0a2-2c4d-4208-b4ac-0ec11db7c9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:28.912129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-25aea0a2-2c4d-4208-b4ac-0ec11db7c9bb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:28.914401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-25aea0a2-2c4d-4208-b4ac-0ec11db7c9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:28.937734 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1593/3174] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:28.942114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919220-52dd-4339-b85a-6b29cbb729fb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:28.966577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919220-52dd-4339-b85a-6b29cbb729fb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:28.978629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:28.979449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:28.979823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:28.980803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:28.990600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:21:28.990600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:28.990600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:29.000652 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1582/3175] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:21:29.005607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aea0a2-2c4d-4208-b4ac-0ec11db7c9bb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:29.020430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aea0a2-2c4d-4208-b4ac-0ec11db7c9bb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:29.029723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:29.030435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:29.030715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:29.030983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:29.031618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:29.034338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:29.126170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1594/3176] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:29 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:29.127306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:29.142592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d588d-cfc3-4c27-bc9e-1f27b9fe464d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:29.189140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:29.190955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:29.267675 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:29.338747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c885cf-a893-4ddc-9708-67439926fca0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:29.351755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:29.351755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:29.351755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:29.351755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:29.352495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:29.352626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:29.352626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:29.352626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:29.352626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:29.353152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:29.353290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:29.367772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:29.369568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:29.406452 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1595/3177] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:21:30.383507 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1583/3178] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:29 2022] POST /identity/v3/users => generated 302 bytes in 1256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:21:30.400303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:30.412754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8718f4b-8016-42cc-bd61-8f08d699233c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:30.419648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:30.427354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:30.427354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:30.427354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:30.427354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:30.427354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:30.438701 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1596/3179] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:30.443131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:30.453600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94e433-8006-423f-a7f5-5b3665a2d428 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:30.458863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a34054-7f20-4f41-874e-195da536d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:30.460007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34054-7f20-4f41-874e-195da536d718 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:30.460007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34054-7f20-4f41-874e-195da536d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:30.460207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34054-7f20-4f41-874e-195da536d718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:30.460813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a34054-7f20-4f41-874e-195da536d718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:30.462484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a34054-7f20-4f41-874e-195da536d718 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:30.484401 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1584/3180] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:30.487316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:30.503698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffce0f-73b8-4f7d-b81c-b2070110175b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:30.512449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:30.513460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:30.514008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:30.514515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] PATH_INFO: `/v3/projects/5bc2aee3c7b442f7acaac4dbba594cb2/users/0a03e43dee164fbfae007c1be58b0ace/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:30.543238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc2aee3c7b442f7acaac4dbba594cb2, user_id=0a03e43dee164fbfae007c1be58b0ace, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:30.546332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:30.655835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1597/3181] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:30 2022] PUT /identity/v3/projects/5bc2aee3c7b442f7acaac4dbba594cb2/users/0a03e43dee164fbfae007c1be58b0ace/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:30.668743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db77a6-7d67-4db1-add5-24a08ad444fe None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:30.669086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db77a6-7d67-4db1-add5-24a08ad444fe None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:30.669279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db77a6-7d67-4db1-add5-24a08ad444fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:30.713097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a3db77a6-7d67-4db1-add5-24a08ad444fe None None] MFA Rules not processed for user `0a03e43dee164fbfae007c1be58b0ace`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:30.714399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3db77a6-7d67-4db1-add5-24a08ad444fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:30.833517 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1585/3182] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:30.834785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:30.904438 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:30.920517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41d48a-e8d4-469e-aae3-9e5182005ccc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:30.925584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:30.930268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:30.930268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:30.930268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:30.930268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:30.930268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:31.057631 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1598/3183] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:30 2022] POST /identity/v3/projects => generated 403 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:21:31.062389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db77a6-7d67-4db1-add5-24a08ad444fe None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:31.075853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db77a6-7d67-4db1-add5-24a08ad444fe None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:31.145726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:31.146798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:31.147073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:31.147430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:31.148175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:31.151119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:31.309650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1586/3184] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:31 2022] POST /identity/v3/users => generated 308 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:21:31.324734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:31.330343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342bc1e-986f-41ff-baf5-ec3df049dc14 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:31.348238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:31.354167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:31.354167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:31.354167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:31.354167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:31.354167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:31.377423 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1599/3185] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:21:31.378722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:31.391386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c36449-a567-4601-89d8-03a235358f63 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:31.422053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:31.422053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:31.422053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:31.422053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] PATH_INFO: `/v3/projects/0551a7e254a2471ab15d5f12cdd99a00/users/78a3374259e04cffa93ed7a62b7dcf64/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:31.456714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0551a7e254a2471ab15d5f12cdd99a00, user_id=78a3374259e04cffa93ed7a62b7dcf64, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:31.459838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:31.560558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1587/3186] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:31 2022] PUT /identity/v3/projects/0551a7e254a2471ab15d5f12cdd99a00/users/78a3374259e04cffa93ed7a62b7dcf64/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:31.560872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:31.576705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822ab9-3bec-4a40-8c1e-42c61a372d34 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:31.682658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93565e8-2de7-4aa6-9210-edad1aed95ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:31.684156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93565e8-2de7-4aa6-9210-edad1aed95ae admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:31.684497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93565e8-2de7-4aa6-9210-edad1aed95ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:31.684940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93565e8-2de7-4aa6-9210-edad1aed95ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:31.685719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93565e8-2de7-4aa6-9210-edad1aed95ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:31.687598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93565e8-2de7-4aa6-9210-edad1aed95ae admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:31.711013 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1600/3187] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:31.715727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:31.743875 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:31.750288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697f146-8539-4b6a-8380-46efbd7193fe admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:31.757407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c979b-be6e-42c8-9117-250708a1e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:31.758349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c979b-be6e-42c8-9117-250708a1e554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:31.758735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c979b-be6e-42c8-9117-250708a1e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:31.759558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c979b-be6e-42c8-9117-250708a1e554 admin admin] PATH_INFO: `/v3/projects/0551a7e254a2471ab15d5f12cdd99a00/users/78a3374259e04cffa93ed7a62b7dcf64/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:31.762616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c979b-be6e-42c8-9117-250708a1e554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0551a7e254a2471ab15d5f12cdd99a00, user_id=78a3374259e04cffa93ed7a62b7dcf64, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:31.766231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c979b-be6e-42c8-9117-250708a1e554 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:31.790534 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1588/3188] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:31 2022] PUT /identity/v3/projects/0551a7e254a2471ab15d5f12cdd99a00/users/78a3374259e04cffa93ed7a62b7dcf64/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:31.801268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:31.802988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:31.803643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:31.882887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] MFA Rules not processed for user `78a3374259e04cffa93ed7a62b7dcf64`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:31.895380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:32.055265 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1601/3189] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:32.715306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:32.720167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:32.720167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:32.766146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:32.775754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:32.994508 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1589/3190] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:33.011128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:33.013221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:33.130800 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:33.187122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae7c4-e555-4dc3-b48f-4e022ca32c6f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:33.217867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:33.220250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:33.222676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:33.223109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:33.286506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:33.289741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:33.319554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1602/3191] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:34.188188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:34.189362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:34.316794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6bec3-9f47-488c-8c87-b0aea5c0b0bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:34.335360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa63653-87a3-4c8f-8023-d9d1b900dc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:34.335360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa63653-87a3-4c8f-8023-d9d1b900dc4e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:34.335360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa63653-87a3-4c8f-8023-d9d1b900dc4e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:34.335972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa63653-87a3-4c8f-8023-d9d1b900dc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:34.369663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa63653-87a3-4c8f-8023-d9d1b900dc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:34.391659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa63653-87a3-4c8f-8023-d9d1b900dc4e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:34.439131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1590/3192] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:36.636062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:36.664886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6ba9e-86ac-4761-9a49-eb6c1f1e4bcf service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:36.676506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad30f5-0c8d-429f-992c-de3448e3384f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:36.677294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad30f5-0c8d-429f-992c-de3448e3384f service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:36.677661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad30f5-0c8d-429f-992c-de3448e3384f service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:36.680681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad30f5-0c8d-429f-992c-de3448e3384f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:36.686210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0dad30f5-0c8d-429f-992c-de3448e3384f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:36.712308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad30f5-0c8d-429f-992c-de3448e3384f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:36.714189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad30f5-0c8d-429f-992c-de3448e3384f service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:36.727928 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1603/3193] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:37.385938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021260b-9dbc-4f46-a316-8bc656909595 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:37.387369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021260b-9dbc-4f46-a316-8bc656909595 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:37.390776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021260b-9dbc-4f46-a316-8bc656909595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:37.456879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2021260b-9dbc-4f46-a316-8bc656909595 None None] MFA Rules not processed for user `a3bede03a6c44c3cbe86f7a06601d115`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:37.461830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2021260b-9dbc-4f46-a316-8bc656909595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:37.635132 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1591/3194] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:37.651347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960ea3-ae31-472f-b787-d87cb95ea528 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:37.652442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960ea3-ae31-472f-b787-d87cb95ea528 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:37.652536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960ea3-ae31-472f-b787-d87cb95ea528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:37.705252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4c960ea3-ae31-472f-b787-d87cb95ea528 None None] MFA Rules not processed for user `a3bede03a6c44c3cbe86f7a06601d115`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:37.705252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c960ea3-ae31-472f-b787-d87cb95ea528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:37.727505 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1604/3195] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:38.285630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021260b-9dbc-4f46-a316-8bc656909595 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:38.303611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021260b-9dbc-4f46-a316-8bc656909595 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:38.312317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:38.313409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:38.314410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:38.314977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:38.324901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:38.327893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:38.332494 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:38.346017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1592/3196] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:39.493595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960ea3-ae31-472f-b787-d87cb95ea528 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:39.618200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960ea3-ae31-472f-b787-d87cb95ea528 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:39.635328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:39.636811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:39.637272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:39.637707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:39.640064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:39.659168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:39.660892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:39.682305 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1605/3197] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:42.235280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:42.281897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d192d-cdc0-4410-9617-a518ec51d8fa service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:42.309650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:42.312030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:42.312482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:42.314052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:42.334496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:42.596084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:42.607934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:42.642443 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1593/3198] 10.222.0.42 () {60 vars in 1396 bytes} [Sun Oct 23 01:21:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:43.029796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:43.055237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df8fad-4d17-4db9-b6f2-60aec54396d2 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:43.067628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea78b5-6a3a-4675-92e8-7a5854aaf5c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:43.068794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea78b5-6a3a-4675-92e8-7a5854aaf5c2 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:43.069233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea78b5-6a3a-4675-92e8-7a5854aaf5c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:43.069969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea78b5-6a3a-4675-92e8-7a5854aaf5c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:43.201602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea78b5-6a3a-4675-92e8-7a5854aaf5c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:43.212402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea78b5-6a3a-4675-92e8-7a5854aaf5c2 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:43.247332 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1606/3199] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:43 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:43.287594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:43.489425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9752-5df1-477b-91ce-153eaedf24e6 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:43.519350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:43.527544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:43.527903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:43.528107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] PATH_INFO: `/v3/users/0a03e43dee164fbfae007c1be58b0ace` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:43.534927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a03e43dee164fbfae007c1be58b0ace)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:43.543727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:43.853348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a03e43dee164fbfae007c1be58b0ace'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:43.900536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a03e43dee164fbfae007c1be58b0ace'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:43.907567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a03e43dee164fbfae007c1be58b0ace'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:44.050365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a03e43dee164fbfae007c1be58b0ace'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:44.051078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a03e43dee164fbfae007c1be58b0ace'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:44.096123 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1594/3200] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:43 2022] DELETE /identity/v3/users/0a03e43dee164fbfae007c1be58b0ace => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:44.098322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:44.099232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:44.099710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:44.151021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:44.154798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:44.284237 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:44.299190 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1607/3201] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:44.372207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:44.378426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:44.417188 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:44.549961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800c1d5-c079-44ed-aea9-a547cfedab1b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:44.574421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c067187-de5d-4a8d-ba82-2f701725bd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:44.575362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c067187-de5d-4a8d-ba82-2f701725bd82 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:44.576241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c067187-de5d-4a8d-ba82-2f701725bd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:44.576513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c067187-de5d-4a8d-ba82-2f701725bd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:44.617610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c067187-de5d-4a8d-ba82-2f701725bd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:44.623324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c067187-de5d-4a8d-ba82-2f701725bd82 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:44.688832 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1595/3202] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:45.267195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:45.268898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:45.295646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fac5ea-3516-4e0d-85c0-cc8d15c163c2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:45.324403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:45.328512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:45.328815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:45.329095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] PATH_INFO: `/v3/users/e26043c04dc34c7299990c1c405c53a6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:45.340085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26043c04dc34c7299990c1c405c53a6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:45.349642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:45.706173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26043c04dc34c7299990c1c405c53a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:45.722646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26043c04dc34c7299990c1c405c53a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:45.727893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26043c04dc34c7299990c1c405c53a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:45.824171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26043c04dc34c7299990c1c405c53a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:45.825054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae004e6-0725-45a9-ae45-792c1151b0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26043c04dc34c7299990c1c405c53a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:45.866061 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1608/3203] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:45 2022] DELETE /identity/v3/users/e26043c04dc34c7299990c1c405c53a6 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:45.867479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:45.868003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:45.868101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:45.944872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:45.946384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:46.357102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1596/3204] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:46.427827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:46.428625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:46.428725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:46.500294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:46.511585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:46.512891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:46.514810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:46.719953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d66a4-b833-40d2-b4e2-0c7b6a1ba553 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:46.747866 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1609/3205] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:46.753824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:46.754577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:46.754843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:46.759958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:46.812105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:46.813812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:46.818422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:46.821284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:46.870883 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1597/3206] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:47.059124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dae7b-1bb7-40a7-b269-b436cdb83d1d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:47.071113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:47.071866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:47.072255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:47.072624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:47.091774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:47.096257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:47.125283 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1610/3207] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:21:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:21:48.237711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:48.240793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:48.319373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705908c-2714-4100-9464-2088e0c045a7 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:48.360512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:48.360512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:48.360512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:48.360512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] PATH_INFO: `/v3/projects/5bc2aee3c7b442f7acaac4dbba594cb2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:48.360990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc2aee3c7b442f7acaac4dbba594cb2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:48.368492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:48.566024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc2aee3c7b442f7acaac4dbba594cb2', 'request_id': 'req-73243f65-1b47-4497-bd0d-b550617a5b0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:48.585024 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:48.586223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc2aee3c7b442f7acaac4dbba594cb2', 'request_id': 'req-73243f65-1b47-4497-bd0d-b550617a5b0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:48.714826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc2aee3c7b442f7acaac4dbba594cb2', 'request_id': 'req-73243f65-1b47-4497-bd0d-b550617a5b0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:48.747926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] The token cache is being invalidate because project 5bc2aee3c7b442f7acaac4dbba594cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:48.751411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:48.751411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:48.756297 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1598/3208] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:48 2022] DELETE /identity/v3/projects/5bc2aee3c7b442f7acaac4dbba594cb2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:21:48.760915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:48.767492 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:48.783755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7b79b-6901-4152-b456-742380997bc4 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:48.950841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:48.951737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:48.953992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:48.954354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] PATH_INFO: `/v3/users/78a3374259e04cffa93ed7a62b7dcf64` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:48.956165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a3374259e04cffa93ed7a62b7dcf64)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:48.959463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:49.294709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a3374259e04cffa93ed7a62b7dcf64'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:49.375717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a3374259e04cffa93ed7a62b7dcf64'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:49.378429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a3374259e04cffa93ed7a62b7dcf64'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:49.484664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a3374259e04cffa93ed7a62b7dcf64'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:49.485378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a3374259e04cffa93ed7a62b7dcf64'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:49.562253 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1611/3209] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:48 2022] DELETE /identity/v3/users/78a3374259e04cffa93ed7a62b7dcf64 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:50.278661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:50.288179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:50.306823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73243f65-1b47-4497-bd0d-b550617a5b0f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:50.399062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:50.400199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:50.400631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:50.401080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] PATH_INFO: `/v3/projects/f211c102b8d3427d8884e2790b264dae` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:50.403432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f211c102b8d3427d8884e2790b264dae)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:50.405513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:50.545164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f211c102b8d3427d8884e2790b264dae', 'request_id': 'req-42a480e8-1ee6-4a80-8a3e-075fc949aebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:50.558777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f211c102b8d3427d8884e2790b264dae', 'request_id': 'req-42a480e8-1ee6-4a80-8a3e-075fc949aebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:50.634636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f211c102b8d3427d8884e2790b264dae', 'request_id': 'req-42a480e8-1ee6-4a80-8a3e-075fc949aebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:50.650842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] The token cache is being invalidate because project f211c102b8d3427d8884e2790b264dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:50.652011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:50.652779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:50.657576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1599/3210] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:50 2022] DELETE /identity/v3/projects/f211c102b8d3427d8884e2790b264dae => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:50.659008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:50.660805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:50.693580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee9417-5d2e-48da-aea1-c801a59ca642 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:50.889832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:50.891858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:50.892403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:50.892860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] PATH_INFO: `/v3/users/67d9cc0b646749c299669d9e6868fa8a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:50.894467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d9cc0b646749c299669d9e6868fa8a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:50.903461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:50.950701 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:51.139311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d9cc0b646749c299669d9e6868fa8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:51.159962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d9cc0b646749c299669d9e6868fa8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:51.161335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d9cc0b646749c299669d9e6868fa8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:51.273640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d9cc0b646749c299669d9e6868fa8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:51.275905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99c06c71-8570-4b1c-8a8a-f7dcbcedb077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d9cc0b646749c299669d9e6868fa8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:51.355369 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1612/3211] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:50 2022] DELETE /identity/v3/users/67d9cc0b646749c299669d9e6868fa8a => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:51.819917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:51.821739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:51.852029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a480e8-1ee6-4a80-8a3e-075fc949aebd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:52.009728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:52.011168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:52.015248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:52.015248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] PATH_INFO: `/v3/projects/0551a7e254a2471ab15d5f12cdd99a00` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:52.018402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0551a7e254a2471ab15d5f12cdd99a00)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:52.021869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:52.078364 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:52.218661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0551a7e254a2471ab15d5f12cdd99a00', 'request_id': 'req-7d8532d0-1215-4cff-9905-e9e040b3cb88'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:52.234372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0551a7e254a2471ab15d5f12cdd99a00', 'request_id': 'req-7d8532d0-1215-4cff-9905-e9e040b3cb88'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:52.347241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0551a7e254a2471ab15d5f12cdd99a00', 'request_id': 'req-7d8532d0-1215-4cff-9905-e9e040b3cb88'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:52.376364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] The token cache is being invalidate because project 0551a7e254a2471ab15d5f12cdd99a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:52.376848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:52.380551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d8532d0-1215-4cff-9905-e9e040b3cb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:52.382253 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1600/3212] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:51 2022] DELETE /identity/v3/projects/0551a7e254a2471ab15d5f12cdd99a00 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:52.390649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29bfc-373c-44a9-b7c2-4d5ec675b303 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:52.391621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29bfc-373c-44a9-b7c2-4d5ec675b303 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:52.392111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29bfc-373c-44a9-b7c2-4d5ec675b303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:52.440048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cdf29bfc-373c-44a9-b7c2-4d5ec675b303 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:52.448671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cdf29bfc-373c-44a9-b7c2-4d5ec675b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:52.597750 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1613/3213] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:52.607596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88092e-8e52-458b-82cf-b9d78f95d94c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:52.607871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88092e-8e52-458b-82cf-b9d78f95d94c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:52.608149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88092e-8e52-458b-82cf-b9d78f95d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:52.645964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7f88092e-8e52-458b-82cf-b9d78f95d94c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:52.647259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7f88092e-8e52-458b-82cf-b9d78f95d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:52.670600 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1601/3214] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:52.670949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29bfc-373c-44a9-b7c2-4d5ec675b303 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:52.687055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29bfc-373c-44a9-b7c2-4d5ec675b303 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:52.698042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:52.704846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:52.704846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:52.704846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:52.704846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:21:52.704846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:52.708608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:52.737746 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1614/3215] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:21:52.742340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88092e-8e52-458b-82cf-b9d78f95d94c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:52.759824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88092e-8e52-458b-82cf-b9d78f95d94c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:52.768900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:52.769609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:52.769958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:52.770431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:52.771113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:52.773346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:52.920649 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1602/3216] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:52 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:52.925268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:52.941122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f9c3b-6285-4afa-8501-dcb2f7a6570d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:53.067556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:53.068420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:53.068882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:53.069245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:53.070394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:53.072535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:53.204926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1615/3217] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:52 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:21:53.210554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:53.231381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734ad8a-000e-4976-8001-9484de040dc0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:53.242217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:53.243244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:53.244000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:53.244523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:53.246106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:53.248788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:53.275377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:53.275759 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1603/3218] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:53.296937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c525b-c435-4356-84c5-0485a527dcc5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:53.308176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778331c-d5a3-4522-a9a8-830ffba2efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:53.308783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778331c-d5a3-4522-a9a8-830ffba2efb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:53.309062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778331c-d5a3-4522-a9a8-830ffba2efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:53.309338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778331c-d5a3-4522-a9a8-830ffba2efb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:53.310137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778331c-d5a3-4522-a9a8-830ffba2efb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:53.318855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778331c-d5a3-4522-a9a8-830ffba2efb3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:53.344547 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1616/3219] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:53.345849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:53.359330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9e1d4-89e7-4564-8dfd-67e496380b26 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:53.376497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:53.377369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:53.377720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:53.378174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] PATH_INFO: `/v3/projects/8525dcc00e844959a1527424291a3149/users/0501ceda4e8140e09fb4e94552487cc3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:53.419471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8525dcc00e844959a1527424291a3149, user_id=0501ceda4e8140e09fb4e94552487cc3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:53.425375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:53.531659 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1604/3220] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:53 2022] PUT /identity/v3/projects/8525dcc00e844959a1527424291a3149/users/0501ceda4e8140e09fb4e94552487cc3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:53.536929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:53.537376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:53.537646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:53.559835 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:53.569353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:53.571237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:53.667578 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1617/3221] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:53.769035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:53.771100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:53.879876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aae44-f676-48c2-9d56-3bc2240ac10d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:53.886810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97bd0e-b904-4d70-99ef-70629d4a5b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:53.887860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97bd0e-b904-4d70-99ef-70629d4a5b61 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:53.890754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97bd0e-b904-4d70-99ef-70629d4a5b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:53.890754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97bd0e-b904-4d70-99ef-70629d4a5b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:53.902853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97bd0e-b904-4d70-99ef-70629d4a5b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:53.906941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97bd0e-b904-4d70-99ef-70629d4a5b61 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:53.920555 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1605/3222] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:54.324947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:54.326146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:54.351615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb35bce-e4f4-47ff-86ec-80e2c0032656 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:54.356606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:54.357271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:54.357551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:54.357825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] PATH_INFO: `/v3/projects/d9363f56b2a94933b7fa59270e1e02e4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:54.366860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9363f56b2a94933b7fa59270e1e02e4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:54.368953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:54.559285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9363f56b2a94933b7fa59270e1e02e4', 'request_id': 'req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:54.566462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9363f56b2a94933b7fa59270e1e02e4', 'request_id': 'req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:54.655894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9363f56b2a94933b7fa59270e1e02e4', 'request_id': 'req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:54.688394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] The token cache is being invalidate because project d9363f56b2a94933b7fa59270e1e02e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:54.689029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:54.689904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:54.691767 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1618/3223] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:54 2022] DELETE /identity/v3/projects/d9363f56b2a94933b7fa59270e1e02e4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:54.697198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a63a1-d8c0-454f-a688-1465bb115baa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:54.698740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a63a1-d8c0-454f-a688-1465bb115baa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:54.699262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a63a1-d8c0-454f-a688-1465bb115baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:54.734106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:54.735666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:54.739450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1a0a63a1-d8c0-454f-a688-1465bb115baa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:54.757588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a0a63a1-d8c0-454f-a688-1465bb115baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:54.852701 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:54.878231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6b2ff-5567-4646-a604-9a8eae9c9fbd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:54.883492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:54.884241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:54.884589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:54.884933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] PATH_INFO: `/v3/users/b74cdbbd7765495db29eb0428fadc992` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:54.887365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74cdbbd7765495db29eb0428fadc992)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:54.889647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:54.904256 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1606/3224] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:54.907207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e36ba-d3c3-469a-8b05-233d4f274ae2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:54.908206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e36ba-d3c3-469a-8b05-233d4f274ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:54.908485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e36ba-d3c3-469a-8b05-233d4f274ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:54.957698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9a7e36ba-d3c3-469a-8b05-233d4f274ae2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:54.959176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9a7e36ba-d3c3-469a-8b05-233d4f274ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:54.973126 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1607/3225] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:54.974275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e36ba-d3c3-469a-8b05-233d4f274ae2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:54.994550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e36ba-d3c3-469a-8b05-233d4f274ae2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.002525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.003219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.003732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.004067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.004856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:21:55.005228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.006922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.029526 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1608/3226] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:21:55.030657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:55.042797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05349117-f084-4ce9-9f9f-8c4e5af18120 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.048784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.049512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.049889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.050492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.051037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.053845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.097281 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:55.114353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74cdbbd7765495db29eb0428fadc992'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:55.145655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74cdbbd7765495db29eb0428fadc992'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:55.150371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74cdbbd7765495db29eb0428fadc992'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:55.195578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1609/3227] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:55 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:55.195578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:55.195578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:55.274460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74cdbbd7765495db29eb0428fadc992'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:55.276418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74cdbbd7765495db29eb0428fadc992'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:55.322027 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1619/3228] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:54 2022] DELETE /identity/v3/users/b74cdbbd7765495db29eb0428fadc992 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:21:55.322258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:55.327176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:55.329131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92844ba0-186f-4094-b664-7d334b1ebb44 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.513491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.513923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.514224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.514494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.525879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:55.540431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee8987-ba88-4239-9bb0-44b53a763082 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.540431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.540431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.540431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.540741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.540741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.543595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.552808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.555270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.568157 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1610/3229] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:55.568859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:55.570339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:55.585917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae15f12-c073-43b9-b1a7-07891d039df6 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.593033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.593933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.597433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.597433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] PATH_INFO: `/v3/users/3838dd33052740fa88b9cf2888c208ff` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.597433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3838dd33052740fa88b9cf2888c208ff)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.598200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.676763 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1620/3230] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:55 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:55.677449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:55.696474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906abd94-c353-4f5f-b50f-518128aff099 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.710820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.711679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.711961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.712229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.712881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.715027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.738918 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1621/3231] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:21:55.748419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:55.762321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feac8e-28ec-4368-b278-063f6ebbb0e3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.769483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.770412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.770918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.771419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.772270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.775072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.797247 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1622/3232] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:55.801863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:55.823831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ada1e-6f94-41dd-a2ab-0454152e9f84 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:55.831839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6d9ce-ee83-476d-9a6d-2ef04dcabc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:55.833596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d9ce-ee83-476d-9a6d-2ef04dcabc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:55.836841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d9ce-ee83-476d-9a6d-2ef04dcabc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:55.836841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d9ce-ee83-476d-9a6d-2ef04dcabc17 admin admin] PATH_INFO: `/v3/projects/0a369d45e4804ffca2e89cb72f447a82/users/60276a4031ee45ffa651b5467a62a81b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:55.857194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6d9ce-ee83-476d-9a6d-2ef04dcabc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a369d45e4804ffca2e89cb72f447a82, user_id=60276a4031ee45ffa651b5467a62a81b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:55.864098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6d9ce-ee83-476d-9a6d-2ef04dcabc17 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:55.886526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3838dd33052740fa88b9cf2888c208ff'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:55.899417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3838dd33052740fa88b9cf2888c208ff'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:55.900597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3838dd33052740fa88b9cf2888c208ff'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.026569 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1623/3233] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:55 2022] PUT /identity/v3/projects/0a369d45e4804ffca2e89cb72f447a82/users/60276a4031ee45ffa651b5467a62a81b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:56.028635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:56.029006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:56.029405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:56.051090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3838dd33052740fa88b9cf2888c208ff'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.051973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3838dd33052740fa88b9cf2888c208ff'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.077485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:56.082171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:56.098341 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1611/3234] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:55 2022] DELETE /identity/v3/users/3838dd33052740fa88b9cf2888c208ff => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:56.173184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:56.175231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:56.206718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1624/3235] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:56.266586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:56.266586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:56.287683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35907f-0691-4800-b573-94c1c0d94f9d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:56.295481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:56.299529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:56.300040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:56.300469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] PATH_INFO: `/v3/projects/fee2e22f48754a4aa47426a27bebf68b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:56.301883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee2e22f48754a4aa47426a27bebf68b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:56.304894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:56.374479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e117-cc15-43e9-854d-4843609ae40d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:56.452204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb09c3-5972-4b56-ba45-caa0653dd96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:56.483037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb09c3-5972-4b56-ba45-caa0653dd96e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:56.483630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb09c3-5972-4b56-ba45-caa0653dd96e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:56.484529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb09c3-5972-4b56-ba45-caa0653dd96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:56.501451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee2e22f48754a4aa47426a27bebf68b', 'request_id': 'req-839a21b3-6a53-4e83-90ec-120ec2ef8b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.508624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee2e22f48754a4aa47426a27bebf68b', 'request_id': 'req-839a21b3-6a53-4e83-90ec-120ec2ef8b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.521189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb09c3-5972-4b56-ba45-caa0653dd96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:56.523179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb09c3-5972-4b56-ba45-caa0653dd96e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:56.535623 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1625/3236] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:56.620822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee2e22f48754a4aa47426a27bebf68b', 'request_id': 'req-839a21b3-6a53-4e83-90ec-120ec2ef8b23'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.664020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] The token cache is being invalidate because project fee2e22f48754a4aa47426a27bebf68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:56.664204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.665151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839a21b3-6a53-4e83-90ec-120ec2ef8b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:56.677851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7377-5f64-42fa-8d7f-cf8d71990baa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:56.679622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7377-5f64-42fa-8d7f-cf8d71990baa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:56.679622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7377-5f64-42fa-8d7f-cf8d71990baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:56.689072 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1612/3237] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:56 2022] DELETE /identity/v3/projects/fee2e22f48754a4aa47426a27bebf68b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:56.729846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-975e7377-5f64-42fa-8d7f-cf8d71990baa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:56.731107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-975e7377-5f64-42fa-8d7f-cf8d71990baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:56.883494 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1626/3238] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:56.892752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade085b5-17de-4dda-8e74-a18557bb9920 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:56.894584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade085b5-17de-4dda-8e74-a18557bb9920 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:56.897883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade085b5-17de-4dda-8e74-a18557bb9920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:56.898470 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:56.931491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ade085b5-17de-4dda-8e74-a18557bb9920 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:56.933630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ade085b5-17de-4dda-8e74-a18557bb9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:56.953579 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1613/3239] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:56.958754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7377-5f64-42fa-8d7f-cf8d71990baa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:56.973165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7377-5f64-42fa-8d7f-cf8d71990baa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:56.981853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:56.982835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:56.983185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:56.984130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:56.986553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:21:56.986553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:56.988773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.014147 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1627/3240] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:21:57.016506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade085b5-17de-4dda-8e74-a18557bb9920 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.036129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade085b5-17de-4dda-8e74-a18557bb9920 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.042515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.043193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.044238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.044671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.045417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.047869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.068336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.070943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:57.107968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631613e-5e4e-4421-99b2-7c72754530e5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.116848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.117513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.117790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.118093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] PATH_INFO: `/v3/projects/ed372b4663a94ff1ba20abe32e2f9e77` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.119395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed372b4663a94ff1ba20abe32e2f9e77)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.121854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.238554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1614/3241] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:57 2022] POST /identity/v3/projects => generated 393 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:57.245253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.286140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed372b4663a94ff1ba20abe32e2f9e77', 'request_id': 'req-5f3fcac6-b671-4331-8a4e-21af2d184a8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:57.301218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed372b4663a94ff1ba20abe32e2f9e77', 'request_id': 'req-5f3fcac6-b671-4331-8a4e-21af2d184a8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:57.350846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed372b4663a94ff1ba20abe32e2f9e77', 'request_id': 'req-5f3fcac6-b671-4331-8a4e-21af2d184a8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:57.382402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] The token cache is being invalidate because project ed372b4663a94ff1ba20abe32e2f9e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:21:57.382688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:57.385303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f3fcac6-b671-4331-8a4e-21af2d184a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:57.388054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1628/3242] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:21:57 2022] DELETE /identity/v3/projects/ed372b4663a94ff1ba20abe32e2f9e77 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:57.394421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fa48-274e-4523-a83e-3f03f416a847 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.397023 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:57.397811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fa48-274e-4523-a83e-3f03f416a847 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.398117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fa48-274e-4523-a83e-3f03f416a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.446799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47646f-e6ce-45fc-9559-1c2876ad5b61 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.452650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1843fa48-274e-4523-a83e-3f03f416a847 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:57.454547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1843fa48-274e-4523-a83e-3f03f416a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:57.460376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.461306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.462231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.462527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.463654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.466804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.489687 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1629/3243] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:57.495788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3070-d878-4eba-8e61-fbf09ad2cc6f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.495788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3070-d878-4eba-8e61-fbf09ad2cc6f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.495788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3070-d878-4eba-8e61-fbf09ad2cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.521203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-910b3070-d878-4eba-8e61-fbf09ad2cc6f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:57.522748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-910b3070-d878-4eba-8e61-fbf09ad2cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:57.536191 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1630/3244] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:21:57.539415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3070-d878-4eba-8e61-fbf09ad2cc6f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.550448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3070-d878-4eba-8e61-fbf09ad2cc6f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.559651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.559825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.560049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.560363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.562090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:21:57.562090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.563348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.585706 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1631/3245] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:21:57.593161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.603910 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1615/3246] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:57 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:57.611245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.613860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:57.617141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1bdb-7e30-4eb9-b950-90c26e53167b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.631799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.632430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.636973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.636973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.636973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.636973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.643414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9931-2a1b-4b27-8243-0d9983738551 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.657433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.658158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.660198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.660198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.660198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.668262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.680766 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1616/3247] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:57.685180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.707344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddc35-b80e-46b4-9fc6-254177bb58b2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.725921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.726722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.726931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.727166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.727874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.729539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:57.752053 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1617/3248] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:57.756410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.774408 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1632/3249] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:21:57 2022] POST /identity/v3/projects => generated 403 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:57.778499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:57.794308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbd66c-00b9-414d-9214-0eb08b9154d1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.966195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef92421-4a21-4bb1-aa08-0783147e6190 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:57.976716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84068207-1cc1-4ec7-8d23-60a96b31f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.978117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068207-1cc1-4ec7-8d23-60a96b31f461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.978400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068207-1cc1-4ec7-8d23-60a96b31f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.978677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068207-1cc1-4ec7-8d23-60a96b31f461 admin admin] PATH_INFO: `/v3/projects/4c25b4509ad7457bad4a2e5e0bc59add/users/19bff9f7a4254110b3b89f0cba5d252f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.980427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:57.981301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:57.983879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:57.984361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:57.985250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:57.991293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:58.017946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84068207-1cc1-4ec7-8d23-60a96b31f461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c25b4509ad7457bad4a2e5e0bc59add, user_id=19bff9f7a4254110b3b89f0cba5d252f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:58.021808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84068207-1cc1-4ec7-8d23-60a96b31f461 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:58.136801 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1633/3250] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:21:57 2022] POST /identity/v3/users => generated 302 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:21:58.141066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:58.146413 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1618/3251] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:57 2022] PUT /identity/v3/projects/4c25b4509ad7457bad4a2e5e0bc59add/users/19bff9f7a4254110b3b89f0cba5d252f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:58.147916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a633-8c6c-4cec-85bb-564201fe2b4b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:58.148202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a633-8c6c-4cec-85bb-564201fe2b4b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:58.151538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a633-8c6c-4cec-85bb-564201fe2b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:58.165820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db832d6-7fa6-479b-ad98-c8f1ac8e688f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:58.198849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a240a633-8c6c-4cec-85bb-564201fe2b4b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:58.200075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a240a633-8c6c-4cec-85bb-564201fe2b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:58.285809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:58.286656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:58.287026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:58.287389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:58.288382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:58.290149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:58.328364 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1634/3252] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:21:58.329548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:58.346417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75d78-d22d-48d6-bcd9-7f8fb3802331 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:58.360238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:58.361894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:58.362194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:58.362471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:58.363152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:58.366571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:58.371045 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1619/3253] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:58.386213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1635/3254] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:21:58.387844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240a633-8c6c-4cec-85bb-564201fe2b4b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:58.398401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240a633-8c6c-4cec-85bb-564201fe2b4b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:58.403834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:58.408994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:58.409117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:58.409117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:58.409117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:58.409117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] PATH_INFO: `/v3/projects/2d10287df6064670a4a3c5419e33863c/users/70f95cc39f334d51ac8366d69c35dfe9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:58.445965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d10287df6064670a4a3c5419e33863c, user_id=70f95cc39f334d51ac8366d69c35dfe9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:58.448768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:58.492613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861e95-11ef-4142-b579-1e8754c41bbe admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:58.500838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493051c-b365-4abd-865e-01b2b0564e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:58.503179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493051c-b365-4abd-865e-01b2b0564e1e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:58.503645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493051c-b365-4abd-865e-01b2b0564e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:58.504089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493051c-b365-4abd-865e-01b2b0564e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:58.518515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493051c-b365-4abd-865e-01b2b0564e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:58.520671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493051c-b365-4abd-865e-01b2b0564e1e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:58.534764 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1636/3255] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:21:58.564486 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1620/3256] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:21:58 2022] PUT /identity/v3/projects/2d10287df6064670a4a3c5419e33863c/users/70f95cc39f334d51ac8366d69c35dfe9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:21:58.566262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6458d-baa7-4002-a830-f2b4f41163b1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:58.566798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6458d-baa7-4002-a830-f2b4f41163b1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:58.567299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6458d-baa7-4002-a830-f2b4f41163b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:58.637268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e9d6458d-baa7-4002-a830-f2b4f41163b1 None None] MFA Rules not processed for user `70f95cc39f334d51ac8366d69c35dfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:21:58.638500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e9d6458d-baa7-4002-a830-f2b4f41163b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:21:58.748898 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1637/3257] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:21:58.822285 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:59.136646 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:21:59.532676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:21:59.666201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67fe54-2def-4ea1-94b6-cf95fef6b2f6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:21:59.679062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:21:59.683704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:21:59.683704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:21:59.683704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] PATH_INFO: `/v3/users/70f95cc39f334d51ac8366d69c35dfe9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:21:59.684087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f95cc39f334d51ac8366d69c35dfe9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:21:59.687952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:21:59.967618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f95cc39f334d51ac8366d69c35dfe9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:59.976069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f95cc39f334d51ac8366d69c35dfe9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:21:59.976884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f95cc39f334d51ac8366d69c35dfe9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:00.045104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f95cc39f334d51ac8366d69c35dfe9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:00.046108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f95cc39f334d51ac8366d69c35dfe9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:00.080264 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1621/3258] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:21:59 2022] DELETE /identity/v3/users/70f95cc39f334d51ac8366d69c35dfe9 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:22:00.081746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:00.081954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:00.082335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:00.123811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:00.125031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:00.233332 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:00.279917 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1638/3259] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:00.301460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:00.303968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:00.348148 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:00.439120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a604-1052-4168-905c-338fcbb662ad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:00.443748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20ad6-6a25-46de-a211-46359429e4cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:00.444609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20ad6-6a25-46de-a211-46359429e4cd service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:00.445104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20ad6-6a25-46de-a211-46359429e4cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:00.445575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20ad6-6a25-46de-a211-46359429e4cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:00.462876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea20ad6-6a25-46de-a211-46359429e4cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:00.465252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea20ad6-6a25-46de-a211-46359429e4cd service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:00.480076 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1622/3260] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:22:01.188041 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:02.821918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:02.825517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:02.850761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7af24-5468-4c91-98dc-5d00b1aa5d52 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:02.861332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:02.863329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:02.864413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:02.868152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] PATH_INFO: `/v3/projects/2d10287df6064670a4a3c5419e33863c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:02.871767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d10287df6064670a4a3c5419e33863c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:02.875602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:02.916599 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:03.037817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d10287df6064670a4a3c5419e33863c', 'request_id': 'req-d41bfd27-1ce0-44f1-99a6-38494e33593f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:03.045009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d10287df6064670a4a3c5419e33863c', 'request_id': 'req-d41bfd27-1ce0-44f1-99a6-38494e33593f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:03.174924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d10287df6064670a4a3c5419e33863c', 'request_id': 'req-d41bfd27-1ce0-44f1-99a6-38494e33593f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:03.186446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] The token cache is being invalidate because project 2d10287df6064670a4a3c5419e33863c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:22:03.186865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:03.190240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d41bfd27-1ce0-44f1-99a6-38494e33593f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:22:03.200825 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1639/3261] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:22:02 2022] DELETE /identity/v3/projects/2d10287df6064670a4a3c5419e33863c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:22:03.203178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45422f-a287-4609-8815-a9c14a76d07a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:03.203663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45422f-a287-4609-8815-a9c14a76d07a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:03.203759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45422f-a287-4609-8815-a9c14a76d07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:03.255716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1a45422f-a287-4609-8815-a9c14a76d07a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:03.258934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a45422f-a287-4609-8815-a9c14a76d07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:03.449349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3175-7b7c-4ce0-aed9-707e0599406f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:03.449349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3175-7b7c-4ce0-aed9-707e0599406f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:03.449349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3175-7b7c-4ce0-aed9-707e0599406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:03.455658 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1623/3262] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:03.549509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-92af3175-7b7c-4ce0-aed9-707e0599406f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:03.553501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-92af3175-7b7c-4ce0-aed9-707e0599406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:03.587226 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1640/3263] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:22:03.589656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45422f-a287-4609-8815-a9c14a76d07a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:03.608114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45422f-a287-4609-8815-a9c14a76d07a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:03.614750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:03.616484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:03.616954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:03.617381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:03.618645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:22:03.619117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:03.626539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:03.665367 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1624/3264] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:22:03.666207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3175-7b7c-4ce0-aed9-707e0599406f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:03.686281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3175-7b7c-4ce0-aed9-707e0599406f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:03.709432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:03.710154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:03.714441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:03.717690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:03.720390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:03.733493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:03.886414 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1641/3265] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:22:03 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:22:03.891208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:03.903391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bfdab-abf0-4c5f-8745-78fcdb3702f7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:04.054773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:04.055574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:04.055959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:04.056342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:04.057126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:04.059225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:04.203593 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1625/3266] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:22:03 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:22:04.204383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:04.222617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bffa4e-d9c1-43cb-8e76-2af94f2ea9b0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:04.240843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:04.241472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:04.241744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:04.242092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:04.242853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:04.245290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:04.261992 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1642/3267] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:22:04.263537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:04.316878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1aabb-5b39-4a8b-8633-b1ba173ced05 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:04.339068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc092d-5c57-4304-90d1-58e0d1709257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:04.339706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc092d-5c57-4304-90d1-58e0d1709257 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:04.340032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc092d-5c57-4304-90d1-58e0d1709257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:04.340301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc092d-5c57-4304-90d1-58e0d1709257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:04.341012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc092d-5c57-4304-90d1-58e0d1709257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:04.345367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc092d-5c57-4304-90d1-58e0d1709257 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:04.372949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1626/3268] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:22:04.375163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:04.389468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec67ee-46fe-4428-997d-20bf1da125b5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:04.406821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:04.407644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:04.407924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:04.408195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] PATH_INFO: `/v3/projects/62a621d00a6b499f921337dda20b66bd/users/4ba4975d23874879b779282e5b9cecb0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:04.437550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a621d00a6b499f921337dda20b66bd, user_id=4ba4975d23874879b779282e5b9cecb0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:04.441436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:04.543370 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1643/3269] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:22:04 2022] PUT /identity/v3/projects/62a621d00a6b499f921337dda20b66bd/users/4ba4975d23874879b779282e5b9cecb0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:22:04.548782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4f9c-a6a9-47ef-ba02-1f4f94400061 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:04.549380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4f9c-a6a9-47ef-ba02-1f4f94400061 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:04.549900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f4f9c-a6a9-47ef-ba02-1f4f94400061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:04.664005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-270f4f9c-a6a9-47ef-ba02-1f4f94400061 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:04.674999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-270f4f9c-a6a9-47ef-ba02-1f4f94400061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:04.947748 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1627/3270] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:05.011565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:05.014002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:05.125743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ccf3-4ab5-4587-95ce-fa76b83d2b0e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:05.130935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:05.132901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:05.133898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:05.134747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:05.149473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:05.152011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:05.167261 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1644/3271] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:22:06.821398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd31773-00d4-4cf4-9e87-32f143bac47a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:06.823022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd31773-00d4-4cf4-9e87-32f143bac47a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:06.823696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd31773-00d4-4cf4-9e87-32f143bac47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:06.838667 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:06.871311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4bd31773-00d4-4cf4-9e87-32f143bac47a None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:06.874199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4bd31773-00d4-4cf4-9e87-32f143bac47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:06.965405 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1628/3272] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:22:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:06.991752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:06.995241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:07.173731 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:07.238940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a8245-2010-4bec-8755-35b47c2f255b service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:07.261368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edbf07-7476-47f2-a560-7c07a73c021b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:07.267205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edbf07-7476-47f2-a560-7c07a73c021b service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:07.267205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edbf07-7476-47f2-a560-7c07a73c021b service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:07.267205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edbf07-7476-47f2-a560-7c07a73c021b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:07.280932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edbf07-7476-47f2-a560-7c07a73c021b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:07.284673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edbf07-7476-47f2-a560-7c07a73c021b service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:07.312591 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1645/3273] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:22:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:10.921190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:10.921727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:10.921892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:10.975587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] MFA Rules not processed for user `ecb97fa679eb4bf8a41862d3c248a217`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:10.977690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:11.111193 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1629/3274] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:11.961143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00276ed0-292a-41e7-9031-a422f37a7648 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:11.962037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00276ed0-292a-41e7-9031-a422f37a7648 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:11.962566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00276ed0-292a-41e7-9031-a422f37a7648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:12.023914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-00276ed0-292a-41e7-9031-a422f37a7648 None None] MFA Rules not processed for user `0501ceda4e8140e09fb4e94552487cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:12.025312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-00276ed0-292a-41e7-9031-a422f37a7648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:12.163306 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1646/3275] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:12.168402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:12.170205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:12.202620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaa336-4a50-4209-a78d-ba7e7d7e207a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:12.208074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:12.208883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:12.209274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:12.217144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:12.218515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:12.221063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:12.318890 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1630/3276] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:22:12 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:22:12.323131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00276ed0-292a-41e7-9031-a422f37a7648 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:12.350220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00276ed0-292a-41e7-9031-a422f37a7648 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:12.514298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:12.515235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:12.515676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:12.516103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:12.516949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:12.520997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:12.620111 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1647/3277] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:22:12 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:22:12.621968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:12.639022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce17c3-7af8-4615-b8b6-e5e8c501032e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:12.654209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:12.657224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:12.657882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:12.657882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:12.665474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:12.669029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:12.717867 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1631/3278] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:22:12.720968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:12.735991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d12c6-0b59-41ab-9766-749303cb762e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:12.760754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:12.761763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:12.781146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:12.782427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] PATH_INFO: `/v3/projects/889de89a813e4a44a31d6c014e2a1f94/users/46f23e077b2547cca0ca7c1b1307e69e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:12.826991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=889de89a813e4a44a31d6c014e2a1f94, user_id=46f23e077b2547cca0ca7c1b1307e69e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:12.830226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:12.904453 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1648/3279] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:22:12 2022] PUT /identity/v3/projects/889de89a813e4a44a31d6c014e2a1f94/users/46f23e077b2547cca0ca7c1b1307e69e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:22:12.908543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:12.923963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb06551-c232-4adb-b068-39bb818638ee admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:13.086847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbdc30-ef7d-4111-a25f-a22b0c069ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:13.087415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdc30-ef7d-4111-a25f-a22b0c069ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:13.087698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdc30-ef7d-4111-a25f-a22b0c069ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:13.087996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdc30-ef7d-4111-a25f-a22b0c069ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:13.088785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbdc30-ef7d-4111-a25f-a22b0c069ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:13.092633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbdc30-ef7d-4111-a25f-a22b0c069ee6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:13.121573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1632/3280] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:22:13.125538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:13.152620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c8764-b753-4fea-b77d-7d3adccb72ea admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:13.171593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4317ef-b5d3-4387-b9f7-4aad46fff53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:13.172295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4317ef-b5d3-4387-b9f7-4aad46fff53b admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:13.172576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4317ef-b5d3-4387-b9f7-4aad46fff53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:13.172856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4317ef-b5d3-4387-b9f7-4aad46fff53b admin admin] PATH_INFO: `/v3/projects/889de89a813e4a44a31d6c014e2a1f94/users/46f23e077b2547cca0ca7c1b1307e69e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:13.183099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4317ef-b5d3-4387-b9f7-4aad46fff53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=889de89a813e4a44a31d6c014e2a1f94, user_id=46f23e077b2547cca0ca7c1b1307e69e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:13.192804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4317ef-b5d3-4387-b9f7-4aad46fff53b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:13.213273 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1649/3281] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:22:13 2022] PUT /identity/v3/projects/889de89a813e4a44a31d6c014e2a1f94/users/46f23e077b2547cca0ca7c1b1307e69e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:22:17.139720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6c17a-5658-4840-bf9c-f82a3c283854 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:17.140686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6c17a-5658-4840-bf9c-f82a3c283854 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:17.141116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6c17a-5658-4840-bf9c-f82a3c283854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:17.211730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-60f6c17a-5658-4840-bf9c-f82a3c283854 None None] MFA Rules not processed for user `a3bede03a6c44c3cbe86f7a06601d115`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:17.219430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-60f6c17a-5658-4840-bf9c-f82a3c283854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:17.253301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:17.373908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1633/3282] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:23.207727 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:23.856112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:23.856489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:23.857426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:24.020386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] MFA Rules not processed for user `60276a4031ee45ffa651b5467a62a81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:24.021606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:24.271368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a693a-726c-4244-9a7d-ec9a13bbd07e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:24.271927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a693a-726c-4244-9a7d-ec9a13bbd07e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:24.271927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a693a-726c-4244-9a7d-ec9a13bbd07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:24.331555 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1650/3283] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:24.333665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:24.337355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-006a693a-726c-4244-9a7d-ec9a13bbd07e None None] MFA Rules not processed for user `19bff9f7a4254110b3b89f0cba5d252f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:24.338198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:24.339047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-006a693a-726c-4244-9a7d-ec9a13bbd07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:24.526331 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1634/3284] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:22:24.536934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226134c-1e28-4a6c-aaa4-77c43207f713 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:24.537410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226134c-1e28-4a6c-aaa4-77c43207f713 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:24.537851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226134c-1e28-4a6c-aaa4-77c43207f713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:24.595683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210280f-892e-4f0d-b833-c340c80765e4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:24.612695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1226134c-1e28-4a6c-aaa4-77c43207f713 None None] MFA Rules not processed for user `19bff9f7a4254110b3b89f0cba5d252f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:24.613155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:24.619495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1226134c-1e28-4a6c-aaa4-77c43207f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:24.619647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:24.620034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:24.620404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:24.622048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:24.630961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:24.632248 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1635/3285] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:22:24.785820 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1651/3286] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:22:24 2022] POST /identity/v3/projects => generated 383 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:22:24.787114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226134c-1e28-4a6c-aaa4-77c43207f713 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:24.817181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226134c-1e28-4a6c-aaa4-77c43207f713 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:24.969501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:24.970162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:24.970445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:24.970722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:24.976882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:24.979077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:25.095550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:25.097759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:25.135187 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1636/3287] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:22:24 2022] POST /identity/v3/users => generated 298 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:22:25.137785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:25.200182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f64070-b8d8-4103-b5e5-b15a561d0519 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:25.223237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:25.225044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:25.225323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:25.228332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:25.232506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:25.242130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:25.283974 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1637/3288] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:22:25.286953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:25.319620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ff6fd-62f4-4268-bf13-fe8df875599b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:25.338556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:25.339275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:25.339672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:25.339863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] PATH_INFO: `/v3/projects/a4faf89299604d51b0b70e63f4b7022c/users/b16c8a1cdf2741cb8618a48a38e98455/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:25.389851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4faf89299604d51b0b70e63f4b7022c, user_id=b16c8a1cdf2741cb8618a48a38e98455, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:25.393630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:25.403914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a7204-ff4b-4967-b14f-ec5ddbbbf790 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:25.422932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:25.423191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:25.423450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:25.423613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:25.440429 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:25.475022 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:25.482620 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1638/3289] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:22:25 2022] PUT /identity/v3/projects/a4faf89299604d51b0b70e63f4b7022c/users/b16c8a1cdf2741cb8618a48a38e98455/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:22:25.488110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:25.546497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:25.548030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:25.581270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1652/3290] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:22:25.775810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f125f-0bc7-439f-803d-97ec1f1660d0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:25.781499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcc1a3-70c8-445f-a685-73c72792744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:25.782682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc1a3-70c8-445f-a685-73c72792744e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:25.783168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc1a3-70c8-445f-a685-73c72792744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:25.784060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc1a3-70c8-445f-a685-73c72792744e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:25.785147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcc1a3-70c8-445f-a685-73c72792744e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:25.788186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcc1a3-70c8-445f-a685-73c72792744e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:25.802899 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1639/3291] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:22:25.807498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:25.835846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3ce70-782d-47e9-ac60-680a508e8d1d service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:25.849690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8368886-baab-469a-8278-1e0f17c152e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:25.850553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368886-baab-469a-8278-1e0f17c152e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:25.851645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368886-baab-469a-8278-1e0f17c152e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:25.852134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368886-baab-469a-8278-1e0f17c152e8 admin admin] PATH_INFO: `/v3/projects/a4faf89299604d51b0b70e63f4b7022c/users/b16c8a1cdf2741cb8618a48a38e98455/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:25.854873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8368886-baab-469a-8278-1e0f17c152e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4faf89299604d51b0b70e63f4b7022c, user_id=b16c8a1cdf2741cb8618a48a38e98455, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:25.858408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8368886-baab-469a-8278-1e0f17c152e8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:25.876678 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1653/3292] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:22:25 2022] PUT /identity/v3/projects/a4faf89299604d51b0b70e63f4b7022c/users/b16c8a1cdf2741cb8618a48a38e98455/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:22:29.065442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458ab6-7650-46cf-a26b-534f7f45f3d2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:29.066399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458ab6-7650-46cf-a26b-534f7f45f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:29.066854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458ab6-7650-46cf-a26b-534f7f45f3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:29.176382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-24458ab6-7650-46cf-a26b-534f7f45f3d2 None None] MFA Rules not processed for user `4ba4975d23874879b779282e5b9cecb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:29.177615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-24458ab6-7650-46cf-a26b-534f7f45f3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:29.336735 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1640/3293] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:30.150486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab579-6c18-42da-8bb1-a2625c4fde2b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:30.151244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab579-6c18-42da-8bb1-a2625c4fde2b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:30.151529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab579-6c18-42da-8bb1-a2625c4fde2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:30.206523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d01ab579-6c18-42da-8bb1-a2625c4fde2b None None] MFA Rules not processed for user `19bff9f7a4254110b3b89f0cba5d252f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:30.208182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d01ab579-6c18-42da-8bb1-a2625c4fde2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:30.437730 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1654/3294] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:31.161460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458ab6-7650-46cf-a26b-534f7f45f3d2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:31.379195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24458ab6-7650-46cf-a26b-534f7f45f3d2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:31.395856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:31.396828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:31.396828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:31.397073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:31.414705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:31.418580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:31.444504 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1641/3295] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:22:37.536976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24b203-c4c0-4ef1-9cc3-12341813dcf2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:37.537463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24b203-c4c0-4ef1-9cc3-12341813dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:37.537691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24b203-c4c0-4ef1-9cc3-12341813dcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:37.584551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fe24b203-c4c0-4ef1-9cc3-12341813dcf2 None None] MFA Rules not processed for user `46f23e077b2547cca0ca7c1b1307e69e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:37.587554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fe24b203-c4c0-4ef1-9cc3-12341813dcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:37.682810 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1655/3296] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:37.694489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:37.695964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:37.713267 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:37.780304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12951e19-4c26-4462-8993-ab863ce91337 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:37.784133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2a1f-6df5-418c-8e70-818e01f3693c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:37.784812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2a1f-6df5-418c-8e70-818e01f3693c service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:37.785156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2a1f-6df5-418c-8e70-818e01f3693c service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:37.785528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2a1f-6df5-418c-8e70-818e01f3693c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:37.795766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2a1f-6df5-418c-8e70-818e01f3693c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:37.797771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2a1f-6df5-418c-8e70-818e01f3693c service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:37.809708 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1642/3297] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:22:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:22:45.255622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51c6b-d4bc-403d-9c5e-2bade8030223 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:45.256190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51c6b-d4bc-403d-9c5e-2bade8030223 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:45.256190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51c6b-d4bc-403d-9c5e-2bade8030223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:45.327425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-11e51c6b-d4bc-403d-9c5e-2bade8030223 None None] MFA Rules not processed for user `4ba4975d23874879b779282e5b9cecb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:45.329019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11e51c6b-d4bc-403d-9c5e-2bade8030223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:45.352561 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1656/3298] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:48.062520 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=26 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:51.079606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d88c5-09bf-4d58-a61c-4953545d0886 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:51.080235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d88c5-09bf-4d58-a61c-4953545d0886 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:51.080235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d88c5-09bf-4d58-a61c-4953545d0886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:51.116413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d53d88c5-09bf-4d58-a61c-4953545d0886 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:51.120490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d53d88c5-09bf-4d58-a61c-4953545d0886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:51.302841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1643/3299] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:22:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:51.315696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51c6b-d4bc-403d-9c5e-2bade8030223 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:51.391996 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:51.463455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51c6b-d4bc-403d-9c5e-2bade8030223 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:51.469311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:51.470354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:51.470782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:51.471263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:51.497343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:51.499159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:51.525191 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1657/3300] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:22:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:22:52.417216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f16d9-4adf-4b52-9a28-afc453763979 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:52.417740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f16d9-4adf-4b52-9a28-afc453763979 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:52.417740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f16d9-4adf-4b52-9a28-afc453763979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:52.463886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9b5f16d9-4adf-4b52-9a28-afc453763979 None None] MFA Rules not processed for user `b16c8a1cdf2741cb8618a48a38e98455`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:22:52.474896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b5f16d9-4adf-4b52-9a28-afc453763979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:52.668565 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1644/3301] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:22:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:22:53.077193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:53.079387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:53.097287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e9ae8-1159-4fd3-9bb4-fcc14a5086d9 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:53.110935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856bdc1-444c-4488-97cb-4bf8ffa6abe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:53.112115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bdc1-444c-4488-97cb-4bf8ffa6abe6 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:53.112543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bdc1-444c-4488-97cb-4bf8ffa6abe6 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:53.113534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bdc1-444c-4488-97cb-4bf8ffa6abe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:53.202470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856bdc1-444c-4488-97cb-4bf8ffa6abe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:53.205112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856bdc1-444c-4488-97cb-4bf8ffa6abe6 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:53.217222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1658/3302] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:22:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:22:57.518792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f16d9-4adf-4b52-9a28-afc453763979 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:22:57.681295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f16d9-4adf-4b52-9a28-afc453763979 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:22:57.694808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:22:57.697080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:22:57.698172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:22:57.700981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:22:57.703658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:22:57.825666 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:22:57.843494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:22:57.845870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:22:57.864970 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1645/3303] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:22:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:01.224113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab733e22-3df6-47cc-949e-9ef7d8a84948 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:01.224595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab733e22-3df6-47cc-949e-9ef7d8a84948 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:01.224740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab733e22-3df6-47cc-949e-9ef7d8a84948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:01.248290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ab733e22-3df6-47cc-949e-9ef7d8a84948 None None] MFA Rules not processed for user `60276a4031ee45ffa651b5467a62a81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:01.249569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab733e22-3df6-47cc-949e-9ef7d8a84948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:01.257915 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1659/3304] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:03.753462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:03.755436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:03.768796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632564f-741a-41ba-b8de-6e0de50cc019 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:03.773306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:03.774014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:03.774575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:03.774865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:03.776716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:03.859457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:03.860891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:03.882520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1646/3305] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:05.260756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab733e22-3df6-47cc-949e-9ef7d8a84948 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:05.283082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab733e22-3df6-47cc-949e-9ef7d8a84948 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:05.290617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:05.291850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:05.292657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:05.293110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:05.296423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:05.319128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:05.322393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:05.368214 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1660/3306] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:13.867571 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=37 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:14.167048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:14.203681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49ab6-3570-413f-9b3f-b5e61dbcfe83 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:14.224725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:14.227282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:14.227428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:14.228720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:14.397473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:14.399721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:14.414515 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1647/3307] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:15.331862 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=59 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:15.716068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:15.717752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:15.828159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13308dec-6626-4d9d-a84a-95ac45fb3c14 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:15.835856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:15.836485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:15.836796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:15.837073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:15.839141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:15.858665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:15.863498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:15.875835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1661/3308] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:15.899828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:15.902414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:15.949888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507d42-2cc8-4a0a-838a-56346cd32b23 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:15.952579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:15.954072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:15.965007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:15.965666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] PATH_INFO: `/v3/users/ecb97fa679eb4bf8a41862d3c248a217` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:15.967905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb97fa679eb4bf8a41862d3c248a217)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:15.973070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:16.248356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb97fa679eb4bf8a41862d3c248a217'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:16.279928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb97fa679eb4bf8a41862d3c248a217'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:16.282402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb97fa679eb4bf8a41862d3c248a217'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:16.402546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb97fa679eb4bf8a41862d3c248a217'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:16.403220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb97fa679eb4bf8a41862d3c248a217'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:16.422922 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1648/3309] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:15 2022] DELETE /identity/v3/users/ecb97fa679eb4bf8a41862d3c248a217 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:16.596479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:16.598638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:16.631537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1f71-5ba6-4031-aff0-5c979f2af9b4 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:16.745942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:16.747027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:16.747576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:16.748025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] PATH_INFO: `/v3/users/cd6a6c5240f94ace91e1f0ed3e53fa7c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:16.749577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6a6c5240f94ace91e1f0ed3e53fa7c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:16.752261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:16.998632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6a6c5240f94ace91e1f0ed3e53fa7c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.008674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6a6c5240f94ace91e1f0ed3e53fa7c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.009820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6a6c5240f94ace91e1f0ed3e53fa7c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.082656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6a6c5240f94ace91e1f0ed3e53fa7c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.083287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6a6c5240f94ace91e1f0ed3e53fa7c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.103248 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1662/3310] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:16 2022] DELETE /identity/v3/users/cd6a6c5240f94ace91e1f0ed3e53fa7c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:17.399701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:17.401210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:17.416714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b5402-0be5-4bb2-8868-936cea8ff927 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:17.496812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:17.498911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:17.498911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:17.498911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] PATH_INFO: `/v3/projects/1c099cb4056b438a9c9dead75e7eb797` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:17.499449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c099cb4056b438a9c9dead75e7eb797)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:17.501382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:17.520501 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:17.642536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c099cb4056b438a9c9dead75e7eb797', 'request_id': 'req-cd79b88b-2137-4f0b-a7b7-ffcace615c66'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.645215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:17.652466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:17.667961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25617997-7896-4047-a92a-a5d423c12ea8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:17.668182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c099cb4056b438a9c9dead75e7eb797', 'request_id': 'req-cd79b88b-2137-4f0b-a7b7-ffcace615c66'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.674982 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:17.735909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:17.736800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:17.737376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:17.737746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] PATH_INFO: `/v3/projects/50bd4c137b6a42488f39d173d46520dd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:17.739199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bd4c137b6a42488f39d173d46520dd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:17.741425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:17.779593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c099cb4056b438a9c9dead75e7eb797', 'request_id': 'req-cd79b88b-2137-4f0b-a7b7-ffcace615c66'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.795241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] The token cache is being invalidate because project 1c099cb4056b438a9c9dead75e7eb797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:17.795770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.796693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.802986 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1649/3311] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:17 2022] DELETE /identity/v3/projects/1c099cb4056b438a9c9dead75e7eb797 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:17.804447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:17.807552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:17.835761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79b88b-2137-4f0b-a7b7-ffcace615c66 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:17.840923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:17.841589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:17.841865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:17.842171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] PATH_INFO: `/v3/users/a3bede03a6c44c3cbe86f7a06601d115` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:17.844917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bede03a6c44c3cbe86f7a06601d115)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:17.845247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:17.886106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bd4c137b6a42488f39d173d46520dd', 'request_id': 'req-6f603ed1-3668-4eff-9d8e-f968619a3a22'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.899502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bd4c137b6a42488f39d173d46520dd', 'request_id': 'req-6f603ed1-3668-4eff-9d8e-f968619a3a22'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:17.984270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bd4c137b6a42488f39d173d46520dd', 'request_id': 'req-6f603ed1-3668-4eff-9d8e-f968619a3a22'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.007841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] The token cache is being invalidate because project 50bd4c137b6a42488f39d173d46520dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:18.009085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.010183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f603ed1-3668-4eff-9d8e-f968619a3a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.019201 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1663/3312] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:17 2022] DELETE /identity/v3/projects/50bd4c137b6a42488f39d173d46520dd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:18.021500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902b93-0d71-42d4-ac5c-c3d3fd0f348d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.021806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902b93-0d71-42d4-ac5c-c3d3fd0f348d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.022112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902b93-0d71-42d4-ac5c-c3d3fd0f348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.027283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bede03a6c44c3cbe86f7a06601d115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.043421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bede03a6c44c3cbe86f7a06601d115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.047573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-99902b93-0d71-42d4-ac5c-c3d3fd0f348d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:18.048447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bede03a6c44c3cbe86f7a06601d115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.048962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-99902b93-0d71-42d4-ac5c-c3d3fd0f348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:18.116088 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1664/3313] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:18.117950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8124f-6b13-4bea-aee0-e81bec0173df None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.118265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8124f-6b13-4bea-aee0-e81bec0173df None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.118540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8124f-6b13-4bea-aee0-e81bec0173df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.128949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bede03a6c44c3cbe86f7a06601d115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.129672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fe88303a-ed1e-4b3f-848b-98c1f56e69e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bede03a6c44c3cbe86f7a06601d115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:18.150008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fdc8124f-6b13-4bea-aee0-e81bec0173df None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:18.151387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fdc8124f-6b13-4bea-aee0-e81bec0173df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:18.155891 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1650/3314] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:17 2022] DELETE /identity/v3/users/a3bede03a6c44c3cbe86f7a06601d115 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:18.157608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090432-fe10-43dc-936f-7d6c75ce6def None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.158514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090432-fe10-43dc-936f-7d6c75ce6def None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.158864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090432-fe10-43dc-936f-7d6c75ce6def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.184404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c3090432-fe10-43dc-936f-7d6c75ce6def None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:18.185947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c3090432-fe10-43dc-936f-7d6c75ce6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:18.248808 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1665/3315] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:18.250942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cd84c-4fd9-44b3-8215-3b2b0eaf74e8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.254305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cd84c-4fd9-44b3-8215-3b2b0eaf74e8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.254305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cd84c-4fd9-44b3-8215-3b2b0eaf74e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.282453 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1651/3316] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:18.287542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ce6cd84c-4fd9-44b3-8215-3b2b0eaf74e8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:18.287542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce6cd84c-4fd9-44b3-8215-3b2b0eaf74e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:18.292202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3090432-fe10-43dc-936f-7d6c75ce6def None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.301907 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1666/3317] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:18.308711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cd84c-4fd9-44b3-8215-3b2b0eaf74e8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.314395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3090432-fe10-43dc-936f-7d6c75ce6def None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.322120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cd84c-4fd9-44b3-8215-3b2b0eaf74e8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.323597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.325074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.326044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.327319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.328333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.329032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:18.332318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.334781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.335871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.336297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.337682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.337682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:18.337682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.339784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.357362 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1667/3318] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:18.359277 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1652/3319] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:18.359811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.361012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.377278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690833-2dbc-4b28-92be-8ca8e1a43760 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.378819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60464f-23c6-449c-a11e-7221e69d26d4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.384167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.385198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.385365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.385738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.386539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.388799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.402213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.406549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.406847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.407119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.411773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.415046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.495927 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1668/3320] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:18.497293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.531370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1653/3321] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:18.535971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.594639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18267fb4-3581-4235-9064-b13fdd8e38ad admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.619317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfb39e-3969-4801-9ff5-8f8a1a97e704 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.624608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4b793-fb23-4194-a916-4e9e4a1e806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.625473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b793-fb23-4194-a916-4e9e4a1e806f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.625826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b793-fb23-4194-a916-4e9e4a1e806f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.626232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b793-fb23-4194-a916-4e9e4a1e806f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.626933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4b793-fb23-4194-a916-4e9e4a1e806f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.629009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4b793-fb23-4194-a916-4e9e4a1e806f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.699533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.700164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.700441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.700770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.701478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.703445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.747922 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1654/3322] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:18.752042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409727-8255-40d7-9489-5474f9078a93 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.753423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409727-8255-40d7-9489-5474f9078a93 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.754280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409727-8255-40d7-9489-5474f9078a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.773884 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:18.780143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f4409727-8255-40d7-9489-5474f9078a93 None None] MFA Rules not processed for user `0501ceda4e8140e09fb4e94552487cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:18.782458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f4409727-8255-40d7-9489-5474f9078a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:18.842261 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1669/3323] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/users => generated 295 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:18.844055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.846813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:18.874639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091851-b53f-4f00-b479-b3e725155109 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.879840 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1655/3324] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:18.879840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4409727-8255-40d7-9489-5474f9078a93 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.884391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.885200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.885624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.886027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] PATH_INFO: `/v3/projects/4ac1b744484c41c88314112b572ccac1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.887403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac1b744484c41c88314112b572ccac1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.889727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.901786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4409727-8255-40d7-9489-5474f9078a93 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.909324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.910434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.911110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.911540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.912932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.915661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.937342 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1656/3325] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:18.938664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:18.956876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77fbc-a6a7-4031-bf14-81fbbdaf8890 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:18.977652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:18.984836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:18.984836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:18.984836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:18.984836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:18.984836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:18.995584 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1657/3326] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:18.996608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.036040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933f392-7bc6-48ec-b05f-65c841fbf792 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.037920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac1b744484c41c88314112b572ccac1', 'request_id': 'req-55eceb61-efcd-4aa7-894e-cb717b01469f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:19.051269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac1b744484c41c88314112b572ccac1', 'request_id': 'req-55eceb61-efcd-4aa7-894e-cb717b01469f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:19.100354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.100983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.101262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.101536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.102278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.104035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.114041 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1658/3327] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:19.114915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.124490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40d195-94b9-44af-b622-f2546720f2f9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.130019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.130622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.131359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.131359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.132450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.134041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.144538 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1659/3328] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:19.145409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.155884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac1b744484c41c88314112b572ccac1', 'request_id': 'req-55eceb61-efcd-4aa7-894e-cb717b01469f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:19.159090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc07f48-b9cf-4ca4-9fca-a3764ee46146 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.166718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d4f64-eb84-4c1a-86f1-19d04001bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.167326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d4f64-eb84-4c1a-86f1-19d04001bcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.171517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d4f64-eb84-4c1a-86f1-19d04001bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.171517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d4f64-eb84-4c1a-86f1-19d04001bcd3 admin admin] PATH_INFO: `/v3/projects/e592dac5307442b5b05f46f00c73af22/users/6270ee408acb439581b83045f2697f6b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.171909 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:19.174605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] The token cache is being invalidate because project 4ac1b744484c41c88314112b572ccac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:19.175664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:19.175664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:19.177505 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1670/3329] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:18 2022] DELETE /identity/v3/projects/4ac1b744484c41c88314112b572ccac1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:19.178267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.179982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:19.189042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d4f64-eb84-4c1a-86f1-19d04001bcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e592dac5307442b5b05f46f00c73af22, user_id=6270ee408acb439581b83045f2697f6b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.192032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d4f64-eb84-4c1a-86f1-19d04001bcd3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.193848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eceb61-efcd-4aa7-894e-cb717b01469f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.199832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06e88d-7767-4dac-a5f3-b832f62d5b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.200700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e88d-7767-4dac-a5f3-b832f62d5b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.200963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e88d-7767-4dac-a5f3-b832f62d5b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.201095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e88d-7767-4dac-a5f3-b832f62d5b85 admin admin] PATH_INFO: `/v3/projects/ada99164dbe24d8698a111af349d9539/users/6bc47b4f60e746c8a9e30b742f783dd9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.216055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06e88d-7767-4dac-a5f3-b832f62d5b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada99164dbe24d8698a111af349d9539, user_id=6bc47b4f60e746c8a9e30b742f783dd9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.218876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06e88d-7767-4dac-a5f3-b832f62d5b85 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.283279 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1660/3330] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:19 2022] PUT /identity/v3/projects/e592dac5307442b5b05f46f00c73af22/users/6270ee408acb439581b83045f2697f6b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:19.283279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bed6-89ef-4b76-a49c-52083a193c18 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.283279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bed6-89ef-4b76-a49c-52083a193c18 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.283869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bed6-89ef-4b76-a49c-52083a193c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.308445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9c31bed6-89ef-4b76-a49c-52083a193c18 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:19.311979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c31bed6-89ef-4b76-a49c-52083a193c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:19.314064 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1671/3331] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:19 2022] PUT /identity/v3/projects/ada99164dbe24d8698a111af349d9539/users/6bc47b4f60e746c8a9e30b742f783dd9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:19.315422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.315691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.315963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.355613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] MFA Rules not processed for user `6270ee408acb439581b83045f2697f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:19.356850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:19.399670 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1661/3332] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:19.399670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72332426-011e-4c2c-a56d-bb6f0cf3d4f3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.399670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72332426-011e-4c2c-a56d-bb6f0cf3d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.399670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72332426-011e-4c2c-a56d-bb6f0cf3d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.418275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-72332426-011e-4c2c-a56d-bb6f0cf3d4f3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:19.419493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72332426-011e-4c2c-a56d-bb6f0cf3d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:19.433701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1662/3333] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:19.438165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe20b-a025-4222-b297-e74c13893ef7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.438450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe20b-a025-4222-b297-e74c13893ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.438720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe20b-a025-4222-b297-e74c13893ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.463693 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1672/3334] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:19.464705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.466584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:19.478559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e99fe20b-a025-4222-b297-e74c13893ef7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:19.479984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e99fe20b-a025-4222-b297-e74c13893ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:19.498196 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1663/3335] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:19.502073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fe20b-a025-4222-b297-e74c13893ef7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.513416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fe20b-a025-4222-b297-e74c13893ef7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.520690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.521349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.521736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.522082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.523791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:19.524096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.525732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.543122 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1664/3336] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:23:19.544501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b7f3c-f427-44c4-b989-1e2e67660931 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.544785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.547874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.548552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.548918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.549251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.557150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787f1fb-c681-4d8c-a781-164495169bde admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.561193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.562678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.562929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.563550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.567174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.567174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.567174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.567174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.575137 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1673/3337] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:19.652717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.659655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:19.668141 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1665/3338] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:19 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:19.668994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.745411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8d6f5-2224-4337-84c3-5f16d3cba205 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.747515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b7745-866a-4cc4-9aa2-331048010c4f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.750524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.751143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.751424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.751697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.752328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.754326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.819061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.819619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.819900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.820172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.874326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.875905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.884643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1674/3339] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:23:19.897022 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1666/3340] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:19 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:19.900213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.914273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da11a-a492-4d88-844b-6b0237c2f1b7 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:19.921244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:19.922594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:19.922794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:19.923127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:19.923849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:19.926772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:19.988278 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:19.989406 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1675/3341] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:19.989517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.990891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:19.995422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:20.001164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8099-a628-42b8-ae32-19d61181e87d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:20.024102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81255d5f-c0c7-4e08-8055-237ffd0460a4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:20.024365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:20.024365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.024365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.024365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.024740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:20.024740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:20.024913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:20.024913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.025427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.026321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] PATH_INFO: `/v3/users/6270ee408acb439581b83045f2697f6b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.030760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6270ee408acb439581b83045f2697f6b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:20.034415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:20.044622 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1667/3342] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:20.049068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:20.065031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857999c-3a1b-4c1b-8eb0-0c91b68d5100 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:20.080760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83cab5-1905-4eb0-ab29-a7dd7858fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:20.081511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83cab5-1905-4eb0-ab29-a7dd7858fa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.081719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83cab5-1905-4eb0-ab29-a7dd7858fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.081962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83cab5-1905-4eb0-ab29-a7dd7858fa27 admin admin] PATH_INFO: `/v3/projects/3c8546a1c3b3418fae012aa51fd37c82/users/7f33238147dc49209bcebea4dfa47ad4/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.099534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83cab5-1905-4eb0-ab29-a7dd7858fa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8546a1c3b3418fae012aa51fd37c82, user_id=7f33238147dc49209bcebea4dfa47ad4, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:20.104671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83cab5-1905-4eb0-ab29-a7dd7858fa27 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:20.189658 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1668/3343] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:20 2022] PUT /identity/v3/projects/3c8546a1c3b3418fae012aa51fd37c82/users/7f33238147dc49209bcebea4dfa47ad4/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:20.201602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168d66-da3b-485a-a815-ea8ab61228d6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.201882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168d66-da3b-485a-a815-ea8ab61228d6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.202181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168d66-da3b-485a-a815-ea8ab61228d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.295182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ed168d66-da3b-485a-a815-ea8ab61228d6 None None] MFA Rules not processed for user `7f33238147dc49209bcebea4dfa47ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:20.296422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed168d66-da3b-485a-a815-ea8ab61228d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:20.308772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6270ee408acb439581b83045f2697f6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:20.320611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6270ee408acb439581b83045f2697f6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:20.322172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6270ee408acb439581b83045f2697f6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:20.392316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6270ee408acb439581b83045f2697f6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:20.393060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20fa2a90-7647-4937-90bb-aa7d96ada71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6270ee408acb439581b83045f2697f6b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:20.406151 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1669/3344] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:20.412448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.413303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.413615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.421020 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:20.422258 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1676/3345] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:19 2022] DELETE /identity/v3/users/6270ee408acb439581b83045f2697f6b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:20.423548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.423906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.424186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.441283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] MFA Rules not processed for user `7f33238147dc49209bcebea4dfa47ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:20.443259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:20.459028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:20.460928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:20.550022 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1670/3346] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:20.569583 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1677/3347] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:20.570808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:20.574205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:20.582124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:20.584127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:20.684452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19688f8d-db66-4bff-bd9d-774256e329c7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:20.702398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:20.702398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.702398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.702398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.733180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:20.734684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:20.756170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1678/3348] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:23:20.783298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0e39-02f9-4a88-8e24-2d550bcbd175 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:20.791382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77347a-a621-4c7c-9b63-f35456cc115d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:20.792325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77347a-a621-4c7c-9b63-f35456cc115d service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:20.792867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77347a-a621-4c7c-9b63-f35456cc115d service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:20.793289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77347a-a621-4c7c-9b63-f35456cc115d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:20.796717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8d77347a-a621-4c7c-9b63-f35456cc115d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:20.809866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77347a-a621-4c7c-9b63-f35456cc115d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:20.811508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77347a-a621-4c7c-9b63-f35456cc115d service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:20.821843 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1671/3349] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:21.250003 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:21.927241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:21.927241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:21.949382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfa684-5054-44e2-8750-b7b245c0748c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:21.978262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:21.980141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:21.981831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:21.982320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] PATH_INFO: `/v3/projects/e592dac5307442b5b05f46f00c73af22` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:21.985724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e592dac5307442b5b05f46f00c73af22)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:21.990563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:22.175501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e592dac5307442b5b05f46f00c73af22', 'request_id': 'req-38247b8f-02bb-45da-a170-55dab52417fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:22.184534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e592dac5307442b5b05f46f00c73af22', 'request_id': 'req-38247b8f-02bb-45da-a170-55dab52417fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:22.285167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e592dac5307442b5b05f46f00c73af22', 'request_id': 'req-38247b8f-02bb-45da-a170-55dab52417fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:22.333909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] The token cache is being invalidate because project e592dac5307442b5b05f46f00c73af22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:22.334405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:22.336218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-38247b8f-02bb-45da-a170-55dab52417fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:22.338015 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1679/3350] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:21 2022] DELETE /identity/v3/projects/e592dac5307442b5b05f46f00c73af22 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:22.343749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291daff8-2562-42c1-addf-4eb80bae0bbd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:22.344170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291daff8-2562-42c1-addf-4eb80bae0bbd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:22.344291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291daff8-2562-42c1-addf-4eb80bae0bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:22.391244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-291daff8-2562-42c1-addf-4eb80bae0bbd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:22.392503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-291daff8-2562-42c1-addf-4eb80bae0bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:22.505692 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1672/3351] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:22.514296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e84f-c92f-44df-ab9f-efef053fdc04 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:22.514721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e84f-c92f-44df-ab9f-efef053fdc04 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:22.515089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e84f-c92f-44df-ab9f-efef053fdc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:22.549620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a715e84f-c92f-44df-ab9f-efef053fdc04 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:22.551038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a715e84f-c92f-44df-ab9f-efef053fdc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:22.568879 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1680/3352] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:22.573411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291daff8-2562-42c1-addf-4eb80bae0bbd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:22.583920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291daff8-2562-42c1-addf-4eb80bae0bbd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:22.593144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:22.595341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:22.595750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:22.596374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:22.597301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:22.597856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:22.599846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:22.618358 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1673/3353] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:22.627135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715e84f-c92f-44df-ab9f-efef053fdc04 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:22.631428 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:22.645465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715e84f-c92f-44df-ab9f-efef053fdc04 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:22.665611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:22.668494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:22.669664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:22.670098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:22.670968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:22.674470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:22.776212 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:22.817646 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1681/3354] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:22 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:22.822029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:22.841996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a6e6-04af-4584-8199-77c8fc26c8b1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:22.997709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:22.998763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:22.999246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:22.999803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:23.000722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:23.003367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:23.140199 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1674/3355] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:22 2022] POST /identity/v3/users => generated 287 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:23.141512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:23.156294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f7e5-02da-456f-841d-fcdab99a6bf7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:23.200683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:23.201381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:23.201597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:23.201864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:23.202545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:23.210701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:23.238811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1682/3356] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:23.242938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:23.266531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4d5b-c72e-4302-914c-8800f8bae314 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:23.284165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c5726-c57e-447c-85bd-b068de25e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:23.286578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c5726-c57e-447c-85bd-b068de25e57c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:23.287054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c5726-c57e-447c-85bd-b068de25e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:23.289592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c5726-c57e-447c-85bd-b068de25e57c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:23.290713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c5726-c57e-447c-85bd-b068de25e57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:23.298383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c5726-c57e-447c-85bd-b068de25e57c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:23.333081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:23.333518 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1675/3357] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:23.347615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4ab77-d1ce-4ef5-899e-47d3f627197f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:23.360758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:23.362559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:23.362559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:23.362559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] PATH_INFO: `/v3/projects/1d059158eca14b8ab0caa00c193d6bc9/users/335bd787ce2e4d07b9d983cbec741c08/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:23.396788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d059158eca14b8ab0caa00c193d6bc9, user_id=335bd787ce2e4d07b9d983cbec741c08, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:23.399871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:23.529585 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1683/3358] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:23 2022] PUT /identity/v3/projects/1d059158eca14b8ab0caa00c193d6bc9/users/335bd787ce2e4d07b9d983cbec741c08/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:23.541599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49cf06-3f8f-48d7-966d-6b88130164ce None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:23.542212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49cf06-3f8f-48d7-966d-6b88130164ce None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:23.542212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49cf06-3f8f-48d7-966d-6b88130164ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:23.600102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ad49cf06-3f8f-48d7-966d-6b88130164ce None None] MFA Rules not processed for user `335bd787ce2e4d07b9d983cbec741c08`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:23.602220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ad49cf06-3f8f-48d7-966d-6b88130164ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:23.703069 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1676/3359] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:23.711032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:23.712821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:23.845847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df82a-718d-4ff0-982f-ec62d7433242 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:23.860289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:23.861050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:23.861638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:23.862003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:23.876383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:23.878130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:23.894521 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1684/3360] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:24.360694 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:24.816969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170f99-779c-4ee5-ab6a-54daf330e226 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:24.817561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170f99-779c-4ee5-ab6a-54daf330e226 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:24.817668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170f99-779c-4ee5-ab6a-54daf330e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:24.854026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6e170f99-779c-4ee5-ab6a-54daf330e226 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:24.856444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6e170f99-779c-4ee5-ab6a-54daf330e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:25.014558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1677/3361] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:25.031031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:25.037631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:25.093770 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:25.223794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd169bad-4c0f-4331-a458-90706cf77443 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:25.236057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:25.236804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:25.238142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:25.238513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:25.283035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:25.284653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:25.307739 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1685/3362] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:23:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:23:26.346188 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:27.008505 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:33.852836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be05ad-d0a5-4658-904f-e1b4baa570c7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:33.853373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be05ad-d0a5-4658-904f-e1b4baa570c7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:33.853373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be05ad-d0a5-4658-904f-e1b4baa570c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:33.883735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a3be05ad-d0a5-4658-904f-e1b4baa570c7 None None] MFA Rules not processed for user `6bc47b4f60e746c8a9e30b742f783dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:33.885067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3be05ad-d0a5-4658-904f-e1b4baa570c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:33.957827 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1678/3363] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:33.964642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:33.977532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a392f7d-6d24-49d7-bda2-cedfe3e162a3 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:33.983354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d33bc-16af-4c65-b83e-36fd3c235cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:33.984234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d33bc-16af-4c65-b83e-36fd3c235cf9 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:33.984512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d33bc-16af-4c65-b83e-36fd3c235cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:33.984785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d33bc-16af-4c65-b83e-36fd3c235cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:33.994519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d33bc-16af-4c65-b83e-36fd3c235cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:33.996117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d33bc-16af-4c65-b83e-36fd3c235cf9 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:34.007235 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1686/3364] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:34.649446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be05ad-d0a5-4658-904f-e1b4baa570c7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:34.797656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be05ad-d0a5-4658-904f-e1b4baa570c7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:34.808977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:34.812303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:34.812303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:34.812303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] PATH_INFO: `/v3/users/335bd787ce2e4d07b9d983cbec741c08` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:34.812815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335bd787ce2e4d07b9d983cbec741c08)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:34.815050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:34.828354 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:35.071653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335bd787ce2e4d07b9d983cbec741c08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:35.101101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335bd787ce2e4d07b9d983cbec741c08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:35.103693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335bd787ce2e4d07b9d983cbec741c08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:35.202063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335bd787ce2e4d07b9d983cbec741c08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:35.203203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335bd787ce2e4d07b9d983cbec741c08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:35.248669 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1679/3365] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:34 2022] DELETE /identity/v3/users/335bd787ce2e4d07b9d983cbec741c08 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:35.253930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:35.254509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:35.254509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:35.288782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:35.290185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:35.429358 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1687/3366] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:35.438453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:35.439875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:35.597250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418cf81-285f-4b4f-83c4-2f22c208b690 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:35.602395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713c4e0-f260-43ea-b707-3da037a53392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:35.603103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713c4e0-f260-43ea-b707-3da037a53392 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:35.603449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713c4e0-f260-43ea-b707-3da037a53392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:35.603852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713c4e0-f260-43ea-b707-3da037a53392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:35.615148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713c4e0-f260-43ea-b707-3da037a53392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:35.617735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713c4e0-f260-43ea-b707-3da037a53392 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:35.629089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1680/3367] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:23:36.584789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:36.585469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:36.612281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194863b9-4e61-4a0c-ba58-a205eb575167 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:36.636724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:36.637430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:36.637712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:36.638000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] PATH_INFO: `/v3/projects/1d059158eca14b8ab0caa00c193d6bc9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:36.640328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d059158eca14b8ab0caa00c193d6bc9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:36.666472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:36.789710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d059158eca14b8ab0caa00c193d6bc9', 'request_id': 'req-329d7cad-738c-4966-991c-d9118d2b6837'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:36.807833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d059158eca14b8ab0caa00c193d6bc9', 'request_id': 'req-329d7cad-738c-4966-991c-d9118d2b6837'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:36.894205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d059158eca14b8ab0caa00c193d6bc9', 'request_id': 'req-329d7cad-738c-4966-991c-d9118d2b6837'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:36.922755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] The token cache is being invalidate because project 1d059158eca14b8ab0caa00c193d6bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:36.924435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:36.924435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-329d7cad-738c-4966-991c-d9118d2b6837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:36.932164 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1688/3368] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:36 2022] DELETE /identity/v3/projects/1d059158eca14b8ab0caa00c193d6bc9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:36.938960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eb78f-161e-4d87-9bae-575dd0924191 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:36.939484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eb78f-161e-4d87-9bae-575dd0924191 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:36.939593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eb78f-161e-4d87-9bae-575dd0924191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:36.962363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-854eb78f-161e-4d87-9bae-575dd0924191 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:36.963645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-854eb78f-161e-4d87-9bae-575dd0924191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:37.030139 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1681/3369] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:37.036581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0094-7a9a-4a9e-918c-74a056d3bd81 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:37.036933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0094-7a9a-4a9e-918c-74a056d3bd81 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:37.037215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb0094-7a9a-4a9e-918c-74a056d3bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:37.059020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cbfb0094-7a9a-4a9e-918c-74a056d3bd81 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:37.060383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cbfb0094-7a9a-4a9e-918c-74a056d3bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:37.076094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1689/3370] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:37.084900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eb78f-161e-4d87-9bae-575dd0924191 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:37.091390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eb78f-161e-4d87-9bae-575dd0924191 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:37.096724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:37.097357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:37.098225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:37.098548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:37.099323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:37.099674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:37.102070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:37.117522 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1682/3371] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:37.137845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb0094-7a9a-4a9e-918c-74a056d3bd81 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:37.137845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb0094-7a9a-4a9e-918c-74a056d3bd81 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:37.143701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:37.144380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:37.145152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:37.145402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:37.146134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:37.148815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:37.609916 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1690/3372] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:37 2022] POST /identity/v3/projects => generated 383 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:37.616228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:37.627168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe708c-f42a-43b5-8af4-cf47458ebd51 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:37.645379 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:37.697570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:37.698371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:37.698710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:37.699115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:37.699923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:37.701933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:37.848095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1683/3373] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:37 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:37.852753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:37.864156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57e01-fb11-4306-9315-6e3073706a32 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:37.870727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:37.871444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:37.871613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:37.871884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:37.872525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:37.874479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:37.886779 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1691/3374] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:37.890787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:37.902124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385db069-e9db-40a7-96d7-7c29411bba75 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:37.907260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca759bf-9a75-4aa7-a8c3-f756b37f8a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:37.907936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca759bf-9a75-4aa7-a8c3-f756b37f8a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:37.908215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca759bf-9a75-4aa7-a8c3-f756b37f8a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:37.908482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca759bf-9a75-4aa7-a8c3-f756b37f8a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:37.909171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca759bf-9a75-4aa7-a8c3-f756b37f8a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:37.910796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca759bf-9a75-4aa7-a8c3-f756b37f8a93 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:37.930207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1684/3375] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:37.934619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:37.945107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a23ec-7672-499e-af45-8ede6cf66e8d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:37.950252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:37.951766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:37.951766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:37.951766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] PATH_INFO: `/v3/projects/c7f54b8f318a44d0bcc6e2c6b7041acd/users/35951de600194085be8233f150a6ded3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:37.969178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f54b8f318a44d0bcc6e2c6b7041acd, user_id=35951de600194085be8233f150a6ded3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:37.972200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:38.040807 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1692/3376] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:37 2022] PUT /identity/v3/projects/c7f54b8f318a44d0bcc6e2c6b7041acd/users/35951de600194085be8233f150a6ded3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:38.051771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e7e8-6b25-49bd-baa1-73ac56e43a18 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:38.052321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e7e8-6b25-49bd-baa1-73ac56e43a18 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:38.052427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e7e8-6b25-49bd-baa1-73ac56e43a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:38.128188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-29b6e7e8-6b25-49bd-baa1-73ac56e43a18 None None] MFA Rules not processed for user `35951de600194085be8233f150a6ded3`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:38.129870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-29b6e7e8-6b25-49bd-baa1-73ac56e43a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:38.222433 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1685/3377] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:38.227564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:38.247718 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:38.342118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c089fc-b9b2-46f8-8a13-d3216790c934 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:38.350789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:38.353893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:38.353893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:38.353893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:38.353893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:38.356143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:38.469660 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1693/3378] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:38 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:38.471338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e7e8-6b25-49bd-baa1-73ac56e43a18 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:38.492694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e7e8-6b25-49bd-baa1-73ac56e43a18 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:38.593474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:38.596305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:38.596305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:38.596305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:38.596305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:38.598708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:38.726330 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1686/3379] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:38 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:38.727795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:38.739090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df76a-9cef-4249-a960-61132242fd83 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:38.744570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:38.745210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:38.745542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:38.745862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:38.746660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:38.748350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:38.765740 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1694/3380] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:38.767010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:38.786637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af101-8446-4ac4-b09e-b9bf71f96606 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:38.801249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:38.801817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:38.802312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:38.802623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] PATH_INFO: `/v3/projects/9cd7b2e6defb45a898305df4ecfbcad0/users/8d79d512be064bdcba560e16991601d1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:38.819530 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:38.823098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd7b2e6defb45a898305df4ecfbcad0, user_id=8d79d512be064bdcba560e16991601d1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:38.829027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:38.911505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1687/3381] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:38 2022] PUT /identity/v3/projects/9cd7b2e6defb45a898305df4ecfbcad0/users/8d79d512be064bdcba560e16991601d1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:38.912987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:38.938017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cfa40-3640-4f0b-b1f3-1749625b1903 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:39.037211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ccabc-030f-49b8-b740-98ae62e455cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:39.038783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ccabc-030f-49b8-b740-98ae62e455cd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.039527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ccabc-030f-49b8-b740-98ae62e455cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.040005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ccabc-030f-49b8-b740-98ae62e455cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.040669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ccabc-030f-49b8-b740-98ae62e455cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:39.042441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ccabc-030f-49b8-b740-98ae62e455cd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:39.066555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:39.073596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1695/3382] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:39.080109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540704-3372-44ec-82c8-86430e0a6dcb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:39.107606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:39.108313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.111491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.111491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] PATH_INFO: `/v3/projects/9cd7b2e6defb45a898305df4ecfbcad0/users/8d79d512be064bdcba560e16991601d1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.111491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd7b2e6defb45a898305df4ecfbcad0, user_id=8d79d512be064bdcba560e16991601d1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:39.113647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:39.137171 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1688/3383] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:39 2022] PUT /identity/v3/projects/9cd7b2e6defb45a898305df4ecfbcad0/users/8d79d512be064bdcba560e16991601d1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:39.149683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f11c-a8bd-4496-b403-ab39db64d21b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.149683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f11c-a8bd-4496-b403-ab39db64d21b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.149683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f11c-a8bd-4496-b403-ab39db64d21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.211436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-15b4f11c-a8bd-4496-b403-ab39db64d21b None None] MFA Rules not processed for user `8d79d512be064bdcba560e16991601d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:39.213045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-15b4f11c-a8bd-4496-b403-ab39db64d21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:39.343544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1696/3384] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:39.349848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:39.369140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf22529-e74f-42e7-9438-21ad6de53b6b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:39.377518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:39.378794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.379372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.381592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.382543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:39.383996 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:39.383996 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:23:39.383996 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:23:39.385401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invalid input for field 'name': '' is too short Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: On instance['name']: Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: On instance['name']: Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: '' Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise error Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application '' Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:39.487417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:23:39.490609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application '' Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:39.492344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1689/3385] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:23:39 2022] POST /identity/v3/domains => generated 283 bytes in 109 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 23 01:23:39.493096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f11c-a8bd-4496-b403-ab39db64d21b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:39.493096 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:39.502958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f11c-a8bd-4496-b403-ab39db64d21b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:39.509796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:39.510496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.510779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.511207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.511910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:39.513011 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:39.513011 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:23:39.513011 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:23:39.513963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: On instance['name']: Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: On instance['name']: Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise error Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.523502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 23 01:23:39.529466 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.530702 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1697/3386] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:23:39 2022] POST /identity/v3/domains => generated 412 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 23 01:23:39.531821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:39.540876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511cf26-f440-45dd-a47a-e428807e2938 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:39.545779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:39.546461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.546723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.547045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.547735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:39.549416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:39.803236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1690/3387] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:23:39 2022] POST /identity/v3/domains => generated 277 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:39.805584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:39.821516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaff69-95fd-4ca1-a2bd-1b374a81da21 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:39.874340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:39.875129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.875417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.875691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.886754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2df385e9e0ab4fa4b3894aab001a03c2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:39.887922 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:39.887922 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:23:39.887922 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:23:39.888797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 23 01:23:39.903021 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 23 01:23:39.904087 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:39.906301 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1698/3388] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:23:39 2022] DELETE /identity/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2 => generated 120 bytes in 101 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:23:39.909156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:39.921529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988144-a62e-426d-8442-da9866e87d03 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:39.926515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:39.931952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:39.931952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:39.931952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:39.931952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2df385e9e0ab4fa4b3894aab001a03c2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:39.932831 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:39.932831 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:23:39.932831 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:23:39.932831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:39.961120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:39.961120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.082204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.082888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.085205 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1691/3389] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:23:39 2022] PATCH /identity/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2 => generated 278 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:40.089307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:40.091223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:40.105187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04868734-619b-430a-bdb0-bce64810212d tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:40.183554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:40.183554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:40.183554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:40.184505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:40.197807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2df385e9e0ab4fa4b3894aab001a03c2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:40.200113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:40.230619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.236447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.389593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2', 'request_id': 'req-0b66f3fd-216f-445d-b857-512508dce142'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.391977 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:40.396239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2', 'request_id': 'req-0b66f3fd-216f-445d-b857-512508dce142'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.531120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2', 'request_id': 'req-0b66f3fd-216f-445d-b857-512508dce142'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.543413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] The token cache is being invalidate because project 2df385e9e0ab4fa4b3894aab001a03c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:40.543790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.544508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.559751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2', 'request_id': 'req-0b66f3fd-216f-445d-b857-512508dce142'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.560509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2', 'request_id': 'req-0b66f3fd-216f-445d-b857-512508dce142'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.564393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2df385e9e0ab4fa4b3894aab001a03c2', 'request_id': 'req-0b66f3fd-216f-445d-b857-512508dce142'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:40.570092 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1699/3390] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:23:40 2022] DELETE /identity/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:40.575231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:40.586891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79bea-8946-437d-93e1-ff6631563b84 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:40.667812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:40.668475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:40.668747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:40.669015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains/b33ea54e0b21425484943532bdafae0a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:40.676521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Could not find domain: b33ea54e0b21425484943532bdafae0a.: keystone.exception.DomainNotFound: Could not find domain: b33ea54e0b21425484943532bdafae0a. Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b33ea54e0b21425484943532bdafae0a. Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:23:40.682419 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:23:40.683602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:23:40.684681 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b33ea54e0b21425484943532bdafae0a. Oct 23 01:23:40.686519 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.689323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1692/3391] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:23:40 2022] DELETE /identity/v3/domains/b33ea54e0b21425484943532bdafae0a => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:23:40.694152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:40.696514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:40.710716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f3fd-216f-445d-b857-512508dce142 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:40.717494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:40.718689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:40.719118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:40.719393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:40.720051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:40.723635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:40.815732 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1700/3392] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:23:40 2022] POST /identity/v3/domains => generated 252 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:40.818891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:40.831827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c35c8-1890-4802-9f17-d43ac81381f3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:40.905832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:40.907819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:40.908110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:40.908435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:40.909171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:40.911728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:40.950635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.sql.core [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-746992479' for key 'project.ixu_project_name_domain_id'") Oct 23 01:23:40.950635 n-d-master-1 devstack@keystone.service[81937]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:23:40.950635 n-d-master-1 devstack@keystone.service[81937]: [parameters: {'id': '14b9cf361a454c3aa912beaf0bdafb32', 'name': 'tempest-domain-dup-746992479', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 01:23:40.950635 n-d-master-1 devstack@keystone.service[81937]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81937) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-746992479.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-746992479. Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:23:40.958221 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-746992479' for key 'project.ixu_project_name_domain_id'") Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 01:23:40.959944 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application yield resource Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise self.value Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.commit() Oct 23 01:23:40.961337 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:23:40.962797 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 01:23:40.964179 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:23:40.965317 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-746992479' for key 'project.ixu_project_name_domain_id'") Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [parameters: {'id': '14b9cf361a454c3aa912beaf0bdafb32', 'name': 'tempest-domain-dup-746992479', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.966619 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-746992479. Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:23:40.967728 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-746992479. Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:40.969198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1693/3393] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:23:40 2022] POST /identity/v3/domains => generated 211 bytes in 146 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:23:40.970810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:40.990947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410843b9-1a58-43ee-84b5-fafae86f34ad tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:40.997652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:40.998457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:40.999148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:40.999148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains/49fd7f915c4e4aa9bd6e85f6e1c7948e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:41.014232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=49fd7f915c4e4aa9bd6e85f6e1c7948e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:41.015264 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:41.015264 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:23:41.015264 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:23:41.016161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:41.038651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.039433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.145313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.147043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.152906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1701/3394] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:23:40 2022] PATCH /identity/v3/domains/49fd7f915c4e4aa9bd6e85f6e1c7948e => generated 253 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:41.153759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:41.156193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:41.173353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5210a9-e764-45b6-add7-42806d686109 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:41.183315 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:41.231180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:41.232114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:41.232552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:41.232965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains/49fd7f915c4e4aa9bd6e85f6e1c7948e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:41.245404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=49fd7f915c4e4aa9bd6e85f6e1c7948e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:41.246727 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:41.246727 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:23:41.246727 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:23:41.247963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:41.276982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.283582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.438385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e', 'request_id': 'req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.454261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e', 'request_id': 'req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.590597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e', 'request_id': 'req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.618979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] The token cache is being invalidate because project 49fd7f915c4e4aa9bd6e85f6e1c7948e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:41.622119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.626583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.648057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e', 'request_id': 'req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.648778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e', 'request_id': 'req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.654275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '49fd7f915c4e4aa9bd6e85f6e1c7948e', 'request_id': 'req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:41.662089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1694/3395] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:23:41 2022] DELETE /identity/v3/domains/49fd7f915c4e4aa9bd6e85f6e1c7948e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:41.666792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:41.680506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a228cd6-d648-4bcd-9043-44b1fd86fb4e tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:41.760204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ed667-cc20-4a13-b1b5-6b9796a91fc3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d79d512be064bdcba560e16991601d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cd7b2e6defb45a898305df4ecfbcad0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:41.761278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ed667-cc20-4a13-b1b5-6b9796a91fc3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:41.761668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ed667-cc20-4a13-b1b5-6b9796a91fc3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:41.762209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ed667-cc20-4a13-b1b5-6b9796a91fc3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] PATH_INFO: `/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:41.770492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ed667-cc20-4a13-b1b5-6b9796a91fc3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ad1ed667-cc20-4a13-b1b5-6b9796a91fc3 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Could not find domain: 2df385e9e0ab4fa4b3894aab001a03c2.: keystone.exception.DomainNotFound: Could not find domain: 2df385e9e0ab4fa4b3894aab001a03c2. Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2df385e9e0ab4fa4b3894aab001a03c2. Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:23:41.778207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:23:41.779395 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:23:41.780744 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2df385e9e0ab4fa4b3894aab001a03c2. Oct 23 01:23:41.781798 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:23:41.781798 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1702/3396] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:23:41 2022] PATCH /identity/v3/domains/2df385e9e0ab4fa4b3894aab001a03c2 => generated 112 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 23 01:23:41.784830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:41.791754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:41.906681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f1fa7-8bb7-4fc2-8062-4cf482fc5bb6 tempest-DomainsNegativeTestJSON-157118938 tempest-DomainsNegativeTestJSON-157118938-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:41.915491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:41.915850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:41.916194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:41.916466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] PATH_INFO: `/v3/users/35951de600194085be8233f150a6ded3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:41.917695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35951de600194085be8233f150a6ded3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:41.919967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:42.233887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35951de600194085be8233f150a6ded3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:42.250297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35951de600194085be8233f150a6ded3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:42.253095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35951de600194085be8233f150a6ded3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:42.328157 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:42.331689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35951de600194085be8233f150a6ded3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:42.335744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35951de600194085be8233f150a6ded3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:42.374663 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1695/3397] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:41 2022] DELETE /identity/v3/users/35951de600194085be8233f150a6ded3 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:42.378935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:42.379844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:42.380296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:42.418587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:42.420413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:42.493078 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:42.511879 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1703/3398] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:23:42.528437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:42.529919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:42.602631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3928c-5dab-4189-949b-177a4ec5d783 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:42.608297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:42.608993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:42.609228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:42.609505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:42.622499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:42.630907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:42.634781 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1696/3399] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:43.288994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:43.290944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:43.305873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e1e44-3022-4a1b-afa3-41e3d509bcad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:43.335771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:43.336918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:43.337766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:43.339345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] PATH_INFO: `/v3/projects/c7f54b8f318a44d0bcc6e2c6b7041acd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:43.341377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f54b8f318a44d0bcc6e2c6b7041acd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:43.343516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:43.515309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f54b8f318a44d0bcc6e2c6b7041acd', 'request_id': 'req-ac63316b-13cd-461d-81a2-d74147bc785b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:43.539190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f54b8f318a44d0bcc6e2c6b7041acd', 'request_id': 'req-ac63316b-13cd-461d-81a2-d74147bc785b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:43.619498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f54b8f318a44d0bcc6e2c6b7041acd', 'request_id': 'req-ac63316b-13cd-461d-81a2-d74147bc785b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:43.638050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] The token cache is being invalidate because project c7f54b8f318a44d0bcc6e2c6b7041acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:43.638478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:43.639516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:43.642490 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1704/3400] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:43 2022] DELETE /identity/v3/projects/c7f54b8f318a44d0bcc6e2c6b7041acd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:43.647117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:43.666081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39418aee-09fb-411f-8e3d-15e9ea9b82dd service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:43.726399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:43.727056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:43.727319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:43.727592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] PATH_INFO: `/v3/users/8d79d512be064bdcba560e16991601d1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:43.728708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d79d512be064bdcba560e16991601d1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:43.730710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:43.752697 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:43.796777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:43.798277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:43.814699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63316b-13cd-461d-81a2-d74147bc785b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:43.820369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:43.821131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:43.821504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:43.821871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] PATH_INFO: `/v3/users/7f33238147dc49209bcebea4dfa47ad4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:43.823315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f33238147dc49209bcebea4dfa47ad4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:43.825441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:43.995386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d79d512be064bdcba560e16991601d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.002959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d79d512be064bdcba560e16991601d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.004330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d79d512be064bdcba560e16991601d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.088285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d79d512be064bdcba560e16991601d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.088943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48055af4-da0a-4c6f-9cda-de2d0df3ef5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d79d512be064bdcba560e16991601d1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.110518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f33238147dc49209bcebea4dfa47ad4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.114348 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1697/3401] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:43 2022] DELETE /identity/v3/users/8d79d512be064bdcba560e16991601d1 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:44.119637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f33238147dc49209bcebea4dfa47ad4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.120496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f33238147dc49209bcebea4dfa47ad4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.210457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f33238147dc49209bcebea4dfa47ad4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.210457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f33238147dc49209bcebea4dfa47ad4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:44.236661 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1705/3402] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:43 2022] DELETE /identity/v3/users/7f33238147dc49209bcebea4dfa47ad4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:44.240849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:44.241138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:44.241413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:44.269350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:44.269350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:44.336713 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1698/3403] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:44.347004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:44.348409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:44.421488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc429ee6-3e49-4c86-a25b-10df3ea6b87f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:44.425331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:44.426225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:44.426501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:44.426767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:44.435217 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:44.439135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:44.440753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:44.452986 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1706/3404] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:45.581537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:45.583029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:45.588102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:45.590112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:45.601024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7771ef-5cbc-4723-a900-cfbd4f93c45f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:45.610764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:45.611650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:45.611939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:45.613584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] PATH_INFO: `/v3/projects/9cd7b2e6defb45a898305df4ecfbcad0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:45.616792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd7b2e6defb45a898305df4ecfbcad0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:45.623263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:45.653941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac34f7-7257-4b86-a34d-80bc0edee4f9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:45.694020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:45.694297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:45.694539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:45.694933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] PATH_INFO: `/v3/projects/3c8546a1c3b3418fae012aa51fd37c82` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:45.697471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8546a1c3b3418fae012aa51fd37c82)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:45.699441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:45.860908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd7b2e6defb45a898305df4ecfbcad0', 'request_id': 'req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:45.869543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd7b2e6defb45a898305df4ecfbcad0', 'request_id': 'req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:45.898176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8546a1c3b3418fae012aa51fd37c82', 'request_id': 'req-e4e27231-8515-4d56-adfd-8d2b9133e859'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:45.906313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8546a1c3b3418fae012aa51fd37c82', 'request_id': 'req-e4e27231-8515-4d56-adfd-8d2b9133e859'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:45.973572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd7b2e6defb45a898305df4ecfbcad0', 'request_id': 'req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:46.020198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] The token cache is being invalidate because project 9cd7b2e6defb45a898305df4ecfbcad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:46.020749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:46.024881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-595a60bc-cec5-4bad-8ad8-7b2e800b15fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:46.024881 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1699/3405] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:45 2022] DELETE /identity/v3/projects/9cd7b2e6defb45a898305df4ecfbcad0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:46.032635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b01b5d-69fb-4270-8c71-5c299b5ab580 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.032923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b01b5d-69fb-4270-8c71-5c299b5ab580 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.033193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b01b5d-69fb-4270-8c71-5c299b5ab580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.042960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8546a1c3b3418fae012aa51fd37c82', 'request_id': 'req-e4e27231-8515-4d56-adfd-8d2b9133e859'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:46.058909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-84b01b5d-69fb-4270-8c71-5c299b5ab580 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:46.064857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-84b01b5d-69fb-4270-8c71-5c299b5ab580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:46.064998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] The token cache is being invalidate because project 3c8546a1c3b3418fae012aa51fd37c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:46.064998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:46.064998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e4e27231-8515-4d56-adfd-8d2b9133e859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:46.064998 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1707/3406] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:45 2022] DELETE /identity/v3/projects/3c8546a1c3b3418fae012aa51fd37c82 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:46.070449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bbced-6d24-483e-bfb2-a2c73033ae97 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.072570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bbced-6d24-483e-bfb2-a2c73033ae97 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.073188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bbced-6d24-483e-bfb2-a2c73033ae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.085876 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:46.098879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c58bbced-6d24-483e-bfb2-a2c73033ae97 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:46.100663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c58bbced-6d24-483e-bfb2-a2c73033ae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:46.141240 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1700/3407] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:46.149694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af236c-3eee-49dc-af47-e8753e8d2545 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.149913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af236c-3eee-49dc-af47-e8753e8d2545 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.150233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af236c-3eee-49dc-af47-e8753e8d2545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.164750 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1708/3408] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:23:46.171768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d9af236c-3eee-49dc-af47-e8753e8d2545 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:46.172623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba958a7-ad37-4715-9561-5e7161a0f86d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.174196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba958a7-ad37-4715-9561-5e7161a0f86d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.174317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d9af236c-3eee-49dc-af47-e8753e8d2545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:46.174420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba958a7-ad37-4715-9561-5e7161a0f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.182602 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1701/3409] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:46.187183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af236c-3eee-49dc-af47-e8753e8d2545 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.197492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af236c-3eee-49dc-af47-e8753e8d2545 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.198748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1ba958a7-ad37-4715-9561-5e7161a0f86d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:46.200202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ba958a7-ad37-4715-9561-5e7161a0f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:46.206484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.206484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.206484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.206484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.206877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:46.206877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.214662 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1709/3410] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:46.216352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba958a7-ad37-4715-9561-5e7161a0f86d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.219739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.238132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba958a7-ad37-4715-9561-5e7161a0f86d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.243003 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1702/3411] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:46.249387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.254332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.255183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.255464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.256436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.257140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:46.257497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.259452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.267397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42824d-6466-4add-aab5-d49f52430a84 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.276175 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1710/3412] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:46.280731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.281049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.281703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.282013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.282283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.282915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.291038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.293705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce83ba-e0ff-4a87-abe3-35c13664b402 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.301620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.302301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.302610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.302885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.303586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.305781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.413246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1703/3413] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:46.417564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.465870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1711/3414] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:46.471584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.509492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec0ec-9b05-4ed1-8cb0-4544fc013916 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.571480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bbbe1-e41e-4834-96e6-97a2e98c6c01 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.572666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.573326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.573666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.573872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.574562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.576482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.576866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.577544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.577925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.578226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.578840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.580703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.689554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1704/3415] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:46.691074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.703225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbce7-3323-4e1c-a09b-05ed6a0430f5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.709430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.712507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.712646 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1712/3416] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:46.713114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.713114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.713114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.713645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.715279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.726397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa1a2-ce48-400f-bb39-cc97f9ea9fd3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.728284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1705/3417] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:23:46.731938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.732533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.732783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.733065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.733338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.734011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.735676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.745955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca0eca-a0cd-4678-bcae-48f50dd4d89a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.747759 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1713/3418] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:23:46.751707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.751920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.752333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.752662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.753031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.753685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.755344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.766814 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1706/3419] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:46.771757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122bf1-7ab4-42ec-b346-55fa11857349 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.779023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.779211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.779710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.780068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.780264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.780902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.782769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.790892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67703-9408-4ac9-b680-bb82e921c002 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.798416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889646-01e2-41ba-a472-d0ee503b23db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.798416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889646-01e2-41ba-a472-d0ee503b23db admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.798416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889646-01e2-41ba-a472-d0ee503b23db admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.798416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889646-01e2-41ba-a472-d0ee503b23db admin admin] PATH_INFO: `/v3/projects/67d31ab33d804faca24cf5f7e6f4485c/users/3ed3bb193add44b4a03a688ef63fd14e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.799445 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1714/3420] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:23:46.800475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:46.812186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c45ba8-8d35-400d-a364-687d9f17de5e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:46.817666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce4675-8e66-4748-b53c-7383da5d03e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:46.819235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce4675-8e66-4748-b53c-7383da5d03e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.819789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce4675-8e66-4748-b53c-7383da5d03e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.820135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce4675-8e66-4748-b53c-7383da5d03e8 admin admin] PATH_INFO: `/v3/projects/4308ac3d1dbe4e798f6650316f479826/users/418a4c6848204bea8eadb505ccb9c04e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.822116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889646-01e2-41ba-a472-d0ee503b23db admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d31ab33d804faca24cf5f7e6f4485c, user_id=3ed3bb193add44b4a03a688ef63fd14e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.825112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889646-01e2-41ba-a472-d0ee503b23db admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.838465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce4675-8e66-4748-b53c-7383da5d03e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4308ac3d1dbe4e798f6650316f479826, user_id=418a4c6848204bea8eadb505ccb9c04e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:46.841259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce4675-8e66-4748-b53c-7383da5d03e8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:46.892490 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:46.940278 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1707/3421] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:46 2022] PUT /identity/v3/projects/67d31ab33d804faca24cf5f7e6f4485c/users/3ed3bb193add44b4a03a688ef63fd14e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:46.941493 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1715/3422] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:46 2022] PUT /identity/v3/projects/4308ac3d1dbe4e798f6650316f479826/users/418a4c6848204bea8eadb505ccb9c04e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:46.955259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.959174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.959174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.964101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784954b-6616-431b-8a06-71705a49ecd7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:46.964595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784954b-6616-431b-8a06-71705a49ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:46.965038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784954b-6616-431b-8a06-71705a49ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:46.993803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] MFA Rules not processed for user `3ed3bb193add44b4a03a688ef63fd14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:46.995152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:47.015006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1784954b-6616-431b-8a06-71705a49ecd7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:47.017611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1784954b-6616-431b-8a06-71705a49ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:47.088703 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1716/3423] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:23:47.094261 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1708/3424] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:47.096236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784954b-6616-431b-8a06-71705a49ecd7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:47.100221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:47.101587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:47.115759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784954b-6616-431b-8a06-71705a49ecd7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:47.121223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:47.121967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.122366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.122750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.123623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:47.125661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:47.176528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fec1f-743a-4ffc-8014-3d4b78b57251 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:47.184750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:47.185505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.185787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.186421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.199690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:47.201506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:47.213215 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1709/3425] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:23:47.247666 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1717/3426] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:47 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:47.248971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:47.260578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0cd4d-06a5-4694-8697-036639a32b99 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:47.329729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:47.330580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.330880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.331122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.331809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:47.340442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:47.469334 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1710/3427] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:47 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:47.471331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:47.488946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e19f94-9c45-4678-9f3a-5bb34bc91267 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:47.494028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:47.494944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.495309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.495577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.496213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:47.498356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:47.513478 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1718/3428] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:47.514914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:47.527725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe325c8-ca64-404a-b2e5-8730b8a470e1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:47.533030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:47.533751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.536604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.536604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] PATH_INFO: `/v3/projects/71147e20b4204b6898fe61d3459966b2/users/e8ecec9741dd4ca68175414bc48a0651/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.549890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71147e20b4204b6898fe61d3459966b2, user_id=e8ecec9741dd4ca68175414bc48a0651, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:47.553051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:47.642528 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1711/3429] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:47 2022] PUT /identity/v3/projects/71147e20b4204b6898fe61d3459966b2/users/e8ecec9741dd4ca68175414bc48a0651/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:47.647045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:47.660195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c30404-737b-4a2e-b469-c429e831ac80 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:47.726929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53d8fb-d096-41bd-bdef-62f80c4c5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:47.727636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d8fb-d096-41bd-bdef-62f80c4c5404 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.727817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d8fb-d096-41bd-bdef-62f80c4c5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.728141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d8fb-d096-41bd-bdef-62f80c4c5404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.728732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53d8fb-d096-41bd-bdef-62f80c4c5404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:47.730379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53d8fb-d096-41bd-bdef-62f80c4c5404 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:47.744718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1719/3430] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:23:47.745929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:47.760199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531af77-a705-42c6-b572-278380ba5074 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:47.765483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:47.766382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.766677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.766913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] PATH_INFO: `/v3/projects/71147e20b4204b6898fe61d3459966b2/users/e8ecec9741dd4ca68175414bc48a0651/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.768933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71147e20b4204b6898fe61d3459966b2, user_id=e8ecec9741dd4ca68175414bc48a0651, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:47.772248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:47.787575 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1712/3431] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:47 2022] PUT /identity/v3/projects/71147e20b4204b6898fe61d3459966b2/users/e8ecec9741dd4ca68175414bc48a0651/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:47.870431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bd0de-3c33-4c4b-99b0-677bc36eafbd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:47.870833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bd0de-3c33-4c4b-99b0-677bc36eafbd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:47.871085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bd0de-3c33-4c4b-99b0-677bc36eafbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:47.934510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-673bd0de-3c33-4c4b-99b0-677bc36eafbd None None] MFA Rules not processed for user `e8ecec9741dd4ca68175414bc48a0651`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:47.935994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-673bd0de-3c33-4c4b-99b0-677bc36eafbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:48.029429 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1720/3432] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:48.034371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.050611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bf402-ea4c-4222-b2b0-b0bc41244402 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.056075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.056749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.057192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.057469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.058168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.059767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.070862 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:48.141661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1713/3433] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:23:48 2022] POST /identity/v3/domains => generated 276 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:48.147526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bd0de-3c33-4c4b-99b0-677bc36eafbd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.160531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bd0de-3c33-4c4b-99b0-677bc36eafbd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.238776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.239506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.240055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.240399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.241122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.243319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.347352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1721/3434] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:48 2022] POST /identity/v3/users => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:48.371723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.385363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c45a-67c3-4d62-af26-a93c5633461c tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.403125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.407407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.407407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.407407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.407407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.407407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.512416 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1714/3435] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:48 2022] POST /identity/v3/users => generated 322 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:48.516969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.529762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5985f-4c7d-4984-8734-003b6c973067 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.535347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.536168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.536472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.536785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users/68302e2149104ce682e30781dc821345` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.553194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:get_user(user_id=68302e2149104ce682e30781dc821345)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.555779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.562088 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1722/3436] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:23:48 2022] GET /identity/v3/users/68302e2149104ce682e30781dc821345 => generated 346 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:48.563784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.575638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a0fc-8e86-4e99-a78a-0b5c010fe7d7 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.581140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.581300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.581574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.581843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.585764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Adding query filter params (domain_id=225f6eee4dba4700bd4cfe572d276fbc) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:48.585764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.585764 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:48.585764 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:23:48.585764 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:23:48.586464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.610311 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1715/3437] 10.222.0.42 () {58 vars in 1207 bytes} [Sun Oct 23 01:23:48 2022] GET /identity/v3/users?domain_id=225f6eee4dba4700bd4cfe572d276fbc => generated 483 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:48.614527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.633499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f799d-2478-462e-ba76-4f516d54f0e6 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.639623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.640439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.640777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.642024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.643282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.643412 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:23:48.643412 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:23:48.643412 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:23:48.645175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.686598 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:48.691147 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1723/3438] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:48 2022] GET /identity/v3/users => generated 9178 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:48.696937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.708378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db455-487f-4a56-8eae-e5e5c025df5f tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.713374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.714154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.714409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.714678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.715475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Adding query filter params (name=tempest-test_user-124507827) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:48.715843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.717888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.760366 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1716/3439] 10.222.0.42 () {58 vars in 1187 bytes} [Sun Oct 23 01:23:48 2022] GET /identity/v3/users?name=tempest-test_user-124507827 => generated 473 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:23:48.761332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.772959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ee7eb-ac9b-414c-9062-3b702a9984fc tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.777767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.778490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.778769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.779045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.779872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:48.780181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.782048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:48.805672 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1724/3440] 10.222.0.42 () {58 vars in 1149 bytes} [Sun Oct 23 01:23:48 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:23:48.813529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:48.828233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f2225-00fe-4174-8f06-a19e6c58368a tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:48.840879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:48.842655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:48.842952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:48.843228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users/16ad8e9225db45a080e6ca3d0edd51e6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:48.870227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:delete_user(user_id=16ad8e9225db45a080e6ca3d0edd51e6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:48.872303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:49.057691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ad8e9225db45a080e6ca3d0edd51e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.065468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ad8e9225db45a080e6ca3d0edd51e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.066318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ad8e9225db45a080e6ca3d0edd51e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.130636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ad8e9225db45a080e6ca3d0edd51e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.131426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ad8e9225db45a080e6ca3d0edd51e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.157557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1717/3441] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:48 2022] DELETE /identity/v3/users/16ad8e9225db45a080e6ca3d0edd51e6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:49.162214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:49.164225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:49.187116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc675ab1-4236-4703-a79b-8aace7666173 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:49.251618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:49.252830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:49.253374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:49.253877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/users/68302e2149104ce682e30781dc821345` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:49.255305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:delete_user(user_id=68302e2149104ce682e30781dc821345)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:49.257732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:49.391597 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:49.427797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68302e2149104ce682e30781dc821345'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.447430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68302e2149104ce682e30781dc821345'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.451347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68302e2149104ce682e30781dc821345'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.551392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68302e2149104ce682e30781dc821345'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.552143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68302e2149104ce682e30781dc821345'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.589273 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1725/3442] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:49 2022] DELETE /identity/v3/users/68302e2149104ce682e30781dc821345 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:49.594615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:49.607683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732616a-d61c-444e-b1a1-ba44245c3914 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:49.700402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:49.700402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:49.700402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:49.700791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/domains/225f6eee4dba4700bd4cfe572d276fbc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:49.702913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=225f6eee4dba4700bd4cfe572d276fbc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:49.704912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:49.736752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.737877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.884009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.884662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:49.891996 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1718/3443] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:23:49 2022] PATCH /identity/v3/domains/225f6eee4dba4700bd4cfe572d276fbc => generated 277 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:49.893149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:49.895162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:49.911313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935f727-cd0c-42c0-bd78-0b7d5712bff9 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:50.046249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8ecec9741dd4ca68175414bc48a0651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71147e20b4204b6898fe61d3459966b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:50.046995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:50.047283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:50.047602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] PATH_INFO: `/v3/domains/225f6eee4dba4700bd4cfe572d276fbc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:50.072241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=225f6eee4dba4700bd4cfe572d276fbc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:50.074056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:50.120659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.125039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.148638 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:50.261922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc', 'request_id': 'req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.270148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc', 'request_id': 'req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.362508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc', 'request_id': 'req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.377078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] The token cache is being invalidate because project 225f6eee4dba4700bd4cfe572d276fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:50.377375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.378133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.388779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc', 'request_id': 'req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.389801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc', 'request_id': 'req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.396020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3 tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '225f6eee4dba4700bd4cfe572d276fbc', 'request_id': 'req-b8b86fee-1318-4c30-81fe-1a7ae07bc9f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.403039 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1726/3444] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:23:49 2022] DELETE /identity/v3/domains/225f6eee4dba4700bd4cfe572d276fbc => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:50.407805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:50.409859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:50.484905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db3269-c946-448a-a926-c3f5b460e24d tempest-UsersV3TestJSON-1554710682 tempest-UsersV3TestJSON-1554710682-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:50.559532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:50.560256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:50.560555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:50.560813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] PATH_INFO: `/v3/users/3ed3bb193add44b4a03a688ef63fd14e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:50.563874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed3bb193add44b4a03a688ef63fd14e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:50.568308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:50.733671 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=10,keystone:SELECT=80,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:50.823964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed3bb193add44b4a03a688ef63fd14e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.839121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed3bb193add44b4a03a688ef63fd14e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.840410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed3bb193add44b4a03a688ef63fd14e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.943552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed3bb193add44b4a03a688ef63fd14e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:50.944595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed3bb193add44b4a03a688ef63fd14e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:51.009212 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1719/3445] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:50 2022] DELETE /identity/v3/users/3ed3bb193add44b4a03a688ef63fd14e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:51.010722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:51.011196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:51.011286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:51.046673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:51.048055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:51.150724 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1727/3446] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:23:51.198040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:51.199710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:51.335823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c35ba-71ed-40be-ad2b-f30750b76421 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:51.347205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:51.348177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:51.348177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:51.348364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:51.351722 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:51.377786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:51.379305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:51.413500 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1720/3447] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:23:52.210306 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:52.540268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:52.543117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:52.573091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86047b4-8239-464a-a734-3a1525a9a83f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:52.588062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:52.589060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:52.589549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:52.590072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] PATH_INFO: `/v3/projects/67d31ab33d804faca24cf5f7e6f4485c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:52.591499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d31ab33d804faca24cf5f7e6f4485c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:52.593852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:52.713065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d31ab33d804faca24cf5f7e6f4485c', 'request_id': 'req-d1326e97-5986-4da2-9d70-6395fb2fd0f4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:52.734370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d31ab33d804faca24cf5f7e6f4485c', 'request_id': 'req-d1326e97-5986-4da2-9d70-6395fb2fd0f4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:52.739325 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:52.824777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d31ab33d804faca24cf5f7e6f4485c', 'request_id': 'req-d1326e97-5986-4da2-9d70-6395fb2fd0f4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:52.844695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] The token cache is being invalidate because project 67d31ab33d804faca24cf5f7e6f4485c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:52.844695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:52.845704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:52.853643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1728/3448] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:52 2022] DELETE /identity/v3/projects/67d31ab33d804faca24cf5f7e6f4485c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:52.854923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:52.867042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f2a7b-b74a-494a-8f52-c93096e360fa service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:53.016040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:53.016189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:53.016638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:53.017066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] PATH_INFO: `/v3/users/e8ecec9741dd4ca68175414bc48a0651` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:53.018946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ecec9741dd4ca68175414bc48a0651)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:53.021101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:53.372060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ecec9741dd4ca68175414bc48a0651'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:53.388848 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:53.405734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ecec9741dd4ca68175414bc48a0651'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:53.411189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ecec9741dd4ca68175414bc48a0651'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:53.579853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ecec9741dd4ca68175414bc48a0651'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:53.580495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-67603fa8-fc44-4df4-9d1f-3b8f6be67abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ecec9741dd4ca68175414bc48a0651'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:53.615369 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1721/3449] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:52 2022] DELETE /identity/v3/users/e8ecec9741dd4ca68175414bc48a0651 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:54.642295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:54.644383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:54.671770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1326e97-5986-4da2-9d70-6395fb2fd0f4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:54.735217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:54.735865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:54.736146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:54.736469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] PATH_INFO: `/v3/projects/71147e20b4204b6898fe61d3459966b2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:54.737823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71147e20b4204b6898fe61d3459966b2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:54.740271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:54.905291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71147e20b4204b6898fe61d3459966b2', 'request_id': 'req-da993d39-2bcf-4043-9801-1edd606c2076'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:54.913601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71147e20b4204b6898fe61d3459966b2', 'request_id': 'req-da993d39-2bcf-4043-9801-1edd606c2076'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:54.992474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71147e20b4204b6898fe61d3459966b2', 'request_id': 'req-da993d39-2bcf-4043-9801-1edd606c2076'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.004567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] The token cache is being invalidate because project 71147e20b4204b6898fe61d3459966b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:55.004908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.007849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-da993d39-2bcf-4043-9801-1edd606c2076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.009538 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1729/3450] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:54 2022] DELETE /identity/v3/projects/71147e20b4204b6898fe61d3459966b2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:55.014623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097986a-e4b9-462f-a7db-3c70a3662c32 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.015694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097986a-e4b9-462f-a7db-3c70a3662c32 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.015933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097986a-e4b9-462f-a7db-3c70a3662c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.037277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1097986a-e4b9-462f-a7db-3c70a3662c32 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:55.038579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1097986a-e4b9-462f-a7db-3c70a3662c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:55.105091 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1722/3451] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:55.112642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73968-878d-42ff-8b6b-ce0991d80c9a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.113023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73968-878d-42ff-8b6b-ce0991d80c9a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.113292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73968-878d-42ff-8b6b-ce0991d80c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.143901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6cb73968-878d-42ff-8b6b-ce0991d80c9a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:55.145174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6cb73968-878d-42ff-8b6b-ce0991d80c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:55.157759 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1730/3452] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:55.158999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097986a-e4b9-462f-a7db-3c70a3662c32 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.170436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097986a-e4b9-462f-a7db-3c70a3662c32 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:55.176665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:55.177511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.179305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.179592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.180276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:55.180626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:55.182378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:55.196611 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1723/3453] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:55.201774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb73968-878d-42ff-8b6b-ce0991d80c9a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.241916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb73968-878d-42ff-8b6b-ce0991d80c9a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:55.255961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:55.256649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.256930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.257200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.259967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:55.270418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:55.354662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.354662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:55.394150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815d08e-37e6-49c6-957a-9a846e7c92ea admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:55.401691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:55.406774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.406774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.406774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] PATH_INFO: `/v3/users/6bc47b4f60e746c8a9e30b742f783dd9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.406774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc47b4f60e746c8a9e30b742f783dd9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:55.409296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:55.442161 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1731/3454] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:55 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:55.444464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.549716 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:55.581219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5eb9-203b-4111-b996-455384967eb3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:55.602198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb909f7d-3bde-4240-b4ad-2078d1f98cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:55.605501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb909f7d-3bde-4240-b4ad-2078d1f98cee admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.605501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb909f7d-3bde-4240-b4ad-2078d1f98cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.605501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb909f7d-3bde-4240-b4ad-2078d1f98cee admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.605501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb909f7d-3bde-4240-b4ad-2078d1f98cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:55.607308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb909f7d-3bde-4240-b4ad-2078d1f98cee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:55.646291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc47b4f60e746c8a9e30b742f783dd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.654106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc47b4f60e746c8a9e30b742f783dd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.654889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc47b4f60e746c8a9e30b742f783dd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.768061 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1732/3455] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:55 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:23:55.769295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.769582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.769855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.787120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc47b4f60e746c8a9e30b742f783dd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.787944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc47b4f60e746c8a9e30b742f783dd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:55.801389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] MFA Rules not processed for user `418a4c6848204bea8eadb505ccb9c04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:55.803218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:55.809324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1724/3456] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:55 2022] DELETE /identity/v3/users/6bc47b4f60e746c8a9e30b742f783dd9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:55.810553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.812227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:55.858089 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:55.894840 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1733/3457] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:55.897606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60dfb6-717b-4f25-9b72-24275a7488ae admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:55.902244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.903212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:55.903612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:55.903872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.904157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.908745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.908745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:55.908745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:55.928158 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1725/3458] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:55.931850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.947239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac3767-5b78-4a21-941a-990eeda6e33a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:55.954512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:55.955714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:55.956354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:55.956796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:55.957833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:55.960448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:55.971824 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1726/3459] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:55.976669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:55.990904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2911e3-9aef-4eae-b8c0-0c0c2ccd2c35 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.006923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea813b1-6ef7-4b68-bd6a-8dba4a29458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.009519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea813b1-6ef7-4b68-bd6a-8dba4a29458b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.009519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea813b1-6ef7-4b68-bd6a-8dba4a29458b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.009519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea813b1-6ef7-4b68-bd6a-8dba4a29458b admin admin] PATH_INFO: `/v3/projects/77899c7c4328476896f9b1603f147b50/users/0701d2ff0a0f479a991b717404282aa1/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.009845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504f54d-34c1-4043-810d-b813c6f1e415 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.029614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea813b1-6ef7-4b68-bd6a-8dba4a29458b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77899c7c4328476896f9b1603f147b50, user_id=0701d2ff0a0f479a991b717404282aa1, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.032546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea813b1-6ef7-4b68-bd6a-8dba4a29458b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.085263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.085884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.086251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.086499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.152427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.154378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.164833 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1734/3460] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:23:56.186939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:56.190450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:56.208729 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1727/3461] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:55 2022] PUT /identity/v3/projects/77899c7c4328476896f9b1603f147b50/users/0701d2ff0a0f479a991b717404282aa1/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:56.219651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089b39-0263-4c4e-9806-9523f0768847 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.219924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089b39-0263-4c4e-9806-9523f0768847 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.220372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089b39-0263-4c4e-9806-9523f0768847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.227884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dbc49-a485-4bed-bc31-9c0cec897ee9 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.254336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-55089b39-0263-4c4e-9806-9523f0768847 None None] MFA Rules not processed for user `0701d2ff0a0f479a991b717404282aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:56.255747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-55089b39-0263-4c4e-9806-9523f0768847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:56.308948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.309591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.309871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.310180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] PATH_INFO: `/v3/projects/ada99164dbe24d8698a111af349d9539` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.311331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada99164dbe24d8698a111af349d9539)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.313292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.333890 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1728/3462] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:23:56.337725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089b39-0263-4c4e-9806-9523f0768847 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:56.351618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089b39-0263-4c4e-9806-9523f0768847 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.354727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.355386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.355660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.355945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.356560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.358486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.536489 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1729/3463] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:56 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:56.539992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:56.549835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada99164dbe24d8698a111af349d9539', 'request_id': 'req-288c6fb7-9d54-479a-be65-aea4c134c1bb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:56.556087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada99164dbe24d8698a111af349d9539', 'request_id': 'req-288c6fb7-9d54-479a-be65-aea4c134c1bb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:56.615456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ae8b3-359c-4508-9cec-cd645a38856f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.620638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.621395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.622013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.622307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.623071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.625050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.733788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada99164dbe24d8698a111af349d9539', 'request_id': 'req-288c6fb7-9d54-479a-be65-aea4c134c1bb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:56.750656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] The token cache is being invalidate because project ada99164dbe24d8698a111af349d9539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:56.751001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:56.751765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-288c6fb7-9d54-479a-be65-aea4c134c1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:56.758811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1735/3464] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:56 2022] DELETE /identity/v3/projects/ada99164dbe24d8698a111af349d9539 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:56.761186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe2a6-19ad-43ad-8ceb-74604fcf33b2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.761356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe2a6-19ad-43ad-8ceb-74604fcf33b2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.761700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfe2a6-19ad-43ad-8ceb-74604fcf33b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.767907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1730/3465] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:56 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:56.769423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:56.771415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:56.790760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38447e-7b00-4c15-809d-5127ffdf67f7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.791590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1ecfe2a6-19ad-43ad-8ceb-74604fcf33b2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:56.792788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ecfe2a6-19ad-43ad-8ceb-74604fcf33b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:56.796858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.797680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.798237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.798668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.800129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.802658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.803405 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1736/3466] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:56.811439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ff2a-edd8-4e18-bfac-59e19d01d38e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.811725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ff2a-edd8-4e18-bfac-59e19d01d38e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.812956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ff2a-edd8-4e18-bfac-59e19d01d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.814930 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1731/3467] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:23:56.818966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:56.829386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1415eca-5485-49ef-992f-7b89e10eaf48 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.832820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c734ff2a-edd8-4e18-bfac-59e19d01d38e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:56.834120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c734ff2a-edd8-4e18-bfac-59e19d01d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:56.836178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.836918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.837260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.840631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] PATH_INFO: `/v3/projects/1db675237ab144a1b380292419cfd43c/users/0f0af192b7114fada2098ff4d74d51fe/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.843180 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1737/3468] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:23:56.847655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734ff2a-edd8-4e18-bfac-59e19d01d38e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:56.855460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db675237ab144a1b380292419cfd43c, user_id=0f0af192b7114fada2098ff4d74d51fe, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.857356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734ff2a-edd8-4e18-bfac-59e19d01d38e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.858441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.862327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.862961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.863310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.863586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.864265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:23:56.865136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.866780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.879435 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1738/3469] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:56.883604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:56.893794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e51dd-05a2-4019-a7d3-bd6d6f2110b3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:56.900786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:56.901547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:56.901923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:56.902437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:56.903024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:56.904981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:56.951044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1732/3470] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:56 2022] PUT /identity/v3/projects/1db675237ab144a1b380292419cfd43c/users/0f0af192b7114fada2098ff4d74d51fe/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:56.954860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.015788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2686ec-50f5-40aa-ae63-ea81524ad8ff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.021231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.021872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.022182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.022447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.023282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.024886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.035293 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1733/3471] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:23:57.040073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.048775 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1739/3472] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:56 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:57.049802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960104-65c6-47cc-a03b-856e4ca6b370 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.052833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.120643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200de03-0039-45b7-ab2a-db24b7f59f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.121712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200de03-0039-45b7-ab2a-db24b7f59f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.122279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200de03-0039-45b7-ab2a-db24b7f59f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.122745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200de03-0039-45b7-ab2a-db24b7f59f60 admin admin] PATH_INFO: `/v3/projects/1db675237ab144a1b380292419cfd43c/users/0f0af192b7114fada2098ff4d74d51fe/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.125156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200de03-0039-45b7-ab2a-db24b7f59f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db675237ab144a1b380292419cfd43c, user_id=0f0af192b7114fada2098ff4d74d51fe, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.128161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200de03-0039-45b7-ab2a-db24b7f59f60 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.138719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62306c1b-7ad2-4caa-83b2-49bfa7aed87c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.140195 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1734/3473] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:57 2022] PUT /identity/v3/projects/1db675237ab144a1b380292419cfd43c/users/0f0af192b7114fada2098ff4d74d51fe/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:57.150986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de707a5-1631-428f-8902-ab0ba5d3131d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.151577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de707a5-1631-428f-8902-ab0ba5d3131d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.151950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de707a5-1631-428f-8902-ab0ba5d3131d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.181249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2de707a5-1631-428f-8902-ab0ba5d3131d None None] MFA Rules not processed for user `0f0af192b7114fada2098ff4d74d51fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:57.182867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2de707a5-1631-428f-8902-ab0ba5d3131d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:57.198711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.199366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.199632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.199895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.200508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.202633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.277376 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1735/3474] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:57.278633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de707a5-1631-428f-8902-ab0ba5d3131d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.287727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de707a5-1631-428f-8902-ab0ba5d3131d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.293567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.294286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.294568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.294841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.295465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.297474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.355680 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1740/3475] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:23:57 2022] POST /identity/v3/users => generated 290 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:57.357140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.368483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54b2b-a934-4c4a-8bbd-acc70a121a1b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.373830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.374746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.377107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.377107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.377107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.377849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.389409 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1741/3476] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:57.393508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.404091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967c67a-0fdb-48ea-aaa1-289be2fab0c7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.410105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.410659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.410932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.411220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.411909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.413839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.425578 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1742/3477] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:23:57.429725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.439262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc14b41-86cb-462a-83b2-7fbcab5252ae admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.444352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02984a62-17a3-4c1e-a0fa-519f63abe7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.444999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984a62-17a3-4c1e-a0fa-519f63abe7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.445276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984a62-17a3-4c1e-a0fa-519f63abe7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.445574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984a62-17a3-4c1e-a0fa-519f63abe7f4 admin admin] PATH_INFO: `/v3/projects/8d9f6afbdbf74318a98dfe455a72ac7c/users/2b8a867611614ea585d510d62c63cfa3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.467217 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1736/3478] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:23:57 2022] POST /identity/v3/projects => generated 359 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:23:57.471847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.480650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02984a62-17a3-4c1e-a0fa-519f63abe7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9f6afbdbf74318a98dfe455a72ac7c, user_id=2b8a867611614ea585d510d62c63cfa3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.483962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02984a62-17a3-4c1e-a0fa-519f63abe7f4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.553574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbef5-d565-4c22-8edb-43ed35be7ce1 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.558949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.559543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.559821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.560318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-2061668423` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.561516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=b05ac01cc6c74ac690d2aa9e04173b4d, value=tempest-tag-2061668423)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.563847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.644392 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1743/3479] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:23:57 2022] PUT /identity/v3/projects/8d9f6afbdbf74318a98dfe455a72ac7c/users/2b8a867611614ea585d510d62c63cfa3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:57.649366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.649651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.649925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.672636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:57.673845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:57.732278 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2061668423. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:23:57.732278 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:23:57.732278 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:23:57.747335 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1737/3480] 10.222.0.42 () {60 vars in 1333 bytes} [Sun Oct 23 01:23:57 2022] PUT /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-2061668423 => generated 0 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 23 01:23:57.749023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.757949 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1744/3481] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:57.765567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729c00-057c-458b-b472-c957f79992e9 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.768227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.769781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:57.854921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a60e-50a2-4aa4-8279-4f746d6040c9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.857783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.860510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.861114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.861437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.861725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-2061668423` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.862075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.862550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.862972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.877180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.880111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.891542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=b05ac01cc6c74ac690d2aa9e04173b4d, value=tempest-tag-2061668423)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.893125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1745/3482] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:23:57.897883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:57.916941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1738/3483] 10.222.0.42 () {58 vars in 1314 bytes} [Sun Oct 23 01:23:57 2022] GET /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-2061668423 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:57.921893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:57.924915 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:57.939541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e06a3-7948-48e9-9fda-afa666ea316e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:57.956701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:57.957527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:57.957809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:57.958186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:57.960597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=b05ac01cc6c74ac690d2aa9e04173b4d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:57.963237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:58.133042 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1746/3484] 10.222.0.42 () {60 vars in 1265 bytes} [Sun Oct 23 01:23:57 2022] PUT /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags => generated 141 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:58.136993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:58.147456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495090a-2346-4329-be03-52afdfba1055 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:58.155463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8e653-9b69-454c-919e-bb4775cad8ef tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:58.156108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8e653-9b69-454c-919e-bb4775cad8ef tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:58.156392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8e653-9b69-454c-919e-bb4775cad8ef tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:58.156666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8e653-9b69-454c-919e-bb4775cad8ef tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:58.169256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8e653-9b69-454c-919e-bb4775cad8ef tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=b05ac01cc6c74ac690d2aa9e04173b4d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:58.171358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8e653-9b69-454c-919e-bb4775cad8ef tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:58.184661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1739/3485] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:58 2022] GET /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags => generated 141 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:23:58.185302 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:58.191053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:58.212718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5622a9f-0fd4-4be9-96fa-fe226d2e9a75 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:58.221442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:58.221442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:58.221442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:58.221820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-1824178566` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:58.222967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=b05ac01cc6c74ac690d2aa9e04173b4d, value=tempest-tag-1824178566)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:58.225754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:58.230713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e090d-275e-4492-8229-43405261a0bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:58.230996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e090d-275e-4492-8229-43405261a0bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:58.231267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e090d-275e-4492-8229-43405261a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:58.254250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e69e090d-275e-4492-8229-43405261a0bd None None] MFA Rules not processed for user `418a4c6848204bea8eadb505ccb9c04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:58.255899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e69e090d-275e-4492-8229-43405261a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:58.325308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1740/3486] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:23:58.389731 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1824178566. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:23:58.389731 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:23:58.389731 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:23:58.398430 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1747/3487] 10.222.0.42 () {58 vars in 1317 bytes} [Sun Oct 23 01:23:58 2022] DELETE /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-1824178566 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:58.403429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e090d-275e-4492-8229-43405261a0bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:58.418502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e090d-275e-4492-8229-43405261a0bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:58.425877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:58.426832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:58.427838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:58.428210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-1824178566` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:58.441717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=b05ac01cc6c74ac690d2aa9e04173b4d, value=tempest-tag-1824178566)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:58.444471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Could not find project tag: tempest-tag-1824178566.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1824178566. Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 23 01:23:58.460263 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 23 01:23:58.461355 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:23:58.461355 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:23:58.461355 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 23 01:23:58.461355 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 23 01:23:58.461355 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1824178566. Oct 23 01:23:58.461355 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:23:58.462636 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1741/3488] 10.222.0.42 () {58 vars in 1314 bytes} [Sun Oct 23 01:23:58 2022] GET /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags/tempest-tag-1824178566 => generated 107 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 23 01:23:58.466276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:58.483426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32a9b6-49fd-498f-8efc-04dd6f3724ff tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:58.488392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:58.489040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:58.489858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:58.490523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:58.491358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=b05ac01cc6c74ac690d2aa9e04173b4d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:58.493510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:58.620230 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1748/3489] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:23:58 2022] DELETE /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:58.624480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:58.635536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33481-91fc-4ecd-964c-e48e772076cc tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:58.646484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:58.646484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:58.646484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:58.646861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:58.658865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=b05ac01cc6c74ac690d2aa9e04173b4d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:58.661091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:58.675754 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1742/3490] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:23:58 2022] GET /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d/tags => generated 66 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:23:58.677306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:58.688226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30fb7b-a736-4c46-a88e-ff39d899bf70 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:58.693829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f0af192b7114fada2098ff4d74d51fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1db675237ab144a1b380292419cfd43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:58.694738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:58.696740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:58.696740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] PATH_INFO: `/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:58.696740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b05ac01cc6c74ac690d2aa9e04173b4d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:58.698949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:58.856030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05ac01cc6c74ac690d2aa9e04173b4d', 'request_id': 'req-c2ef4350-bc55-44f5-981e-29c4736dc26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:58.862389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05ac01cc6c74ac690d2aa9e04173b4d', 'request_id': 'req-c2ef4350-bc55-44f5-981e-29c4736dc26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:58.967927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05ac01cc6c74ac690d2aa9e04173b4d', 'request_id': 'req-c2ef4350-bc55-44f5-981e-29c4736dc26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:58.986398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] The token cache is being invalidate because project b05ac01cc6c74ac690d2aa9e04173b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:23:58.986807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:58.988090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c2ef4350-bc55-44f5-981e-29c4736dc26d tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:58.995501 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1749/3491] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:23:58 2022] DELETE /identity/v3/projects/b05ac01cc6c74ac690d2aa9e04173b4d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:23:58.996356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:58.999136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:59.014094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f6abc-0fab-4f40-b470-2b7e34402d97 tempest-IdentityV3ProjectTagsTest-34779145 tempest-IdentityV3ProjectTagsTest-34779145-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:59.104959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:59.106255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:59.106763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:59.107934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] PATH_INFO: `/v3/users/0701d2ff0a0f479a991b717404282aa1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:59.109948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0701d2ff0a0f479a991b717404282aa1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:59.115066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:59.319102 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:23:59.386118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0701d2ff0a0f479a991b717404282aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:59.394163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0701d2ff0a0f479a991b717404282aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:59.395008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0701d2ff0a0f479a991b717404282aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:59.523219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0701d2ff0a0f479a991b717404282aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:59.530057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0701d2ff0a0f479a991b717404282aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:23:59.564948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:59.565233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:59.565521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:59.566062 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1743/3492] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:23:58 2022] DELETE /identity/v3/users/0701d2ff0a0f479a991b717404282aa1 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:23:59.585111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:23:59.587190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:59.680419 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1750/3493] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:23:59.681492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:23:59.682987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:23:59.758941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb2555-b276-4c31-88b1-794ae089e42b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:23:59.765077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:23:59.770468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:23:59.770468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:23:59.770468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:23:59.779661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:23:59.781542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:23:59.796104 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1744/3494] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:23:59.841082 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:00.548517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:00.550791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:00.592820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07eda6-ea44-4c76-9939-399c7ebe67c8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:00.608956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:00.609693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:00.610000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:00.610296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] PATH_INFO: `/v3/projects/77899c7c4328476896f9b1603f147b50` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:00.612574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=77899c7c4328476896f9b1603f147b50)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:00.615104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:00.886435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77899c7c4328476896f9b1603f147b50', 'request_id': 'req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:00.892452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77899c7c4328476896f9b1603f147b50', 'request_id': 'req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.037011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77899c7c4328476896f9b1603f147b50', 'request_id': 'req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.062040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] The token cache is being invalidate because project 77899c7c4328476896f9b1603f147b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:01.062339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.063867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.070047 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1751/3495] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:00 2022] DELETE /identity/v3/projects/77899c7c4328476896f9b1603f147b50 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:01.070759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:01.085077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89885e1-5342-46d9-8e60-baf4653f2de5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:01.203551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:01.204219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:01.204500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:01.207865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] PATH_INFO: `/v3/users/0f0af192b7114fada2098ff4d74d51fe` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:01.210279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f0af192b7114fada2098ff4d74d51fe)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:01.217575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:01.435289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f0af192b7114fada2098ff4d74d51fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.445378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f0af192b7114fada2098ff4d74d51fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.446280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f0af192b7114fada2098ff4d74d51fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.459642 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:01.579895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f0af192b7114fada2098ff4d74d51fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.581367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ff60559-02f4-4911-b6a7-95cb9da90e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f0af192b7114fada2098ff4d74d51fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:01.616812 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1745/3496] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:01 2022] DELETE /identity/v3/users/0f0af192b7114fada2098ff4d74d51fe => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:01.695258 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:02.405755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:02.409408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:02.432517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ef8e-636f-4c2c-beb8-3f7a7b2ee0cc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:02.510113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:02.511382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:02.511916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:02.512189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] PATH_INFO: `/v3/projects/1db675237ab144a1b380292419cfd43c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:02.513713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db675237ab144a1b380292419cfd43c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:02.517552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:02.662071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db675237ab144a1b380292419cfd43c', 'request_id': 'req-663ccbf7-85d9-4613-a999-8b891e826fa8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:02.664268 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:02.668704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db675237ab144a1b380292419cfd43c', 'request_id': 'req-663ccbf7-85d9-4613-a999-8b891e826fa8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:02.779011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db675237ab144a1b380292419cfd43c', 'request_id': 'req-663ccbf7-85d9-4613-a999-8b891e826fa8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:02.803958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] The token cache is being invalidate because project 1db675237ab144a1b380292419cfd43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:02.804240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:02.808490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-663ccbf7-85d9-4613-a999-8b891e826fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:02.811066 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1752/3497] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:02 2022] DELETE /identity/v3/projects/1db675237ab144a1b380292419cfd43c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:02.816147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00ec59-1ff1-4f5d-8bcb-765cc4245a4b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:02.816434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00ec59-1ff1-4f5d-8bcb-765cc4245a4b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:02.816705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00ec59-1ff1-4f5d-8bcb-765cc4245a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:02.836589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2e00ec59-1ff1-4f5d-8bcb-765cc4245a4b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:02.838120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e00ec59-1ff1-4f5d-8bcb-765cc4245a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:02.932686 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1746/3498] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:02.940981 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:02.944493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa903e3-6170-4906-b23e-4c12ec88946f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:02.944493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa903e3-6170-4906-b23e-4c12ec88946f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:02.944493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa903e3-6170-4906-b23e-4c12ec88946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:02.976344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8aa903e3-6170-4906-b23e-4c12ec88946f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:02.976344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8aa903e3-6170-4906-b23e-4c12ec88946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:03.006495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1753/3499] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:03.010849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00ec59-1ff1-4f5d-8bcb-765cc4245a4b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:03.033148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00ec59-1ff1-4f5d-8bcb-765cc4245a4b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:03.044674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:03.048830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:03.055445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:03.055737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:03.057551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:03.057869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:03.073420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:03.106048 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1747/3500] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:03.107694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa903e3-6170-4906-b23e-4c12ec88946f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:03.117233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa903e3-6170-4906-b23e-4c12ec88946f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:03.130955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:03.131587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:03.131868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:03.132135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:03.132773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:03.140197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:03.307627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1754/3501] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:03 2022] POST /identity/v3/projects => generated 397 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:03.311773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:03.328140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418f7ad-22a9-4ee2-8471-25029ef2ffad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:03.448625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:03.449797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:03.450451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:03.450451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:03.451664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:03.454767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:03.852174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1748/3502] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:03 2022] POST /identity/v3/users => generated 299 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:03.856345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:03.866642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4d45f-212c-4c69-95d7-3525b1e4dc11 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:03.872417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:03.874151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:03.874151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:03.874151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:03.874673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:03.877172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:03.890294 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1755/3503] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:03.893931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:03.908405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67b65f-6850-4d93-96eb-5e2a1b513081 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:03.916254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7338a-02fe-4419-88c7-0a00068b9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:03.916872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7338a-02fe-4419-88c7-0a00068b9e81 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:03.917152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7338a-02fe-4419-88c7-0a00068b9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:03.917450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7338a-02fe-4419-88c7-0a00068b9e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:03.918095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7338a-02fe-4419-88c7-0a00068b9e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:03.919676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7338a-02fe-4419-88c7-0a00068b9e81 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:03.934652 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1749/3504] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:03.937166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:03.954295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6927c-0540-4e65-911f-360cd0e82304 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:03.963440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:03.964122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:03.964400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:03.964671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] PATH_INFO: `/v3/projects/9df6851bce8e4e609a1e4bf0afdec2ab/users/f6b4ae34575e4f17a27758e7980f6d99/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:03.990945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df6851bce8e4e609a1e4bf0afdec2ab, user_id=f6b4ae34575e4f17a27758e7980f6d99, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:03.995104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:04.079078 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1756/3505] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:03 2022] PUT /identity/v3/projects/9df6851bce8e4e609a1e4bf0afdec2ab/users/f6b4ae34575e4f17a27758e7980f6d99/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:04.090836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4e22-6f7a-4a78-8eb7-541a770fb0e1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:04.091121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4e22-6f7a-4a78-8eb7-541a770fb0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:04.092165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4e22-6f7a-4a78-8eb7-541a770fb0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:04.182218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2b9c4e22-6f7a-4a78-8eb7-541a770fb0e1 None None] MFA Rules not processed for user `f6b4ae34575e4f17a27758e7980f6d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:04.184795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2b9c4e22-6f7a-4a78-8eb7-541a770fb0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:04.299415 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1750/3506] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:04.305113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:04.435047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73055d2-efd9-4dcc-bf36-6c78981e743e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:04.438496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:04.439222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:04.439637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:04.440099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:04.443146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:04.446069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:04.668110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1757/3507] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:04 2022] POST /identity/v3/projects => generated 395 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:04.671886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4e22-6f7a-4a78-8eb7-541a770fb0e1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:04.694486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4e22-6f7a-4a78-8eb7-541a770fb0e1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:04.831146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:04.831672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:04.832054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:04.832427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:04.833220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:04.838585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:04.854181 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:04.982176 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1751/3508] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:04 2022] POST /identity/v3/users => generated 304 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:04.983431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:04.996516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fb39-7f3e-4fe4-b150-af0c35813c09 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:05.004471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:05.005392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:05.005827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:05.006295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:05.007130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:05.009001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:05.022555 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1758/3509] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:05.026811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:05.042664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e993e-a2e9-49ba-8ef8-40baa8ada844 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:05.056922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:05.057943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:05.059748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:05.060023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] PATH_INFO: `/v3/projects/98ab5e28d5f84168959c6862ff76240f/users/6ee749bb25cf498793c2979cf60b78ac/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:05.119900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ab5e28d5f84168959c6862ff76240f, user_id=6ee749bb25cf498793c2979cf60b78ac, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:05.123035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:05.268787 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1752/3510] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:05 2022] PUT /identity/v3/projects/98ab5e28d5f84168959c6862ff76240f/users/6ee749bb25cf498793c2979cf60b78ac/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:05.273196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:05.285920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38308968-e8ba-499b-af35-844bd656f446 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:05.403088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9616dc6-3f0d-4197-99d4-defc5d22a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:05.403632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616dc6-3f0d-4197-99d4-defc5d22a737 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:05.403912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616dc6-3f0d-4197-99d4-defc5d22a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:05.404184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616dc6-3f0d-4197-99d4-defc5d22a737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:05.405077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9616dc6-3f0d-4197-99d4-defc5d22a737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:05.407081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9616dc6-3f0d-4197-99d4-defc5d22a737 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:05.419024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1759/3511] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:05.423246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:05.435653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f585ce-4ee6-4c3c-977a-51150d0bc9ea admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:05.441406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:05.442985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:05.443263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:05.443694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] PATH_INFO: `/v3/projects/98ab5e28d5f84168959c6862ff76240f/users/6ee749bb25cf498793c2979cf60b78ac/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:05.445941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ab5e28d5f84168959c6862ff76240f, user_id=6ee749bb25cf498793c2979cf60b78ac, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:05.448746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:05.460498 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1753/3512] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:05 2022] PUT /identity/v3/projects/98ab5e28d5f84168959c6862ff76240f/users/6ee749bb25cf498793c2979cf60b78ac/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:05.477303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb9772-6fce-42af-bcd2-e7346ea50b4f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:05.479460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb9772-6fce-42af-bcd2-e7346ea50b4f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:05.479984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb9772-6fce-42af-bcd2-e7346ea50b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:05.598469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a0fb9772-6fce-42af-bcd2-e7346ea50b4f None None] MFA Rules not processed for user `6ee749bb25cf498793c2979cf60b78ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:05.600188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0fb9772-6fce-42af-bcd2-e7346ea50b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:05.717687 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1760/3513] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:05.726802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:05.889573 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:05.964698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45a633-66a7-4406-b415-13eb9e47fe6e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:05.976721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b4ae34575e4f17a27758e7980f6d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df6851bce8e4e609a1e4bf0afdec2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:05.977363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:05.977644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:05.977922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:05.978583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 23 01:24:05.991434 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 23 01:24:05.996655 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:05.999418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb9772-6fce-42af-bcd2-e7346ea50b4f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:06.005841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1754/3514] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:24:05 2022] POST /identity/v3/projects => generated 136 bytes in 277 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:06.019717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb9772-6fce-42af-bcd2-e7346ea50b4f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:06.039064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee749bb25cf498793c2979cf60b78ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ab5e28d5f84168959c6862ff76240f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:06.044734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:06.045345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:06.045849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:06.048315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:06.054391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Invalid input for field 'name': '' is too short Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: On instance['name']: Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: On instance['name']: Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: '' Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise error Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application '' Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.081028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:24:06.083518 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application '' Oct 23 01:24:06.084825 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.091564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1761/3515] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:24:05 2022] POST /identity/v3/projects => generated 283 bytes in 91 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 23 01:24:06.096056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:06.117525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06d8e-8b5f-4a82-90b9-39df8250d860 tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:06.137028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee749bb25cf498793c2979cf60b78ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ab5e28d5f84168959c6862ff76240f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:06.137028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:06.137289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:06.137482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:06.138282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:06.140311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: On instance['name']: Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: On instance['name']: Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise error Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:24:06.174369 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:06.175647 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application On instance['name']: Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 23 01:24:06.177259 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.187086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:06.189093 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1755/3516] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:24:06 2022] POST /identity/v3/projects => generated 412 bytes in 93 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 23 01:24:06.205540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0777c-de65-4a17-931c-7b216dcc86cb tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:06.217309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee749bb25cf498793c2979cf60b78ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ab5e28d5f84168959c6862ff76240f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:06.219133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:06.219545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:06.221682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] PATH_INFO: `/v3/projects/21f1f26a448448c8ba717c508b2a772a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:06.237293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21f1f26a448448c8ba717c508b2a772a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:06.244979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Could not find project: 21f1f26a448448c8ba717c508b2a772a.: keystone.exception.ProjectNotFound: Could not find project: 21f1f26a448448c8ba717c508b2a772a. Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 23 01:24:06.299366 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 21f1f26a448448c8ba717c508b2a772a. Oct 23 01:24:06.300342 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:06.310536 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1762/3517] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:06 2022] DELETE /identity/v3/projects/21f1f26a448448c8ba717c508b2a772a => generated 113 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:06.311566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:06.323893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cc712-1129-4f76-a7f6-01f5a6290884 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:06.337543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b4ae34575e4f17a27758e7980f6d99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df6851bce8e4e609a1e4bf0afdec2ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:06.338494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:06.338934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:06.339362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:06.340199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 23 01:24:06.355343 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._list_projects() Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 23 01:24:06.356479 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.364783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:06.369907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1756/3518] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:24:06 2022] GET /identity/v3/projects => generated 135 bytes in 57 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:06.381372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cd528-8763-496b-9149-c3b1770713a8 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:06.402575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee749bb25cf498793c2979cf60b78ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ab5e28d5f84168959c6862ff76240f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:06.403208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:06.403487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:06.403781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:06.404425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:06.407133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:06.539875 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1763/3519] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:06 2022] POST /identity/v3/projects => generated 357 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:06.544390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:06.575524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594bbc0-6c3e-4ca8-a87b-09d4bb5e59ce tempest-ProjectsNegativeStaticTestJSON-1938736407 tempest-ProjectsNegativeStaticTestJSON-1938736407-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:06.746618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee749bb25cf498793c2979cf60b78ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ab5e28d5f84168959c6862ff76240f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:06.747632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:06.747915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:06.748185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:06.749785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:06.755214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:06.853658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.sql.core [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-99466319' for key 'project.ixu_project_name_domain_id'") Oct 23 01:24:06.853658 n-d-master-1 devstack@keystone.service[81937]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:24:06.853658 n-d-master-1 devstack@keystone.service[81937]: [parameters: {'id': '8ce826c0d2ba4a9a85cfcd822cc054e7', 'name': 'tempest-project-dup-99466319', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 01:24:06.853658 n-d-master-1 devstack@keystone.service[81937]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81937) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-99466319, project id 8ce826c0d2ba4a9a85cfcd822cc054e7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-99466319, project id 8ce826c0d2ba4a9a85cfcd822cc054e7. Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:24:06.865636 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-99466319' for key 'project.ixu_project_name_domain_id'") Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:24:06.868159 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application yield resource Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise self.value Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:24:06.869512 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.commit() Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:24:06.870965 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 01:24:06.872302 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application conn.query(q) Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result.read() Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 01:24:06.873611 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-99466319' for key 'project.ixu_project_name_domain_id'") Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [parameters: {'id': '8ce826c0d2ba4a9a85cfcd822cc054e7', 'name': 'tempest-project-dup-99466319', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.875441 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-99466319 at domain ID default. Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:06.876617 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-99466319, project id 8ce826c0d2ba4a9a85cfcd822cc054e7. Oct 23 01:24:06.879003 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:06.883550 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1757/3520] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:24:06 2022] POST /identity/v3/projects => generated 283 bytes in 339 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:24:06.886040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:06.904132 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:06.910260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef21a9-6b0d-4f03-9ea7-00c82a1f08d6 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:06.929452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee749bb25cf498793c2979cf60b78ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ab5e28d5f84168959c6862ff76240f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:06.929452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:06.929452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:06.929864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] PATH_INFO: `/v3/projects/8c82077a336244d7b8e37d9726c17ef1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:06.931715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c82077a336244d7b8e37d9726c17ef1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:06.934224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:07.158258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c82077a336244d7b8e37d9726c17ef1', 'request_id': 'req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.166369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c82077a336244d7b8e37d9726c17ef1', 'request_id': 'req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.277441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c82077a336244d7b8e37d9726c17ef1', 'request_id': 'req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.321087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] The token cache is being invalidate because project 8c82077a336244d7b8e37d9726c17ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:07.324573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.331800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b00a626-c53a-4f77-a7b9-bbdc13d4c1a5 tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.336765 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1764/3521] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:06 2022] DELETE /identity/v3/projects/8c82077a336244d7b8e37d9726c17ef1 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:07.342723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:07.358701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:07.432460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:07.432743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:07.433069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:07.444638 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:07.507990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9780d2-bc08-4670-b9b0-a80e581a625c tempest-ProjectsNegativeStaticTestJSON-938778969 tempest-ProjectsNegativeStaticTestJSON-938778969-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:07.524012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] MFA Rules not processed for user `2b8a867611614ea585d510d62c63cfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:07.527892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:07.638180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:07.639142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:07.639575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:07.640000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] PATH_INFO: `/v3/users/f6b4ae34575e4f17a27758e7980f6d99` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:07.642887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b4ae34575e4f17a27758e7980f6d99)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:07.649714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:07.693593 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1765/3522] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:07.867171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:07.868787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:07.934531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b4ae34575e4f17a27758e7980f6d99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.944265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b4ae34575e4f17a27758e7980f6d99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.945762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b4ae34575e4f17a27758e7980f6d99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:07.986736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470fe74-d4fd-4004-806a-3fd1dceef061 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:07.986736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c5f5-0572-4135-9b11-7c200f4da240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:07.986736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c5f5-0572-4135-9b11-7c200f4da240 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:07.986736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c5f5-0572-4135-9b11-7c200f4da240 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:07.987553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c5f5-0572-4135-9b11-7c200f4da240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:07.996424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34c5f5-0572-4135-9b11-7c200f4da240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:07.998169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34c5f5-0572-4135-9b11-7c200f4da240 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:08.009603 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1766/3523] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:24:08.049127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b4ae34575e4f17a27758e7980f6d99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:08.049869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b4ae34575e4f17a27758e7980f6d99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:08.071074 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1758/3524] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:07 2022] DELETE /identity/v3/users/f6b4ae34575e4f17a27758e7980f6d99 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:08.075747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692ae40-4f54-4f68-bd3d-68f8402d5ddc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:08.076066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692ae40-4f54-4f68-bd3d-68f8402d5ddc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:08.076340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692ae40-4f54-4f68-bd3d-68f8402d5ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:08.097132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c692ae40-4f54-4f68-bd3d-68f8402d5ddc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:08.099512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c692ae40-4f54-4f68-bd3d-68f8402d5ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:08.185404 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1767/3525] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:08.196827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:08.199027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:08.301096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d31c-14b3-47b5-a617-ff53a6baa182 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:08.307577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:08.308529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:08.309139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:08.309557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:08.321377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:08.323238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:08.352202 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1759/3526] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:24:09.140050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432bf54-a67d-4071-9b31-26c8678b0fd9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:09.140050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432bf54-a67d-4071-9b31-26c8678b0fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:09.140249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432bf54-a67d-4071-9b31-26c8678b0fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:09.176526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d432bf54-a67d-4071-9b31-26c8678b0fd9 None None] MFA Rules not processed for user `2b8a867611614ea585d510d62c63cfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:09.177946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d432bf54-a67d-4071-9b31-26c8678b0fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:09.229232 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:09.303612 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1768/3527] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:09.396362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:09.399555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:09.424081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6ba96-fbc5-4154-9b21-eb811e267b7b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:09.438879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:09.441380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:09.442934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:09.448268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] PATH_INFO: `/v3/projects/9df6851bce8e4e609a1e4bf0afdec2ab` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:09.448268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df6851bce8e4e609a1e4bf0afdec2ab)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:09.464299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:09.773194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df6851bce8e4e609a1e4bf0afdec2ab', 'request_id': 'req-06aa7d3d-60b4-4076-9de9-566d75dbe889'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:09.797558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df6851bce8e4e609a1e4bf0afdec2ab', 'request_id': 'req-06aa7d3d-60b4-4076-9de9-566d75dbe889'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:09.901235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df6851bce8e4e609a1e4bf0afdec2ab', 'request_id': 'req-06aa7d3d-60b4-4076-9de9-566d75dbe889'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:09.960188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] The token cache is being invalidate because project 9df6851bce8e4e609a1e4bf0afdec2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:09.960515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:09.963196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:09.975354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432bf54-a67d-4071-9b31-26c8678b0fd9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:09.975864 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1760/3528] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:09 2022] DELETE /identity/v3/projects/9df6851bce8e4e609a1e4bf0afdec2ab => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:09.990140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432bf54-a67d-4071-9b31-26c8678b0fd9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:10.117773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:10.118474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:10.118758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:10.119030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] PATH_INFO: `/v3/users/6ee749bb25cf498793c2979cf60b78ac` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:10.120485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee749bb25cf498793c2979cf60b78ac)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:10.124096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:10.383599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee749bb25cf498793c2979cf60b78ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:10.401131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee749bb25cf498793c2979cf60b78ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:10.403447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee749bb25cf498793c2979cf60b78ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:10.488179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee749bb25cf498793c2979cf60b78ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:10.490115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7fd12e5-354d-495d-bd12-5e475c4c069f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee749bb25cf498793c2979cf60b78ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:10.520579 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1769/3529] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:09 2022] DELETE /identity/v3/users/6ee749bb25cf498793c2979cf60b78ac => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:10.975886 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:11.565064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:11.566683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:11.586129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa7d3d-60b4-4076-9de9-566d75dbe889 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:11.679597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:11.681107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:11.681750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:11.683280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] PATH_INFO: `/v3/projects/98ab5e28d5f84168959c6862ff76240f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:11.684796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ab5e28d5f84168959c6862ff76240f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:11.687095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:11.897790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ab5e28d5f84168959c6862ff76240f', 'request_id': 'req-808bcd61-9bd3-49c2-91a6-481a8f4d3089'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:11.904288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ab5e28d5f84168959c6862ff76240f', 'request_id': 'req-808bcd61-9bd3-49c2-91a6-481a8f4d3089'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:12.002739 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:12.035229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ab5e28d5f84168959c6862ff76240f', 'request_id': 'req-808bcd61-9bd3-49c2-91a6-481a8f4d3089'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:12.079809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] The token cache is being invalidate because project 98ab5e28d5f84168959c6862ff76240f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:12.080188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:12.083628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-808bcd61-9bd3-49c2-91a6-481a8f4d3089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:12.087167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1761/3530] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:11 2022] DELETE /identity/v3/projects/98ab5e28d5f84168959c6862ff76240f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:12.092071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775164b-23c7-4bab-a46f-ccdf48c1c6b7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:12.092620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775164b-23c7-4bab-a46f-ccdf48c1c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:12.092720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775164b-23c7-4bab-a46f-ccdf48c1c6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:12.137371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4775164b-23c7-4bab-a46f-ccdf48c1c6b7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:12.141566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4775164b-23c7-4bab-a46f-ccdf48c1c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:12.299954 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1770/3531] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:12.312141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0576ea-a132-42b4-b636-b927d0d4ea47 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:12.312687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0576ea-a132-42b4-b636-b927d0d4ea47 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:12.313539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0576ea-a132-42b4-b636-b927d0d4ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:12.356695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9b0576ea-a132-42b4-b636-b927d0d4ea47 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:12.358255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b0576ea-a132-42b4-b636-b927d0d4ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:12.375101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775164b-23c7-4bab-a46f-ccdf48c1c6b7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:12.375345 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1762/3532] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:12.394197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775164b-23c7-4bab-a46f-ccdf48c1c6b7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:12.399611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:12.401088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:12.401591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:12.402108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:12.403034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:12.403523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:12.405543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:12.429906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1771/3533] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:12.435267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0576ea-a132-42b4-b636-b927d0d4ea47 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:12.447207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0576ea-a132-42b4-b636-b927d0d4ea47 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:12.463552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:12.465731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:12.465923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:12.466233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:12.477163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:12.493345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:12.647814 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1763/3534] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:12 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:12.651884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:12.664892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54ab8-c397-49e3-b527-1ed556e97ca1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:12.764157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:12.765373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:12.765882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:12.766700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:12.767548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:12.798358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:12.901829 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1772/3535] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:12 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:12.906145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:12.920273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37ceaa-269b-405d-a3af-7564b4fa76f8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:12.925273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:12.926106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:12.927064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:12.927334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:12.928020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:12.929856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:12.944151 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1764/3536] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:12.945340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:12.955976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300519d0-a252-4cf2-8ef8-bf11b3611122 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:12.961805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3291e-220c-40a5-aa08-85b8dedb5ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:12.962533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3291e-220c-40a5-aa08-85b8dedb5ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:12.962876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3291e-220c-40a5-aa08-85b8dedb5ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:12.963853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3291e-220c-40a5-aa08-85b8dedb5ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:12.964578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3291e-220c-40a5-aa08-85b8dedb5ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:12.967019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3291e-220c-40a5-aa08-85b8dedb5ee5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:12.983503 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1773/3537] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:24:12.984944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:12.996294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffaa8b-0fc3-44f5-84f1-2bca02fd5623 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:13.000949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:13.001643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:13.001917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:13.002230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] PATH_INFO: `/v3/projects/c772c332366c450b91580f187bee63dc/users/c67963c9b5f74535942212416fbd5af9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:13.019886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c772c332366c450b91580f187bee63dc, user_id=c67963c9b5f74535942212416fbd5af9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:13.023663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:13.128443 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1765/3538] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:12 2022] PUT /identity/v3/projects/c772c332366c450b91580f187bee63dc/users/c67963c9b5f74535942212416fbd5af9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:13.140219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:13.140682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:13.140782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:13.171137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] MFA Rules not processed for user `c67963c9b5f74535942212416fbd5af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:13.172355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:13.255007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1774/3539] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:13.255846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:13.373789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93fdcf-030a-43d2-bf78-98fd6cd23961 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:13.385740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:13.386438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:13.386714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:13.387461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:13.388244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:13.391779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:13.400733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:13.402158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:13.497850 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:13.544295 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1766/3540] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:13 2022] POST /identity/v3/projects => generated 367 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:13.548068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:13.609046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b905e9-f27b-421e-9e8f-df575141c596 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:13.688354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607185f7-1852-4846-af94-bbe97c86cd3a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:13.700217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:13.700954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:13.701230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:13.701501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:13.702492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:13.704865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:13.733807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:13.735082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:13.735642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:13.736266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:13.739446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:13.751611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:13.753406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:13.764184 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1775/3541] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:24:13.831222 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1767/3542] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:13 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:13.835195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:13.845988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dc09a-acab-4d6e-b1d2-b02aa064a6fd service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:13.852072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:13.855391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:13.855391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:13.855391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:13.855391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:13.855391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:13.866908 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1776/3543] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:13.870790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:13.884455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e91ba-698c-4c71-ba78-20e5aeda8038 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:13.889840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:13.890687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:13.890971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:13.891243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] PATH_INFO: `/v3/projects/a1c8a8697f6840f8accc33e1835ce513/users/e568c8b4eea24047a153bcda9f41fd75/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:13.907818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c8a8697f6840f8accc33e1835ce513, user_id=e568c8b4eea24047a153bcda9f41fd75, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:13.911230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:14.033245 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1768/3544] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:13 2022] PUT /identity/v3/projects/a1c8a8697f6840f8accc33e1835ce513/users/e568c8b4eea24047a153bcda9f41fd75/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:14.034588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:14.045346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb1d1-9317-490d-ba74-f5bc86f1fcaa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:14.130873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ed883-249c-4c3f-b8fc-980d8ef556f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:14.132109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ed883-249c-4c3f-b8fc-980d8ef556f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:14.132598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ed883-249c-4c3f-b8fc-980d8ef556f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:14.133076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ed883-249c-4c3f-b8fc-980d8ef556f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:14.133931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ed883-249c-4c3f-b8fc-980d8ef556f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:14.136067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ed883-249c-4c3f-b8fc-980d8ef556f3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:14.156604 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1777/3545] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:14.162355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:14.168491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4ba2-7684-48fb-ad81-f6af7eae7329 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:14.173495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:14.174547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:14.175067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:14.175544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] PATH_INFO: `/v3/projects/a1c8a8697f6840f8accc33e1835ce513/users/e568c8b4eea24047a153bcda9f41fd75/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:14.177852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c8a8697f6840f8accc33e1835ce513, user_id=e568c8b4eea24047a153bcda9f41fd75, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:14.181020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:14.193100 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1769/3546] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:14 2022] PUT /identity/v3/projects/a1c8a8697f6840f8accc33e1835ce513/users/e568c8b4eea24047a153bcda9f41fd75/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:14.203536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86db54-f573-48f4-a4c9-3770f495a444 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:14.204014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86db54-f573-48f4-a4c9-3770f495a444 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:14.204140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86db54-f573-48f4-a4c9-3770f495a444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:14.234497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4b86db54-f573-48f4-a4c9-3770f495a444 None None] MFA Rules not processed for user `e568c8b4eea24047a153bcda9f41fd75`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:14.235825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4b86db54-f573-48f4-a4c9-3770f495a444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:14.317154 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1778/3547] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:14.321473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:14.351472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93502-6731-45a1-8b8b-e53e135d4307 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:14.363197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:14.364346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:14.364627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:14.364889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:14.365539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:14.366588 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:14.366588 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:14.366588 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:14.367472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:14.484243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1770/3548] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:24:14 2022] POST /identity/v3/regions => generated 224 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:14.485925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86db54-f573-48f4-a4c9-3770f495a444 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:14.500114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86db54-f573-48f4-a4c9-3770f495a444 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:14.529877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:14.530572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:14.530857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:14.531283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:14.531783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:14.532806 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:14.532806 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:14.532806 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:14.533725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:14.675474 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1779/3549] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:24:14 2022] POST /identity/v3/regions => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:14.686108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:14.696903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c843b3-969b-4d73-b7bb-4e7469ec6115 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:14.714113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:14.715113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:14.715693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:14.716246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/eb428965-f2bc-4664-9006-6bf9fce608ce` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:14.717603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:create_region(region_id=eb428965-f2bc-4664-9006-6bf9fce608ce)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:14.720239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:14.797315 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1771/3550] 10.222.0.42 () {60 vars in 1259 bytes} [Sun Oct 23 01:24:14 2022] PUT /identity/v3/regions/eb428965-f2bc-4664-9006-6bf9fce608ce => generated 232 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:14.801710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:14.823120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fb431-8aff-40f9-8280-cc279a5b0caf tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:14.853320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:14.855384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:14.856045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:14.856045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/eb428965-f2bc-4664-9006-6bf9fce608ce` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:14.856516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:delete_region(region_id=eb428965-f2bc-4664-9006-6bf9fce608ce)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:14.857534 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:14.857534 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:14.857534 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:14.861362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:14.957050 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1780/3551] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:24:14 2022] DELETE /identity/v3/regions/eb428965-f2bc-4664-9006-6bf9fce608ce => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:14.963461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:14.983651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addbc83-7902-4e6f-8080-29d94681d9fc tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.014418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.015056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.015326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.015597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.016241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.018097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.200323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1772/3552] 10.222.0.42 () {60 vars in 1150 bytes} [Sun Oct 23 01:24:14 2022] POST /identity/v3/regions => generated 254 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:15.200961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.213348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ac5e-fd52-4bf2-97f4-05987d1e081b tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.232563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.233206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.233488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.233761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/837b990d894e41a3ae351d6222b0ae0c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.234725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:update_region(region_id=837b990d894e41a3ae351d6222b0ae0c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.235758 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:15.235758 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:15.235758 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:15.236642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.357220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1781/3553] 10.222.0.42 () {60 vars in 1250 bytes} [Sun Oct 23 01:24:15 2022] PATCH /identity/v3/regions/837b990d894e41a3ae351d6222b0ae0c => generated 253 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:15.360852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.380386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc111f-5f04-4b0f-a9fe-e37b432a38c3 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.396369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.397100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.397453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.397819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/837b990d894e41a3ae351d6222b0ae0c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.398506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:get_region(region_id=837b990d894e41a3ae351d6222b0ae0c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.399632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.408445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1773/3554] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:24:15 2022] GET /identity/v3/regions/837b990d894e41a3ae351d6222b0ae0c => generated 253 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:15.409547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.421849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fab7fb-ad5a-4dab-bbb3-28e95c01a1fb tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.427606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.428275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.428555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.429123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/837b990d894e41a3ae351d6222b0ae0c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.429709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:delete_region(region_id=837b990d894e41a3ae351d6222b0ae0c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.431587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.515427 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1782/3555] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:15 2022] DELETE /identity/v3/regions/837b990d894e41a3ae351d6222b0ae0c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:15.522776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.534643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698b10-2d11-4c9d-82d8-bf8a9fd21019 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.551683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.552309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.552591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.552863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.553907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.555351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.563039 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1774/3556] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:24:15 2022] GET /identity/v3/regions => generated 669 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:15.567911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.580902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b663-667a-493c-99bf-087154f926d9 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.588874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.589810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.590164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.590440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/837b990d894e41a3ae351d6222b0ae0c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.591060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:delete_region(region_id=837b990d894e41a3ae351d6222b0ae0c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.592815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Could not find region: 837b990d894e41a3ae351d6222b0ae0c.: keystone.exception.RegionNotFound: Could not find region: 837b990d894e41a3ae351d6222b0ae0c. Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 837b990d894e41a3ae351d6222b0ae0c. Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:15.626956 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 837b990d894e41a3ae351d6222b0ae0c. Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:15.631128 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1783/3557] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:15 2022] DELETE /identity/v3/regions/837b990d894e41a3ae351d6222b0ae0c => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:15.634381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.645948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139cd69-c019-4fdd-88f7-b77d5a3ce378 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.651341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.652003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.652279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.652546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.653139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.654231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.659558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1775/3558] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:24:15 2022] GET /identity/v3/regions => generated 669 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:15.664488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.674928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7cfe5-3d2d-43a2-baac-c665c63c2673 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.680388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.681572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.681572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.681572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.682201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.683773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.727883 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:15.781874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.790246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1784/3559] 10.222.0.42 () {60 vars in 1150 bytes} [Sun Oct 23 01:24:15 2022] POST /identity/v3/regions => generated 253 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:15.795673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac478d-b2a0-4a8a-8667-4638a411b3b8 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.819234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.825025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.825025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.825025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.825025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Adding query filter params (parent_region_id=1f4b15ef2337488f82b3f054d3b66e75) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:15.825025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.825463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.833424 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1776/3560] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:24:15 2022] GET /identity/v3/regions?parent_region_id=1f4b15ef2337488f82b3f054d3b66e75 => generated 399 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:15.834445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.848190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156372fd-bc3a-4c74-987f-94f739f7dfe7 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.855161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.855875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.856289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.856627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/cc73b0d3a2624203ad50c43d45e4ecf7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.857283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:delete_region(region_id=cc73b0d3a2624203ad50c43d45e4ecf7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.859540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:15.957722 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1785/3561] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:15 2022] DELETE /identity/v3/regions/cc73b0d3a2624203ad50c43d45e4ecf7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:15.962393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:15.973164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ba2e1-5ced-43bf-ab1a-839439faa539 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:15.988274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:15.989481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:15.989765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:15.990066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/a5cf0f2fc77d41c5860de0188d1545f2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:15.990873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a5cf0f2fc77d41c5860de0188d1545f2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:15.991882 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:15.991882 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:15.991882 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:15.992756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:16.060784 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1777/3562] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:15 2022] DELETE /identity/v3/regions/a5cf0f2fc77d41c5860de0188d1545f2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:16.064723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:16.079829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc171f38-6a7c-485a-9e42-73270e2a1834 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:16.128617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d9e0d-bbeb-4f63-9496-90fbcf4e8a57 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568c8b4eea24047a153bcda9f41fd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c8a8697f6840f8accc33e1835ce513', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:16.130113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9e0d-bbeb-4f63-9496-90fbcf4e8a57 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:16.130392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9e0d-bbeb-4f63-9496-90fbcf4e8a57 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:16.130661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9e0d-bbeb-4f63-9496-90fbcf4e8a57 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] PATH_INFO: `/v3/regions/1f4b15ef2337488f82b3f054d3b66e75` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:16.131242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d9e0d-bbeb-4f63-9496-90fbcf4e8a57 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1f4b15ef2337488f82b3f054d3b66e75)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:16.132951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d9e0d-bbeb-4f63-9496-90fbcf4e8a57 tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:16.253358 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1786/3563] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:16 2022] DELETE /identity/v3/regions/1f4b15ef2337488f82b3f054d3b66e75 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:16.257199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:16.372013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e974a-9be6-42c3-a94a-bd60db3846ca tempest-RegionsTestJSON-2044707698 tempest-RegionsTestJSON-2044707698-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:16.392140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:16.393191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:16.393568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:16.393947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] PATH_INFO: `/v3/users/c67963c9b5f74535942212416fbd5af9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:16.395922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67963c9b5f74535942212416fbd5af9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:16.399960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:16.792425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67963c9b5f74535942212416fbd5af9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:16.800328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67963c9b5f74535942212416fbd5af9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:16.802074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67963c9b5f74535942212416fbd5af9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:16.962490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67963c9b5f74535942212416fbd5af9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:16.962490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67963c9b5f74535942212416fbd5af9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:16.992146 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1778/3564] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:16 2022] DELETE /identity/v3/users/c67963c9b5f74535942212416fbd5af9 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:16.996649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:16.997167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:16.997729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:17.020013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:17.021844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:17.036850 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:17.099571 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1787/3565] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:17.142854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:17.144382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:17.315814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d699-446d-4648-a84d-fa875fbc2965 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:17.320318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:17.321051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:17.321404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:17.321794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:17.344972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:17.346797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:17.360970 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1779/3566] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:24:18.173547 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:18.458173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:18.460231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:18.485673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3acd5-3284-485d-9421-f7fc4a8f00f7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:18.491634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:18.492577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:18.493069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:18.493553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] PATH_INFO: `/v3/projects/c772c332366c450b91580f187bee63dc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:18.495342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c772c332366c450b91580f187bee63dc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:18.498281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:18.727389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c772c332366c450b91580f187bee63dc', 'request_id': 'req-66bf495a-9d8b-4990-bf22-a0062bc1f553'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:18.733302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c772c332366c450b91580f187bee63dc', 'request_id': 'req-66bf495a-9d8b-4990-bf22-a0062bc1f553'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:18.853074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c772c332366c450b91580f187bee63dc', 'request_id': 'req-66bf495a-9d8b-4990-bf22-a0062bc1f553'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:18.868686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] The token cache is being invalidate because project c772c332366c450b91580f187bee63dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:18.868909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:18.869517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:18.871093 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1788/3567] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:18 2022] DELETE /identity/v3/projects/c772c332366c450b91580f187bee63dc => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:18.875715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:18.890523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872089d-bdb9-4284-b635-b27cdec45f26 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:18.959237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:18.960093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:18.960529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:18.960801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] PATH_INFO: `/v3/users/e568c8b4eea24047a153bcda9f41fd75` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:18.962014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e568c8b4eea24047a153bcda9f41fd75)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:18.964086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:19.119101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:19.120438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:19.147715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e568c8b4eea24047a153bcda9f41fd75'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:19.154911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e568c8b4eea24047a153bcda9f41fd75'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:19.155649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e568c8b4eea24047a153bcda9f41fd75'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:19.209161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf495a-9d8b-4990-bf22-a0062bc1f553 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:19.214515 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:19.220843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e0d57-b8d8-4b1a-bb4d-3d14f89b61e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:19.220843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0d57-b8d8-4b1a-bb4d-3d14f89b61e4 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:19.220843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0d57-b8d8-4b1a-bb4d-3d14f89b61e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:19.220843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0d57-b8d8-4b1a-bb4d-3d14f89b61e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:19.222614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3f8e0d57-b8d8-4b1a-bb4d-3d14f89b61e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:19.236181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e0d57-b8d8-4b1a-bb4d-3d14f89b61e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:19.237845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e0d57-b8d8-4b1a-bb4d-3d14f89b61e4 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:19.240688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e568c8b4eea24047a153bcda9f41fd75'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:19.241338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e568c8b4eea24047a153bcda9f41fd75'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:19.251916 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1789/3568] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:24:19.253196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4860-ba4b-4328-adb6-d137d4449527 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:19.254465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4860-ba4b-4328-adb6-d137d4449527 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:19.254465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4860-ba4b-4328-adb6-d137d4449527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:19.273698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d5cd4860-ba4b-4328-adb6-d137d4449527 None None] MFA Rules not processed for user `19bff9f7a4254110b3b89f0cba5d252f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:19.278285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d5cd4860-ba4b-4328-adb6-d137d4449527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:19.287159 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1780/3569] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:18 2022] DELETE /identity/v3/users/e568c8b4eea24047a153bcda9f41fd75 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:19.346214 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1790/3570] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:19.767864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:19.769311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:19.851620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a048-5580-4997-8eca-c91304661e61 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:19.856282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:19.856968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:19.857246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:19.857513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] PATH_INFO: `/v3/projects/a1c8a8697f6840f8accc33e1835ce513` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:19.858793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c8a8697f6840f8accc33e1835ce513)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:19.860712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:19.989051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c8a8697f6840f8accc33e1835ce513', 'request_id': 'req-779559f0-001b-481a-b015-9b95c361f0a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:19.996292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c8a8697f6840f8accc33e1835ce513', 'request_id': 'req-779559f0-001b-481a-b015-9b95c361f0a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:20.121381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c8a8697f6840f8accc33e1835ce513', 'request_id': 'req-779559f0-001b-481a-b015-9b95c361f0a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:20.134640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] The token cache is being invalidate because project a1c8a8697f6840f8accc33e1835ce513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:20.134928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:20.135578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-779559f0-001b-481a-b015-9b95c361f0a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:20.137113 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1781/3571] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:19 2022] DELETE /identity/v3/projects/a1c8a8697f6840f8accc33e1835ce513 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:20.141858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f977-1b95-487f-ba1d-3238bd9cfc2a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.142439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f977-1b95-487f-ba1d-3238bd9cfc2a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.142540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f977-1b95-487f-ba1d-3238bd9cfc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.175087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aef1f977-1b95-487f-ba1d-3238bd9cfc2a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:20.175087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aef1f977-1b95-487f-ba1d-3238bd9cfc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:20.227518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1791/3572] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:20.242437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605531-9c48-4da7-9c39-7937e38ef3ea None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.242933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605531-9c48-4da7-9c39-7937e38ef3ea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.243037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605531-9c48-4da7-9c39-7937e38ef3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.264142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-90605531-9c48-4da7-9c39-7937e38ef3ea None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:20.265347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90605531-9c48-4da7-9c39-7937e38ef3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:20.273609 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1782/3573] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:20.277799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1f977-1b95-487f-ba1d-3238bd9cfc2a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:20.296046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1f977-1b95-487f-ba1d-3238bd9cfc2a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:20.305282 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:20.308037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:20.309374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.309785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.310155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.311226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:20.311535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:20.313253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:20.327490 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1792/3574] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:20.332888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605531-9c48-4da7-9c39-7937e38ef3ea None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:20.345910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605531-9c48-4da7-9c39-7937e38ef3ea None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:20.355070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:20.355712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.355947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.356213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.356885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:20.359057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:20.460599 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1783/3575] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:20 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:20.465103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:20.479531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6789c5-5d1d-4c03-ae7a-ca83b9ed106c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:20.548467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:20.548990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.549268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.549538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.550187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:20.552861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:20.674828 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1793/3576] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:20 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:20.679942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:20.695107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5898bf-288a-4001-9e1e-13642033565b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:20.695107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:20.695462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.695583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.695766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.696403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:20.697987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:20.707594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1784/3577] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:20.711429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:20.721312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50b466-e80b-4b6f-925b-4cc448f49a32 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:20.726376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790b32-394b-410a-bf92-9596a1a454f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:20.726964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790b32-394b-410a-bf92-9596a1a454f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.727243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790b32-394b-410a-bf92-9596a1a454f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.727513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790b32-394b-410a-bf92-9596a1a454f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.728148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790b32-394b-410a-bf92-9596a1a454f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:20.729722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790b32-394b-410a-bf92-9596a1a454f6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:20.741188 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1794/3578] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:20.744955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:20.754914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efb065-e172-4ea9-a395-bd16ea97b7d7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:20.760834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:20.764478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.764478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.764478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] PATH_INFO: `/v3/projects/aed9f7e6172a4472809ee103252f1921/users/5f05feeb2ab74caba28ae5ad5d61a574/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.782028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed9f7e6172a4472809ee103252f1921, user_id=5f05feeb2ab74caba28ae5ad5d61a574, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:20.784721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:20.893935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1785/3579] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:20 2022] PUT /identity/v3/projects/aed9f7e6172a4472809ee103252f1921/users/5f05feeb2ab74caba28ae5ad5d61a574/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:20.904815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e89b36-d8ae-42a7-8a9d-118d6121ae53 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:20.905095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e89b36-d8ae-42a7-8a9d-118d6121ae53 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:20.905365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e89b36-d8ae-42a7-8a9d-118d6121ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:20.936204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-51e89b36-d8ae-42a7-8a9d-118d6121ae53 None None] MFA Rules not processed for user `5f05feeb2ab74caba28ae5ad5d61a574`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:20.937672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-51e89b36-d8ae-42a7-8a9d-118d6121ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:21.015845 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1795/3580] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:21.021375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:21.026823 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:21.106274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b5e25-7806-43ce-ba2d-9abaa9855ae3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:21.111207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:21.111823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.112104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.112376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.113009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:21.115000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:21.215337 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1786/3581] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:21 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:21.219424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e89b36-d8ae-42a7-8a9d-118d6121ae53 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:21.230851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e89b36-d8ae-42a7-8a9d-118d6121ae53 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:21.292713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:21.293342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.293708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.294037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.294713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:21.296846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:21.414502 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1796/3582] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:21 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:21.418628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:21.430186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fffce-026d-4d26-9722-ac6166ca8e35 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:21.435249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:21.435952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.436237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.436506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.437293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:21.439411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:21.452357 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1787/3583] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:21.460965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:21.488542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b440-bf94-4b05-be6a-e2a900b09962 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:21.488542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:21.488542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.488542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.494495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] PATH_INFO: `/v3/projects/fd30da713fe844fe8b65cefcdb87650b/users/97279010903c4fd2b6a64bc3b0552e1c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.511021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd30da713fe844fe8b65cefcdb87650b, user_id=97279010903c4fd2b6a64bc3b0552e1c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:21.514642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:21.699195 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1797/3584] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:21 2022] PUT /identity/v3/projects/fd30da713fe844fe8b65cefcdb87650b/users/97279010903c4fd2b6a64bc3b0552e1c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:21.703157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:21.713141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03375b-cce5-4702-a090-927daa2ee08b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:21.726905 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:21.785942 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:21.796053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40642560-f760-4735-98fa-2e6a6f522a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:21.796669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40642560-f760-4735-98fa-2e6a6f522a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.796950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40642560-f760-4735-98fa-2e6a6f522a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.797222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40642560-f760-4735-98fa-2e6a6f522a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.797880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40642560-f760-4735-98fa-2e6a6f522a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:21.800197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40642560-f760-4735-98fa-2e6a6f522a65 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:21.811228 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1788/3585] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:21.815498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:21.826298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6df44-c2fc-4780-8f4d-e89cbbad4622 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:21.831026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:21.831677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.831957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.832261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] PATH_INFO: `/v3/projects/fd30da713fe844fe8b65cefcdb87650b/users/97279010903c4fd2b6a64bc3b0552e1c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.837016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd30da713fe844fe8b65cefcdb87650b, user_id=97279010903c4fd2b6a64bc3b0552e1c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:21.840782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:21.850608 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1798/3586] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:21 2022] PUT /identity/v3/projects/fd30da713fe844fe8b65cefcdb87650b/users/97279010903c4fd2b6a64bc3b0552e1c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:21.861338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadc187-a9a1-4a41-968e-3b9b50d7a311 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.861619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadc187-a9a1-4a41-968e-3b9b50d7a311 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.861933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadc187-a9a1-4a41-968e-3b9b50d7a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.892871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2aadc187-a9a1-4a41-968e-3b9b50d7a311 None None] MFA Rules not processed for user `97279010903c4fd2b6a64bc3b0552e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:21.894155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2aadc187-a9a1-4a41-968e-3b9b50d7a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:21.966347 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1789/3587] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:21.970613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:21.981453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc00bf-c46b-41ed-bbd3-bbbc4dd131cf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:21.986237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:21.987135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:21.987421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:21.987898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:21.989302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:21.990692 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:21.990692 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:21.990692 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:22.001640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:22.122461 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1799/3588] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:21 2022] POST /identity/v3/roles => generated 234 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:22.126601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadc187-a9a1-4a41-968e-3b9b50d7a311 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:22.135744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadc187-a9a1-4a41-968e-3b9b50d7a311 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:22.140597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:22.141501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:22.141796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:22.142134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:22.142859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:22.143864 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:22.143864 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:22.143864 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:22.144789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:22.311058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1790/3589] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:22 2022] POST /identity/v3/roles => generated 235 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:22.315046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:22.324958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902a94-c04b-4378-af2c-a7879604dfd5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:22.329904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:22.331277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:22.331277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:22.331277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:22.331749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:22.333444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:22.483997 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1800/3590] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:22 2022] POST /identity/v3/roles => generated 234 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:22.487912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:22.501492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5b75-5325-4bf0-b28c-b752e58acfa2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:22.510251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:22.511205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:22.511717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:22.512205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:22.513179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:22.515022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:22.636932 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1791/3591] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:24:22 2022] POST /identity/v3/domains => generated 275 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:22.641326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:22.660847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a59b33-85fa-474b-91a6-05f3ddd70d0e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:22.735229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:22.735851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:22.736134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:22.736406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:22.737057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:22.739035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:22.881654 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1801/3592] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:22 2022] POST /identity/v3/projects => generated 399 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:22.882888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:22.895196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69ebc9-9814-4ac9-8c06-e076e74bb600 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:22.953742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:22.954621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:22.955013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:22.955298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:22.955918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:22.957102 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:22.957102 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:22.957102 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:22.958796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:23.059397 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1792/3593] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:24:22 2022] POST /identity/v3/groups => generated 301 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:23.060770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:23.073582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a058e-3fe9-496e-a2fb-28d05e88cc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:23.079430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:23.080196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:23.080579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:23.080972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:23.081899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:23.083696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:23.214160 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1802/3594] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:23 2022] POST /identity/v3/roles => generated 234 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:23.218338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:23.250343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d2c1-5d6e-4fd6-a83a-b8f860cd0089 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:23.257535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:23.258593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:23.259979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:23.260495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:23.261780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:23.268959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:23.398534 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1793/3595] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:23 2022] POST /identity/v3/users => generated 439 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:23.402924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:23.417246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f648f0b-c474-40a2-afe7-25b5daf66c61 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:23.424768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:23.425477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:23.426393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:23.426865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:23.427761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:23.429322 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:23.429322 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:23.429322 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:23.430593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:23.639341 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1803/3596] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:23 2022] POST /identity/v3/roles => generated 270 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:23.643216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:23.655416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86852d-e372-4906-a4c4-f536265000be tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:23.667971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:23.668648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:23.668932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:23.669326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/76596fecfa394eef909aa8cc11cbf406` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:23.708222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=76596fecfa394eef909aa8cc11cbf406)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:23.711014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:23.796694 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1794/3597] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:23 2022] PUT /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/76596fecfa394eef909aa8cc11cbf406 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:23.800818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:23.814854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573a108-7e2c-4237-82e8-34063440a5a9 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:23.896833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:23.896833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:23.897525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:23.897525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:23.898518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Adding query filter params (scope.project.id=aa39dfee9d4b48a5a1fef42175f1d42a, user.id=2b064d62bd7d475f9ea5ba1175cbe3d4) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:23.898834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:23.900565 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:23.900565 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:23.900565 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:23.901718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:23.962760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1804/3598] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:24:23 2022] GET /identity/v3/role_assignments?scope.project.id=aa39dfee9d4b48a5a1fef42175f1d42a&user.id=2b064d62bd7d475f9ea5ba1175cbe3d4&effective => generated 228 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:23.964472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:23.979029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8f56-0cda-43c4-b5c0-86e1d8b78bae tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:23.992987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:23.993738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:23.994674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:23.995163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/76596fecfa394eef909aa8cc11cbf406` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:23.997900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=76596fecfa394eef909aa8cc11cbf406)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:23.999662 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:23.999662 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:23.999662 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:24.002969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:24.012801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 76596fecfa394eef909aa8cc11cbf406 was removed from user 2b064d62bd7d475f9ea5ba1175cbe3d4 on project aa39dfee9d4b48a5a1fef42175f1d42a. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:24.013357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:24.014295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:24.106454 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1795/3599] 10.222.0.42 () {58 vars in 1467 bytes} [Sun Oct 23 01:24:23 2022] DELETE /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/76596fecfa394eef909aa8cc11cbf406 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:24.111219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:24.114118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:24.137490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427e769-7e20-4518-9648-b1daa859e4f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:24.214944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:24.215672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:24.216028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:24.216500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/76596fecfa394eef909aa8cc11cbf406` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:24.218269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=76596fecfa394eef909aa8cc11cbf406)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:24.219769 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:24.219769 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:24.219769 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:24.221046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:24.368779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 76596fecfa394eef909aa8cc11cbf406 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:24.369170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:24.371045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:24.376515 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1805/3600] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:24 2022] DELETE /identity/v3/roles/76596fecfa394eef909aa8cc11cbf406 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:24.381466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:24.395255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7153b5-428b-42ec-973b-311630fa3521 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:24.505468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:24.505711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:24.506011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:24.506286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/b97f3fe2e30d4647a382d252bc122fb7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:24.508665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=b97f3fe2e30d4647a382d252bc122fb7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:24.511492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:24.619056 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1796/3601] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:24 2022] PUT /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/b97f3fe2e30d4647a382d252bc122fb7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:24.623086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:24.624593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:24.645673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9aff-8e84-4dc7-87fb-5cfb9d7c64ab tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:24.725761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:24.726663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:24.727117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:24.727576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:24.729454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:24.732427 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:24.732427 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:24.732427 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:24.736499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:24.870809 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1806/3602] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:24 2022] PUT /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 520 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:24.875669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:24.893152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeffb2-fb68-49cc-b2f8-c04d7f81f199 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:24.900455 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:25.025357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:25.026207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:25.026597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:25.029720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:25.030727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Adding query filter params (scope.project.id=aa39dfee9d4b48a5a1fef42175f1d42a, user.id=2b064d62bd7d475f9ea5ba1175cbe3d4) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:25.033859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:25.033859 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:25.033859 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:25.033859 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:25.033859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:25.173644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1797/3603] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:24:24 2022] GET /identity/v3/role_assignments?scope.project.id=aa39dfee9d4b48a5a1fef42175f1d42a&user.id=2b064d62bd7d475f9ea5ba1175cbe3d4&effective => generated 1061 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:25.175291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:25.193764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dfb7b-65cb-4dd1-881a-a705ed9eade7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:25.193764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:25.193764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:25.194227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:25.194227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:25.200918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:25.201990 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:25.201990 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:25.201990 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:25.202899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:25.328365 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1807/3604] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:25 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:25.332496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:25.345582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a276cd-e405-4f96-b4e8-2a5472576ced tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:25.439294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:25.439850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:25.440172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:25.440450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:25.442747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Adding query filter params (scope.project.id=aa39dfee9d4b48a5a1fef42175f1d42a, user.id=2b064d62bd7d475f9ea5ba1175cbe3d4) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:25.443299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:25.445435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:25.532412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:25.539514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:25.552958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1798/3605] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:24:25 2022] GET /identity/v3/role_assignments?scope.project.id=aa39dfee9d4b48a5a1fef42175f1d42a&user.id=2b064d62bd7d475f9ea5ba1175cbe3d4&effective => generated 577 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:25.560422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:25.596739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9c15b-2b06-4380-bee2-612063c10e3e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:25.610491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:25.611725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:25.612097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:25.612627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:25.619254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:25.620377 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:25.620377 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:25.620377 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:25.633253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57.: keystone.exception.ImpliedRoleNotFound: b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57. Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = query.one() Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._iter().one() Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._only_one_row( Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:25.654086 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 23 01:24:25.655502 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 23 01:24:25.656756 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 23 01:24:25.656756 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 23 01:24:25.656756 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 23 01:24:25.656756 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57. Oct 23 01:24:25.656756 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:25.656756 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1799/3606] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:25 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 137 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:25.663605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:25.694478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75fe0-eff0-4b3f-9718-a9ea67975777 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:25.696613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a927a3-0bb1-484e-9279-8002da4e6348 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:25.703203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:25.704070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:25.704686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:25.705162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:25.707319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:25.712842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:25.712842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:25.712842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:25.713371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/b97f3fe2e30d4647a382d252bc122fb7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:25.715577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=b97f3fe2e30d4647a382d252bc122fb7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:25.718212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:25.729548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role b97f3fe2e30d4647a382d252bc122fb7 was removed from user 2b064d62bd7d475f9ea5ba1175cbe3d4 on project aa39dfee9d4b48a5a1fef42175f1d42a. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:25.731199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:25.732006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:25.783479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:25.786259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:25.828096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1808/3607] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:24:25.848121 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1800/3608] 10.222.0.42 () {58 vars in 1467 bytes} [Sun Oct 23 01:24:25 2022] DELETE /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/b97f3fe2e30d4647a382d252bc122fb7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:25.855957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:25.871376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bce68-5274-40ad-85db-cf012e0ded0a service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:25.933232 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:25.973832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:25.974932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:25.976002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:25.976002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:25.978273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:25.980173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.072019 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1809/3609] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:25 2022] POST /identity/v3/roles => generated 272 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:26.075881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.077406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:26.094770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc364bf4-c0aa-4f4a-8a48-e829708038fb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.110660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.113925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.113925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.113925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.113925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Adding query filter params (domain_id=c8dfa47c13c6439cb9bc809a805f1603) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:26.113925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:26.114827 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:26.114827 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:26.114827 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:26.116296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.126156 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1801/3610] 10.222.0.42 () {58 vars in 1207 bytes} [Sun Oct 23 01:24:26 2022] GET /identity/v3/roles?domain_id=c8dfa47c13c6439cb9bc809a805f1603 => generated 409 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:26.129367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.141997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e667105-8e12-49dd-9f92-51dc315f76a7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.148261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.148811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.150470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.150871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/7855d823cc7c484aba0e109d074ae094` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.152335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7855d823cc7c484aba0e109d074ae094)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:26.155023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.289354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 7855d823cc7c484aba0e109d074ae094 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:26.289960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:26.290766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:26.293200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1810/3611] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:26 2022] DELETE /identity/v3/roles/7855d823cc7c484aba0e109d074ae094 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:26.297041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.299031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:26.319160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dccdf-77d5-487f-a166-ff9d7ad1b1fe tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.438548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.439250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.439646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.440609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.441358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Adding query filter params (domain_id=c8dfa47c13c6439cb9bc809a805f1603) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:26.442459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:26.445289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.453402 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1802/3612] 10.222.0.42 () {58 vars in 1207 bytes} [Sun Oct 23 01:24:26 2022] GET /identity/v3/roles?domain_id=c8dfa47c13c6439cb9bc809a805f1603 => generated 148 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:26.457210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.469729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50c30-bcd1-4ee9-a1a6-bb0c8d2a19dd tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.490001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.490368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.490650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.490921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/7855d823cc7c484aba0e109d074ae094` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.503127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Could not find role: 7855d823cc7c484aba0e109d074ae094.: keystone.exception.RoleNotFound: Could not find role: 7855d823cc7c484aba0e109d074ae094. Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 23 01:24:26.513609 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:24:26.515043 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 7855d823cc7c484aba0e109d074ae094. Oct 23 01:24:26.516072 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:26.519420 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1811/3613] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:26 2022] DELETE /identity/v3/roles/7855d823cc7c484aba0e109d074ae094 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:26.520235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.531009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01430a8a-4ff5-407f-a1f0-6337614a8c5a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.536313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.537186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.537495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.537770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.547810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c8dfa47c13c6439cb9bc809a805f1603, group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:26.547810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.679684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.679854 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1803/3614] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:26 2022] PUT /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:26.692562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b974a-1939-4c57-abcd-9e4b18763a4e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.775673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.776324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.776727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.776994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.778674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=c8dfa47c13c6439cb9bc809a805f1603, group_id=f793aa4603704435b35cc08f6b7ea47e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:26.779687 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:26.779687 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:26.779687 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:26.781467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.802042 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1812/3615] 10.222.0.42 () {58 vars in 1365 bytes} [Sun Oct 23 01:24:26 2022] GET /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles => generated 409 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:26.808977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.820233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872046-8e82-4ef7-8d1a-2643c13648e1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.826610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.827541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.828045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.828580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.831438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=c8dfa47c13c6439cb9bc809a805f1603, group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:26.833094 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:26.833094 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:26.833094 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:26.835801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.845240 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1804/3616] 10.222.0.42 () {58 vars in 1465 bytes} [Sun Oct 23 01:24:26 2022] HEAD /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:26.851113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:26.866638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791608-55a7-40fa-9972-548c5188754b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:26.875455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:26.876751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:26.877227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:26.877527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:26.880346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c8dfa47c13c6439cb9bc809a805f1603, group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:26.882562 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:26.882562 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:26.882562 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:26.888134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:26.896352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 0a5a6f632efc47d5be8d96e821133954 was removed from group f793aa4603704435b35cc08f6b7ea47e on domain c8dfa47c13c6439cb9bc809a805f1603. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:26.898119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:26.899110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:26.992421 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1813/3617] 10.222.0.42 () {58 vars in 1467 bytes} [Sun Oct 23 01:24:26 2022] DELETE /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:26.998183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:27.000501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:27.023787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672120-8279-4b1d-bd5d-2c30bcf04f68 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:27.117614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:27.119774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:27.120212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:27.120630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:27.123650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:27.127028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:27.211217 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1805/3618] 10.222.0.42 () {60 vars in 1486 bytes} [Sun Oct 23 01:24:26 2022] PUT /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:27.213670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:27.226664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e54be-46de-4e40-8cb5-c267befaddf8 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:27.345435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f1a91-3084-4f6e-96b6-efc5f69a974f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:27.346135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1a91-3084-4f6e-96b6-efc5f69a974f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:27.346420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1a91-3084-4f6e-96b6-efc5f69a974f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:27.346694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f1a91-3084-4f6e-96b6-efc5f69a974f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:27.354565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f1a91-3084-4f6e-96b6-efc5f69a974f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_grants(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, group_id=f793aa4603704435b35cc08f6b7ea47e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:27.357006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f1a91-3084-4f6e-96b6-efc5f69a974f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:27.372375 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1814/3619] 10.222.0.42 () {58 vars in 1368 bytes} [Sun Oct 23 01:24:27 2022] GET /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles => generated 410 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:27.376137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:27.393218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3fc1-66de-4492-a86c-daae5d0f7ffa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:27.408865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:27.409621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:27.410034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:27.410930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/groups/f793aa4603704435b35cc08f6b7ea47e/users/2b064d62bd7d475f9ea5ba1175cbe3d4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:27.417214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f793aa4603704435b35cc08f6b7ea47e, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:27.418390 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:27.418390 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:27.418390 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:27.432465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:27.499785 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:27.558321 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1806/3620] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:24:27 2022] PUT /identity/v3/groups/f793aa4603704435b35cc08f6b7ea47e/users/2b064d62bd7d475f9ea5ba1175cbe3d4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:27.562505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:27.562795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:27.563072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:27.646934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] MFA Rules not processed for user `2b064d62bd7d475f9ea5ba1175cbe3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:27.648899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:27.799249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1815/3621] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:27.800446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:27.886588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56809c4a-ebf5-4d0b-835a-2479baab1265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:27.896348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:27.898804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:27.899250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:27.901200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:27.910410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:27.912159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:27.920825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:check_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:27.934442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:27.947158 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1807/3622] 10.222.0.42 () {58 vars in 1468 bytes} [Sun Oct 23 01:24:27 2022] HEAD /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:27.948457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:27.964224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6710a-7d81-4bf3-a2f5-110ed7200da1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:27.970413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:27.971640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:27.973730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:27.974416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:27.978329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:27.985465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:27.993094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 0a5a6f632efc47d5be8d96e821133954 was removed from group f793aa4603704435b35cc08f6b7ea47e on project aa39dfee9d4b48a5a1fef42175f1d42a. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:27.993754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:27.995324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:28.033164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66c95-126a-461c-896d-9756f83cd0b0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:28.041266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:28.042588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:28.043042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:28.043713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] PATH_INFO: `/v3/users/418a4c6848204bea8eadb505ccb9c04e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:28.049145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=418a4c6848204bea8eadb505ccb9c04e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:28.049145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:28.117116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1808/3623] 10.222.0.42 () {58 vars in 1470 bytes} [Sun Oct 23 01:24:27 2022] DELETE /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:28.120672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:28.124252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:28.306053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a25bf-fcfd-4134-b1ae-e34a1cbf2f0b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:28.312976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:28.314538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:28.315377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:28.315812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/groups/f793aa4603704435b35cc08f6b7ea47e/users/2b064d62bd7d475f9ea5ba1175cbe3d4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:28.319078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f793aa4603704435b35cc08f6b7ea47e, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:28.320256 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:28.320256 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:28.320256 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:28.322948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:28.385838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418a4c6848204bea8eadb505ccb9c04e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:28.392871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418a4c6848204bea8eadb505ccb9c04e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:28.393796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418a4c6848204bea8eadb505ccb9c04e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:28.413448 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:28.440661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b064d62bd7d475f9ea5ba1175cbe3d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:28.482459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418a4c6848204bea8eadb505ccb9c04e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:28.483087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418a4c6848204bea8eadb505ccb9c04e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:28.514675 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1816/3624] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:27 2022] DELETE /identity/v3/users/418a4c6848204bea8eadb505ccb9c04e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:28.581139 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1809/3625] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:24:28 2022] DELETE /identity/v3/groups/f793aa4603704435b35cc08f6b7ea47e/users/2b064d62bd7d475f9ea5ba1175cbe3d4 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:28.587281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:28.590452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:28.710992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee580e-9d74-4636-ad84-e0d40920d64f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:28.828555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:28.829275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:28.830361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:28.831849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:28.839311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:28.841347 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:28.841347 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:28.841347 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:28.845707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:28.934686 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1817/3626] 10.222.0.42 () {60 vars in 1381 bytes} [Sun Oct 23 01:24:28 2022] PUT /identity/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:28.941892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:28.957996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c308-559d-491a-90f7-bb85f2ff8311 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:28.975167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:28.976117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:28.976655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:28.977145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:28.978914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=f793aa4603704435b35cc08f6b7ea47e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:28.983844 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:28.983844 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:28.983844 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:28.990310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.010902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1810/3627] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:24:28 2022] GET /identity/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles => generated 375 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:29.014345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.045127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3c17f-4902-4f7f-b867-490e7112b8c4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:29.053335 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:29.063643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:29.064339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.064626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.064952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.067251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:29.068289 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:29.068289 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:29.068289 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:29.069221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.076534 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1818/3628] 10.222.0.42 () {58 vars in 1363 bytes} [Sun Oct 23 01:24:29 2022] HEAD /identity/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:29.082724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.105636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f2c4-b52b-4858-980a-3851e3107c6f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:29.112541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:29.114186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.114695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.115206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.117651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=f793aa4603704435b35cc08f6b7ea47e, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:29.119123 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:29.119123 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:29.119123 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:29.121285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.229319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.232129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:29.235289 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1811/3629] 10.222.0.42 () {58 vars in 1365 bytes} [Sun Oct 23 01:24:29 2022] DELETE /identity/v3/system/groups/f793aa4603704435b35cc08f6b7ea47e/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:29.245396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.264669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9ed47-e2b6-4718-be76-a8dea51bff13 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:29.297716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:29.299844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.301665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.302603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.311933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c8dfa47c13c6439cb9bc809a805f1603, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:29.319635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.379063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea81f4c-b2ce-4eb8-9f45-16976bf25fd7 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:29.385467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:29.386764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.387048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.389228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] PATH_INFO: `/v3/projects/4308ac3d1dbe4e798f6650316f479826` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.393793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4308ac3d1dbe4e798f6650316f479826)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:29.398791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.410946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1812/3630] 10.222.0.42 () {60 vars in 1480 bytes} [Sun Oct 23 01:24:29 2022] PUT /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:29.427863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.514498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb00d0a-b8ad-4903-8c58-4d48a4cb7520 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:29.521884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:29.521884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.522258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.522258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.524007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=c8dfa47c13c6439cb9bc809a805f1603, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:29.526241 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:29.526241 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:29.526241 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:29.530737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.548128 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:29.568706 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1813/3631] 10.222.0.42 () {58 vars in 1362 bytes} [Sun Oct 23 01:24:29 2022] GET /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles => generated 408 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:29.575788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.584603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4308ac3d1dbe4e798f6650316f479826', 'request_id': 'req-e819e300-bc41-4b9c-a8db-b288e31eca28'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:29.600781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f399670-81e1-4eac-9950-4780561aeb65 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:29.602039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4308ac3d1dbe4e798f6650316f479826', 'request_id': 'req-e819e300-bc41-4b9c-a8db-b288e31eca28'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:29.683051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:29.684600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.684600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.684600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.690328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=c8dfa47c13c6439cb9bc809a805f1603, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:29.698374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.711987 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1814/3632] 10.222.0.42 () {58 vars in 1462 bytes} [Sun Oct 23 01:24:29 2022] HEAD /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:29.712781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4308ac3d1dbe4e798f6650316f479826', 'request_id': 'req-e819e300-bc41-4b9c-a8db-b288e31eca28'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:29.721489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.731033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] The token cache is being invalidate because project 4308ac3d1dbe4e798f6650316f479826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:29.732627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:29.734174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e819e300-bc41-4b9c-a8db-b288e31eca28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:29.738077 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1819/3633] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:29 2022] DELETE /identity/v3/projects/4308ac3d1dbe4e798f6650316f479826 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:29.743867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501310df-2ae2-4ee1-bee3-babc715216ee None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.750030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501310df-2ae2-4ee1-bee3-babc715216ee None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.750030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501310df-2ae2-4ee1-bee3-babc715216ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.750268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cae82-51be-48b1-8e03-3b44ae744120 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:29.762392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:29.763376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.764480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.765066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.772699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c8dfa47c13c6439cb9bc809a805f1603, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:29.779450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:29.793181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 0a5a6f632efc47d5be8d96e821133954 was removed from user 2b064d62bd7d475f9ea5ba1175cbe3d4 on domain c8dfa47c13c6439cb9bc809a805f1603. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:29.793797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:29.795026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-501310df-2ae2-4ee1-bee3-babc715216ee None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:29.795879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:29.797406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-501310df-2ae2-4ee1-bee3-babc715216ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:29.869486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1820/3634] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:29.883561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02fbb-98e7-43ec-9e8b-ddb71bd91b39 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:29.886475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02fbb-98e7-43ec-9e8b-ddb71bd91b39 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:29.886909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02fbb-98e7-43ec-9e8b-ddb71bd91b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:29.906302 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1815/3635] 10.222.0.42 () {58 vars in 1464 bytes} [Sun Oct 23 01:24:29 2022] DELETE /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:29.906302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:29.909556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:29.917963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a0c02fbb-98e7-43ec-9e8b-ddb71bd91b39 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:29.919570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0c02fbb-98e7-43ec-9e8b-ddb71bd91b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:30.046366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c17bae-7e20-4479-a581-a61bd84360f2 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.056370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.057665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.057948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.058243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.062609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.065646 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1821/3636] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:30.070114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02fbb-98e7-43ec-9e8b-ddb71bd91b39 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.070273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.083816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02fbb-98e7-43ec-9e8b-ddb71bd91b39 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.089827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.090833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.091218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.091595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.092395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:30.093248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.096722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.112627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1822/3637] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:30.117274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.131197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadc15a-7162-4e06-a779-3df1ca04fd41 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.137920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.138737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.139111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.139476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.140558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.142983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.237008 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1816/3638] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:29 2022] PUT /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:30.241332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.269006 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1823/3639] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:30 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:30.279279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.366825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639f58-792d-4028-9855-3439fe163464 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.372050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.372671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.372942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.373208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.373925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.375899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.376425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ac8c0-b1c5-440e-bfc8-3aec22ccb721 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.439463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.440065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.442313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.442615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.444595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_grants(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.447147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.467145 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1817/3640] 10.222.0.42 () {58 vars in 1365 bytes} [Sun Oct 23 01:24:30 2022] GET /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles => generated 409 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:30.468510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.490321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a51ec-4846-4251-8025-3a5cb6242126 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.499985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.500811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.501211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.501566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.505540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:check_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.520219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.528622 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1818/3641] 10.222.0.42 () {58 vars in 1465 bytes} [Sun Oct 23 01:24:30 2022] HEAD /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:30.532622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.544449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49967-5b9d-4748-bfc5-00b7f2f9b78e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.560751 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1824/3642] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:30 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:30.562357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.583319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.586535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.586535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.586535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.587259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e291-ff07-4f34-bb2e-1a09fbf9dbb0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.590449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=aa39dfee9d4b48a5a1fef42175f1d42a, user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.593120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.598989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.599654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.599887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.600178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.600796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.602481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.608734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 0a5a6f632efc47d5be8d96e821133954 was removed from user 2b064d62bd7d475f9ea5ba1175cbe3d4 on project aa39dfee9d4b48a5a1fef42175f1d42a. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:30.609037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:30.609784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:30.634868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1825/3643] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:30 2022] GET /identity/v3/roles => generated 2321 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:24:30.638715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.641150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:30.657076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca44c1-5b6d-43e0-aaf5-e7f0a1876f2e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.663236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.663933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.664626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.664973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.665736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.667655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.685234 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1826/3644] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:30 2022] GET /identity/v3/roles => generated 2321 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:30.688834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.700946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbcbc5-fd84-4c95-981f-e85b4ae0540f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.706232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20baaaf-d9c4-423d-986c-e203e8a5cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:30.713033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20baaaf-d9c4-423d-986c-e203e8a5cb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.713033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20baaaf-d9c4-423d-986c-e203e8a5cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.713033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20baaaf-d9c4-423d-986c-e203e8a5cb99 admin admin] PATH_INFO: `/v3/projects/316cbb6f558c4bc8b34050cc1b8ea134/users/4024e1a8f515435f86d3d36d59262813/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.730640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20baaaf-d9c4-423d-986c-e203e8a5cb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316cbb6f558c4bc8b34050cc1b8ea134, user_id=4024e1a8f515435f86d3d36d59262813, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:30.734625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20baaaf-d9c4-423d-986c-e203e8a5cb99 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:30.752391 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1819/3645] 10.222.0.42 () {58 vars in 1467 bytes} [Sun Oct 23 01:24:30 2022] DELETE /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:30.758779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:30.763728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:30.835850 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1827/3646] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:30 2022] PUT /identity/v3/projects/316cbb6f558c4bc8b34050cc1b8ea134/users/4024e1a8f515435f86d3d36d59262813/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:30.837629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:30.838226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:30.838602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:30.859480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:30.861424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:30.870702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8f10-6d8d-418e-82ea-12366eba7249 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:30.999374 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1828/3647] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:24:31.001170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.003041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.003341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.004181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.006181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.007230 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:31.007230 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:31.007230 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:31.008154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.011621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.017380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:31.121274 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1820/3648] 10.222.0.42 () {60 vars in 1378 bytes} [Sun Oct 23 01:24:30 2022] PUT /identity/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:31.125586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd5823-afed-42ea-90c2-20f6e06b92f5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:31.125844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.135211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.136224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.136738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.137222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.141599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9af438-c238-4b68-a2b9-4d2fa207144b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:31.156418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.157222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.157512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.157789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.160249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=2b064d62bd7d475f9ea5ba1175cbe3d4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.161951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.162980 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:31.162980 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:31.162980 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:31.163891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.165028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.176947 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1829/3649] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:24:31.191035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1821/3650] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:24:31 2022] GET /identity/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:31.195177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.208516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d67c0-9740-493d-a2b6-eb8914892ee8 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:31.215408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.215408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.215671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.216050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.217913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.219053 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:31.219053 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:31.219053 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:31.220366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.227326 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1830/3651] 10.222.0.42 () {58 vars in 1360 bytes} [Sun Oct 23 01:24:31 2022] HEAD /identity/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:31.236503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.245753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c41f0-3ed5-412b-ad45-016b68cda927 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:31.250815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.251481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.251764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.252611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.254380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=2b064d62bd7d475f9ea5ba1175cbe3d4, role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.255392 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:31.255392 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:31.255392 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:31.256261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.387557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1822/3652] 10.222.0.42 () {58 vars in 1362 bytes} [Sun Oct 23 01:24:31 2022] DELETE /identity/v3/system/users/2b064d62bd7d475f9ea5ba1175cbe3d4/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:31.392769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.414573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa48ce-9c80-494d-ad62-ac7670034c75 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:31.430654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.434003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.434975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.435425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.437646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.442790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.487508 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:31.556516 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1831/3653] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:31 2022] POST /identity/v3/roles => generated 270 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:31.560168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.574232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e9e5-c6d9-4951-9c26-adc8773cd28b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:31.580245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.582256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.582809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.583357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.584134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.585445 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:31.585445 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:31.585445 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:31.586948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.718092 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1823/3654] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:31 2022] POST /identity/v3/roles => generated 270 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:31.723474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.739086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3be9c-ae59-4bc2-9a45-1efbd7ac219c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:31.746840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:31.748039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:31.748780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:31.749267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/38d6a95596334fdaa23caea830a2d46d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:31.762851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2673350ef9f243f8ad25285eac566c20, implied_role_id=38d6a95596334fdaa23caea830a2d46d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:31.767134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:31.911454 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1832/3655] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:31 2022] PUT /identity/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/38d6a95596334fdaa23caea830a2d46d => generated 531 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:31.915652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:31.930858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64ab5c-3157-4c85-9c33-a5ff6bc9671c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:32.024738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:32.025510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:32.025666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:32.026081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:32.027439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:32.029145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:32.107808 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1824/3656] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:24:31 2022] POST /identity/v3/domains => generated 276 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:32.111729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:32.127794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a94ca-f8d7-41c3-bca6-c0c3c47feae5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:32.216046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:32.218182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:32.219797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:32.220280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:32.221211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:32.226436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:32.328273 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:32.337625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1833/3657] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:32 2022] POST /identity/v3/roles => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:32.338561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:32.355944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df043-5a3d-4aae-913b-c0e2c02e0890 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:32.368424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:32.370213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:32.371846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:32.372339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/96c3b5530e9f4e85b79f4fd329c467a8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:32.377486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2673350ef9f243f8ad25285eac566c20, implied_role_id=96c3b5530e9f4e85b79f4fd329c467a8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:32.379361 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:32.379361 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:32.379361 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:32.380261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:32.532727 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1825/3658] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:32 2022] PUT /identity/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/96c3b5530e9f4e85b79f4fd329c467a8 => generated 530 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:32.537076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:32.550961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3130e1-6ebc-4a89-b71a-6a483c8057e6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:32.663418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:32.664082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:32.664361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:32.664635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:32.666548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2673350ef9f243f8ad25285eac566c20, implied_role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:32.668315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:32.851554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1834/3659] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:32 2022] PUT /identity/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/0a5a6f632efc47d5be8d96e821133954 => generated 525 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:32.853163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:32.869583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf468-392a-41e4-97e9-a1d31a6e87a1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:32.966016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:32.967051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:32.967341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:32.967609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/0a5a6f632efc47d5be8d96e821133954/implies/2673350ef9f243f8ad25285eac566c20` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:32.969655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0a5a6f632efc47d5be8d96e821133954, implied_role_id=2673350ef9f243f8ad25285eac566c20)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:32.971309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] 2673350ef9f243f8ad25285eac566c20 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 2673350ef9f243f8ad25285eac566c20 cannot be an implied roles. Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 23 01:24:32.990506 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 23 01:24:32.991628 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:32.991628 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:32.991628 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 23 01:24:32.991628 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 23 01:24:32.991628 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 2673350ef9f243f8ad25285eac566c20 cannot be an implied roles. Oct 23 01:24:32.991628 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:32.991628 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1826/3660] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:32 2022] PUT /identity/v3/roles/0a5a6f632efc47d5be8d96e821133954/implies/2673350ef9f243f8ad25285eac566c20 => generated 116 bytes in 139 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:32.995991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:33.007050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9546d3-bc93-4a3a-b199-f87ed7046b96 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:33.011773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:33.012431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:33.012715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:33.012987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:33.014661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2673350ef9f243f8ad25285eac566c20, implied_role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:33.016252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:33.149048 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1835/3661] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:32 2022] DELETE /identity/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:33.150612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:33.164524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a370-b88e-4836-a10f-51e14969780b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:33.239004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:33.239909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:33.240248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:33.243414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/96c3b5530e9f4e85b79f4fd329c467a8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:33.243414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2673350ef9f243f8ad25285eac566c20, implied_role_id=96c3b5530e9f4e85b79f4fd329c467a8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:33.245350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:33.342621 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1827/3662] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:33 2022] DELETE /identity/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/96c3b5530e9f4e85b79f4fd329c467a8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:33.348399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:33.363869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895a604-b957-4c83-8860-3d95ee07b2de tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:33.546495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:33.548156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:33.548441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:33.548711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/96c3b5530e9f4e85b79f4fd329c467a8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:33.549936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=96c3b5530e9f4e85b79f4fd329c467a8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:33.553566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:33.734564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 96c3b5530e9f4e85b79f4fd329c467a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:33.735536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:33.736525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:33.739090 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1836/3663] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:33 2022] DELETE /identity/v3/roles/96c3b5530e9f4e85b79f4fd329c467a8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:33.743069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:33.744793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:33.768089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2cb9-e3c3-47e6-b7b1-139d6e5f262c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:33.844622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:33.845336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:33.845613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:33.845891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/584158ce12af468fa2e5131f0b710dbf` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:33.874899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=584158ce12af468fa2e5131f0b710dbf)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:33.878300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:33.916351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '584158ce12af468fa2e5131f0b710dbf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:33.917261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '584158ce12af468fa2e5131f0b710dbf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.101132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '584158ce12af468fa2e5131f0b710dbf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.102029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '584158ce12af468fa2e5131f0b710dbf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.106065 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1828/3664] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:24:33 2022] PATCH /identity/v3/domains/584158ce12af468fa2e5131f0b710dbf => generated 277 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:34.110230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:34.140947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b25fd5-7e88-4af2-9350-a5c7b0ee550a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:34.207916 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:34.227442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:34.228451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:34.228897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:34.229413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/584158ce12af468fa2e5131f0b710dbf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:34.248988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=584158ce12af468fa2e5131f0b710dbf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:34.251241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:34.323271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '584158ce12af468fa2e5131f0b710dbf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.328461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '584158ce12af468fa2e5131f0b710dbf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.567156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584158ce12af468fa2e5131f0b710dbf', 'request_id': 'req-a741de4b-13f4-479e-aaf4-4baf729b1a26'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.573143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584158ce12af468fa2e5131f0b710dbf', 'request_id': 'req-a741de4b-13f4-479e-aaf4-4baf729b1a26'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.669491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584158ce12af468fa2e5131f0b710dbf', 'request_id': 'req-a741de4b-13f4-479e-aaf4-4baf729b1a26'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.683873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] The token cache is being invalidate because project 584158ce12af468fa2e5131f0b710dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:34.684247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.684966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.698087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '584158ce12af468fa2e5131f0b710dbf', 'request_id': 'req-a741de4b-13f4-479e-aaf4-4baf729b1a26'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.698994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '584158ce12af468fa2e5131f0b710dbf', 'request_id': 'req-a741de4b-13f4-479e-aaf4-4baf729b1a26'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.704569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a741de4b-13f4-479e-aaf4-4baf729b1a26 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '584158ce12af468fa2e5131f0b710dbf', 'request_id': 'req-a741de4b-13f4-479e-aaf4-4baf729b1a26'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:34.712286 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1837/3665] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:34 2022] DELETE /identity/v3/domains/584158ce12af468fa2e5131f0b710dbf => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:34.718330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:34.721774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:34.740050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ae25d-114c-4e0b-bf0e-c10d1e5a824f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:34.760478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:34.760766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:34.761043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:34.789466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] MFA Rules not processed for user `60276a4031ee45ffa651b5467a62a81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:34.791082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:34.913791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:34.913791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:34.917120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:34.918761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/38d6a95596334fdaa23caea830a2d46d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:34.923134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2673350ef9f243f8ad25285eac566c20, implied_role_id=38d6a95596334fdaa23caea830a2d46d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:34.925865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:34.964729 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1838/3666] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:24:35.043679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1829/3667] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:34 2022] DELETE /identity/v3/roles/2673350ef9f243f8ad25285eac566c20/implies/38d6a95596334fdaa23caea830a2d46d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:35.048520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:35.050732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:35.085521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf6479-e3cc-4aa2-91c8-5b3263409db6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:35.241161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:35.243413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:35.244530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:35.246524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/38d6a95596334fdaa23caea830a2d46d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:35.250339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=38d6a95596334fdaa23caea830a2d46d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:35.254535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:35.401491 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:35.463760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 38d6a95596334fdaa23caea830a2d46d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:35.464188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:35.465750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:35.474775 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1839/3668] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:35 2022] DELETE /identity/v3/roles/38d6a95596334fdaa23caea830a2d46d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:35.476050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:35.478012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:35.506393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6728b8-c7b7-47b2-a0b8-b4480d3c7cfb tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:35.635551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:35.636220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:35.636504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:35.636783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/2673350ef9f243f8ad25285eac566c20` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:35.638236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2673350ef9f243f8ad25285eac566c20)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:35.639265 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:35.639265 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:35.639265 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:35.640160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:35.810028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 2673350ef9f243f8ad25285eac566c20 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:35.810028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:35.810747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:35.824070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1830/3669] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:35 2022] DELETE /identity/v3/roles/2673350ef9f243f8ad25285eac566c20 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:35.829807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:35.846452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27208fe-5b51-4ed7-bca2-eaf904073819 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:36.005877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:36.005877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:36.005877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:36.006190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:36.007609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.009551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:36.155946 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1840/3670] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:35 2022] PUT /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 520 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:36.159962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:36.162537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:36.180645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a1a96-0e66-437a-be28-47c701573a1d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:36.294331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:36.295044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:36.295327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:36.295595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:36.297388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.298849 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:36.298849 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:36.298849 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:36.301315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:36.302302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.303479 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:36.303479 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:36.303479 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:36.304633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:36.325440 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1831/3671] 10.222.0.42 () {58 vars in 1345 bytes} [Sun Oct 23 01:24:36 2022] HEAD /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:36.333096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:36.345013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fbde-ba2c-4b37-b4f3-beb67a05dd9a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:36.372847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:36.374291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:36.374659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:36.374854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:36.378116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.379226 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:36.379226 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:36.379226 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:36.380120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:36.400315 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1841/3672] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:24:36 2022] GET /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 520 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:36.405039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:36.420440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858fcc1-ff74-44ba-99e2-730bd629822a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:36.435221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:36.436112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:36.436494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:36.436857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:36.441764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.448299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:36.487558 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:36.573344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1832/3673] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:36 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:36.578154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:36.596191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ddfc-84e8-488d-83ca-1729c52dee1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:36.750710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:36.751377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:36.752202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:36.752394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:36.755330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.760990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57.: keystone.exception.ImpliedRoleNotFound: b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57. Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = query.one() Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._iter().one() Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._only_one_row( Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:36.782921 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 23 01:24:36.784249 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 23 01:24:36.785896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 23 01:24:36.785896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57. Oct 23 01:24:36.785896 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:36.791441 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1842/3674] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:24:36 2022] GET /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 137 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:36.791984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:36.815612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dd3cb-66fc-4bc7-ad71-c1b61d363a3d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:36.836069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:36.836891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:36.837280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:36.837583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:36.841335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.845179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57.: keystone.exception.ImpliedRoleNotFound: b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57. Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = query.one() Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._iter().one() Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._only_one_row( Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:36.867022 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 23 01:24:36.868332 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 23 01:24:36.869606 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 23 01:24:36.869606 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 23 01:24:36.869606 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 23 01:24:36.869606 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b97f3fe2e30d4647a382d252bc122fb7 does not imply 76b10ead544d4c9aab27ef68d1475f57. Oct 23 01:24:36.869606 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:24:36.871606 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1833/3675] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:36 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 137 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 23 01:24:36.876411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:36.892599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5d30a-c324-488d-8fa1-9cb49a9ecfbf tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:36.901308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:36.902173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:36.902721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:36.903247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:36.905291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:36.907236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:37.098328 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1843/3676] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:36 2022] PUT /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 520 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:37.102986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:37.125284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1d7c-91c1-4ea1-bc04-62bcab2a204c tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:37.198799 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:37.276161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:37.277100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:37.277551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:37.278172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:37.280050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=1a5a17835bf9407e8a5229cbc51f51aa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:37.281992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:37.447716 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1834/3677] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:37 2022] PUT /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa => generated 519 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:37.452482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:37.474001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f17d-b458-4d71-8ca5-e02ca74aa1f4 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:37.626375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:37.626375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:37.626375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:37.626695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:37.626695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=1a5a17835bf9407e8a5229cbc51f51aa, implied_role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:37.629537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:37.766327 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1844/3678] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:37 2022] PUT /identity/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954 => generated 519 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:37.770782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:37.785337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973be6f0-24f2-43b7-b52d-ce3d5dff4ae6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:37.958672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:37.960359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:37.961386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:37.961920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:37.962679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:37.967123 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:37.967123 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:37.967123 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:37.967123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:38.004078 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1835/3679] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:24:37 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:38.005109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:38.019735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef423-4821-4f88-a772-faf8628ff986 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:38.027379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5016542-28a0-4f7c-b377-6dcfd5887ba1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:38.035868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016542-28a0-4f7c-b377-6dcfd5887ba1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:38.035868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016542-28a0-4f7c-b377-6dcfd5887ba1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:38.035868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5016542-28a0-4f7c-b377-6dcfd5887ba1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:38.035868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5016542-28a0-4f7c-b377-6dcfd5887ba1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=1a5a17835bf9407e8a5229cbc51f51aa, implied_role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:38.036298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5016542-28a0-4f7c-b377-6dcfd5887ba1 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:38.169208 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1845/3680] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:38 2022] DELETE /identity/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:38.169315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:38.180682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d195e-5e16-4d8f-abd9-ce359e9b6265 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:38.311349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:38.312397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:38.312847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:38.313313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:38.315492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=1a5a17835bf9407e8a5229cbc51f51aa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:38.321174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:38.431847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2444f49-3821-4b70-bbae-d82c14396ca1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:38.433696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2444f49-3821-4b70-bbae-d82c14396ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:38.434642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2444f49-3821-4b70-bbae-d82c14396ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:38.439246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1836/3681] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:38 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:38.444497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:38.492746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f2444f49-3821-4b70-bbae-d82c14396ca1 None None] MFA Rules not processed for user `2b8a867611614ea585d510d62c63cfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:38.496042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f2444f49-3821-4b70-bbae-d82c14396ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:38.583154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204242-c7bd-43ff-bc93-c3cef2e1f373 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:38.586677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:38.587583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:38.588103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:38.588454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:38.590542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:38.593527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:38.645586 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1846/3682] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:24:38.714441 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1837/3683] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:38 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:38.719649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2444f49-3821-4b70-bbae-d82c14396ca1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:38.743041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2444f49-3821-4b70-bbae-d82c14396ca1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:38.825173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:38.834601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:38.834601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:38.834601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:38.834601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:38.834601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:38.846201 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1847/3684] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:38 2022] GET /identity/v3/roles => generated 2321 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:38.860204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:38.889512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc468-5622-4dab-9322-326c27ae954d tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:38.901584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:38.902350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:38.902628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:38.903153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:38.903869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:38.905538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:39.026859 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1838/3685] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:24:38 2022] POST /identity/v3/roles => generated 234 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:39.033819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:39.047165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7d0d1-1504-41bb-8151-eba32a00fdaa tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:39.059896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:39.061321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:39.061764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:39.062371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/3c373f57f0f54061969e4f3e7f49bc21` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:39.066994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:update_role(role_id=3c373f57f0f54061969e4f3e7f49bc21)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:39.068332 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:39.068332 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:39.068332 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:39.069576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:39.150524 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:39.207944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1848/3686] 10.222.0.42 () {60 vars in 1243 bytes} [Sun Oct 23 01:24:39 2022] PATCH /identity/v3/roles/3c373f57f0f54061969e4f3e7f49bc21 => generated 237 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:39.213364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:39.235775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de11bc-8240-4aac-b3b4-91088497ec5f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:39.242145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:39.242802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:39.243281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:39.243558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/3c373f57f0f54061969e4f3e7f49bc21` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:39.254152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:get_role(role_id=3c373f57f0f54061969e4f3e7f49bc21)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:39.255394 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:39.255394 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:39.255394 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:39.256362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:39.261869 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1839/3687] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:24:39 2022] GET /identity/v3/roles/3c373f57f0f54061969e4f3e7f49bc21 => generated 237 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:39.262613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:39.274866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdac36-d990-43bf-9893-3ca3a0622935 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:39.280477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:39.281565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:39.282098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:39.282826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:39.283632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:39.286364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:39.301800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1849/3688] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:39 2022] GET /identity/v3/roles => generated 2549 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:39.303183 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:39.305864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:39.317895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace9c06-a6a3-46e1-991b-8520fe25403a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:39.327674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:39.329216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:39.330721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:39.330721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/3c373f57f0f54061969e4f3e7f49bc21` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:39.332286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c373f57f0f54061969e4f3e7f49bc21)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:39.334278 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:39.334278 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:39.334278 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:39.335452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:39.546016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 3c373f57f0f54061969e4f3e7f49bc21 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:39.546016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:39.546016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:39.551082 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1840/3689] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:39 2022] DELETE /identity/v3/roles/3c373f57f0f54061969e4f3e7f49bc21 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:39.552680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:39.562474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:39.592498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78bc62-c4c6-41f4-b16c-9eb256d95397 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:39.710816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:39.711712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:39.712124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:39.712513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:39.720224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:39.722391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:39.929596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1850/3690] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:39 2022] PUT /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 520 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:39.930293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:39.944503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d9ec-f340-4734-85cb-37944879a060 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:40.096742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:40.099849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:40.100442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:40.100952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:40.103379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=1a5a17835bf9407e8a5229cbc51f51aa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:40.105394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:40.274406 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1841/3691] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:39 2022] PUT /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa => generated 519 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:40.278667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:40.294859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443969d3-3340-4d72-9b4a-0ad438830041 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:40.471670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:40.472589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:40.473154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:40.473438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:40.479071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=1a5a17835bf9407e8a5229cbc51f51aa, implied_role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:40.480773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:40.713726 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1851/3692] 10.222.0.42 () {60 vars in 1363 bytes} [Sun Oct 23 01:24:40 2022] PUT /identity/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954 => generated 519 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:40.718478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:40.747130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea153b71-8c24-44d7-8c11-4bc6e945ae01 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:40.907866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:40.908914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:40.909456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:40.910012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:40.911870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=1a5a17835bf9407e8a5229cbc51f51aa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:40.913160 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:40.913160 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:40.913160 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:40.916869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:40.930500 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1842/3693] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:24:40 2022] GET /identity/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies => generated 488 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:40.931220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:40.949366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932d23-d4d2-49f7-98ee-a9f6c946f561 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:40.954924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:40.956010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:40.957133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:40.957800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:40.959231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:40.960541 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:40.960541 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:40.960541 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:40.962372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:40.978523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:40.983686 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1852/3694] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:24:40 2022] GET /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies => generated 659 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:40.989541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2ad9e-5d8b-4486-9fb5-5d30e3ffc842 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:40.999942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:40.999942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:40.999942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:41.000363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:41.000847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=1a5a17835bf9407e8a5229cbc51f51aa, implied_role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:41.002490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:41.087731 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1843/3695] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:40 2022] DELETE /identity/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa/implies/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:41.091970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:41.105246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20127e-9d6c-4a7f-99dd-d04d750b2e9e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:41.198202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:41.199158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:41.199678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:41.200127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:41.202088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=1a5a17835bf9407e8a5229cbc51f51aa)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:41.205710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:41.294406 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1853/3696] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:41 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/1a5a17835bf9407e8a5229cbc51f51aa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:41.298843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:41.311413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a87337-fb77-40f5-b592-035b20a608c6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:41.403211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:41.404039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:41.404387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:41.404863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:41.407006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b97f3fe2e30d4647a382d252bc122fb7, implied_role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:41.408696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:41.483187 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1844/3697] 10.222.0.42 () {58 vars in 1347 bytes} [Sun Oct 23 01:24:41 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7/implies/76b10ead544d4c9aab27ef68d1475f57 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:41.485171 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:41.495372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:41.516307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f2646-8fcb-4fdb-aa65-eba986bbdc48 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:41.602389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:41.603042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:41.603325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:41.603754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/584158ce12af468fa2e5131f0b710dbf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:41.614305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Could not find domain: 584158ce12af468fa2e5131f0b710dbf.: keystone.exception.DomainNotFound: Could not find domain: 584158ce12af468fa2e5131f0b710dbf. Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 584158ce12af468fa2e5131f0b710dbf. Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:41.620169 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:41.621341 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 584158ce12af468fa2e5131f0b710dbf. Oct 23 01:24:41.622457 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:41.623540 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1854/3698] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:24:41 2022] PATCH /identity/v3/domains/584158ce12af468fa2e5131f0b710dbf => generated 112 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:41.626056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:41.644131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd78114-d00c-4352-a786-5bd72761a864 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:41.650217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:41.651068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:41.651356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:41.651823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/users/2b064d62bd7d475f9ea5ba1175cbe3d4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:41.653270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b064d62bd7d475f9ea5ba1175cbe3d4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:41.659922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:41.839902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b064d62bd7d475f9ea5ba1175cbe3d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:41.873167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b064d62bd7d475f9ea5ba1175cbe3d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:41.873167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b064d62bd7d475f9ea5ba1175cbe3d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:42.001935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b064d62bd7d475f9ea5ba1175cbe3d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:42.001935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b064d62bd7d475f9ea5ba1175cbe3d4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:42.042095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1845/3699] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:41 2022] DELETE /identity/v3/users/2b064d62bd7d475f9ea5ba1175cbe3d4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:42.045769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:42.048020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:42.067888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121db102-54fe-42af-82ea-b868a804f92b tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:42.291524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:42.291524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:42.291524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:42.311967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/0a5a6f632efc47d5be8d96e821133954` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:42.311967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0a5a6f632efc47d5be8d96e821133954)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:42.311967 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:42.311967 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:42.311967 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:42.311967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:42.549182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 0a5a6f632efc47d5be8d96e821133954 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:42.549538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:42.550343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:42.552528 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1855/3700] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:42 2022] DELETE /identity/v3/roles/0a5a6f632efc47d5be8d96e821133954 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:42.556579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:42.569304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc614-5d18-4b77-98b3-9b920c690791 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:42.635594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaa65b-c9b3-4ea6-bef1-c3c77ce31b27 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:42.636244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa65b-c9b3-4ea6-bef1-c3c77ce31b27 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:42.636528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa65b-c9b3-4ea6-bef1-c3c77ce31b27 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:42.636804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa65b-c9b3-4ea6-bef1-c3c77ce31b27 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/groups/f793aa4603704435b35cc08f6b7ea47e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:42.637993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaa65b-c9b3-4ea6-bef1-c3c77ce31b27 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f793aa4603704435b35cc08f6b7ea47e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:42.639175 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-0efaa65b-c9b3-4ea6-bef1-c3c77ce31b27 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:42.639175 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:42.639175 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:42.640353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaa65b-c9b3-4ea6-bef1-c3c77ce31b27 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:42.826170 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:42.835430 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1846/3701] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:24:42 2022] DELETE /identity/v3/groups/f793aa4603704435b35cc08f6b7ea47e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:42.839546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:42.841107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:42.858174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2be60c-9699-40da-b5dd-54a70d6fff3a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:42.946460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:42.947459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:42.947927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:42.948555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:42.950422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa39dfee9d4b48a5a1fef42175f1d42a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:42.953082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:43.085341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa39dfee9d4b48a5a1fef42175f1d42a', 'request_id': 'req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.094431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df43b9-0bbd-4347-b749-3c8476361687 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:43.094431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df43b9-0bbd-4347-b749-3c8476361687 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:43.094431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df43b9-0bbd-4347-b749-3c8476361687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:43.115490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa39dfee9d4b48a5a1fef42175f1d42a', 'request_id': 'req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.139801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-14df43b9-0bbd-4347-b749-3c8476361687 None None] MFA Rules not processed for user `4024e1a8f515435f86d3d36d59262813`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:43.141391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-14df43b9-0bbd-4347-b749-3c8476361687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:43.213490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa39dfee9d4b48a5a1fef42175f1d42a', 'request_id': 'req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.237190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] The token cache is being invalidate because project aa39dfee9d4b48a5a1fef42175f1d42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:43.239525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.241358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.245761 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1856/3702] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:42 2022] DELETE /identity/v3/projects/aa39dfee9d4b48a5a1fef42175f1d42a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:43.249889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:43.257298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:43.302679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1847/3703] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:43.305504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:43.305688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:43.308420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:43.370730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] MFA Rules not processed for user `4024e1a8f515435f86d3d36d59262813`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:43.374091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:43.399050 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1848/3704] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:43.411119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:43.414579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:43.488522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a244-37ca-4ac8-a84e-4282f0ced4f6 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:43.503709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:43.504156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:43.504436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:43.506103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:43.508255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c8dfa47c13c6439cb9bc809a805f1603)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:43.514236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:43.574165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.575235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.608584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83ee4e-85dd-4bc0-9bfc-a854eb62bd10 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:43.688059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.688823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.694876 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1857/3705] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:24:43 2022] PATCH /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603 => generated 276 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:43.696554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:43.699070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be882b74-1531-463f-9901-950accf67791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:43.699757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be882b74-1531-463f-9901-950accf67791 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:43.700040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be882b74-1531-463f-9901-950accf67791 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:43.700311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be882b74-1531-463f-9901-950accf67791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:43.701369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:43.704010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-be882b74-1531-463f-9901-950accf67791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:43.786940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115ad42-e6ce-4ae7-a4f6-d22d4eb16d4f tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:43.795823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be882b74-1531-463f-9901-950accf67791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:43.798184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be882b74-1531-463f-9901-950accf67791 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:43.799325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:43.800592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:43.800872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:43.801149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/domains/c8dfa47c13c6439cb9bc809a805f1603` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:43.811478 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1849/3706] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:24:43.830305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c8dfa47c13c6439cb9bc809a805f1603)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:43.832634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:43.875124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:43.879810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.028355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603', 'request_id': 'req-406bc3f0-aa75-4a47-9572-9f04251a3e03'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.036823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603', 'request_id': 'req-406bc3f0-aa75-4a47-9572-9f04251a3e03'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.182402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603', 'request_id': 'req-406bc3f0-aa75-4a47-9572-9f04251a3e03'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.201402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] The token cache is being invalidate because project c8dfa47c13c6439cb9bc809a805f1603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:44.201695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.205595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.219382 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:44.220830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603', 'request_id': 'req-406bc3f0-aa75-4a47-9572-9f04251a3e03'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.222541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603', 'request_id': 'req-406bc3f0-aa75-4a47-9572-9f04251a3e03'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.226419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c8dfa47c13c6439cb9bc809a805f1603', 'request_id': 'req-406bc3f0-aa75-4a47-9572-9f04251a3e03'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.233701 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1858/3707] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:43 2022] DELETE /identity/v3/domains/c8dfa47c13c6439cb9bc809a805f1603 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:44.237622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be882b74-1531-463f-9901-950accf67791 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:44.249527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be882b74-1531-463f-9901-950accf67791 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:44.332298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:44.333416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:44.334570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:44.335121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:44.336996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1a5a17835bf9407e8a5229cbc51f51aa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:44.339260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:44.464924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 1a5a17835bf9407e8a5229cbc51f51aa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:44.468422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.468816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.473615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1850/3708] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:44 2022] DELETE /identity/v3/roles/1a5a17835bf9407e8a5229cbc51f51aa => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:44.477513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:44.480631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:44.505900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc3f0-aa75-4a47-9572-9f04251a3e03 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:44.697669 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:44.703521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:44.703829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:44.704121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:44.704396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/76b10ead544d4c9aab27ef68d1475f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:44.706694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_role(role_id=76b10ead544d4c9aab27ef68d1475f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:44.708347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:44.817473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role 76b10ead544d4c9aab27ef68d1475f57 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:44.817813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.818724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:44.823268 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1859/3709] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:44 2022] DELETE /identity/v3/roles/76b10ead544d4c9aab27ef68d1475f57 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:44.824744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:44.826417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:44.840520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1884b-4ce7-463e-9f27-61a4b14d3b1e tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:44.910708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97279010903c4fd2b6a64bc3b0552e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd30da713fe844fe8b65cefcdb87650b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:44.911587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:44.911920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:44.912047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] PATH_INFO: `/v3/roles/b97f3fe2e30d4647a382d252bc122fb7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:44.919532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b97f3fe2e30d4647a382d252bc122fb7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:44.934542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:45.139790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invalidating the token cache because role b97f3fe2e30d4647a382d252bc122fb7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:45.151186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:45.152179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8484aec9-27d5-49c8-91f2-145726d4589a tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:45.155722 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1851/3710] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:44 2022] DELETE /identity/v3/roles/b97f3fe2e30d4647a382d252bc122fb7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:45.165436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:45.168604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:45.405841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4637df-8c58-4fc3-84d1-ec539bdda7b5 tempest-RolesV3TestJSON-509082853 tempest-RolesV3TestJSON-509082853-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:45.564938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:45.565640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:45.565924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:45.566251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] PATH_INFO: `/v3/users/5f05feeb2ab74caba28ae5ad5d61a574` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:45.567541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f05feeb2ab74caba28ae5ad5d61a574)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:45.572866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:45.852890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f05feeb2ab74caba28ae5ad5d61a574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:45.899585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f05feeb2ab74caba28ae5ad5d61a574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:45.912052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f05feeb2ab74caba28ae5ad5d61a574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:46.043275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f05feeb2ab74caba28ae5ad5d61a574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:46.043275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f05feeb2ab74caba28ae5ad5d61a574'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:46.099718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1860/3711] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:45 2022] DELETE /identity/v3/users/5f05feeb2ab74caba28ae5ad5d61a574 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:46.105358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:46.106216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:46.106647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:46.138086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:46.139593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:46.267367 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1852/3712] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:46.277751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:46.279461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:46.350460 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:46.386875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3334f-8180-4d40-8829-e82cbf1b04b3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:46.393061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:46.394584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:46.405060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:46.405607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:46.433620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:46.444215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:46.478910 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1861/3713] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:24:47.158063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:47.162975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:47.187566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6d810-c497-498a-bc58-5a3eae8674f4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:47.194877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:47.195838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:47.196286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:47.196709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] PATH_INFO: `/v3/projects/aed9f7e6172a4472809ee103252f1921` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:47.204081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed9f7e6172a4472809ee103252f1921)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:47.207208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:47.351675 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:47.374670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed9f7e6172a4472809ee103252f1921', 'request_id': 'req-147bab5e-87ec-4d8f-a290-58f6871285f4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:47.385863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed9f7e6172a4472809ee103252f1921', 'request_id': 'req-147bab5e-87ec-4d8f-a290-58f6871285f4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:47.567471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed9f7e6172a4472809ee103252f1921', 'request_id': 'req-147bab5e-87ec-4d8f-a290-58f6871285f4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:47.590799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] The token cache is being invalidate because project aed9f7e6172a4472809ee103252f1921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:47.593527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:47.595781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:47.601747 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1853/3714] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:47 2022] DELETE /identity/v3/projects/aed9f7e6172a4472809ee103252f1921 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:47.605654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:47.645703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1cd78-720f-4878-b620-63df32211b01 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:47.743737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:47.744750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:47.745188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:47.745634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] PATH_INFO: `/v3/users/97279010903c4fd2b6a64bc3b0552e1c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:47.746997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97279010903c4fd2b6a64bc3b0552e1c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:47.749829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:48.134903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97279010903c4fd2b6a64bc3b0552e1c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:48.142786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97279010903c4fd2b6a64bc3b0552e1c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:48.143681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97279010903c4fd2b6a64bc3b0552e1c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:48.204790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97279010903c4fd2b6a64bc3b0552e1c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:48.205539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c941dcb4-bcea-49c5-9d0e-a329a8c3cf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97279010903c4fd2b6a64bc3b0552e1c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:48.223724 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1862/3715] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:47 2022] DELETE /identity/v3/users/97279010903c4fd2b6a64bc3b0552e1c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:48.830529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:48.832908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:48.848349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bab5e-87ec-4d8f-a290-58f6871285f4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:48.918358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:48.919690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:48.920352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:48.920993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] PATH_INFO: `/v3/projects/fd30da713fe844fe8b65cefcdb87650b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:48.922480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd30da713fe844fe8b65cefcdb87650b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:48.929101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:49.114180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd30da713fe844fe8b65cefcdb87650b', 'request_id': 'req-15b98730-49cb-4adf-ad9e-be63dc96cd5d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:49.124382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd30da713fe844fe8b65cefcdb87650b', 'request_id': 'req-15b98730-49cb-4adf-ad9e-be63dc96cd5d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:49.223754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd30da713fe844fe8b65cefcdb87650b', 'request_id': 'req-15b98730-49cb-4adf-ad9e-be63dc96cd5d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:49.259566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] The token cache is being invalidate because project fd30da713fe844fe8b65cefcdb87650b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:49.259871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:49.261405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15b98730-49cb-4adf-ad9e-be63dc96cd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:49.271913 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1854/3716] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:48 2022] DELETE /identity/v3/projects/fd30da713fe844fe8b65cefcdb87650b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:49.274359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f2ef-f57d-40a7-985f-7a79b53302c0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.275354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f2ef-f57d-40a7-985f-7a79b53302c0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.275731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2f2ef-f57d-40a7-985f-7a79b53302c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:49.311708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-06a2f2ef-f57d-40a7-985f-7a79b53302c0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:49.314017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-06a2f2ef-f57d-40a7-985f-7a79b53302c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:49.379024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1863/3717] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:49.387230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df218-e302-4b45-b1a7-52df3845ffb3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.388442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df218-e302-4b45-b1a7-52df3845ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.388442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df218-e302-4b45-b1a7-52df3845ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:49.414473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-380df218-e302-4b45-b1a7-52df3845ffb3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:49.415833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-380df218-e302-4b45-b1a7-52df3845ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:49.424411 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1855/3718] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:49.429728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2f2ef-f57d-40a7-985f-7a79b53302c0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:49.441472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2f2ef-f57d-40a7-985f-7a79b53302c0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:49.446193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:49.446802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.447080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.447401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:49.448076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:49.448372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:49.450038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:49.462250 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1864/3719] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:49.466668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df218-e302-4b45-b1a7-52df3845ffb3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:49.476935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df218-e302-4b45-b1a7-52df3845ffb3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:49.482865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:49.483488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.483767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.484165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:49.484804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:49.486650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:49.550771 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:49.631350 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1856/3720] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:49 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:49.636734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:49.651853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709c82a-c275-45a4-a49b-83e10d9460ee admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:49.736566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:49.737351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.737625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.737892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:49.738546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:49.740430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:49.870569 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1865/3721] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:49 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:49.874852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:49.887955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e472d8-bf77-4746-a010-d0bd4c30da79 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:49.893144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:49.894682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.894964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.895230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:49.895870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:49.897458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:49.907695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1857/3722] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:49.912184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:49.922616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1b7f-d542-422a-9f14-31aeb8f694e8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:49.928286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc30984-473b-4f22-9274-180728ee13e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:49.929320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc30984-473b-4f22-9274-180728ee13e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.929594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc30984-473b-4f22-9274-180728ee13e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.929856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc30984-473b-4f22-9274-180728ee13e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:49.930520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc30984-473b-4f22-9274-180728ee13e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:49.932799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc30984-473b-4f22-9274-180728ee13e3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:49.966106 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1866/3723] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:49.967474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:49.978755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711923c-2559-40de-9995-f6705f5de5dc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:49.986636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:49.987713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:49.988163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:49.988638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] PATH_INFO: `/v3/projects/45d044e4355948b89832079705fd6fab/users/4fa59ca1f72d461293d87327db31bcaa/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:50.013568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d044e4355948b89832079705fd6fab, user_id=4fa59ca1f72d461293d87327db31bcaa, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:50.017293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:50.130785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1858/3724] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:49 2022] PUT /identity/v3/projects/45d044e4355948b89832079705fd6fab/users/4fa59ca1f72d461293d87327db31bcaa/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:50.141025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671264b-10a7-4501-89bc-90967d0565cb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:50.141302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671264b-10a7-4501-89bc-90967d0565cb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:50.141618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671264b-10a7-4501-89bc-90967d0565cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:50.189203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e671264b-10a7-4501-89bc-90967d0565cb None None] MFA Rules not processed for user `4fa59ca1f72d461293d87327db31bcaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:50.191409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e671264b-10a7-4501-89bc-90967d0565cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:50.241391 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:50.299380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:50.300692 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1867/3725] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:50.421525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327cb2-b55e-44c6-bd96-3e1884563d47 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:50.428213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:50.429160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:50.429622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:50.429924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:50.430601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:50.433218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:50.553606 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1859/3726] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:50 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:50.554319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671264b-10a7-4501-89bc-90967d0565cb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:50.579579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671264b-10a7-4501-89bc-90967d0565cb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:50.688567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:50.689463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:50.689846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:50.690818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:50.691551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:50.693596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:50.879795 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1868/3727] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:50 2022] POST /identity/v3/users => generated 290 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:50.881243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:50.904799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837401ba-7250-4dca-811e-d207b308d509 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:50.910540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:50.911272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:50.911650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:50.912039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:50.912841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:50.914691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:50.930455 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1860/3728] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:50.931735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:50.946230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc69597-f479-4d11-a90c-50eea460eaf4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:50.954734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:50.955505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:50.955892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:50.956256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] PATH_INFO: `/v3/projects/9767978a69b04ce983326bf381a20902/users/063fee9924a1426b880fcd30a215ab6a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:50.974133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9767978a69b04ce983326bf381a20902, user_id=063fee9924a1426b880fcd30a215ab6a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:50.977004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:51.095525 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1869/3729] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:50 2022] PUT /identity/v3/projects/9767978a69b04ce983326bf381a20902/users/063fee9924a1426b880fcd30a215ab6a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:51.099559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:51.118463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9c4b9-0efe-465e-9cb0-b3eba4a808b8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:51.268714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52112973-eda0-49ea-b58f-8362a77c411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:51.269354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112973-eda0-49ea-b58f-8362a77c411a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:51.269629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112973-eda0-49ea-b58f-8362a77c411a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:51.269898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112973-eda0-49ea-b58f-8362a77c411a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:51.270584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52112973-eda0-49ea-b58f-8362a77c411a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:51.272187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52112973-eda0-49ea-b58f-8362a77c411a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:51.292493 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1861/3730] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:24:51.296909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:51.310730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf52531-74b3-4bf7-85bd-08edc7483e49 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:51.316013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:51.317269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:51.317917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:51.318445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] PATH_INFO: `/v3/projects/9767978a69b04ce983326bf381a20902/users/063fee9924a1426b880fcd30a215ab6a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:51.320876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9767978a69b04ce983326bf381a20902, user_id=063fee9924a1426b880fcd30a215ab6a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:51.324172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:51.350325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff77c9-8c6d-4ff6-b8fa-9fdc80af5432 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:51.350619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff77c9-8c6d-4ff6-b8fa-9fdc80af5432 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:51.350903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff77c9-8c6d-4ff6-b8fa-9fdc80af5432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:51.351556 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1870/3731] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:51 2022] PUT /identity/v3/projects/9767978a69b04ce983326bf381a20902/users/063fee9924a1426b880fcd30a215ab6a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:51.392301 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:51.404269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7bff77c9-8c6d-4ff6-b8fa-9fdc80af5432 None None] MFA Rules not processed for user `063fee9924a1426b880fcd30a215ab6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:51.405530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7bff77c9-8c6d-4ff6-b8fa-9fdc80af5432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:51.513056 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1862/3732] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:24:51.517734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:51.546482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f22a0-8f12-489f-931c-4b64c13ab3d7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:51.555352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:51.555984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:51.556270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:51.556548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:51.557326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:51.559828 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:51.559828 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:51.559828 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:51.559828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:51.680463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1871/3733] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:24:51 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:51.683666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff77c9-8c6d-4ff6-b8fa-9fdc80af5432 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:51.708925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff77c9-8c6d-4ff6-b8fa-9fdc80af5432 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:51.758185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:51.766431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:51.766431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:51.766431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/c1a380e130004ccd8a74e3e16ee70123` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:51.766431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c1a380e130004ccd8a74e3e16ee70123)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:51.766879 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:51.766879 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:51.766879 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:51.766879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:51.928381 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1863/3734] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:51 2022] DELETE /identity/v3/services/c1a380e130004ccd8a74e3e16ee70123 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:51.933650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:51.945412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574d750-b19e-47f5-99ce-a70dbced7996 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:51.962491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:51.963111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:51.963397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:51.963673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:51.964584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:51.966087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.064049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1872/3735] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:51 2022] POST /identity/v3/services => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:52.065897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.077187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e1418-a17a-4ca4-a448-bceddd322cb4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:52.096770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:52.097742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:52.098245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:52.098592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/12960e2fd94b4a58b3574fff89bc9683` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:52.099397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:update_service(service_id=12960e2fd94b4a58b3574fff89bc9683)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:52.100819 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:52.100819 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:52.100819 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:52.101820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.225078 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1864/3736] 10.222.0.42 () {60 vars in 1252 bytes} [Sun Oct 23 01:24:52 2022] PATCH /identity/v3/services/12960e2fd94b4a58b3574fff89bc9683 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:52.229635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.242767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253eed2-0940-430d-87a3-6266bdd46374 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:52.261625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:52.262323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:52.262614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:52.262889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/12960e2fd94b4a58b3574fff89bc9683` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:52.263629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:get_service(service_id=12960e2fd94b4a58b3574fff89bc9683)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:52.264643 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:52.264643 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:52.264643 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:52.265693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.277936 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1873/3737] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:52 2022] GET /identity/v3/services/12960e2fd94b4a58b3574fff89bc9683 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:52.280705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.292382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d5bda-7762-4e78-8c50-299e2c2fd383 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:52.298542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:52.299195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:52.299523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:52.300058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/12960e2fd94b4a58b3574fff89bc9683` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:52.304048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:delete_service(service_id=12960e2fd94b4a58b3574fff89bc9683)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:52.305717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.400288 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1865/3738] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:52 2022] DELETE /identity/v3/services/12960e2fd94b4a58b3574fff89bc9683 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:52.404673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.415298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42523e-d2c5-4da7-a163-d15c66e75475 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:52.431746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:52.432387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:52.432668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:52.432941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/12960e2fd94b4a58b3574fff89bc9683` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:52.433563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:get_service(service_id=12960e2fd94b4a58b3574fff89bc9683)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:52.435198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Could not find service: 12960e2fd94b4a58b3574fff89bc9683.: keystone.exception.ServiceNotFound: Could not find service: 12960e2fd94b4a58b3574fff89bc9683. Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 12960e2fd94b4a58b3574fff89bc9683. Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:24:52.449724 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:24:52.451190 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 12960e2fd94b4a58b3574fff89bc9683. Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:24:52.452309 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1874/3739] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:24:52 2022] GET /identity/v3/services/12960e2fd94b4a58b3574fff89bc9683 => generated 113 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:24:52.453516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.470238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4957d-ab0d-4a95-85f2-ac284296583b tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:52.476640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:52.477825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:52.478528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:52.479076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:52.479993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:52.481303 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:52.481303 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:52.481303 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:52.485043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.638977 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1866/3740] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:52 2022] POST /identity/v3/services => generated 274 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:52.640571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.651303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51d30e-4ef7-4e53-997d-a1947c5d1e99 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:52.666033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:52.666638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:52.666940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:52.667208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:52.667838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:52.669484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.794267 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1875/3741] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:52 2022] POST /identity/v3/services => generated 272 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:52.798830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.813148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb60c82-db2a-4eb2-96e5-da1831817605 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:52.840792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:52.842243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:52.842530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:52.843623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:52.844553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:52.846970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:52.969197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:52.973395 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1867/3742] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:52 2022] POST /identity/v3/services => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:52.984523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c725-a497-4ad9-8c17-93dabb56bfd6 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.022779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.023421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.023706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.023985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.025085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.025613 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:53.025613 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:53.025613 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:53.026544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.046509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1876/3743] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:24:52 2022] GET /identity/v3/services => generated 2976 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:53.054229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:53.073629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b56a-6090-4cd6-b89e-1ce66193d599 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.079857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.080825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.081279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.081812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.087938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2117904382) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:53.087938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.087938 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:53.087938 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:24:53.087938 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:24:53.087938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.092328 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1868/3744] 10.222.0.42 () {58 vars in 1222 bytes} [Sun Oct 23 01:24:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2117904382 => generated 417 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:53.096750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:53.110293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231525-cf19-42a8-8ecf-d97199a22922 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.116395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.128076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.128076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.128076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.128076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-519574321) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:53.128076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.128523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.133107 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1877/3745] 10.222.0.42 () {58 vars in 1220 bytes} [Sun Oct 23 01:24:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-519574321 => generated 414 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:53.133820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:53.156226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d70fa-d63f-45fc-90a3-c29448804986 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.161825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.162497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.162774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.163933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.164578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1773296470) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:53.165009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.167280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.172707 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1869/3746] 10.222.0.42 () {58 vars in 1222 bytes} [Sun Oct 23 01:24:53 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1773296470 => generated 418 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:53.177104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:53.191574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b005dc-47ac-4cf2-9413-404d8d71bab5 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.195460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.196095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.196406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.196685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/357eee2d040a4ac9b733e482880ac902` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.197273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:delete_service(service_id=357eee2d040a4ac9b733e482880ac902)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.198320 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:53.198320 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:53.198320 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:53.199196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.351459 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1878/3747] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:53 2022] DELETE /identity/v3/services/357eee2d040a4ac9b733e482880ac902 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:53.355312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:53.370112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7539a-cff1-4a31-86aa-d06fab8016ec tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.389061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.389707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.390007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.390508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/cb98c853ce8b4723bb6e2dc58b2c3073` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.391510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cb98c853ce8b4723bb6e2dc58b2c3073)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.394061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.428405 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:53.494238 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1870/3748] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:53 2022] DELETE /identity/v3/services/cb98c853ce8b4723bb6e2dc58b2c3073 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:53.498552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:53.510673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb671-bacd-4dc8-996b-94bdab7cb9f4 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.526361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b0081-7fef-461a-a0ec-5662f56bae90 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063fee9924a1426b880fcd30a215ab6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9767978a69b04ce983326bf381a20902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.526987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b0081-7fef-461a-a0ec-5662f56bae90 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.527264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b0081-7fef-461a-a0ec-5662f56bae90 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.527652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b0081-7fef-461a-a0ec-5662f56bae90 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] PATH_INFO: `/v3/services/0cb7741992574a0b8746b07bbe3d4a2e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.528226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b0081-7fef-461a-a0ec-5662f56bae90 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0cb7741992574a0b8746b07bbe3d4a2e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.529869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b0081-7fef-461a-a0ec-5662f56bae90 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.618198 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1879/3749] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:53 2022] DELETE /identity/v3/services/0cb7741992574a0b8746b07bbe3d4a2e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:53.623310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:53.697675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176a2cc-6ee8-42b0-ae59-b72a711e8e83 tempest-ServicesTestJSON-677891632 tempest-ServicesTestJSON-677891632-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:53.713728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:53.714415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:53.714727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:53.715014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] PATH_INFO: `/v3/users/4fa59ca1f72d461293d87327db31bcaa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:53.716149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa59ca1f72d461293d87327db31bcaa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:53.718120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:53.957118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa59ca1f72d461293d87327db31bcaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:53.963992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa59ca1f72d461293d87327db31bcaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:53.964666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa59ca1f72d461293d87327db31bcaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:54.046119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa59ca1f72d461293d87327db31bcaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:54.047351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa59ca1f72d461293d87327db31bcaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:54.067234 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1871/3750] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:53 2022] DELETE /identity/v3/users/4fa59ca1f72d461293d87327db31bcaa => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:54.071777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:54.072072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:54.072349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:54.092255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:54.094129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:54.162474 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1880/3751] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:54.167439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:54.169117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:54.243225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7620b73-2e28-4d49-b01d-ef15ebf3e7b6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:54.247942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:54.248551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:54.249326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:54.249326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:54.258896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:54.260939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:54.271160 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1872/3752] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:24:54.349668 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:54.836341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:54.838016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:54.852410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec45a-35a6-4570-9847-240d53850c53 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:54.857243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:54.858133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:54.858414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:54.858689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] PATH_INFO: `/v3/projects/45d044e4355948b89832079705fd6fab` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:54.860000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d044e4355948b89832079705fd6fab)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:54.862323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:54.987969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d044e4355948b89832079705fd6fab', 'request_id': 'req-71227326-cc30-4a5a-9e42-4fd174dd48fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:54.993319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d044e4355948b89832079705fd6fab', 'request_id': 'req-71227326-cc30-4a5a-9e42-4fd174dd48fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.120340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d044e4355948b89832079705fd6fab', 'request_id': 'req-71227326-cc30-4a5a-9e42-4fd174dd48fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.132296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] The token cache is being invalidate because project 45d044e4355948b89832079705fd6fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:55.132583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.133205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.134729 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1881/3753] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:54 2022] DELETE /identity/v3/projects/45d044e4355948b89832079705fd6fab => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:55.138749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:55.148691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34dde1-691b-495f-b06e-79af3d4f1123 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:55.205166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:55.205910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:55.206285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:55.206635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] PATH_INFO: `/v3/users/063fee9924a1426b880fcd30a215ab6a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:55.207849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063fee9924a1426b880fcd30a215ab6a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:55.209832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:55.416667 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:55.421482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063fee9924a1426b880fcd30a215ab6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.429192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063fee9924a1426b880fcd30a215ab6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.430382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063fee9924a1426b880fcd30a215ab6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.491289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063fee9924a1426b880fcd30a215ab6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.492030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcf4052a-e541-4bae-93f1-8a4e860a3d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063fee9924a1426b880fcd30a215ab6a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:55.510502 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1873/3754] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:55 2022] DELETE /identity/v3/users/063fee9924a1426b880fcd30a215ab6a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:55.959818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:55.961239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:55.975550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71227326-cc30-4a5a-9e42-4fd174dd48fd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:56.051614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:56.052520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.052957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.053417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] PATH_INFO: `/v3/projects/9767978a69b04ce983326bf381a20902` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.055019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9767978a69b04ce983326bf381a20902)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:56.057334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:56.168183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9767978a69b04ce983326bf381a20902', 'request_id': 'req-2a5942b0-4818-4fdf-a38d-fa559a72b66b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:56.173767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9767978a69b04ce983326bf381a20902', 'request_id': 'req-2a5942b0-4818-4fdf-a38d-fa559a72b66b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:56.234834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9767978a69b04ce983326bf381a20902', 'request_id': 'req-2a5942b0-4818-4fdf-a38d-fa559a72b66b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:56.249935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] The token cache is being invalidate because project 9767978a69b04ce983326bf381a20902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:56.250075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:56.250702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2a5942b0-4818-4fdf-a38d-fa559a72b66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:56.255692 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1882/3755] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:55 2022] DELETE /identity/v3/projects/9767978a69b04ce983326bf381a20902 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:56.258687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9430a-40b9-4bc8-8c54-1364d7258dfb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.258687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9430a-40b9-4bc8-8c54-1364d7258dfb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.258687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9430a-40b9-4bc8-8c54-1364d7258dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.281843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-41f9430a-40b9-4bc8-8c54-1364d7258dfb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:56.283329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-41f9430a-40b9-4bc8-8c54-1364d7258dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:56.333165 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:56.355033 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1874/3756] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:56.357280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71a4a-4eab-443f-add9-36fb89c8a5f7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.358015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71a4a-4eab-443f-add9-36fb89c8a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.358294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71a4a-4eab-443f-add9-36fb89c8a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.380084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cac71a4a-4eab-443f-add9-36fb89c8a5f7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:56.381610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cac71a4a-4eab-443f-add9-36fb89c8a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:56.392206 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1883/3757] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:56.397323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9430a-40b9-4bc8-8c54-1364d7258dfb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:56.407585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9430a-40b9-4bc8-8c54-1364d7258dfb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:56.427382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:56.427382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.427382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.427382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.427749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:56.427971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:56.430572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:56.449797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1875/3758] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:24:56.451065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71a4a-4eab-443f-add9-36fb89c8a5f7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:56.488451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71a4a-4eab-443f-add9-36fb89c8a5f7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:56.504558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:56.505307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.505659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.506068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.506782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:56.515134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:56.712089 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1884/3759] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:56 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:56.712237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:56.731019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37151e-c1e7-4fd5-8dc8-bf167a14a151 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:56.826133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:56.826756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.827064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.827335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.827972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:56.829868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:56.917386 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1876/3760] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:56 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:56.918545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:56.931848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15016-cbad-42a3-b00a-4b3e6db914ad admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:56.937016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:56.937776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.938158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.938503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.939292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:56.941122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:56.953094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1885/3761] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:24:56.957698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:56.979345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ecb2-9d7f-405e-a50a-7689014fb151 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:56.992127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40340a-fd64-4310-861b-20857926aea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:56.993775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40340a-fd64-4310-861b-20857926aea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:56.994669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40340a-fd64-4310-861b-20857926aea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:56.995036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40340a-fd64-4310-861b-20857926aea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:56.995886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40340a-fd64-4310-861b-20857926aea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:56.998141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40340a-fd64-4310-861b-20857926aea2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:57.014479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1877/3762] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:57.023536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:57.034652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaebda-9b8c-4142-a5e6-315bd202329c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:57.041672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:57.042849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:57.043452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:57.044252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] PATH_INFO: `/v3/projects/cf2b660c6759499ea0fe45ff539396e8/users/560e0bc9232842a58f84462413bb3a7d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:57.078881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2b660c6759499ea0fe45ff539396e8, user_id=560e0bc9232842a58f84462413bb3a7d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:57.085959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:57.186097 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1886/3763] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:57 2022] PUT /identity/v3/projects/cf2b660c6759499ea0fe45ff539396e8/users/560e0bc9232842a58f84462413bb3a7d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:57.193557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d29b5-3c6a-469b-9671-ceebbf9d1882 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:57.194290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d29b5-3c6a-469b-9671-ceebbf9d1882 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:57.194720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d29b5-3c6a-469b-9671-ceebbf9d1882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:57.267597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fc7d29b5-3c6a-469b-9671-ceebbf9d1882 None None] MFA Rules not processed for user `560e0bc9232842a58f84462413bb3a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:57.270155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc7d29b5-3c6a-469b-9671-ceebbf9d1882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:57.379408 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1878/3764] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:57.383894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:57.461406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d8b7b-a6a9-4251-957f-2eb5542d60c2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:57.466593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:57.467214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:57.467554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:57.467829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:57.474639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:57.474639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:57.569162 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1887/3765] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:57 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:24:57.573445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d29b5-3c6a-469b-9671-ceebbf9d1882 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:57.585553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d29b5-3c6a-469b-9671-ceebbf9d1882 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:57.662212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:57.662895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:57.663245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:57.663680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:57.664336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:57.668264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:57.761711 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1879/3766] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:57 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:57.763239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:57.779810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef306a-5895-42f6-937c-6d2651b66218 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:57.785138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:57.785869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:57.786290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:57.786684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:57.787491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:57.789180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:57.805753 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1888/3767] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:57.808887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:57.824200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee6f6b-3a67-47be-9019-cb51e7eecd38 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:57.833831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:57.834689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:57.835107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:57.835543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] PATH_INFO: `/v3/projects/8bf9c6ba659e4a57a9d669def2bb403a/users/207aee02d7ae492898dc3b0bb660ebd0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:57.869937 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:57.882643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c6ba659e4a57a9d669def2bb403a, user_id=207aee02d7ae492898dc3b0bb660ebd0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:57.885609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:57.961120 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1880/3768] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:57 2022] PUT /identity/v3/projects/8bf9c6ba659e4a57a9d669def2bb403a/users/207aee02d7ae492898dc3b0bb660ebd0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:24:57.961527 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:24:57.963028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:57.984800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c561-871d-409b-8655-46e491e0680f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:58.093862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652218-ca07-4797-b3d4-b2742c042ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:58.094701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652218-ca07-4797-b3d4-b2742c042ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:58.095161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652218-ca07-4797-b3d4-b2742c042ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:58.095894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652218-ca07-4797-b3d4-b2742c042ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:58.096572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652218-ca07-4797-b3d4-b2742c042ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:58.098938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652218-ca07-4797-b3d4-b2742c042ba7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:58.111395 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1889/3769] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:58.116221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:58.126614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb91c0-5f5e-4134-aa0e-308ad6649a7d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:58.131457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:58.132353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:58.132612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:58.132887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] PATH_INFO: `/v3/projects/8bf9c6ba659e4a57a9d669def2bb403a/users/207aee02d7ae492898dc3b0bb660ebd0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:58.134930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c6ba659e4a57a9d669def2bb403a, user_id=207aee02d7ae492898dc3b0bb660ebd0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:58.137899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:58.151797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1881/3770] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:24:58 2022] PUT /identity/v3/projects/8bf9c6ba659e4a57a9d669def2bb403a/users/207aee02d7ae492898dc3b0bb660ebd0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:58.164238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc76b96-cfbd-49b4-86c2-a0d10e4f23dc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:58.164526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc76b96-cfbd-49b4-86c2-a0d10e4f23dc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:58.164801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc76b96-cfbd-49b4-86c2-a0d10e4f23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:58.200640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dcc76b96-cfbd-49b4-86c2-a0d10e4f23dc None None] MFA Rules not processed for user `207aee02d7ae492898dc3b0bb660ebd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:24:58.202565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dcc76b96-cfbd-49b4-86c2-a0d10e4f23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:58.309198 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1890/3771] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:24:58.314617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:58.328129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510cc9-7086-40f5-8768-5f02ae0e2e3a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:58.335006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '207aee02d7ae492898dc3b0bb660ebd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9c6ba659e4a57a9d669def2bb403a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:58.335658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:58.335934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:58.336531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:58.337162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:58.339097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:58.459871 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1882/3772] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:24:58 2022] POST /identity/v3/projects => generated 358 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:58.464515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc76b96-cfbd-49b4-86c2-a0d10e4f23dc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:58.476036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc76b96-cfbd-49b4-86c2-a0d10e4f23dc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:58.569700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '207aee02d7ae492898dc3b0bb660ebd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9c6ba659e4a57a9d669def2bb403a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:58.571875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:58.572197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:58.572440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:58.573098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:58.578031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:58.723370 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1891/3773] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:58 2022] POST /identity/v3/users => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:24:58.728283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:58.751290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee07782-8bfa-4d28-8013-b25c5fb3920d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:58.751290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab9e1-7b75-47cd-b1e7-61c7e07e681d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '207aee02d7ae492898dc3b0bb660ebd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9c6ba659e4a57a9d669def2bb403a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:58.751290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab9e1-7b75-47cd-b1e7-61c7e07e681d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:58.751693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab9e1-7b75-47cd-b1e7-61c7e07e681d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:58.751693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab9e1-7b75-47cd-b1e7-61c7e07e681d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:58.751693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab9e1-7b75-47cd-b1e7-61c7e07e681d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:24:58.751693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab9e1-7b75-47cd-b1e7-61c7e07e681d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:58.751693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab9e1-7b75-47cd-b1e7-61c7e07e681d tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:58.791349 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1883/3774] 10.222.0.42 () {58 vars in 1157 bytes} [Sun Oct 23 01:24:58 2022] GET /identity/v3/users?domain_id=default => generated 8607 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:24:58.792896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:58.804896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ab73-9089-4ede-aa29-75aa3e2179eb tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:58.811260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '207aee02d7ae492898dc3b0bb660ebd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9c6ba659e4a57a9d669def2bb403a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:58.811921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:58.812201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:58.812719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] PATH_INFO: `/v3/users/139223f4c5ef42a791006a1007fbbb2d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:58.840411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorizing `identity:update_user(user_id=139223f4c5ef42a791006a1007fbbb2d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:58.842047 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:24:58.842047 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:24:58.842047 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:24:58.843636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:58.960559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '139223f4c5ef42a791006a1007fbbb2d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.063317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invalidating the token cache because user 139223f4c5ef42a791006a1007fbbb2d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:59.063618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.064334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.069820 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1892/3775] 10.222.0.42 () {60 vars in 1244 bytes} [Sun Oct 23 01:24:58 2022] PATCH /identity/v3/users/139223f4c5ef42a791006a1007fbbb2d => generated 488 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:24:59.071636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:59.071921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:59.072190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:59.092785 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.auth.plugins.core [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] User is disabled: 139223f4c5ef42a791006a1007fbbb2d: AssertionError: User is disabled: 139223f4c5ef42a791006a1007fbbb2d Oct 23 01:24:59.109326 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.server.flask.application [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.42: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 23 01:24:59.111434 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1884/3776] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:24:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 41 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 23 01:24:59.116136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:59.117909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:59.136746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c39dd0-4b32-4ab1-ac47-31c51a05a558 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:59.141835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '207aee02d7ae492898dc3b0bb660ebd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9c6ba659e4a57a9d669def2bb403a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:59.142884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:59.144544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:59.144544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] PATH_INFO: `/v3/users/139223f4c5ef42a791006a1007fbbb2d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:59.167946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=139223f4c5ef42a791006a1007fbbb2d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:59.170095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:59.367199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139223f4c5ef42a791006a1007fbbb2d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.382791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139223f4c5ef42a791006a1007fbbb2d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.385501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139223f4c5ef42a791006a1007fbbb2d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.466548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139223f4c5ef42a791006a1007fbbb2d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.468540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139223f4c5ef42a791006a1007fbbb2d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.555815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:24:59.560317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:24:59.564217 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1893/3777] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:24:59 2022] DELETE /identity/v3/users/139223f4c5ef42a791006a1007fbbb2d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:24:59.725126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a9446-f1d4-451c-aed0-7db12df55b66 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:24:59.736539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '207aee02d7ae492898dc3b0bb660ebd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9c6ba659e4a57a9d669def2bb403a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:24:59.737203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:24:59.737475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:24:59.738272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] PATH_INFO: `/v3/projects/a6eea6d16af6405da616c55e9b69ff90` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:24:59.741187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6eea6d16af6405da616c55e9b69ff90)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:24:59.743198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:24:59.895428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6eea6d16af6405da616c55e9b69ff90', 'request_id': 'req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.901629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6eea6d16af6405da616c55e9b69ff90', 'request_id': 'req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.971804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6eea6d16af6405da616c55e9b69ff90', 'request_id': 'req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.989819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] The token cache is being invalidate because project a6eea6d16af6405da616c55e9b69ff90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:24:59.990269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.991182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:24:59.993414 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1885/3778] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:24:59 2022] DELETE /identity/v3/projects/a6eea6d16af6405da616c55e9b69ff90 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:00.001925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:00.020307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66442a9b-6408-4273-8647-53a995b131bc tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:00.082783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e37195-c372-41e6-b481-59f1498ada12 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '207aee02d7ae492898dc3b0bb660ebd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9c6ba659e4a57a9d669def2bb403a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:00.083805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37195-c372-41e6-b481-59f1498ada12 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:00.084184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37195-c372-41e6-b481-59f1498ada12 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:00.084605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37195-c372-41e6-b481-59f1498ada12 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:00.085306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e37195-c372-41e6-b481-59f1498ada12 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:00.087487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e37195-c372-41e6-b481-59f1498ada12 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-64e37195-c372-41e6-b481-59f1498ada12 tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Could not find domain: 92fabe19db994afb82452fe4fa22b76c.: keystone.exception.DomainNotFound: Could not find domain: 92fabe19db994afb82452fe4fa22b76c. Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 92fabe19db994afb82452fe4fa22b76c. Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:25:00.104641 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 23 01:25:00.106537 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:25:00.107832 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:25:00.116774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:25:00.116774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 92fabe19db994afb82452fe4fa22b76c. Oct 23 01:25:00.116774 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:25:00.116774 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1894/3779] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:24:59 2022] POST /identity/v3/users => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:25:00.117088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:00.117088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:00.189487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c9f2-a460-4d72-a5d3-93034f8ccf3f tempest-UsersNegativeTest-288700927 tempest-UsersNegativeTest-288700927-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:00.194208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:00.197695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:00.197695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:00.197695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] PATH_INFO: `/v3/users/560e0bc9232842a58f84462413bb3a7d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:00.197695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560e0bc9232842a58f84462413bb3a7d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:00.198474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:00.327901 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:00.400964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560e0bc9232842a58f84462413bb3a7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:00.408785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560e0bc9232842a58f84462413bb3a7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:00.409523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560e0bc9232842a58f84462413bb3a7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:00.414044 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:00.493283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560e0bc9232842a58f84462413bb3a7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:00.494321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560e0bc9232842a58f84462413bb3a7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:00.530180 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1886/3780] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:00 2022] DELETE /identity/v3/users/560e0bc9232842a58f84462413bb3a7d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:00.535084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1a38-4d7b-402d-a34a-fff2903277e0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:00.535360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1a38-4d7b-402d-a34a-fff2903277e0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:00.535630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1a38-4d7b-402d-a34a-fff2903277e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:00.563974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4a8e1a38-4d7b-402d-a34a-fff2903277e0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:00.563974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a8e1a38-4d7b-402d-a34a-fff2903277e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:00.619028 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1895/3781] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:00.630931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:00.632916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:00.697921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540363a-729b-420a-a358-76ab770a3f60 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:00.702473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:00.703214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:00.703513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:00.703773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:00.714331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:00.719073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:00.726965 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1887/3782] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:25:00.990201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:00.990750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:00.991191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:01.011995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:01.013376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:01.132100 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1896/3783] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:01.191671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:01.195508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:01.299737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586dc07-479f-4e4a-bbc4-61638e40e9b5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:01.305811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:01.306463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:01.306742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:01.307233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:01.315852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:01.318076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:01.341418 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1888/3784] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:25:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:25:01.361314 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:01.400565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:01.402352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:01.432253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda6b48-6afe-456a-82ae-70674734d699 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:01.442075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:01.442938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:01.443847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:01.444371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] PATH_INFO: `/v3/projects/cf2b660c6759499ea0fe45ff539396e8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:01.445864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2b660c6759499ea0fe45ff539396e8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:01.449113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:01.652623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2b660c6759499ea0fe45ff539396e8', 'request_id': 'req-e6fb9629-36b4-45e9-a30d-d8300530ba0e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:01.658605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2b660c6759499ea0fe45ff539396e8', 'request_id': 'req-e6fb9629-36b4-45e9-a30d-d8300530ba0e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:01.749838 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:01.793794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2b660c6759499ea0fe45ff539396e8', 'request_id': 'req-e6fb9629-36b4-45e9-a30d-d8300530ba0e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:01.809213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] The token cache is being invalidate because project cf2b660c6759499ea0fe45ff539396e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:01.809582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:01.810313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:01.811824 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1897/3785] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:01 2022] DELETE /identity/v3/projects/cf2b660c6759499ea0fe45ff539396e8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:01.816484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:01.830672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ecdc6-620e-41f2-a669-bd2fc9df38c0 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:01.897443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:01.898190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:01.898473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:01.898738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] PATH_INFO: `/v3/users/207aee02d7ae492898dc3b0bb660ebd0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:01.899889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=207aee02d7ae492898dc3b0bb660ebd0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:01.901899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:02.209227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207aee02d7ae492898dc3b0bb660ebd0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:02.220028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207aee02d7ae492898dc3b0bb660ebd0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:02.221411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207aee02d7ae492898dc3b0bb660ebd0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:02.330159 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:02.385599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207aee02d7ae492898dc3b0bb660ebd0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:02.387005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-12782275-c6b2-4c03-bd42-2b00be6ab01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207aee02d7ae492898dc3b0bb660ebd0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:02.415080 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1889/3786] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:01 2022] DELETE /identity/v3/users/207aee02d7ae492898dc3b0bb660ebd0 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:03.004052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:03.006471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:03.032490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb9629-36b4-45e9-a30d-d8300530ba0e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:03.127602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:03.130156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:03.130627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:03.131075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] PATH_INFO: `/v3/projects/8bf9c6ba659e4a57a9d669def2bb403a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:03.133724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf9c6ba659e4a57a9d669def2bb403a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:03.148571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:03.224415 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:03.271826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf9c6ba659e4a57a9d669def2bb403a', 'request_id': 'req-3c4bf4f6-41e4-4538-8e10-78718bdf35de'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:03.278887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf9c6ba659e4a57a9d669def2bb403a', 'request_id': 'req-3c4bf4f6-41e4-4538-8e10-78718bdf35de'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:03.399353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf9c6ba659e4a57a9d669def2bb403a', 'request_id': 'req-3c4bf4f6-41e4-4538-8e10-78718bdf35de'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:03.423007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] The token cache is being invalidate because project 8bf9c6ba659e4a57a9d669def2bb403a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:03.423647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:03.424548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3c4bf4f6-41e4-4538-8e10-78718bdf35de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:03.427535 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1898/3787] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:03 2022] DELETE /identity/v3/projects/8bf9c6ba659e4a57a9d669def2bb403a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:03.434186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b341-7f82-4f52-b00d-2353695b36b5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:03.435111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b341-7f82-4f52-b00d-2353695b36b5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:03.435615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b341-7f82-4f52-b00d-2353695b36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:03.472022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b8c6b341-7f82-4f52-b00d-2353695b36b5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:03.474035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b8c6b341-7f82-4f52-b00d-2353695b36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:03.525578 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:03.575714 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1890/3788] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:25:03.576507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25101c32-d65f-4f25-9524-fd5c83be7253 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:03.576507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25101c32-d65f-4f25-9524-fd5c83be7253 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:03.576507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25101c32-d65f-4f25-9524-fd5c83be7253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:03.624002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-25101c32-d65f-4f25-9524-fd5c83be7253 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:03.624002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-25101c32-d65f-4f25-9524-fd5c83be7253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:03.642102 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1899/3789] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:03.646442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b341-7f82-4f52-b00d-2353695b36b5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:03.680649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b341-7f82-4f52-b00d-2353695b36b5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:03.695310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:03.698489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:03.699249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:03.700338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:03.702329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:03.709467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:03.710016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:03.741930 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1891/3790] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:03.746484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25101c32-d65f-4f25-9524-fd5c83be7253 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:03.763875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25101c32-d65f-4f25-9524-fd5c83be7253 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:03.779894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:03.783213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:03.785467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:03.785835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:03.787319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:03.793293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:03.932511 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1900/3791] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:03 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:03.936714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:03.951527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d2c40-1ca0-4217-9b28-39630f09dae1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.026650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.027268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.027548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.027819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.028476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.030417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.102822 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1892/3792] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:03 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:25:04.106881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.119289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0552e4-7dbe-4a1d-8ce4-4728746a2f5b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.125063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.126143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.126655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.127151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.128201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.130267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.142226 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1901/3793] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:04.146285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.156449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770aa39-b851-464d-91f0-2459f8bfe67d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.161687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.162397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.162681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.163083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] PATH_INFO: `/v3/projects/c565193cc2c74d1a89cd65622b900c34/users/e823249c8ffa4ab9bfac2d4e524af008/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.181145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c565193cc2c74d1a89cd65622b900c34, user_id=e823249c8ffa4ab9bfac2d4e524af008, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.183837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.206283 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:04.264213 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1893/3794] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:04 2022] PUT /identity/v3/projects/c565193cc2c74d1a89cd65622b900c34/users/e823249c8ffa4ab9bfac2d4e524af008/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:04.268802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.288024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f96c-4736-4a3c-8e80-1825e96ce5aa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.340834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943856-efc3-445e-91ee-a6cf481232f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.341541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943856-efc3-445e-91ee-a6cf481232f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.341818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943856-efc3-445e-91ee-a6cf481232f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.342123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943856-efc3-445e-91ee-a6cf481232f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.342770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943856-efc3-445e-91ee-a6cf481232f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.344390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943856-efc3-445e-91ee-a6cf481232f9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.355835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1902/3795] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:04.360140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.371727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50bb46-f972-4140-90aa-b790e2c0fcf9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.376657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.377320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.377599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.378205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] PATH_INFO: `/v3/projects/c565193cc2c74d1a89cd65622b900c34/users/e823249c8ffa4ab9bfac2d4e524af008/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.380305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c565193cc2c74d1a89cd65622b900c34, user_id=e823249c8ffa4ab9bfac2d4e524af008, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.382966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.394122 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1894/3796] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:04 2022] PUT /identity/v3/projects/c565193cc2c74d1a89cd65622b900c34/users/e823249c8ffa4ab9bfac2d4e524af008/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:04.404733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b44d-ba2c-477f-9d5d-936eb88a6640 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.405355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b44d-ba2c-477f-9d5d-936eb88a6640 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.405355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44b44d-ba2c-477f-9d5d-936eb88a6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.439345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2b44b44d-ba2c-477f-9d5d-936eb88a6640 None None] MFA Rules not processed for user `e823249c8ffa4ab9bfac2d4e524af008`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:04.440598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2b44b44d-ba2c-477f-9d5d-936eb88a6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:04.526860 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1903/3797] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:04.538446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.613242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78bf18-be08-40bd-bc4f-7dc0435b0f54 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.618174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.618786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.619209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.619490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.620118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.622139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.734354 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1895/3798] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:04 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:04.739165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b44d-ba2c-477f-9d5d-936eb88a6640 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.749587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44b44d-ba2c-477f-9d5d-936eb88a6640 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.807003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.807566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.807840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.808106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.808895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.810862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.932507 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1904/3799] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:04 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:25:04.937490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.949780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038636d-5d61-4f40-845b-2eff2d7d0c03 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.954480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.955161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.955444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.955727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.956353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.957923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:04.970133 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1896/3800] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:25:04.974569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:04.984973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32445d4-14d7-4d67-8f3a-17a05fadd376 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:04.990323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff9901-42db-4c91-9b15-7a06e67beeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:04.990929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff9901-42db-4c91-9b15-7a06e67beeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:04.991252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff9901-42db-4c91-9b15-7a06e67beeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:04.991561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff9901-42db-4c91-9b15-7a06e67beeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:04.992324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff9901-42db-4c91-9b15-7a06e67beeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:04.994022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff9901-42db-4c91-9b15-7a06e67beeb0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:05.005545 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1905/3801] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:25:05.009790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:05.020331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9afe8e-8c31-4382-b084-86112975355c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:05.024002 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:05.026713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:05.027401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:05.027653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:05.027920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] PATH_INFO: `/v3/projects/21f42829ab2842afbdd1faedc965d79b/users/c5ea101c6cb241d59b3aba665f779b24/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:05.044058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f42829ab2842afbdd1faedc965d79b, user_id=c5ea101c6cb241d59b3aba665f779b24, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:05.046732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:05.151372 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1897/3802] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:05 2022] PUT /identity/v3/projects/21f42829ab2842afbdd1faedc965d79b/users/c5ea101c6cb241d59b3aba665f779b24/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:05.163757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb058c-6cfb-4f20-a69f-fee3877322d9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:05.164223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb058c-6cfb-4f20-a69f-fee3877322d9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:05.164344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb058c-6cfb-4f20-a69f-fee3877322d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:05.193274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2fdb058c-6cfb-4f20-a69f-fee3877322d9 None None] MFA Rules not processed for user `c5ea101c6cb241d59b3aba665f779b24`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:05.194442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2fdb058c-6cfb-4f20-a69f-fee3877322d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:05.260199 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1906/3803] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:05.272855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:05.275089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:05.359341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6704d0-f41c-4793-9139-baae0c08b6b0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:05.377767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70adfc-17f6-4f39-9a7a-89f3336bfb49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:05.382315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70adfc-17f6-4f39-9a7a-89f3336bfb49 service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:05.382315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70adfc-17f6-4f39-9a7a-89f3336bfb49 service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:05.382315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70adfc-17f6-4f39-9a7a-89f3336bfb49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:05.450188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70adfc-17f6-4f39-9a7a-89f3336bfb49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:05.451798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70adfc-17f6-4f39-9a7a-89f3336bfb49 service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:05.464056 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1898/3804] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:05.789675 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:05.950153 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:06.938338 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:07.408124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb058c-6cfb-4f20-a69f-fee3877322d9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:07.500752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb058c-6cfb-4f20-a69f-fee3877322d9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:07.506533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:07.507156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:07.507438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:07.507710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] PATH_INFO: `/v3/users/e823249c8ffa4ab9bfac2d4e524af008` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:07.508869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e823249c8ffa4ab9bfac2d4e524af008)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:07.510901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:07.823631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e823249c8ffa4ab9bfac2d4e524af008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:07.842854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e823249c8ffa4ab9bfac2d4e524af008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:07.845397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e823249c8ffa4ab9bfac2d4e524af008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:07.880918 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:07.950212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e823249c8ffa4ab9bfac2d4e524af008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:07.951052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e823249c8ffa4ab9bfac2d4e524af008'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:07.985654 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1907/3805] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:07 2022] DELETE /identity/v3/users/e823249c8ffa4ab9bfac2d4e524af008 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:07.991180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:07.991367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:07.991672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:08.027897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:08.029139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:08.175107 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1899/3806] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:08.175978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:08.178004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:08.286330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47b69-a1c5-4fa7-8573-28c0696e1a5c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:08.291135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:08.291938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:08.292447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:08.293585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:08.307337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:08.309381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:08.330227 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1908/3807] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:08.964332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:08.966444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:08.984596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bee29-cdab-467a-a0cc-326d8fc97d78 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:08.996639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:08.998220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:08.998825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:09.000107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] PATH_INFO: `/v3/projects/c565193cc2c74d1a89cd65622b900c34` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:09.004118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c565193cc2c74d1a89cd65622b900c34)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:09.006443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:09.124529 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:09.235137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c565193cc2c74d1a89cd65622b900c34', 'request_id': 'req-9a90020f-8d86-49be-ab9e-01fa97beb165'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.254157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c565193cc2c74d1a89cd65622b900c34', 'request_id': 'req-9a90020f-8d86-49be-ab9e-01fa97beb165'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.355725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c565193cc2c74d1a89cd65622b900c34', 'request_id': 'req-9a90020f-8d86-49be-ab9e-01fa97beb165'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.377647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] The token cache is being invalidate because project c565193cc2c74d1a89cd65622b900c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:09.378017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.378691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.380510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1900/3808] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:08 2022] DELETE /identity/v3/projects/c565193cc2c74d1a89cd65622b900c34 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:09.384784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:09.407817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2231-80b2-4f96-8b0b-3de07cd1d6ff service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:09.499140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:09.499927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:09.500144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:09.500421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] PATH_INFO: `/v3/users/c5ea101c6cb241d59b3aba665f779b24` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:09.501645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ea101c6cb241d59b3aba665f779b24)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:09.505221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:09.860193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ea101c6cb241d59b3aba665f779b24'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.885503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ea101c6cb241d59b3aba665f779b24'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.886332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ea101c6cb241d59b3aba665f779b24'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.966322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ea101c6cb241d59b3aba665f779b24'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:09.967136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-496ed6c9-041c-4f2f-b95c-2320127a02cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ea101c6cb241d59b3aba665f779b24'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:10.008776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1909/3809] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:09 2022] DELETE /identity/v3/users/c5ea101c6cb241d59b3aba665f779b24 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:10.660137 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:10.841727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:10.844339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:10.882405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90020f-8d86-49be-ab9e-01fa97beb165 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:11.013996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:11.014962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:11.015251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:11.015528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] PATH_INFO: `/v3/projects/21f42829ab2842afbdd1faedc965d79b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:11.016687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f42829ab2842afbdd1faedc965d79b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:11.018675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:11.164692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f42829ab2842afbdd1faedc965d79b', 'request_id': 'req-6614fbb4-6456-4718-88c2-88fc605ad4f0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:11.171803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f42829ab2842afbdd1faedc965d79b', 'request_id': 'req-6614fbb4-6456-4718-88c2-88fc605ad4f0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:11.326745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f42829ab2842afbdd1faedc965d79b', 'request_id': 'req-6614fbb4-6456-4718-88c2-88fc605ad4f0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:11.340551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] The token cache is being invalidate because project 21f42829ab2842afbdd1faedc965d79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:11.341226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:11.342203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6614fbb4-6456-4718-88c2-88fc605ad4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:11.352347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845014-cdbe-4c7f-8f4f-7c90c264756e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:11.354461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845014-cdbe-4c7f-8f4f-7c90c264756e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:11.355072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845014-cdbe-4c7f-8f4f-7c90c264756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:11.361115 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1901/3810] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:10 2022] DELETE /identity/v3/projects/21f42829ab2842afbdd1faedc965d79b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:11.383287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-26845014-cdbe-4c7f-8f4f-7c90c264756e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:11.384544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26845014-cdbe-4c7f-8f4f-7c90c264756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:11.460076 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1910/3811] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:11.468578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a21f-8311-46d8-b989-a42d71bb1b8d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:11.469317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a21f-8311-46d8-b989-a42d71bb1b8d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:11.469648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a21f-8311-46d8-b989-a42d71bb1b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:11.500122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-eb24a21f-8311-46d8-b989-a42d71bb1b8d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:11.501562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb24a21f-8311-46d8-b989-a42d71bb1b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:11.510200 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1902/3812] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:11.514761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26845014-cdbe-4c7f-8f4f-7c90c264756e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:11.531661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26845014-cdbe-4c7f-8f4f-7c90c264756e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:11.532772 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:11.538691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:11.539932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:11.540225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:11.540504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:11.541173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:11.542157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:11.543826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:11.563239 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1911/3813] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:11.564516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a21f-8311-46d8-b989-a42d71bb1b8d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:11.575238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a21f-8311-46d8-b989-a42d71bb1b8d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:11.582111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:11.582862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:11.583391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:11.583726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:11.584458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:11.586610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:11.711451 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1903/3814] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:11 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:11.715807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:11.730724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f197ae6-694b-4c37-9abc-9b66f55cdb41 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:11.811697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:11.812748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:11.813104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:11.814079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:11.814858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:11.818789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:11.944341 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1912/3815] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:11 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:25:11.948838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:11.962152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3e773-9f66-4666-b20b-44e3fc28b9ce admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:11.980647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:11.981615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:11.982190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:11.982628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:11.984235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:11.988254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:12.016952 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1904/3816] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:12.021301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:12.049231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fa848-6922-4662-b675-1eec26089110 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:12.060947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460d74d-2699-4e7a-8ef2-0aa9321ac09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:12.063128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d74d-2699-4e7a-8ef2-0aa9321ac09a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.063413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d74d-2699-4e7a-8ef2-0aa9321ac09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.063686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d74d-2699-4e7a-8ef2-0aa9321ac09a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.064375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460d74d-2699-4e7a-8ef2-0aa9321ac09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:12.070109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460d74d-2699-4e7a-8ef2-0aa9321ac09a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:12.088736 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1913/3817] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:12.093587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:12.105155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e79d0-36b0-43dd-be95-13610cef191c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:12.110653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:12.111636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.112777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.113320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] PATH_INFO: `/v3/projects/bab840ecfb46440793efcf0ba9cd4b4e/users/f14b752c44824a1cbbeb21b3c7488b42/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.148870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab840ecfb46440793efcf0ba9cd4b4e, user_id=f14b752c44824a1cbbeb21b3c7488b42, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:12.151729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:12.314063 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1905/3818] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:12 2022] PUT /identity/v3/projects/bab840ecfb46440793efcf0ba9cd4b4e/users/f14b752c44824a1cbbeb21b3c7488b42/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:12.318048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dd97-c361-4a62-9709-df41f9065437 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.318336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dd97-c361-4a62-9709-df41f9065437 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.318611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dd97-c361-4a62-9709-df41f9065437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.369266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0be6dd97-c361-4a62-9709-df41f9065437 None None] MFA Rules not processed for user `f14b752c44824a1cbbeb21b3c7488b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:12.371696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0be6dd97-c361-4a62-9709-df41f9065437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:12.467042 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1914/3819] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:12.489377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:12.579505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021d3e-e79a-409f-8228-dbfba2f4451c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:12.588574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:12.589814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.589814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.590037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.590636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:12.593229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:12.621604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42b59-6adc-4869-9708-93f4d34f8125 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.622284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42b59-6adc-4869-9708-93f4d34f8125 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.622547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42b59-6adc-4869-9708-93f4d34f8125 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.623906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1915/3820] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 01:25:12.632156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.632666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.633113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.677344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:12.679006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:12.750656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1906/3821] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:12 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:12.753788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:12.761892 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1916/3822] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:25:12.765365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:12.765365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:12.777908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0f9fa-1261-4e70-babf-f3bc5cba083c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:12.851440 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:12.858392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb370-a9b1-42a7-8650-a0f4d9f7978d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:12.864487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:12.865105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.865383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.865654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.865907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:12.866313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:12.866598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:12.866893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:12.867163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:12.868581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:12.881480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:12.883624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:12.893914 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1917/3823] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:13.000861 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:13.018062 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1907/3824] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:12 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:13.023037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:13.040562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8f0c-8d62-444d-95b6-587fbc0b4d91 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:13.057686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:13.069752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:13.069752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:13.069752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:13.069752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:13.069752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:13.084637 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1918/3825] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:13.085579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:13.115400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5bc70-b232-4cee-bfad-1781b4ec2f6b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:13.115400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:13.115400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:13.115400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:13.116815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] PATH_INFO: `/v3/projects/c5b87c4414c94faf9f802f85b20f171c/users/ac3311d0deeb4525b8082f0e03a44c62/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:13.153434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b87c4414c94faf9f802f85b20f171c, user_id=ac3311d0deeb4525b8082f0e03a44c62, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:13.160838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:13.475193 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1908/3826] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:13 2022] PUT /identity/v3/projects/c5b87c4414c94faf9f802f85b20f171c/users/ac3311d0deeb4525b8082f0e03a44c62/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:13.478955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:13.503313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9d4bb-0e4e-4f9e-96f5-76d48b593e34 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:13.614439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d91a9-af88-43a4-a37c-b7cf7fd53a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:13.615370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d91a9-af88-43a4-a37c-b7cf7fd53a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:13.615732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d91a9-af88-43a4-a37c-b7cf7fd53a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:13.616095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d91a9-af88-43a4-a37c-b7cf7fd53a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:13.616866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d91a9-af88-43a4-a37c-b7cf7fd53a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:13.618708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d91a9-af88-43a4-a37c-b7cf7fd53a25 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:13.634206 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1919/3827] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:13.639135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:13.676835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccf82b-aef6-4030-8472-68fe8b98a0c3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:13.687285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:13.688567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:13.689103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:13.689470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] PATH_INFO: `/v3/projects/c5b87c4414c94faf9f802f85b20f171c/users/ac3311d0deeb4525b8082f0e03a44c62/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:13.691941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b87c4414c94faf9f802f85b20f171c, user_id=ac3311d0deeb4525b8082f0e03a44c62, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:13.694829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:13.722701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1909/3828] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:13 2022] PUT /identity/v3/projects/c5b87c4414c94faf9f802f85b20f171c/users/ac3311d0deeb4525b8082f0e03a44c62/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:13.733782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679df00-c7d9-47f6-a7ae-34399e31c074 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:13.741755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679df00-c7d9-47f6-a7ae-34399e31c074 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:13.741755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679df00-c7d9-47f6-a7ae-34399e31c074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:13.804742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5679df00-c7d9-47f6-a7ae-34399e31c074 None None] MFA Rules not processed for user `ac3311d0deeb4525b8082f0e03a44c62`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:13.806964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5679df00-c7d9-47f6-a7ae-34399e31c074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:13.945687 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1920/3829] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:14.008111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:14.010013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:14.125096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88d57-7a53-4eaf-80e1-8cabacb4513e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:14.129499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b68a6-8776-4d53-a4bb-42aaa93886ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:14.130560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b68a6-8776-4d53-a4bb-42aaa93886ab service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:14.138777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b68a6-8776-4d53-a4bb-42aaa93886ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:14.138777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b68a6-8776-4d53-a4bb-42aaa93886ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:14.146121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b68a6-8776-4d53-a4bb-42aaa93886ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:14.147898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b68a6-8776-4d53-a4bb-42aaa93886ab service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:14.162014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1910/3830] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:14.212274 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:14.741857 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:15.620085 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:16.609354 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:17.642049 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:18.380698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679df00-c7d9-47f6-a7ae-34399e31c074 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:18.536632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679df00-c7d9-47f6-a7ae-34399e31c074 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:18.550786 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:18.560471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:18.562064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:18.562552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:18.563023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] PATH_INFO: `/v3/users/f14b752c44824a1cbbeb21b3c7488b42` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:18.565710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14b752c44824a1cbbeb21b3c7488b42)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:18.568162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:18.866821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14b752c44824a1cbbeb21b3c7488b42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:18.878960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14b752c44824a1cbbeb21b3c7488b42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:18.879931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14b752c44824a1cbbeb21b3c7488b42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:18.954316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14b752c44824a1cbbeb21b3c7488b42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:18.956266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14b752c44824a1cbbeb21b3c7488b42'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:18.982645 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1921/3831] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:18 2022] DELETE /identity/v3/users/f14b752c44824a1cbbeb21b3c7488b42 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:18.987131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:18.988005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:18.988453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:19.044967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:19.046449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:19.109159 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:19.147560 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1911/3832] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:19.191536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:19.195150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:19.381448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38780-5e16-48da-98d0-35aa0d97813d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:19.421860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:19.425425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:19.425943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:19.426447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:19.440198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:19.440198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:19.440744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:19.442477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:19.457333 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1922/3833] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:19.460439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c9ddf-407c-47b4-b508-cf166f4f2dbf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:19.465648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:19.466644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:19.467138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:19.467637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] PATH_INFO: `/v3/users/4024e1a8f515435f86d3d36d59262813` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:19.469054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4024e1a8f515435f86d3d36d59262813)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:19.472136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:19.695938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4024e1a8f515435f86d3d36d59262813'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:19.710925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4024e1a8f515435f86d3d36d59262813'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:19.712801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4024e1a8f515435f86d3d36d59262813'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:19.869894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4024e1a8f515435f86d3d36d59262813'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:19.870759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4024e1a8f515435f86d3d36d59262813'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:19.895852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1912/3834] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:19 2022] DELETE /identity/v3/users/4024e1a8f515435f86d3d36d59262813 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:19.996180 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:20.362104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:20.379859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8856481-4273-429f-b6fd-5a974b46bd78 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:20.480074 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:20.504594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:20.508348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:20.508348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:20.508348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] PATH_INFO: `/v3/projects/316cbb6f558c4bc8b34050cc1b8ea134` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:20.508784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316cbb6f558c4bc8b34050cc1b8ea134)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:20.512796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:20.612282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:20.626565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:20.743651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f9260-24ab-4906-99dd-a00bd31c0087 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:20.762346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316cbb6f558c4bc8b34050cc1b8ea134', 'request_id': 'req-a8f82786-6e0b-4885-848f-d6b341399ea3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:20.785592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316cbb6f558c4bc8b34050cc1b8ea134', 'request_id': 'req-a8f82786-6e0b-4885-848f-d6b341399ea3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:20.941112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316cbb6f558c4bc8b34050cc1b8ea134', 'request_id': 'req-a8f82786-6e0b-4885-848f-d6b341399ea3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:20.955804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:20.957087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:20.957607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:20.958970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] PATH_INFO: `/v3/projects/bab840ecfb46440793efcf0ba9cd4b4e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:20.961173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab840ecfb46440793efcf0ba9cd4b4e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:20.970024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] The token cache is being invalidate because project 316cbb6f558c4bc8b34050cc1b8ea134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:20.972482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:20.973661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:20.978315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a8f82786-6e0b-4885-848f-d6b341399ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:20.984744 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1923/3835] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:20 2022] DELETE /identity/v3/projects/316cbb6f558c4bc8b34050cc1b8ea134 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:20.988527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b7447-f84b-417e-b822-4d145c6f742e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:20.989626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b7447-f84b-417e-b822-4d145c6f742e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:20.989626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b7447-f84b-417e-b822-4d145c6f742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:21.036302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-609b7447-f84b-417e-b822-4d145c6f742e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:21.037680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-609b7447-f84b-417e-b822-4d145c6f742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:21.069200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1924/3836] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:25:21.081833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ba7c-bbee-4d65-8050-94845547188c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:21.082675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ba7c-bbee-4d65-8050-94845547188c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:21.082967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91ba7c-bbee-4d65-8050-94845547188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:21.147764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab840ecfb46440793efcf0ba9cd4b4e', 'request_id': 'req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.165733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bf91ba7c-bbee-4d65-8050-94845547188c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:21.167466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf91ba7c-bbee-4d65-8050-94845547188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:21.171184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab840ecfb46440793efcf0ba9cd4b4e', 'request_id': 'req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.275744 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:21.276571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab840ecfb46440793efcf0ba9cd4b4e', 'request_id': 'req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.321014 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1925/3837] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:21.322019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ba7c-bbee-4d65-8050-94845547188c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:21.322802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] The token cache is being invalidate because project bab840ecfb46440793efcf0ba9cd4b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:21.323347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.324303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.334630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1913/3838] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:20 2022] DELETE /identity/v3/projects/bab840ecfb46440793efcf0ba9cd4b4e => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:21.338947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:21.341217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:21.345618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91ba7c-bbee-4d65-8050-94845547188c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:21.364278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:21.364633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:21.364927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:21.365333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:21.366030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:21.366314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:21.368159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:21.384344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546de53a-39e8-4dc0-8dfd-bbe3307b0b58 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:21.392466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:21.394223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:21.394750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:21.395252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] PATH_INFO: `/v3/users/ac3311d0deeb4525b8082f0e03a44c62` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:21.397312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1926/3839] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:21.398453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3311d0deeb4525b8082f0e03a44c62)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:21.401200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:21.402049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:21.405707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:21.452591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483bd39-1b5d-4277-984b-f0a6aac85616 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:21.499723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:21.499723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:21.499723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:21.499723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:21.501410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:21.501410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:21.671376 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1927/3840] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:21 2022] POST /identity/v3/projects => generated 387 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:21.675613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:21.804814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d8f83-88a3-4ca6-b85a-77868af30997 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:21.805465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3311d0deeb4525b8082f0e03a44c62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.813004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:21.814202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:21.814868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:21.815338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:21.816856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:21.819483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:21.835528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3311d0deeb4525b8082f0e03a44c62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.836203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3311d0deeb4525b8082f0e03a44c62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.938473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3311d0deeb4525b8082f0e03a44c62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.939332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3311d0deeb4525b8082f0e03a44c62'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:21.942672 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1928/3841] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:21 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:25:21.949238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:21.953440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:22.005571 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1914/3842] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:21 2022] DELETE /identity/v3/users/ac3311d0deeb4525b8082f0e03a44c62 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:22.055103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da89e-6a04-4885-973b-9079c10b508c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:22.207867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:22.210128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:22.220333 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:22.284381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:22.285027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:22.285309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:22.285696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:22.291889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:22.297721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:22.326368 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1929/3843] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:22.329649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:22.357385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd498892-ba85-4efe-b5a4-0be0a779768f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:22.357627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0944125-d87a-4865-8422-350f1e40aeff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:22.361476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:22.362983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:22.364154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:22.365014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:22.365469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:22.365941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:22.366254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:22.366397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:22.366658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] PATH_INFO: `/v3/users/0501ceda4e8140e09fb4e94552487cc3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:22.367852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0501ceda4e8140e09fb4e94552487cc3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:22.367982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:22.380069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:22.391940 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1930/3844] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:22.396446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:22.413726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b61ef7-a22c-42a2-9cc1-955290274b18 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:22.421954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d89b7-d0ce-42ed-b448-50c84c383b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:22.425073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d89b7-d0ce-42ed-b448-50c84c383b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:22.425073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d89b7-d0ce-42ed-b448-50c84c383b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:22.425073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d89b7-d0ce-42ed-b448-50c84c383b57 admin admin] PATH_INFO: `/v3/projects/4464938aec13451f910daa714d060e46/users/1864708a7b2f4223bc8f0015c765eb0f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:22.452919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d89b7-d0ce-42ed-b448-50c84c383b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4464938aec13451f910daa714d060e46, user_id=1864708a7b2f4223bc8f0015c765eb0f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:22.455973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d89b7-d0ce-42ed-b448-50c84c383b57 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:22.619281 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1931/3845] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:22 2022] PUT /identity/v3/projects/4464938aec13451f910daa714d060e46/users/1864708a7b2f4223bc8f0015c765eb0f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:22.621552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:22.622100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:22.622546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:22.646927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:22.649178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:22.692219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0501ceda4e8140e09fb4e94552487cc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:22.705618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0501ceda4e8140e09fb4e94552487cc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:22.706612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0501ceda4e8140e09fb4e94552487cc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:22.740330 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1932/3846] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:22.761746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:22.761746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:22.817547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0501ceda4e8140e09fb4e94552487cc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:22.818314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0501ceda4e8140e09fb4e94552487cc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:22.854795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd6910-6797-4e0c-b0c5-3a288b0bd08f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:22.855641 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1915/3847] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:22 2022] DELETE /identity/v3/users/0501ceda4e8140e09fb4e94552487cc3 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:22.857001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:22.859366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:22.925818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:22.925818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:22.925818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:22.925818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:22.927001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:23.002859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426f40-91ec-44a2-80fb-c167562eb5c9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:23.024027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:23.024720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.025006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.025419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] PATH_INFO: `/v3/projects/c5b87c4414c94faf9f802f85b20f171c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.027602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b87c4414c94faf9f802f85b20f171c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.029731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.050456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.053957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.068679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1933/3848] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:23.125830 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:23.221799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b87c4414c94faf9f802f85b20f171c', 'request_id': 'req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.233924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b87c4414c94faf9f802f85b20f171c', 'request_id': 'req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.261956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:23.263234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:23.279890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f570a-a609-44c1-ba03-dd9b9d076b64 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:23.319955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b87c4414c94faf9f802f85b20f171c', 'request_id': 'req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.337202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] The token cache is being invalidate because project c5b87c4414c94faf9f802f85b20f171c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:23.337555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.339757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd8efa85-1b0a-4f03-94ea-c3096ebce9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.346620 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1916/3849] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:22 2022] DELETE /identity/v3/projects/c5b87c4414c94faf9f802f85b20f171c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:23.348979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cee6-f26b-4598-9ecb-1d5ed498e184 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.349264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cee6-f26b-4598-9ecb-1d5ed498e184 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.349543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cee6-f26b-4598-9ecb-1d5ed498e184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.388543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:23.389202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.389483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.389792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] PATH_INFO: `/v3/projects/8525dcc00e844959a1527424291a3149` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.391462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-04a6cee6-f26b-4598-9ecb-1d5ed498e184 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:23.393881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8525dcc00e844959a1527424291a3149)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.395541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-04a6cee6-f26b-4598-9ecb-1d5ed498e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:23.397696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.417168 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1917/3850] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:23.426808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d9b4-94d4-400f-ad3c-f0648c055648 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.427130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d9b4-94d4-400f-ad3c-f0648c055648 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.427373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d9b4-94d4-400f-ad3c-f0648c055648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.472722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d3c3d9b4-94d4-400f-ad3c-f0648c055648 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:23.474340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d3c3d9b4-94d4-400f-ad3c-f0648c055648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:23.490390 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1918/3851] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:23.498214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d9b4-94d4-400f-ad3c-f0648c055648 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:23.512061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d9b4-94d4-400f-ad3c-f0648c055648 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:23.521655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:23.523765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.523765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.523765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.524859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:23.525407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.527844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.543051 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1919/3852] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:25:23.546917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:23.558659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a831-55bb-4e05-b1d4-34245175a316 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:23.564396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:23.565896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.566312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.566688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.567611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.569763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.611171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8525dcc00e844959a1527424291a3149', 'request_id': 'req-ce3d2a40-5855-4946-9569-0179c7ec2880'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.617286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8525dcc00e844959a1527424291a3149', 'request_id': 'req-ce3d2a40-5855-4946-9569-0179c7ec2880'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.710909 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1920/3853] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:23 2022] POST /identity/v3/projects => generated 357 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:23.712193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:23.787289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8525dcc00e844959a1527424291a3149', 'request_id': 'req-ce3d2a40-5855-4946-9569-0179c7ec2880'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.801759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0450bac-7399-4c0e-ac1c-b5197a82cf30 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:23.808287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] The token cache is being invalidate because project 8525dcc00e844959a1527424291a3149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:23.808788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.810931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:23.811251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:23.812047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.812511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.812939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.813434 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1934/3854] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:23 2022] DELETE /identity/v3/projects/8525dcc00e844959a1527424291a3149 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:23.813937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.817394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.818727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:23.822723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:23.913725 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1921/3855] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:23 2022] POST /identity/v3/users => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:23.915106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:23.919280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:23.941410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d2a40-5855-4946-9569-0179c7ec2880 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:23.945823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3b00-df1a-42ff-9ee7-e0950068ae89 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:23.946714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:23.947541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.947953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.948313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] PATH_INFO: `/v3/users/46f23e077b2547cca0ca7c1b1307e69e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.953233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f23e077b2547cca0ca7c1b1307e69e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.953233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.965603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:23.966541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:23.967009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:23.967456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:23.968280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:23.971082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:23.995551 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1922/3856] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:23.996745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:24.010423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc0e5-3353-4ed8-a866-1f9620fff537 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:24.019771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:24.020984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:24.021357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:24.022322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:24.022592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:24.024408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:24.040489 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1923/3857] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:24.042115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:24.054772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357d5a-c808-48f8-94a2-ebbd0d0b0efa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:24.060767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1aa26-1159-4cfb-8259-edecbe6cfce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:24.061531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aa26-1159-4cfb-8259-edecbe6cfce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:24.061892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aa26-1159-4cfb-8259-edecbe6cfce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:24.062717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aa26-1159-4cfb-8259-edecbe6cfce9 admin admin] PATH_INFO: `/v3/projects/354f2352ccc94f8e91fc9b90451c0787/users/1b43791d1591401eababe40e68389f89/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:24.095114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1aa26-1159-4cfb-8259-edecbe6cfce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354f2352ccc94f8e91fc9b90451c0787, user_id=1b43791d1591401eababe40e68389f89, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:24.096236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1aa26-1159-4cfb-8259-edecbe6cfce9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:24.162143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f23e077b2547cca0ca7c1b1307e69e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:24.170411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f23e077b2547cca0ca7c1b1307e69e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:24.171363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f23e077b2547cca0ca7c1b1307e69e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:24.184940 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1924/3858] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:24 2022] PUT /identity/v3/projects/354f2352ccc94f8e91fc9b90451c0787/users/1b43791d1591401eababe40e68389f89/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:24.204853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b84f-5ddb-4319-9131-bc0f839601e1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:24.204853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b84f-5ddb-4319-9131-bc0f839601e1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:24.204853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b84f-5ddb-4319-9131-bc0f839601e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:24.272792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e2f0b84f-5ddb-4319-9131-bc0f839601e1 None None] MFA Rules not processed for user `1b43791d1591401eababe40e68389f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:24.274052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e2f0b84f-5ddb-4319-9131-bc0f839601e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:24.302818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f23e077b2547cca0ca7c1b1307e69e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:24.302818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f23e077b2547cca0ca7c1b1307e69e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:24.333939 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1935/3859] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:23 2022] DELETE /identity/v3/users/46f23e077b2547cca0ca7c1b1307e69e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:24.388595 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1925/3860] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:24.392987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:24.396510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:24.412418 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:24.496176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1231a4c-0a05-47ff-8a87-1b283c1d1930 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:24.511886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:24.512526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:24.512803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:24.513075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:24.513721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:24.515943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:24.614635 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1936/3861] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:24 2022] POST /identity/v3/projects => generated 357 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:25:24.618791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0b84f-5ddb-4319-9131-bc0f839601e1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:24.711894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0b84f-5ddb-4319-9131-bc0f839601e1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:24.806780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:24.807542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:24.807859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:24.808133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:24.808800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:24.810842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:24.933095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1926/3862] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:24 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:25:24.937308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:24.954770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c835-4815-4251-b0d5-833f475dbdd7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:24.972522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:24.973171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:24.976492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:24.976785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:24.979537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:24.982625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.007859 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1937/3863] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:25.013192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.022989 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:25.034208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98a27-4e15-4ffc-add3-ce8d41a9e1ef admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:25.040921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:25.042118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.042585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.043826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] PATH_INFO: `/v3/projects/7cdded87c7b34b3bb7a26d59543f2c6b/users/e2fc0c662ecd4ae8a27f065ca898ba8c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.065334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdded87c7b34b3bb7a26d59543f2c6b, user_id=e2fc0c662ecd4ae8a27f065ca898ba8c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:25.068286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.139567 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1927/3864] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:25 2022] PUT /identity/v3/projects/7cdded87c7b34b3bb7a26d59543f2c6b/users/e2fc0c662ecd4ae8a27f065ca898ba8c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:25.146213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.157890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac49d-3e1e-4f86-bf77-2656d69bf9d0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:25.271153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e5453-3afd-4671-8bfe-356c60dccb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:25.273666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5453-3afd-4671-8bfe-356c60dccb73 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.275398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5453-3afd-4671-8bfe-356c60dccb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.277069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e5453-3afd-4671-8bfe-356c60dccb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.281678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e5453-3afd-4671-8bfe-356c60dccb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:25.286554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e5453-3afd-4671-8bfe-356c60dccb73 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.324883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.327875 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1938/3865] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:25.347042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342357d-2cd3-40f2-98ac-18e2fec8ed66 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:25.374869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:25.375404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.375782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.376145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] PATH_INFO: `/v3/projects/7cdded87c7b34b3bb7a26d59543f2c6b/users/e2fc0c662ecd4ae8a27f065ca898ba8c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.382344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdded87c7b34b3bb7a26d59543f2c6b, user_id=e2fc0c662ecd4ae8a27f065ca898ba8c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:25.386281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.419159 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1928/3866] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:25 2022] PUT /identity/v3/projects/7cdded87c7b34b3bb7a26d59543f2c6b/users/e2fc0c662ecd4ae8a27f065ca898ba8c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:25.432954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a8d1-886e-4819-bb55-84f2bfc471ed None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.432954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a8d1-886e-4819-bb55-84f2bfc471ed None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.432954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a8d1-886e-4819-bb55-84f2bfc471ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.478913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f409a8d1-886e-4819-bb55-84f2bfc471ed None None] MFA Rules not processed for user `e2fc0c662ecd4ae8a27f065ca898ba8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:25.480764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f409a8d1-886e-4819-bb55-84f2bfc471ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:25.575529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.577840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:25.622545 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1939/3867] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:25.628913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a8d1-886e-4819-bb55-84f2bfc471ed None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.648531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a8d1-886e-4819-bb55-84f2bfc471ed None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:25.654541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fc0c662ecd4ae8a27f065ca898ba8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cdded87c7b34b3bb7a26d59543f2c6b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:25.657634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.658179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.658555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.659251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:25.659556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:25.662273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.683965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1940/3868] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:25.685357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.706557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f84327-834f-49e7-92cd-09904eb56e95 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:25.713326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fc0c662ecd4ae8a27f065ca898ba8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cdded87c7b34b3bb7a26d59543f2c6b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:25.714071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.714354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.714632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.715323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:25.718393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.747230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f990f-c879-4d60-a1d6-0636282019fb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:25.758235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:25.759063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.759438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.760169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] PATH_INFO: `/v3/projects/889de89a813e4a44a31d6c014e2a1f94` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.761745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=889de89a813e4a44a31d6c014e2a1f94)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:25.764816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.833600 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1941/3869] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:25 2022] POST /identity/v3/projects => generated 349 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:25.838638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.925914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef3a74-b415-44c4-b12e-6d83a6eb7a18 tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:25.931461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fc0c662ecd4ae8a27f065ca898ba8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cdded87c7b34b3bb7a26d59543f2c6b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:25.932164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:25.932507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:25.932981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:25.933713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:25.934253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:25.936306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:25.959285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1942/3870] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:25.967971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889de89a813e4a44a31d6c014e2a1f94', 'request_id': 'req-05a6ab3a-b786-471c-a7a6-9588a6934a87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:25.974330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:25.976617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:25.979833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889de89a813e4a44a31d6c014e2a1f94', 'request_id': 'req-05a6ab3a-b786-471c-a7a6-9588a6934a87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:26.086909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35332c56-c8eb-4ced-9fae-d149a1c2c6aa tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:26.110740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889de89a813e4a44a31d6c014e2a1f94', 'request_id': 'req-05a6ab3a-b786-471c-a7a6-9588a6934a87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:26.133875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] The token cache is being invalidate because project 889de89a813e4a44a31d6c014e2a1f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:26.135932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:26.137327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-05a6ab3a-b786-471c-a7a6-9588a6934a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:26.143656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1929/3871] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:25 2022] DELETE /identity/v3/projects/889de89a813e4a44a31d6c014e2a1f94 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:26.148706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15859b6-a98f-4330-8567-b3ab80b563f1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.150317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15859b6-a98f-4330-8567-b3ab80b563f1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.151192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15859b6-a98f-4330-8567-b3ab80b563f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.181930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d15859b6-a98f-4330-8567-b3ab80b563f1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:26.185624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d15859b6-a98f-4330-8567-b3ab80b563f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:26.198795 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:26.255750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:26.256361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.256633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.256902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.260927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:26.276779 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1930/3872] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:26.285648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799ced-353b-4e8b-be18-64bbcaccfd0b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.286145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799ced-353b-4e8b-be18-64bbcaccfd0b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.286695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799ced-353b-4e8b-be18-64bbcaccfd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.312962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ed799ced-353b-4e8b-be18-64bbcaccfd0b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:26.315931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed799ced-353b-4e8b-be18-64bbcaccfd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:26.355646 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1931/3873] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:25:26.357190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed799ced-353b-4e8b-be18-64bbcaccfd0b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:26.359368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:26.361184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:26.379690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed799ced-353b-4e8b-be18-64bbcaccfd0b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:26.380656 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1943/3874] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:25:26.389755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:26.390477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.390758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.391026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.391712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:26.392013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:26.393859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:26.412958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1932/3875] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:26.413142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:26.431312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92f7f-ea25-4f78-a401-b1b71c51a32e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:26.439318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:26.440820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.441097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.441507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.442340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:26.444242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:26.547778 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1944/3876] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:26 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:26.550022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:26.570330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb842137-6804-4d00-9a34-78dbde8fc35a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:26.687019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:26.687850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.688312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.688597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.689251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:26.691918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:26.819472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:26.833776 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1933/3877] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:26 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:26.841877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbf06b-f107-4b8a-9869-5b282d609078 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:26.848528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:26.849471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.850624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.850844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.851489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:26.853094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:26.865089 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1945/3878] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:25:26.869588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:26.881540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260bec-90b6-446f-ba52-9c9dfca3f8d7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:26.887595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128c47e-e5d5-46a0-8b43-1ee46b066b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:26.888587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128c47e-e5d5-46a0-8b43-1ee46b066b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.889207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128c47e-e5d5-46a0-8b43-1ee46b066b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.889708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128c47e-e5d5-46a0-8b43-1ee46b066b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.890652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128c47e-e5d5-46a0-8b43-1ee46b066b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:26.893356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128c47e-e5d5-46a0-8b43-1ee46b066b14 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:26.911748 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1934/3879] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:26.911997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:26.922665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4bf07-33c4-4b9d-a6bf-d6d0f56ee2c0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:26.928265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:26.929274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:26.929553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:26.929825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] PATH_INFO: `/v3/projects/585f94966b4142ba964fe851e75a6808/users/766d3b58a01d4cac95f90c788163aa21/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:26.948207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=585f94966b4142ba964fe851e75a6808, user_id=766d3b58a01d4cac95f90c788163aa21, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:26.950872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:27.021372 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1946/3880] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:26 2022] PUT /identity/v3/projects/585f94966b4142ba964fe851e75a6808/users/766d3b58a01d4cac95f90c788163aa21/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:27.026633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a870673-c2e0-4a76-8cac-95d498831420 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:27.026915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a870673-c2e0-4a76-8cac-95d498831420 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:27.027311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a870673-c2e0-4a76-8cac-95d498831420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:27.050760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4a870673-c2e0-4a76-8cac-95d498831420 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:27.052239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a870673-c2e0-4a76-8cac-95d498831420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:27.137887 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:27.156044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1935/3881] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:27.180424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:27.188658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:27.312167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeda53-bebd-4f0a-af75-f8465a8cab2e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:27.320839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:27.321611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:27.322737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:27.322737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:27.364125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:27.366971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:27.391016 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1947/3882] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:27.619342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a870673-c2e0-4a76-8cac-95d498831420 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:27.737339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a870673-c2e0-4a76-8cac-95d498831420 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:27.742897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fc0c662ecd4ae8a27f065ca898ba8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cdded87c7b34b3bb7a26d59543f2c6b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:27.744133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:27.744596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:27.745078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] PATH_INFO: `/v3/projects/867ffaf97dd7412f9b1bbe9da626f9a2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:27.746703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=867ffaf97dd7412f9b1bbe9da626f9a2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:27.752716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:27.958464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867ffaf97dd7412f9b1bbe9da626f9a2', 'request_id': 'req-af4071d3-7868-4eee-aa64-769da8b3df6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:27.971485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867ffaf97dd7412f9b1bbe9da626f9a2', 'request_id': 'req-af4071d3-7868-4eee-aa64-769da8b3df6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.058131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867ffaf97dd7412f9b1bbe9da626f9a2', 'request_id': 'req-af4071d3-7868-4eee-aa64-769da8b3df6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.084640 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:28.092563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] The token cache is being invalidate because project 867ffaf97dd7412f9b1bbe9da626f9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:28.092880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.093825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af4071d3-7868-4eee-aa64-769da8b3df6b tempest-QuotasTest-1352018049 tempest-QuotasTest-1352018049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.096257 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1936/3883] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:27 2022] DELETE /identity/v3/projects/867ffaf97dd7412f9b1bbe9da626f9a2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:28.311265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:28.313332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:28.328649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc2828-298a-4823-802b-61ac7fe1bf6a service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:28.417331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:28.418143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:28.418421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:28.418708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] PATH_INFO: `/v3/users/1b43791d1591401eababe40e68389f89` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:28.419928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b43791d1591401eababe40e68389f89)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:28.421874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:28.612770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b43791d1591401eababe40e68389f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.622496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b43791d1591401eababe40e68389f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.623249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b43791d1591401eababe40e68389f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.709156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b43791d1591401eababe40e68389f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.709797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b43791d1591401eababe40e68389f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:28.758298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1948/3884] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:28 2022] DELETE /identity/v3/users/1b43791d1591401eababe40e68389f89 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:28.761298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:28.761298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:28.761298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:28.791286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:28.793470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:28.875252 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1937/3885] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:28.885134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:28.886771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:28.915288 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:28.964960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a609-b405-4a80-9d84-4f8fa50b6c8e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:28.968947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:28.969651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:28.970007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:28.970362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:28.982491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:28.984797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:28.996658 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1949/3886] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:29.514998 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:29.707501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:29.708207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:29.722355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:29.724091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:29.739173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831091-6a73-443f-a9b9-ba5bd8298bfa None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:29.742991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fddc04-0ebf-4fc9-8a64-c09e8d694a74 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:29.750304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:29.751326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:29.752182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:29.752699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:29.753539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:29.754064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] PATH_INFO: `/v3/projects/354f2352ccc94f8e91fc9b90451c0787` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:29.755130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:29.755603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] PATH_INFO: `/v3/users/2b8a867611614ea585d510d62c63cfa3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:29.756440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=354f2352ccc94f8e91fc9b90451c0787)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:29.759171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:29.759980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8a867611614ea585d510d62c63cfa3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:29.763178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:30.037757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354f2352ccc94f8e91fc9b90451c0787', 'request_id': 'req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.039310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8a867611614ea585d510d62c63cfa3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.056123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8a867611614ea585d510d62c63cfa3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.057545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354f2352ccc94f8e91fc9b90451c0787', 'request_id': 'req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.059974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8a867611614ea585d510d62c63cfa3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.144171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354f2352ccc94f8e91fc9b90451c0787', 'request_id': 'req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.175716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] The token cache is being invalidate because project 354f2352ccc94f8e91fc9b90451c0787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:30.176428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.177410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.182902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1938/3887] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:29 2022] DELETE /identity/v3/projects/354f2352ccc94f8e91fc9b90451c0787 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:30.187025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:30.191217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:30.234569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8a867611614ea585d510d62c63cfa3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.235373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8a867611614ea585d510d62c63cfa3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.280605 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1950/3888] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:29 2022] DELETE /identity/v3/users/2b8a867611614ea585d510d62c63cfa3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:30.399739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fab94-2fd0-4a7d-a0db-b47d51a6c1cb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:30.493141 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:30.553325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:30.554572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:30.554858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:30.555131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] PATH_INFO: `/v3/users/e2fc0c662ecd4ae8a27f065ca898ba8c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:30.558267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fc0c662ecd4ae8a27f065ca898ba8c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:30.560227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:30.827176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fc0c662ecd4ae8a27f065ca898ba8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.846951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fc0c662ecd4ae8a27f065ca898ba8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.849150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fc0c662ecd4ae8a27f065ca898ba8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.954379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fc0c662ecd4ae8a27f065ca898ba8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:30.963704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fc0c662ecd4ae8a27f065ca898ba8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:31.013734 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1939/3889] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:30 2022] DELETE /identity/v3/users/e2fc0c662ecd4ae8a27f065ca898ba8c => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:25:31.429262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:31.429262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:31.448221 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:31.534159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:31.536383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:31.635901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275546-d148-4eab-91ee-2792f0fa84fd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:31.722359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b62a2-dbb4-48f7-97e9-31013a1f9b5b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:31.731862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:31.732818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:31.739188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:31.739188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] PATH_INFO: `/v3/projects/8d9f6afbdbf74318a98dfe455a72ac7c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:31.739188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9f6afbdbf74318a98dfe455a72ac7c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:31.751460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:31.781191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:31.781823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:31.782146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:31.782418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:31.785239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:31.966672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:31.969428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:31.990635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9f6afbdbf74318a98dfe455a72ac7c', 'request_id': 'req-1e53f820-6325-4f89-ac08-49aa251003f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.004376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9f6afbdbf74318a98dfe455a72ac7c', 'request_id': 'req-1e53f820-6325-4f89-ac08-49aa251003f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.019734 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1951/3890] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:32.022911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:32.025907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:32.060109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cb6dc-2a39-4253-97f9-0b1888c07723 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:32.118474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9f6afbdbf74318a98dfe455a72ac7c', 'request_id': 'req-1e53f820-6325-4f89-ac08-49aa251003f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.138926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] The token cache is being invalidate because project 8d9f6afbdbf74318a98dfe455a72ac7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:32.139595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.140709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1e53f820-6325-4f89-ac08-49aa251003f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.143406 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1940/3891] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:31 2022] DELETE /identity/v3/projects/8d9f6afbdbf74318a98dfe455a72ac7c => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:32.148980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dc71-63e2-40a3-9e0e-9021b21b5488 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.149610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dc71-63e2-40a3-9e0e-9021b21b5488 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.150989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dc71-63e2-40a3-9e0e-9021b21b5488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.209515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6bc1dc71-63e2-40a3-9e0e-9021b21b5488 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:32.213695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6bc1dc71-63e2-40a3-9e0e-9021b21b5488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:32.217120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:32.217773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.218072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.219648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] PATH_INFO: `/v3/projects/7cdded87c7b34b3bb7a26d59543f2c6b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.219791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdded87c7b34b3bb7a26d59543f2c6b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:32.222361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:32.233578 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:32.242318 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1941/3892] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:25:32.250359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166c383-ab76-4acd-bca0-492373c78bb8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.251286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166c383-ab76-4acd-bca0-492373c78bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.253098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166c383-ab76-4acd-bca0-492373c78bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.298529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e166c383-ab76-4acd-bca0-492373c78bb8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:32.303850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e166c383-ab76-4acd-bca0-492373c78bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:32.325297 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1942/3893] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:32.328037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166c383-ab76-4acd-bca0-492373c78bb8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:32.354827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166c383-ab76-4acd-bca0-492373c78bb8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:32.366991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:32.368059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.368654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.369596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.370784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:32.371314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:32.374063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:32.390238 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1943/3894] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:25:32.396182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:32.410817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f8c5d-f7e5-4f91-80e0-1cb6ab6f313e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:32.419494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdded87c7b34b3bb7a26d59543f2c6b', 'request_id': 'req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.464277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdded87c7b34b3bb7a26d59543f2c6b', 'request_id': 'req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.502173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e85c12-df09-47e2-9011-3386d1408e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:32.502943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e85c12-df09-47e2-9011-3386d1408e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.503259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e85c12-df09-47e2-9011-3386d1408e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.504215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e85c12-df09-47e2-9011-3386d1408e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.504930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e85c12-df09-47e2-9011-3386d1408e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:32.507898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e85c12-df09-47e2-9011-3386d1408e8c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:32.628764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdded87c7b34b3bb7a26d59543f2c6b', 'request_id': 'req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.630377 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:32.648008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] The token cache is being invalidate because project 7cdded87c7b34b3bb7a26d59543f2c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:32.648530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.653745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:32.658385 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1952/3895] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:32 2022] DELETE /identity/v3/projects/7cdded87c7b34b3bb7a26d59543f2c6b => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:32.663969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:32.671427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:32.674435 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1944/3896] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:32 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:32.676202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.676687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.677415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.727605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:32.729414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:32.821559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1ee6-51e3-45b5-9ce2-5deaa16bc425 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:32.890974 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1945/3897] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:32.894112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:32.895904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:32.926295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8ff86-3698-4370-938d-3512a8a5916d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:32.931599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab716967-78bc-4fad-8514-bcea859435d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:32.932402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716967-78bc-4fad-8514-bcea859435d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.932784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716967-78bc-4fad-8514-bcea859435d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.933240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716967-78bc-4fad-8514-bcea859435d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.933965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab716967-78bc-4fad-8514-bcea859435d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:32.936320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab716967-78bc-4fad-8514-bcea859435d2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:32.949073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:32.951606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:32.952151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:32.952507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:32.955690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:33.042308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1946/3898] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:32 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:33.043863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969da1b-c6f0-4a26-bdb9-62e520602a2a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.044146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969da1b-c6f0-4a26-bdb9-62e520602a2a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.050930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969da1b-c6f0-4a26-bdb9-62e520602a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.133522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8969da1b-c6f0-4a26-bdb9-62e520602a2a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:33.138433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8969da1b-c6f0-4a26-bdb9-62e520602a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:33.146228 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1947/3899] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:33.150896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969da1b-c6f0-4a26-bdb9-62e520602a2a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:33.165894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969da1b-c6f0-4a26-bdb9-62e520602a2a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:33.171147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:33.174858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:33.182288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:33.182938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.183302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.183697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.184553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:33.193096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:33.203416 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1953/3900] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:33.205427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:33.222293 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1948/3901] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:33.226320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:33.237260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56a3a5-bb58-4173-a740-9d83ab794dfa service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:33.239696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedbdc2-d101-4c9d-bc3e-559b53c32005 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:33.246510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:33.247442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.249224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.249673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.252915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:33.253128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:33.253310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.253310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.253310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.254029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:33.254133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:33.254133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:33.259492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:33.314622 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1954/3902] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:33.314622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:33.314833 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1949/3903] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:33.314833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:33.329194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e1c17-11b2-4abc-b666-d940906de233 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:33.345964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81318-fbc5-42b9-b6a9-4b2b4b436628 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:33.348303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:33.348953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.349208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.349473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.350269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:33.366585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c5848-e172-4da4-b589-dc27ec2b5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:33.367576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c5848-e172-4da4-b589-dc27ec2b5ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.367948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c5848-e172-4da4-b589-dc27ec2b5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.368317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c5848-e172-4da4-b589-dc27ec2b5ccc admin admin] PATH_INFO: `/v3/projects/a3bb23cbc0c142a2a4b7a39df99a7d4a/users/fbb8ce5c15bd4a6199cfdf84c49837ef/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.377967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:33.401024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c5848-e172-4da4-b589-dc27ec2b5ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3bb23cbc0c142a2a4b7a39df99a7d4a, user_id=fbb8ce5c15bd4a6199cfdf84c49837ef, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:33.406211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c5848-e172-4da4-b589-dc27ec2b5ccc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:33.500887 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1950/3904] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:33 2022] POST /identity/v3/projects => generated 397 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:33.506187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:33.531514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1955/3905] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:33 2022] PUT /identity/v3/projects/a3bb23cbc0c142a2a4b7a39df99a7d4a/users/fbb8ce5c15bd4a6199cfdf84c49837ef/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:33.538636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.539227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.539737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.609488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:33.615133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:33.774471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8355c-756f-42c9-9dcf-c7f010ca5666 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:33.860644 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1956/3906] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:33.900583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:33.901593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:33.902328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:33.902840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:33.903708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:33.906071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:33.932367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:33.933880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:34.002871 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1951/3907] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:33 2022] POST /identity/v3/users => generated 299 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:34.007074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:34.026019 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:34.038262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975977d-0a59-4cba-a74a-e2fd2a944e74 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:34.067173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:34.067964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:34.068342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:34.068715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:34.069999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada05c9-adee-42e6-a022-4c830ec6869f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:34.070761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:34.074437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:34.082665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:34.083643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:34.084116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:34.084605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:34.108486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:34.109478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:34.119907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1952/3908] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:25:34.122398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:34.133050 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1957/3909] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:34.141682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccddd19-67b6-4e07-97da-336c598bbb62 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:34.147636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647ae59-b964-4843-b640-7a71512fb4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:34.148553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647ae59-b964-4843-b640-7a71512fb4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:34.149088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647ae59-b964-4843-b640-7a71512fb4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:34.149572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647ae59-b964-4843-b640-7a71512fb4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:34.150726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647ae59-b964-4843-b640-7a71512fb4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:34.152744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647ae59-b964-4843-b640-7a71512fb4f6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:34.165672 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1953/3910] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:34.174511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:34.183324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e62740-0e3e-4676-9642-c0fff8e59b49 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:34.191002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:34.191770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:34.192121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:34.192462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] PATH_INFO: `/v3/projects/34236cb9cfef40c8b12477b3a02b9a30/users/83bcc52eeb144c078c7e0c23aadde1ec/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:34.233188 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:34.238439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34236cb9cfef40c8b12477b3a02b9a30, user_id=83bcc52eeb144c078c7e0c23aadde1ec, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:34.242086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:34.366652 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1958/3911] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:34 2022] PUT /identity/v3/projects/34236cb9cfef40c8b12477b3a02b9a30/users/83bcc52eeb144c078c7e0c23aadde1ec/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:34.494491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ba69-b05a-458a-9ec0-aebb59064631 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:34.494898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ba69-b05a-458a-9ec0-aebb59064631 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:34.495260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ba69-b05a-458a-9ec0-aebb59064631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:34.537794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9473ba69-b05a-458a-9ec0-aebb59064631 None None] MFA Rules not processed for user `83bcc52eeb144c078c7e0c23aadde1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:34.539673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9473ba69-b05a-458a-9ec0-aebb59064631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:34.637709 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1954/3912] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:34.662604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:34.664707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:34.780415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99d1fc-ef99-42f5-b702-363673211ab5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:34.823103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:34.823740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:34.824019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:34.824290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:34.845874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:34.847389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:34.860004 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1959/3913] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:35.617341 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:35.703733 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:36.441039 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:36.504278 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:36.899786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09cb9-f5c9-4898-b700-70cf624613bb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:36.900327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09cb9-f5c9-4898-b700-70cf624613bb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:36.900568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09cb9-f5c9-4898-b700-70cf624613bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:36.976085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-28d09cb9-f5c9-4898-b700-70cf624613bb None None] MFA Rules not processed for user `1864708a7b2f4223bc8f0015c765eb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:36.980128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-28d09cb9-f5c9-4898-b700-70cf624613bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:37.185081 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1955/3914] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:37.211649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:37.213675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:37.386861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3a60b-0ad9-4562-8119-b0b4c866c32f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:37.416932 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:37.419332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:37.420160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:37.422341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:37.422800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:37.448616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:37.448616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:37.497267 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1960/3915] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:37.566310 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:38.758758 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:38.924500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d09cb9-f5c9-4898-b700-70cf624613bb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:38.943223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d09cb9-f5c9-4898-b700-70cf624613bb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:38.971307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990c274-cfeb-445d-8bca-cd883cfd76c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:38.975322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c274-cfeb-445d-8bca-cd883cfd76c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:38.976375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c274-cfeb-445d-8bca-cd883cfd76c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:38.977787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c274-cfeb-445d-8bca-cd883cfd76c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:38.981750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d990c274-cfeb-445d-8bca-cd883cfd76c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:39.014497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990c274-cfeb-445d-8bca-cd883cfd76c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:39.019885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990c274-cfeb-445d-8bca-cd883cfd76c0 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:39.048994 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1956/3916] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:39.344037 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:40.226836 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:40.579724 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:41.495870 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:42.584186 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:43.832654 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:44.413553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:44.415148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:44.572640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef602-88ce-4c29-af17-333b0267c6ed service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:44.582842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:44.584025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:44.584790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:44.585349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] PATH_INFO: `/v3/users/60276a4031ee45ffa651b5467a62a81b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:44.586989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60276a4031ee45ffa651b5467a62a81b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:44.589150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:44.665725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cdcb1-abd1-4f0f-9a81-9533b520a0aa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:44.665725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cdcb1-abd1-4f0f-9a81-9533b520a0aa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:44.665725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cdcb1-abd1-4f0f-9a81-9533b520a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:44.769339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b77cdcb1-abd1-4f0f-9a81-9533b520a0aa None None] MFA Rules not processed for user `766d3b58a01d4cac95f90c788163aa21`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:44.769784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b77cdcb1-abd1-4f0f-9a81-9533b520a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:44.854194 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:44.878433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60276a4031ee45ffa651b5467a62a81b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:44.901243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60276a4031ee45ffa651b5467a62a81b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:44.902999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60276a4031ee45ffa651b5467a62a81b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:44.957419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1957/3917] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:44.971010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60276a4031ee45ffa651b5467a62a81b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:44.975987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cdcb1-abd1-4f0f-9a81-9533b520a0aa None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:44.976322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a14d32d8-7ea4-495c-8809-9837326f7c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60276a4031ee45ffa651b5467a62a81b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:45.005911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cdcb1-abd1-4f0f-9a81-9533b520a0aa None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:45.013762 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1961/3918] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:44 2022] DELETE /identity/v3/users/60276a4031ee45ffa651b5467a62a81b => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:45.024804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:45.025889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:45.028197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:45.028774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:45.031138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:45.097747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:45.099674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:45.169865 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1958/3919] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:45.286164 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:46.469681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca628e-6dfc-4e4b-aa69-754794e8ecfb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:46.470291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca628e-6dfc-4e4b-aa69-754794e8ecfb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:46.470291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca628e-6dfc-4e4b-aa69-754794e8ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:46.522735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aaca628e-6dfc-4e4b-aa69-754794e8ecfb None None] MFA Rules not processed for user `1864708a7b2f4223bc8f0015c765eb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:46.527941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aaca628e-6dfc-4e4b-aa69-754794e8ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:46.594433 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1962/3920] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:46.788499 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:46.944847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:46.946447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:46.963626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6853a31-5171-4569-8ebe-c2a07cc16b69 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:47.048659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:47.049541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:47.050130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:47.050350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] PATH_INFO: `/v3/projects/0a369d45e4804ffca2e89cb72f447a82` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:47.052712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a369d45e4804ffca2e89cb72f447a82)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:47.056305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:47.217332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a369d45e4804ffca2e89cb72f447a82', 'request_id': 'req-cbe525ac-a659-474e-b511-ec11f30a064a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.226263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a369d45e4804ffca2e89cb72f447a82', 'request_id': 'req-cbe525ac-a659-474e-b511-ec11f30a064a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.306667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a369d45e4804ffca2e89cb72f447a82', 'request_id': 'req-cbe525ac-a659-474e-b511-ec11f30a064a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.328459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] The token cache is being invalidate because project 0a369d45e4804ffca2e89cb72f447a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:47.329873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.330556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.333102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1959/3921] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:46 2022] DELETE /identity/v3/projects/0a369d45e4804ffca2e89cb72f447a82 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:47.337720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca628e-6dfc-4e4b-aa69-754794e8ecfb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:47.367248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca628e-6dfc-4e4b-aa69-754794e8ecfb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:47.505956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:47.506925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:47.507324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:47.507710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] PATH_INFO: `/v3/users/b16c8a1cdf2741cb8618a48a38e98455` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:47.512954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16c8a1cdf2741cb8618a48a38e98455)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:47.520015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:47.765952 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:47.880258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16c8a1cdf2741cb8618a48a38e98455'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.898123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16c8a1cdf2741cb8618a48a38e98455'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.900241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16c8a1cdf2741cb8618a48a38e98455'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.971267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16c8a1cdf2741cb8618a48a38e98455'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:47.975764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf6d2957-f49a-4a66-a142-438ece9e8189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16c8a1cdf2741cb8618a48a38e98455'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:48.010989 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1963/3922] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:25:47 2022] DELETE /identity/v3/users/b16c8a1cdf2741cb8618a48a38e98455 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:48.806893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:48.809050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:48.827395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe525ac-a659-474e-b511-ec11f30a064a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:48.913350 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:48.936752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:48.937789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:48.938269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:48.938613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] PATH_INFO: `/v3/projects/a4faf89299604d51b0b70e63f4b7022c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:48.942051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4faf89299604d51b0b70e63f4b7022c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:48.944781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:49.018691 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:49.144705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4faf89299604d51b0b70e63f4b7022c', 'request_id': 'req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:49.158603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4faf89299604d51b0b70e63f4b7022c', 'request_id': 'req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:49.291490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4faf89299604d51b0b70e63f4b7022c', 'request_id': 'req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:49.309935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] The token cache is being invalidate because project a4faf89299604d51b0b70e63f4b7022c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:25:49.310178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:49.312084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0d7c0487-4e3b-42b5-946a-dd07b59cfed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:25:49.315946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1960/3923] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:25:48 2022] DELETE /identity/v3/projects/a4faf89299604d51b0b70e63f4b7022c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:49.321106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e707-b369-44f0-99b4-882eae8caed6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:49.321569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e707-b369-44f0-99b4-882eae8caed6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:49.321918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e707-b369-44f0-99b4-882eae8caed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:49.371720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b882e707-b369-44f0-99b4-882eae8caed6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:49.377809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b882e707-b369-44f0-99b4-882eae8caed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:49.584842 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1964/3924] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:49.592769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfe5d-bf39-4501-93a1-b40305868f2a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:49.593328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfe5d-bf39-4501-93a1-b40305868f2a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:49.593672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfe5d-bf39-4501-93a1-b40305868f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:49.629074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-23dbfe5d-bf39-4501-93a1-b40305868f2a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:49.630600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-23dbfe5d-bf39-4501-93a1-b40305868f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:49.646320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882e707-b369-44f0-99b4-882eae8caed6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:49.653144 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1961/3925] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:49.660544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882e707-b369-44f0-99b4-882eae8caed6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:49.671818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:49.675139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:49.675139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:49.675139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:49.675139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:25:49.675139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:49.677947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:49.701339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfe5d-bf39-4501-93a1-b40305868f2a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:49.714116 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1965/3926] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:25:49.718523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfe5d-bf39-4501-93a1-b40305868f2a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:49.727257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b74f2-1bb7-4d4c-8e8b-1a7daf465607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:49.727890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b74f2-1bb7-4d4c-8e8b-1a7daf465607 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:49.728426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b74f2-1bb7-4d4c-8e8b-1a7daf465607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:49.746987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b74f2-1bb7-4d4c-8e8b-1a7daf465607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:49.750109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b74f2-1bb7-4d4c-8e8b-1a7daf465607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:49.755119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b74f2-1bb7-4d4c-8e8b-1a7daf465607 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:49.901023 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1962/3927] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:25:49 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:49.905224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:49.927349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5614d8-75e1-4a1c-a8a8-3201d93adfdb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:50.060206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f03c-804f-4fc7-ae6d-f46b877c6efe None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:50.066600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f03c-804f-4fc7-ae6d-f46b877c6efe None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:50.066600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f03c-804f-4fc7-ae6d-f46b877c6efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:50.120765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:50.121377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:50.121638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:50.122848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c765f03c-804f-4fc7-ae6d-f46b877c6efe None None] MFA Rules not processed for user `19bff9f7a4254110b3b89f0cba5d252f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:50.123395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:50.124795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c765f03c-804f-4fc7-ae6d-f46b877c6efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:50.125665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:50.128889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:50.218117 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1963/3928] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:25:50.269533 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1966/3929] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:25:49 2022] POST /identity/v3/users => generated 291 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:25:50.277063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765f03c-804f-4fc7-ae6d-f46b877c6efe None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:50.291071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765f03c-804f-4fc7-ae6d-f46b877c6efe None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:50.296572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:50.297373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:50.297810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:50.298317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:50.299871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:50.300884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:50.311960 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1964/3930] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:25:50.316449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:50.341918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3eed-8cc8-4e52-807a-af5d054cb485 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:50.353924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadb46f-6cea-41fe-9ef2-87ee292d119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:50.354698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb46f-6cea-41fe-9ef2-87ee292d119f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:50.355086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb46f-6cea-41fe-9ef2-87ee292d119f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:50.355521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb46f-6cea-41fe-9ef2-87ee292d119f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:50.356538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadb46f-6cea-41fe-9ef2-87ee292d119f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:50.359983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadb46f-6cea-41fe-9ef2-87ee292d119f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:50.375220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1967/3931] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:25:50.383882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:50.396853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8adcb-2af0-4852-bef1-b22d4620ee8f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:50.406844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b3f00-4cd4-431b-9700-bc760ff01b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:50.408576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3f00-4cd4-431b-9700-bc760ff01b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:50.409328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3f00-4cd4-431b-9700-bc760ff01b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:50.409819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3f00-4cd4-431b-9700-bc760ff01b82 admin admin] PATH_INFO: `/v3/projects/badf117bb5bf4e76b3bab3ef518dce11/users/c1fb3cadf09d4d5da19e37b0080a0f26/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:50.434799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b3f00-4cd4-431b-9700-bc760ff01b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badf117bb5bf4e76b3bab3ef518dce11, user_id=c1fb3cadf09d4d5da19e37b0080a0f26, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:50.438073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b3f00-4cd4-431b-9700-bc760ff01b82 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:50.530061 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1965/3932] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:25:50 2022] PUT /identity/v3/projects/badf117bb5bf4e76b3bab3ef518dce11/users/c1fb3cadf09d4d5da19e37b0080a0f26/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:25:50.546207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:50.546887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:50.553008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:50.611880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] MFA Rules not processed for user `c1fb3cadf09d4d5da19e37b0080a0f26`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:50.615345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:50.774782 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1968/3933] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:50.784838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5adaa-2cda-4af1-a9f9-1539851e734e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:50.785112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5adaa-2cda-4af1-a9f9-1539851e734e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:50.785573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5adaa-2cda-4af1-a9f9-1539851e734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:50.835334 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:50.836624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1bb5adaa-2cda-4af1-a9f9-1539851e734e None None] MFA Rules not processed for user `c1fb3cadf09d4d5da19e37b0080a0f26`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:50.837921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1bb5adaa-2cda-4af1-a9f9-1539851e734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:50.855764 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1966/3934] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:51.086930 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:51.206487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:51.208207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:51.240851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043199ee-5665-46bd-9bd6-2950d55f3a41 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:51.241775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043199ee-5665-46bd-9bd6-2950d55f3a41 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:51.242252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043199ee-5665-46bd-9bd6-2950d55f3a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:51.309803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-043199ee-5665-46bd-9bd6-2950d55f3a41 None None] MFA Rules not processed for user `fbb8ce5c15bd4a6199cfdf84c49837ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:51.311055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-043199ee-5665-46bd-9bd6-2950d55f3a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:51.401220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01124-793b-47e4-a5a0-15b4e44b4d4a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:51.426086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:51.433575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:51.434073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:51.434520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:51.456211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:51.460243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:51.481334 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1969/3935] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:51.498590 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1967/3936] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:53.252470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:53.265830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd4da-8b27-4918-bd0a-cfcf2afe08d3 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:53.280421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:53.281231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:53.281684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:53.282744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:53.293492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:53.295088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:53.335890 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1970/3937] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:25:58.648906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:58.649898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:58.650261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:58.670080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] MFA Rules not processed for user `fbb8ce5c15bd4a6199cfdf84c49837ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:25:58.671375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:58.678492 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1968/3938] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:25:59.732870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:25:59.734407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:59.800942 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:25:59.866895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ad35-e61e-47f6-b89d-54fea4ef3823 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:25:59.872635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:25:59.873768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:25:59.874396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:25:59.876320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:25:59.879169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:25:59.894748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:25:59.896718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:25:59.909565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1971/3939] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:07.834455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:07.841340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:07.925237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4a423-1603-45f1-9666-094b77b77d0e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:07.932205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc6ff6-eb37-4905-9771-798a3e79ca81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:07.933479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6ff6-eb37-4905-9771-798a3e79ca81 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:07.934142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6ff6-eb37-4905-9771-798a3e79ca81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:07.934702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6ff6-eb37-4905-9771-798a3e79ca81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:07.936953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5bdc6ff6-eb37-4905-9771-798a3e79ca81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:07.955909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc6ff6-eb37-4905-9771-798a3e79ca81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:07.955909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc6ff6-eb37-4905-9771-798a3e79ca81 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:07.963977 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1969/3940] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:08.847791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:08.849855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:08.938761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cad377-52ff-47ec-9588-59256d8ecf62 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:08.943562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:08.944494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:08.944849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:08.945192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] PATH_INFO: `/v3/users/83bcc52eeb144c078c7e0c23aadde1ec` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:08.946433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bcc52eeb144c078c7e0c23aadde1ec)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:08.948542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:09.186910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bcc52eeb144c078c7e0c23aadde1ec'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:09.198275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bcc52eeb144c078c7e0c23aadde1ec'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:09.200215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bcc52eeb144c078c7e0c23aadde1ec'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:09.333927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bcc52eeb144c078c7e0c23aadde1ec'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:09.334707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bcc52eeb144c078c7e0c23aadde1ec'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:09.375500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:09.375931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:09.376102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:09.376906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1972/3941] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:26:08 2022] DELETE /identity/v3/users/83bcc52eeb144c078c7e0c23aadde1ec => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:09.407693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:09.409555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:09.559189 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1970/3942] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:26:09.586782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:09.588564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:09.693962 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:09.742139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23002ae4-192d-4280-b1de-e84140f3969c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:09.754958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a120-8470-4f75-a934-f7bcd2a4f273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:09.755589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a120-8470-4f75-a934-f7bcd2a4f273 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:09.755865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a120-8470-4f75-a934-f7bcd2a4f273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:09.756649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a120-8470-4f75-a934-f7bcd2a4f273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:09.782099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a120-8470-4f75-a934-f7bcd2a4f273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:09.784124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a120-8470-4f75-a934-f7bcd2a4f273 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:09.799349 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1973/3943] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:10.261742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:10.263596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:10.288317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50bff-8861-45f7-970a-07545b6034f7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:10.310526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:10.310526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:10.310526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:10.310865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] PATH_INFO: `/v3/projects/34236cb9cfef40c8b12477b3a02b9a30` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:10.315896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34236cb9cfef40c8b12477b3a02b9a30)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:10.327880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:10.400196 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:10.533689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34236cb9cfef40c8b12477b3a02b9a30', 'request_id': 'req-e29ec93d-9c56-4faa-8582-0bacdd5c9101'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:10.551133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34236cb9cfef40c8b12477b3a02b9a30', 'request_id': 'req-e29ec93d-9c56-4faa-8582-0bacdd5c9101'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:10.662081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34236cb9cfef40c8b12477b3a02b9a30', 'request_id': 'req-e29ec93d-9c56-4faa-8582-0bacdd5c9101'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:10.690901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] The token cache is being invalidate because project 34236cb9cfef40c8b12477b3a02b9a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:26:10.692027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:10.692968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:10.696667 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1971/3944] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:10 2022] DELETE /identity/v3/projects/34236cb9cfef40c8b12477b3a02b9a30 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:10.701284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97db1e8-c121-4ac3-8159-f89f740df474 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:10.701851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97db1e8-c121-4ac3-8159-f89f740df474 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:10.701851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97db1e8-c121-4ac3-8159-f89f740df474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:10.742884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a97db1e8-c121-4ac3-8159-f89f740df474 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:10.744134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a97db1e8-c121-4ac3-8159-f89f740df474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:10.811458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:10.819393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:10.930411 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1974/3945] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:10.934542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5896d6-447e-404b-97b9-47a4862472be None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:10.934835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5896d6-447e-404b-97b9-47a4862472be None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:10.935112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5896d6-447e-404b-97b9-47a4862472be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:10.995215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4c5896d6-447e-404b-97b9-47a4862472be None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:10.996725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c5896d6-447e-404b-97b9-47a4862472be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:11.003660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec93d-9c56-4faa-8582-0bacdd5c9101 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:11.014494 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1975/3946] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:11.015957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5896d6-447e-404b-97b9-47a4862472be None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:11.025525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:11.026474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.027992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.028281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.029509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5896d6-447e-404b-97b9-47a4862472be None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:11.032139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:11.044429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:11.045168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.045545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.045916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.048192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:26:11.048192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:11.054653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:11.062901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:11.064536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:11.083329 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1976/3947] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:26:11.085570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:11.109747 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1972/3948] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:11.111774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a75e3-7b5b-4de7-a968-42cf8772f679 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:11.117089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:11.118033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.118309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.129262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.129262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:11.129262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:11.268858 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1977/3949] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:26:11.270998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:11.284911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2041792-7cd6-459f-ba46-7dc18653a0be service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:11.360605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:11.361617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.362039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.362418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.363577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:11.365681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:11.465913 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1973/3950] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:26:11 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:26:11.466958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:11.482828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f4b7-0956-400c-ad4a-b058fadc1183 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:11.494928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:11.500501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.500501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.500501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.500501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:11.501236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:11.516940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:11.525435 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1978/3951] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:26:11.537499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173427-a999-4b78-ade4-f8ec4eb7d628 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:11.543451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac6aa2-8fe6-4201-955e-1dc3d6930fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:11.544419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac6aa2-8fe6-4201-955e-1dc3d6930fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.544419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac6aa2-8fe6-4201-955e-1dc3d6930fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.544647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac6aa2-8fe6-4201-955e-1dc3d6930fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.545252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac6aa2-8fe6-4201-955e-1dc3d6930fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:11.548184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac6aa2-8fe6-4201-955e-1dc3d6930fa9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:11.565586 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1974/3952] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:26:11.571576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:11.607505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a4d1e-94b4-444d-9356-ea40b1bf2061 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:11.623509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:11.624308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.624812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.625099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] PATH_INFO: `/v3/projects/4ea696b063a34ca7ae58de5347066e5b/users/34afc843a85448489fd85ef5b40f22e2/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.656813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea696b063a34ca7ae58de5347066e5b, user_id=34afc843a85448489fd85ef5b40f22e2, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:11.661915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:11.760829 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1979/3953] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:26:11 2022] PUT /identity/v3/projects/4ea696b063a34ca7ae58de5347066e5b/users/34afc843a85448489fd85ef5b40f22e2/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:11.771904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:11.772247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:11.772470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:11.807472 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:11.812821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] MFA Rules not processed for user `34afc843a85448489fd85ef5b40f22e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:11.817163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:11.910163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1975/3954] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:11.955832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:11.957631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:12.075570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48e20-c335-4801-bd41-5390f26de78c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:12.081465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:12.082570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:12.083475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:12.083938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:12.100519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:12.102423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:12.128395 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1980/3955] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:13.778563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:13.780119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:13.850060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694348-9146-4d52-a646-0cdc4cc1d2c7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:13.857940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:13.858623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:13.858956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:13.859759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] PATH_INFO: `/v3/users/766d3b58a01d4cac95f90c788163aa21` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:13.860906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] RBAC: Authorizing `identity:delete_user(user_id=766d3b58a01d4cac95f90c788163aa21)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:13.862887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:14.146802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766d3b58a01d4cac95f90c788163aa21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.153710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766d3b58a01d4cac95f90c788163aa21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.154549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766d3b58a01d4cac95f90c788163aa21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.256296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766d3b58a01d4cac95f90c788163aa21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.256735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5f4547b9-e6cb-4369-84b6-8dc54ff3406e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766d3b58a01d4cac95f90c788163aa21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.283797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1976/3956] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:26:13 2022] DELETE /identity/v3/users/766d3b58a01d4cac95f90c788163aa21 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:14.593447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:14.600704 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:14.605467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa0c11-64d6-4ecd-9b80-e98af5ef8154 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:14.667652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:14.668253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:14.668578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:14.668852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] PATH_INFO: `/v3/projects/585f94966b4142ba964fe851e75a6808` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:14.669969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585f94966b4142ba964fe851e75a6808)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:14.671934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:14.783094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585f94966b4142ba964fe851e75a6808', 'request_id': 'req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.788829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585f94966b4142ba964fe851e75a6808', 'request_id': 'req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.865888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585f94966b4142ba964fe851e75a6808', 'request_id': 'req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.881690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] The token cache is being invalidate because project 585f94966b4142ba964fe851e75a6808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:26:14.881690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.882308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff0ff6a6-e672-4b8d-bbed-65c1e83a7460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:14.883803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1981/3957] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:14 2022] DELETE /identity/v3/projects/585f94966b4142ba964fe851e75a6808 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:14.888778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1fb7-0842-45b5-8aab-101e51450bdb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:14.890198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1fb7-0842-45b5-8aab-101e51450bdb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:14.890453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1fb7-0842-45b5-8aab-101e51450bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:14.920266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-96fe1fb7-0842-45b5-8aab-101e51450bdb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:14.922143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96fe1fb7-0842-45b5-8aab-101e51450bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:14.942161 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:14.993039 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1977/3958] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:15.002073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88280f-d49c-4c9d-93db-135d299d8bd6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.002375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88280f-d49c-4c9d-93db-135d299d8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.002641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88280f-d49c-4c9d-93db-135d299d8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.028758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1d88280f-d49c-4c9d-93db-135d299d8bd6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:15.029842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1d88280f-d49c-4c9d-93db-135d299d8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:15.043750 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1982/3959] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:15.044943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe1fb7-0842-45b5-8aab-101e51450bdb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:15.062055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe1fb7-0842-45b5-8aab-101e51450bdb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:15.073107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:15.078566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.079771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.081064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.084114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:26:15.084908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:15.097274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:15.125032 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1978/3960] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:26:15.128421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88280f-d49c-4c9d-93db-135d299d8bd6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:15.157548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88280f-d49c-4c9d-93db-135d299d8bd6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:15.166002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:15.167351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.167633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.168015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.168584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:15.170454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:15.292290 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1983/3961] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:26:15 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:26:15.296829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:15.310908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa122c9-ab16-4c0f-979c-cb5d542fd33e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:15.393416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:15.394069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.394353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.394630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.395292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:15.397442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:15.531023 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1979/3962] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:26:15 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:26:15.535631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:15.546559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e04e-2177-42e4-a14a-fb3888fdca28 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:15.551646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:15.552354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.552775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.553047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.553950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:15.555648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:15.571496 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1984/3963] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:26:15.575829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:15.591841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c5669-39ac-431e-b005-c12fba07a9f3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:15.604089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a96f-b981-467e-8c38-c5d7fd62fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:15.604821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a96f-b981-467e-8c38-c5d7fd62fc0c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.605172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a96f-b981-467e-8c38-c5d7fd62fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.605666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a96f-b981-467e-8c38-c5d7fd62fc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.606615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a96f-b981-467e-8c38-c5d7fd62fc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:15.608472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a96f-b981-467e-8c38-c5d7fd62fc0c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:15.631117 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1980/3964] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:26:15.634157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:15.653819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b75a1e-42d3-4f2b-8d28-9499c24c02b3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:15.670340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:15.672100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.672727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.673310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] PATH_INFO: `/v3/projects/bf35beeccb814ce490d2142b21c2b1c1/users/f86e186e88524064b8dca040c1814927/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.722900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf35beeccb814ce490d2142b21c2b1c1, user_id=f86e186e88524064b8dca040c1814927, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:15.722900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:15.813945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1985/3965] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:26:15 2022] PUT /identity/v3/projects/bf35beeccb814ce490d2142b21c2b1c1/users/f86e186e88524064b8dca040c1814927/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:26:15.827222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e25e7-814d-4663-b82f-f49be107e598 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:15.827497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e25e7-814d-4663-b82f-f49be107e598 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:15.827903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e25e7-814d-4663-b82f-f49be107e598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:15.892473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d27e25e7-814d-4663-b82f-f49be107e598 None None] MFA Rules not processed for user `f86e186e88524064b8dca040c1814927`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:15.893237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d27e25e7-814d-4663-b82f-f49be107e598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:15.970873 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1981/3966] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:15.993225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:15.995187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:16.051025 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:16.091443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78678de2-ac0c-4409-8190-0f685e4588f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:16.096402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:16.097071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:16.097486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:16.097766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:16.107213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:16.114201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:16.120063 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1986/3967] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:17.490918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76de1-7adf-4a8f-ab6d-eef3fe35265f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:17.491431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76de1-7adf-4a8f-ab6d-eef3fe35265f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:17.491659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76de1-7adf-4a8f-ab6d-eef3fe35265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:17.514729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2bf76de1-7adf-4a8f-ab6d-eef3fe35265f None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:17.514729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2bf76de1-7adf-4a8f-ab6d-eef3fe35265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:17.526085 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:17.574246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1982/3968] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:17.784892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:17.786904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:17.895392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f43db-428c-4dec-9b33-fac3c040d3ea service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:17.900528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:17.901134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:17.901412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:17.901679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:17.911145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:17.912763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:17.921275 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1987/3969] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:26:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:26:19.833796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e154e1-5c20-4106-af1a-d3f40e8251cb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:19.834448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e154e1-5c20-4106-af1a-d3f40e8251cb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:19.834448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e154e1-5c20-4106-af1a-d3f40e8251cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:19.855191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b9e154e1-5c20-4106-af1a-d3f40e8251cb None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:19.856829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b9e154e1-5c20-4106-af1a-d3f40e8251cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:19.866842 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1983/3970] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:19.880532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:19.894864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666741f-1113-407a-91f6-8b6063500cd2 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:19.901054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:19.901664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:19.902346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:19.903244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:19.914570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:19.918675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:19.923922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:19.925352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:19.926040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:19.945045 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1988/3971] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:26:19.959882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:19.961916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:19.976855 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1984/3972] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:19.991549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:20.008111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6841e-bbef-4df5-a8b2-1f309e747537 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:20.016735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eaa8e-31a0-4bb9-a5c6-b65b527db111 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:20.017545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eaa8e-31a0-4bb9-a5c6-b65b527db111 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:20.017993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eaa8e-31a0-4bb9-a5c6-b65b527db111 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:20.018403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eaa8e-31a0-4bb9-a5c6-b65b527db111 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:20.028173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eaa8e-31a0-4bb9-a5c6-b65b527db111 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:20.029998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19eaa8e-31a0-4bb9-a5c6-b65b527db111 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:20.039662 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1989/3973] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:26:20.683509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:20.685298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:20.786621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3ffc0-3358-493f-be0b-74be03bc01d0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:20.795942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:20.798903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:20.798903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:20.798903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] PATH_INFO: `/v3/users/34afc843a85448489fd85ef5b40f22e2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:20.798903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34afc843a85448489fd85ef5b40f22e2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:20.801105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:21.049075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34afc843a85448489fd85ef5b40f22e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:21.062868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34afc843a85448489fd85ef5b40f22e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:21.063968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34afc843a85448489fd85ef5b40f22e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:21.136032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34afc843a85448489fd85ef5b40f22e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:21.137127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34afc843a85448489fd85ef5b40f22e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:21.165820 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1985/3974] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:26:20 2022] DELETE /identity/v3/users/34afc843a85448489fd85ef5b40f22e2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:21.170323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:21.171254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:21.171934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:21.203039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:21.204801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:21.321338 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1990/3975] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:21.333427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:21.335256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:21.384356 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:21.417070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd7df-6d4e-4b5a-a6a8-391ae09ed936 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:21.422628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:21.423333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:21.423675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:21.424008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:21.437446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:21.439618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:21.474386 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1986/3976] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:21.863158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:21.864576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:21.899796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835b0f1-3327-4703-aeb6-616a2dfc4416 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:21.913837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:21.915077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:21.920506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:21.920506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] PATH_INFO: `/v3/projects/4ea696b063a34ca7ae58de5347066e5b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:21.920506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea696b063a34ca7ae58de5347066e5b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:21.920506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:22.035607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:22.037290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:22.066171 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:22.088767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea696b063a34ca7ae58de5347066e5b', 'request_id': 'req-fb5449ae-68a0-4569-81d1-828a0d32000a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:22.101029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea696b063a34ca7ae58de5347066e5b', 'request_id': 'req-fb5449ae-68a0-4569-81d1-828a0d32000a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:22.167161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736fde-4138-4b6c-9f3d-8caf3ab5d424 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:22.222041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea696b063a34ca7ae58de5347066e5b', 'request_id': 'req-fb5449ae-68a0-4569-81d1-828a0d32000a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:22.243962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] The token cache is being invalidate because project 4ea696b063a34ca7ae58de5347066e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:26:22.244759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:22.245691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fb5449ae-68a0-4569-81d1-828a0d32000a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:22.251041 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1991/3977] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:21 2022] DELETE /identity/v3/projects/4ea696b063a34ca7ae58de5347066e5b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:22.254259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7a20-fb39-47e3-bb9a-93068e30f150 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.254766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7a20-fb39-47e3-bb9a-93068e30f150 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.255230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d7a20-fb39-47e3-bb9a-93068e30f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.303079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0c2d7a20-fb39-47e3-bb9a-93068e30f150 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:22.305023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0c2d7a20-fb39-47e3-bb9a-93068e30f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:22.330436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:22.331203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.331569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.331841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.334007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:22.350457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:22.352226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:22.375943 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1992/3978] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:22.377018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1987/3979] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:22.390494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e0b9f-06d7-424d-8b9a-f6babb05dae6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.392150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e0b9f-06d7-424d-8b9a-f6babb05dae6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.392599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e0b9f-06d7-424d-8b9a-f6babb05dae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.395997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:22.399179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:22.439622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3e5e0b9f-06d7-424d-8b9a-f6babb05dae6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:22.444192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3e5e0b9f-06d7-424d-8b9a-f6babb05dae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:22.494322 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:22.516748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ee144-ae59-41a2-97d6-da92a6afc593 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:22.526057 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1993/3980] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:22.526277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:22.526277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.526277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.526619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.534240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1bcc-195a-4785-b77f-a43d51503af0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.537726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1bcc-195a-4785-b77f-a43d51503af0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.537726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1bcc-195a-4785-b77f-a43d51503af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.547230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:22.549208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:22.560033 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1988/3981] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:26:22.566220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cfab1bcc-195a-4785-b77f-a43d51503af0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:22.568657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cfab1bcc-195a-4785-b77f-a43d51503af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:22.581303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1994/3982] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:26:22.587057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:22.598197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539fc04-8c86-492a-87e7-64da0ad7c85d service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:22.603499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:22.604367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.605058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.605431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.606196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:26:22.606771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:22.608927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:22.625818 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1989/3983] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:26:22.627019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1bcc-195a-4785-b77f-a43d51503af0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:22.637474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1bcc-195a-4785-b77f-a43d51503af0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:22.642749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:22.643361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.643638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.643911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.644540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:22.646806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:22.754269 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1995/3984] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:26:22 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:26:22.756590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:22.772819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239700-7b56-40cd-aa47-c6856341f931 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:22.870228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:22.870885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:22.871268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:22.871365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:22.871974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:22.873900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:23.045824 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1990/3985] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:26:22 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:26:23.050503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:23.062018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a93d-7cf2-4545-9c28-32f204ff5c80 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:23.074568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:23.078800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:23.079614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:23.080109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:23.080847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:23.082735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:23.102882 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1996/3986] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:26:23.104067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:23.116335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac50c-e203-4e5f-a999-038b44a5c3f1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:23.121166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc5d9c-50d8-4f0c-a924-1c708b43ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:23.121718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5d9c-50d8-4f0c-a924-1c708b43ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:23.122065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5d9c-50d8-4f0c-a924-1c708b43ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:23.122321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5d9c-50d8-4f0c-a924-1c708b43ef71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:23.123045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc5d9c-50d8-4f0c-a924-1c708b43ef71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:23.126423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc5d9c-50d8-4f0c-a924-1c708b43ef71 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:23.141637 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1991/3987] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:26:23.143400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:23.157715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861abac-dacf-4510-a914-ad45c0181943 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:23.163111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:23.166417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:23.166417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:23.166417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] PATH_INFO: `/v3/projects/f19e03655c9f48ddaaa493fc6e53e59c/users/b02be00b23e94b89952baf839c5ea4b0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:23.181100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19e03655c9f48ddaaa493fc6e53e59c, user_id=b02be00b23e94b89952baf839c5ea4b0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:23.184051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:23.285093 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1997/3988] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:26:23 2022] PUT /identity/v3/projects/f19e03655c9f48ddaaa493fc6e53e59c/users/b02be00b23e94b89952baf839c5ea4b0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:23.288473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d10e4-088d-4480-afc0-d11b64317e6b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:23.290933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d10e4-088d-4480-afc0-d11b64317e6b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:23.290933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d10e4-088d-4480-afc0-d11b64317e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:23.328105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-684d10e4-088d-4480-afc0-d11b64317e6b None None] MFA Rules not processed for user `b02be00b23e94b89952baf839c5ea4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:23.329597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-684d10e4-088d-4480-afc0-d11b64317e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:23.442011 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1992/3989] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:23.450066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:23.450672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602347-761f-4948-a1f5-18ecbae79799 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:23.451013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602347-761f-4948-a1f5-18ecbae79799 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:23.451289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602347-761f-4948-a1f5-18ecbae79799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:23.452518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:23.459586 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:23.474602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3a602347-761f-4948-a1f5-18ecbae79799 None None] MFA Rules not processed for user `f86e186e88524064b8dca040c1814927`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:23.475907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3a602347-761f-4948-a1f5-18ecbae79799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:23.535626 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:23.556629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326331c-09fe-4fa2-a5fc-a81a72d4c2aa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:23.563304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d23282-4ae3-458d-ad8f-0075b1fe189f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:23.564028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d23282-4ae3-458d-ad8f-0075b1fe189f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:23.564306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d23282-4ae3-458d-ad8f-0075b1fe189f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:23.564580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d23282-4ae3-458d-ad8f-0075b1fe189f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:23.586165 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1993/3990] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:23.588620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d23282-4ae3-458d-ad8f-0075b1fe189f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:23.590124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d23282-4ae3-458d-ad8f-0075b1fe189f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:23.601510 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1998/3991] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:26:24.091696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11fa9-5d5b-41ba-9af4-9bade651e6d6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:24.092055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11fa9-5d5b-41ba-9af4-9bade651e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:24.092260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11fa9-5d5b-41ba-9af4-9bade651e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:24.116027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b5a11fa9-5d5b-41ba-9af4-9bade651e6d6 None None] MFA Rules not processed for user `f86e186e88524064b8dca040c1814927`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:24.117253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b5a11fa9-5d5b-41ba-9af4-9bade651e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:24.128578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1994/3992] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:33.603361 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=25 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:34.111999 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:37.443303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:37.443792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:37.444025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:37.466108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:37.467882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:37.543259 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 1999/3993] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:37.558253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11fa9-5d5b-41ba-9af4-9bade651e6d6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:37.699103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11fa9-5d5b-41ba-9af4-9bade651e6d6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:37.712208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:37.713253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:37.713528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:37.714004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:37.724910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:37.726524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:37.738164 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1995/3994] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:26:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:26:40.008052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:40.009486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:40.158660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552f6cb-eb29-4556-bd24-2c6bb79246b8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:40.164831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1355-88e8-49c8-aaf4-0a260c86541e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:40.165454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1355-88e8-49c8-aaf4-0a260c86541e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:40.165737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1355-88e8-49c8-aaf4-0a260c86541e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:40.166037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1355-88e8-49c8-aaf4-0a260c86541e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:40.167884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cb6c1355-88e8-49c8-aaf4-0a260c86541e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:40.182461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1355-88e8-49c8-aaf4-0a260c86541e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:40.184401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1355-88e8-49c8-aaf4-0a260c86541e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:40.196979 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2000/3995] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:42.142051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:42.221489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab5494-bd50-47c7-b427-306609648cf9 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:42.231880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:42.233232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:42.233591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:42.233964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] PATH_INFO: `/v3/users/b02be00b23e94b89952baf839c5ea4b0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:42.235226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02be00b23e94b89952baf839c5ea4b0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:42.237206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:42.522517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02be00b23e94b89952baf839c5ea4b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:42.531143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02be00b23e94b89952baf839c5ea4b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:42.532065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02be00b23e94b89952baf839c5ea4b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:42.653232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02be00b23e94b89952baf839c5ea4b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:42.655099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02be00b23e94b89952baf839c5ea4b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:42.690198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1996/3996] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:26:42 2022] DELETE /identity/v3/users/b02be00b23e94b89952baf839c5ea4b0 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:42.695449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:42.696970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:42.697203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:42.747252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:42.748586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:42.862744 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2001/3997] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:26:42.880881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:42.882350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:42.895036 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:42.951130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651fbe2-945d-430d-9ab1-5523968328c7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:42.956628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48b92e-1feb-437d-a6c6-553f464af055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:42.957258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b92e-1feb-437d-a6c6-553f464af055 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:42.957547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b92e-1feb-437d-a6c6-553f464af055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:42.957836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b92e-1feb-437d-a6c6-553f464af055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:42.968487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48b92e-1feb-437d-a6c6-553f464af055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:42.970194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48b92e-1feb-437d-a6c6-553f464af055 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:42.986693 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1997/3998] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:43.268132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:43.269656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:43.285650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8262c98-2807-4429-9e50-043755169bf8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:43.292921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:43.294264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:43.294610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:43.296255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] PATH_INFO: `/v3/projects/f19e03655c9f48ddaaa493fc6e53e59c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:43.298189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19e03655c9f48ddaaa493fc6e53e59c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:43.302732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:43.409401 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:43.446599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19e03655c9f48ddaaa493fc6e53e59c', 'request_id': 'req-6ac932be-7bc3-41d6-ade2-586af9b15def'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:43.454401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19e03655c9f48ddaaa493fc6e53e59c', 'request_id': 'req-6ac932be-7bc3-41d6-ade2-586af9b15def'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:43.569792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19e03655c9f48ddaaa493fc6e53e59c', 'request_id': 'req-6ac932be-7bc3-41d6-ade2-586af9b15def'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:43.582323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] The token cache is being invalidate because project f19e03655c9f48ddaaa493fc6e53e59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:26:43.582707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:43.583406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ac932be-7bc3-41d6-ade2-586af9b15def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:26:43.584965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2002/3999] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:26:43 2022] DELETE /identity/v3/projects/f19e03655c9f48ddaaa493fc6e53e59c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:43.589852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622459b-7d89-4710-b127-32457494cd31 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:43.597245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622459b-7d89-4710-b127-32457494cd31 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:43.597245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622459b-7d89-4710-b127-32457494cd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:43.610597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9622459b-7d89-4710-b127-32457494cd31 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:43.611806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9622459b-7d89-4710-b127-32457494cd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:43.679079 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1998/4000] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:26:43.686638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d879-4356-4ee9-8c14-dd91d5e0440b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:43.686919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d879-4356-4ee9-8c14-dd91d5e0440b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:43.687190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d879-4356-4ee9-8c14-dd91d5e0440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:43.707931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c755d879-4356-4ee9-8c14-dd91d5e0440b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:43.709134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c755d879-4356-4ee9-8c14-dd91d5e0440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:43.717814 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2003/4001] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:43.722104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622459b-7d89-4710-b127-32457494cd31 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:43.731956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622459b-7d89-4710-b127-32457494cd31 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:43.736923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:43.737562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:43.737862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:43.738190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:43.738840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:26:43.739168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:43.740843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:43.753755 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 1999/4002] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:26:43.758089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d879-4356-4ee9-8c14-dd91d5e0440b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:43.767893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d879-4356-4ee9-8c14-dd91d5e0440b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:43.772560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:43.773268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:43.773651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:43.774176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:43.774968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:43.777087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:43.915292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:43.918562 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2004/4003] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:26:43 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:26:43.935139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fddd4-1a9e-4a40-8090-a8479db93eaa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:44.086066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:44.087148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:44.087804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:44.088154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:44.088952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:44.090978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:44.221451 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2000/4004] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:26:43 2022] POST /identity/v3/users => generated 285 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:26:44.225603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:44.242394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482410c-bf55-451e-919a-9cd968bfbb35 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:44.253749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:44.254875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:44.254875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:44.255084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:44.255627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:44.257211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:44.285999 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2005/4005] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:26:44.287961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:44.303667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdde1ac-08be-41b5-b001-5df139c153d3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:44.308583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb8a5a-ea4a-4346-83a9-3ba01ca8f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:44.309158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8a5a-ea4a-4346-83a9-3ba01ca8f1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:44.309433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8a5a-ea4a-4346-83a9-3ba01ca8f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:44.309701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8a5a-ea4a-4346-83a9-3ba01ca8f1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:44.310382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb8a5a-ea4a-4346-83a9-3ba01ca8f1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:44.312316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb8a5a-ea4a-4346-83a9-3ba01ca8f1f6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:44.327055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2001/4006] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:26:44.333003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:44.347550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f966bd-5b36-4bc0-920c-b4d0a42969b6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:44.352505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:44.353201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:44.353481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:44.353758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] PATH_INFO: `/v3/projects/cf5d26c065ab4164a86e6f9b0ebf8d5e/users/41385299140b4a55acf024c3293eb4fb/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:44.369936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5d26c065ab4164a86e6f9b0ebf8d5e, user_id=41385299140b4a55acf024c3293eb4fb, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:44.373054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:44.509350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2006/4007] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:26:44 2022] PUT /identity/v3/projects/cf5d26c065ab4164a86e6f9b0ebf8d5e/users/41385299140b4a55acf024c3293eb4fb/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:26:44.511268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9058-0b1a-4d95-b572-3ad8f7cdb5b4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:44.511514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9058-0b1a-4d95-b572-3ad8f7cdb5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:44.511780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9058-0b1a-4d95-b572-3ad8f7cdb5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:44.543191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f2de9058-0b1a-4d95-b572-3ad8f7cdb5b4 None None] MFA Rules not processed for user `41385299140b4a55acf024c3293eb4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:44.544456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f2de9058-0b1a-4d95-b572-3ad8f7cdb5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:44.550291 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:44.653825 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2002/4008] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:44.671176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:44.672992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:44.766246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7078c-0ba5-4e01-b990-bc6ada2f6245 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:44.774876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1acd8-f7d9-4791-97b0-c2ed95c2a78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:44.775775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1acd8-f7d9-4791-97b0-c2ed95c2a78e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:44.776133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1acd8-f7d9-4791-97b0-c2ed95c2a78e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:44.776523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1acd8-f7d9-4791-97b0-c2ed95c2a78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:44.789527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1acd8-f7d9-4791-97b0-c2ed95c2a78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:44.791971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1acd8-f7d9-4791-97b0-c2ed95c2a78e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:44.801162 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2007/4009] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:26:49.670269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:49.670886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:49.670886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:49.699250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] MFA Rules not processed for user `4ba4975d23874879b779282e5b9cecb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:49.715237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:49.864455 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2003/4010] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:50.336820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:50.336820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:50.336820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:50.390751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:50.391960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:50.458894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:50.460773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:50.490660 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:26:50.496658 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2008/4011] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:26:50.516131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:50.518103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:50.519837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1fdc1-1ffe-4c30-ae36-38bfec54e2cd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:50.540089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78cbda-259d-4d97-86b8-1e1d3ec1b7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:50.540795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78cbda-259d-4d97-86b8-1e1d3ec1b7ed service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:50.541512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78cbda-259d-4d97-86b8-1e1d3ec1b7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:50.541808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78cbda-259d-4d97-86b8-1e1d3ec1b7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:50.547060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd78cbda-259d-4d97-86b8-1e1d3ec1b7ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:50.578350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78cbda-259d-4d97-86b8-1e1d3ec1b7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:50.580165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78cbda-259d-4d97-86b8-1e1d3ec1b7ed service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:50.591167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2004/4012] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:26:50.639966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854f4b0-8e2a-4a3e-8422-3b3f1f38cdc2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:50.666866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:50.667743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:50.668099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:50.668431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:50.695798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:50.697730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:50.729212 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2009/4013] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:26:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:26:55.567226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:55.567785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:55.567996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:55.612536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:26:55.614269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:26:55.633246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2005/4014] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:26:55.655251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:26:55.679286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb191-ecb3-4709-8d33-28f6d74da991 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:26:55.687589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7efd-6a8a-4bd3-84ea-246294c8f9c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:26:55.690610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7efd-6a8a-4bd3-84ea-246294c8f9c6 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:26:55.692520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7efd-6a8a-4bd3-84ea-246294c8f9c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:26:55.693010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7efd-6a8a-4bd3-84ea-246294c8f9c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:26:55.709954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e7efd-6a8a-4bd3-84ea-246294c8f9c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:26:55.714410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e7efd-6a8a-4bd3-84ea-246294c8f9c6 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:26:55.726773 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2010/4015] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:26:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:03.737492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:03.739597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:03.888506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d525cb-e6ec-4c8c-b489-e7d00f268e83 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:03.894836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:03.895865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:03.896388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:03.896899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:03.898966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:03.914552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:03.920176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:03.936231 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2006/4016] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:27:05.722338 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=39 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:11.156514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e436c3-f24c-42a2-858a-161f81330e0e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:11.156514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e436c3-f24c-42a2-858a-161f81330e0e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:11.156514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e436c3-f24c-42a2-858a-161f81330e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:11.156514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d0e436c3-f24c-42a2-858a-161f81330e0e None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:11.156514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d0e436c3-f24c-42a2-858a-161f81330e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:11.156514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2011/4017] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:27:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:11.157961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:11.157961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680bc8-25a5-4ce5-8da8-efb2ea861e97 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:11.157961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:11.157961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:11.158841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:11.158841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:11.158841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:11.158841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:11.159950 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:11.164023 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2007/4018] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:13.989020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:13.990063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:13.990604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:14.029241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:14.030499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:14.038925 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2012/4019] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:14.055144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:14.073716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd29f5-223e-4af3-b263-eab4e671e4c1 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:14.080881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:14.082208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:14.083134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:14.083665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:14.098152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:14.102221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:14.120477 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2008/4020] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:14.971932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:14.973409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:15.117924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cae5e-fc75-4d78-b2ba-9c8e32e808c9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:15.129510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c80aa-e405-4951-993c-dd1781b43e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:15.130573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c80aa-e405-4951-993c-dd1781b43e22 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:15.131114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c80aa-e405-4951-993c-dd1781b43e22 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:15.131629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c80aa-e405-4951-993c-dd1781b43e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:15.133789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-659c80aa-e405-4951-993c-dd1781b43e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:15.248934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c80aa-e405-4951-993c-dd1781b43e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:15.253228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c80aa-e405-4951-993c-dd1781b43e22 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:15.291428 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2013/4021] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:20.027313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:20.030629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:20.163706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204005a4-a189-4eca-9742-006f349aa9e1 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:20.172913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:20.176290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:20.176844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:20.177376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] PATH_INFO: `/v3/users/c1fb3cadf09d4d5da19e37b0080a0f26` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:20.179613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fb3cadf09d4d5da19e37b0080a0f26)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:20.183375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:20.812691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fb3cadf09d4d5da19e37b0080a0f26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:20.840243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fb3cadf09d4d5da19e37b0080a0f26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:20.843521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fb3cadf09d4d5da19e37b0080a0f26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:20.966489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fb3cadf09d4d5da19e37b0080a0f26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:20.967111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fb3cadf09d4d5da19e37b0080a0f26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:21.007382 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2009/4022] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:27:20 2022] DELETE /identity/v3/users/c1fb3cadf09d4d5da19e37b0080a0f26 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:27:21.012379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c1da8-cb5f-4bfc-9684-13b9066ebb7e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:21.020055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c1da8-cb5f-4bfc-9684-13b9066ebb7e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:21.020055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c1da8-cb5f-4bfc-9684-13b9066ebb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:21.059827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9b6c1da8-cb5f-4bfc-9684-13b9066ebb7e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:21.061644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9b6c1da8-cb5f-4bfc-9684-13b9066ebb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:21.216863 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2014/4023] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:21.245158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:21.249088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:21.385261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c080a1-530e-4513-bb7b-5c4195fa5931 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:21.402883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:21.404525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:21.405004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:21.407009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:21.452337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:21.456781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:21.514633 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2010/4024] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:22.041782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:22.042415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:22.042699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:22.132799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:22.137881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:22.171318 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:22.354875 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2015/4025] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:22.361506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:22.363683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:22.383321 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:22.632236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe643-2510-40c1-b722-1201285b695e service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:22.651604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83714f-7703-464d-ba24-9461182db17b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:22.652433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83714f-7703-464d-ba24-9461182db17b service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:22.652988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83714f-7703-464d-ba24-9461182db17b service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:22.653525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83714f-7703-464d-ba24-9461182db17b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:22.681817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83714f-7703-464d-ba24-9461182db17b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:22.684319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83714f-7703-464d-ba24-9461182db17b service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:22.706225 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2011/4026] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:27:23.119795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:23.121510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:23.147347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc0d76-1764-4c8a-8d9e-11291af3162a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:23.162270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:23.163143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:23.163485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:23.163827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] PATH_INFO: `/v3/projects/badf117bb5bf4e76b3bab3ef518dce11` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:23.169715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=badf117bb5bf4e76b3bab3ef518dce11)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:23.190254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:23.404202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badf117bb5bf4e76b3bab3ef518dce11', 'request_id': 'req-abfb73c1-08cd-4222-84ab-940d8b29a38b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:23.425900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badf117bb5bf4e76b3bab3ef518dce11', 'request_id': 'req-abfb73c1-08cd-4222-84ab-940d8b29a38b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:23.567443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badf117bb5bf4e76b3bab3ef518dce11', 'request_id': 'req-abfb73c1-08cd-4222-84ab-940d8b29a38b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:23.591388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] The token cache is being invalidate because project badf117bb5bf4e76b3bab3ef518dce11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:27:23.591796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:23.593475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-abfb73c1-08cd-4222-84ab-940d8b29a38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:23.598294 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2016/4027] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:23 2022] DELETE /identity/v3/projects/badf117bb5bf4e76b3bab3ef518dce11 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:23.604724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57681231-f684-49df-b695-6f8becb02ea9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:23.605270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57681231-f684-49df-b695-6f8becb02ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:23.605270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57681231-f684-49df-b695-6f8becb02ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:23.659341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-57681231-f684-49df-b695-6f8becb02ea9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:23.665566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57681231-f684-49df-b695-6f8becb02ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:23.832214 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2012/4028] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:23.841071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeae98b-943a-4feb-b687-1d43d83b14bc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:23.842656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeae98b-943a-4feb-b687-1d43d83b14bc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:23.843038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeae98b-943a-4feb-b687-1d43d83b14bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:23.916244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3aeae98b-943a-4feb-b687-1d43d83b14bc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:23.919426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3aeae98b-943a-4feb-b687-1d43d83b14bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:23.970440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57681231-f684-49df-b695-6f8becb02ea9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:23.997698 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2017/4029] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:24.012112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57681231-f684-49df-b695-6f8becb02ea9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:24.030304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:24.031265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:24.032066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:24.032513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:24.035846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:27:24.038180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:24.040027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:24.082388 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2013/4030] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:27:24.086571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeae98b-943a-4feb-b687-1d43d83b14bc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:24.097899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeae98b-943a-4feb-b687-1d43d83b14bc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:24.126397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:24.127754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:24.128244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:24.128689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:24.129513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:24.134688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:24.270791 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2018/4031] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:27:24 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:27:24.275243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:24.295682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a5d7-2091-424c-8b3b-3250bdfa6de5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:24.413161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:24.414051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:24.414514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:24.414965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:24.421714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:24.424804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:24.558283 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2014/4032] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:27:24 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:27:24.565379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:24.577158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b4ab6-aceb-4cb3-94e9-6978db539eb6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:24.591225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:24.592292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:24.595740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:24.596075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:24.596909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:24.601243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:24.634854 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2019/4033] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:27:24.639276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:24.656573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3bc9-c630-481c-8a04-3916a1bb51bb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:24.664762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337033e-b4e2-4c33-adb6-85c45c85fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:24.669553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337033e-b4e2-4c33-adb6-85c45c85fc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:24.670076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337033e-b4e2-4c33-adb6-85c45c85fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:24.670944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337033e-b4e2-4c33-adb6-85c45c85fc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:24.671823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337033e-b4e2-4c33-adb6-85c45c85fc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:24.673664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337033e-b4e2-4c33-adb6-85c45c85fc73 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:24.705019 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2015/4034] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:27:24.709337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:24.736302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a724b-702b-4d52-892c-016c3e7329d1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:24.746729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:24.747421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:24.753027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:24.753958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] PATH_INFO: `/v3/projects/2db2a6834ec144418eb2cf222302fdb2/users/a0a8950e247041d8be4fdfda5e2122fa/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:24.798346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db2a6834ec144418eb2cf222302fdb2, user_id=a0a8950e247041d8be4fdfda5e2122fa, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:24.802578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:24.936164 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2020/4035] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:27:24 2022] PUT /identity/v3/projects/2db2a6834ec144418eb2cf222302fdb2/users/a0a8950e247041d8be4fdfda5e2122fa/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:24.946881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f704-814f-48e1-af95-b7befeece064 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:24.947164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f704-814f-48e1-af95-b7befeece064 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:24.947467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f704-814f-48e1-af95-b7befeece064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:24.959618 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:24.979127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d260f704-814f-48e1-af95-b7befeece064 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:24.980518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d260f704-814f-48e1-af95-b7befeece064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:25.192878 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2016/4036] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:25.217950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:25.222909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:25.356520 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:25.399366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab915db-cf5f-4499-9a6e-8f678c7a09fa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:25.414730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:25.416837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:25.417131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:25.417411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:25.455535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:25.458523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:25.500943 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2021/4037] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:25.560199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260f704-814f-48e1-af95-b7befeece064 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:25.562483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d260f704-814f-48e1-af95-b7befeece064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:25.807649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260f704-814f-48e1-af95-b7befeece064 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:25.837903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:25.838578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:25.838867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:25.840330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:25.851286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:26.040101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:26.042257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:26.081611 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2017/4038] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:32.632438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:32.652113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828d8c-4d2f-4f06-ab4b-160d68f0fed9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:32.666626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:32.671755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:32.677109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:32.678522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:32.694822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:32.731710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:32.740840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:32.794078 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2022/4039] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:36.055855 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:42.758350 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=14 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:43.895777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:43.897311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:43.923558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1912b9-cbee-4c82-8c59-5970b1f41b1c service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:43.941242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:43.943124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:43.943615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:43.946688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] PATH_INFO: `/v3/users/fbb8ce5c15bd4a6199cfdf84c49837ef` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:43.950157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb8ce5c15bd4a6199cfdf84c49837ef)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:43.952970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:44.174209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb8ce5c15bd4a6199cfdf84c49837ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:44.233612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb8ce5c15bd4a6199cfdf84c49837ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:44.237290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb8ce5c15bd4a6199cfdf84c49837ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:44.351403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb8ce5c15bd4a6199cfdf84c49837ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:44.352132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1edf996-4d78-46d4-a603-af2be342d08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb8ce5c15bd4a6199cfdf84c49837ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:44.421219 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2018/4040] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:27:43 2022] DELETE /identity/v3/users/fbb8ce5c15bd4a6199cfdf84c49837ef => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:46.021220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:46.036817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957834d2-c6c4-44a5-8a2d-b08605679fb5 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:46.301497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:46.307326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:46.307859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:46.308366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] PATH_INFO: `/v3/projects/a3bb23cbc0c142a2a4b7a39df99a7d4a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:46.309942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3bb23cbc0c142a2a4b7a39df99a7d4a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:46.312198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:46.524047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'request_id': 'req-6600a13b-4e8d-4605-b32d-029d492a659a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:46.537054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'request_id': 'req-6600a13b-4e8d-4605-b32d-029d492a659a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:46.631000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3bb23cbc0c142a2a4b7a39df99a7d4a', 'request_id': 'req-6600a13b-4e8d-4605-b32d-029d492a659a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:46.655391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] The token cache is being invalidate because project a3bb23cbc0c142a2a4b7a39df99a7d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:27:46.656077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:46.657059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6600a13b-4e8d-4605-b32d-029d492a659a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:46.659120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2023/4041] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:46 2022] DELETE /identity/v3/projects/a3bb23cbc0c142a2a4b7a39df99a7d4a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:46.665495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7d08-2547-40d8-a552-138a848193ff None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:46.885175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7d08-2547-40d8-a552-138a848193ff None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:46.885175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee7d08-2547-40d8-a552-138a848193ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:46.885175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-efee7d08-2547-40d8-a552-138a848193ff None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:46.885175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-efee7d08-2547-40d8-a552-138a848193ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:46.885175 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2019/4042] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:46.885605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed3ce-e4ca-4438-b19b-22a9e90f1014 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:46.885605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed3ce-e4ca-4438-b19b-22a9e90f1014 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:46.885605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed3ce-e4ca-4438-b19b-22a9e90f1014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:46.885605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-976ed3ce-e4ca-4438-b19b-22a9e90f1014 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:46.885605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-976ed3ce-e4ca-4438-b19b-22a9e90f1014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:46.885605 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2024/4043] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:46.885950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee7d08-2547-40d8-a552-138a848193ff None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:46.885950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee7d08-2547-40d8-a552-138a848193ff None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:46.885950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:46.885950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:46.886489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:46.886489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:46.886489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:27:46.886489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:46.889911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:46.931264 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2020/4044] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:27:46.937058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ed3ce-e4ca-4438-b19b-22a9e90f1014 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:46.988480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ed3ce-e4ca-4438-b19b-22a9e90f1014 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:47.002818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:47.005782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:47.006098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:47.006369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:47.007020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:47.011613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:47.147467 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2025/4045] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:27:46 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:27:47.150608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:47.163332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fa9b2-551f-4b89-ab3a-329c50ec2833 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:47.408126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:47.408926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:47.409353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:47.409696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:47.410512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:47.413009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:47.427339 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:47.515399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2021/4046] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:27:47 2022] POST /identity/v3/users => generated 291 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:27:47.538033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:47.555134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2a3b-ec2f-4808-a56e-9612196d1b7c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:47.563552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:47.564434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:47.564874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:47.565254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:47.566123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:47.590848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:47.611250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:47.611973 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2026/4047] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:27:47.622412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4f0f5-2e0d-4b01-ac1e-40ea67a432b7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:47.628510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef3b06-8255-4f77-9a72-8f57e8db145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:47.629201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3b06-8255-4f77-9a72-8f57e8db145b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:47.629630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3b06-8255-4f77-9a72-8f57e8db145b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:47.643447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3b06-8255-4f77-9a72-8f57e8db145b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:47.643447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef3b06-8255-4f77-9a72-8f57e8db145b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:47.643447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef3b06-8255-4f77-9a72-8f57e8db145b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:47.669176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:47.670486 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2022/4048] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:27:47.682410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e736-98ca-4820-bd3c-b19c5ee2e21c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:47.709124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:47.709124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:47.709434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:47.709660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] PATH_INFO: `/v3/projects/bddcdc2e1f98450e8b7a6fbbe5a08b7c/users/05ceb97b88e9411abd0d5882bf05027a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:47.728368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddcdc2e1f98450e8b7a6fbbe5a08b7c, user_id=05ceb97b88e9411abd0d5882bf05027a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:47.731829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:48.410511 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2027/4049] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:27:47 2022] PUT /identity/v3/projects/bddcdc2e1f98450e8b7a6fbbe5a08b7c/users/05ceb97b88e9411abd0d5882bf05027a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:48.415400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:48.415836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:48.416208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:48.447644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:48.450473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:48.538673 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2023/4050] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:48.554531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:48.557018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:48.599012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:48.599012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:48.623443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3601f-ee60-4106-8197-5c42ce6bb5c6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:48.634980 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:48.637308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:48.638008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:48.638279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:48.642181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] PATH_INFO: `/v3/users/19bff9f7a4254110b3b89f0cba5d252f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:48.650267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19bff9f7a4254110b3b89f0cba5d252f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:48.650799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:48.711625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817f47-4d29-4acc-9b8d-8bc18ee1cce6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:48.718315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:48.719346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:48.719745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:48.720114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:48.736651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:48.752170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:48.781025 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2028/4051] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:27:48.990457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19bff9f7a4254110b3b89f0cba5d252f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:49.006042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19bff9f7a4254110b3b89f0cba5d252f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:49.010297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19bff9f7a4254110b3b89f0cba5d252f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:49.133830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19bff9f7a4254110b3b89f0cba5d252f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:49.134918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13e17e3e-c09c-4808-af8d-7d5c955c465e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19bff9f7a4254110b3b89f0cba5d252f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:49.172797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2024/4052] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:27:48 2022] DELETE /identity/v3/users/19bff9f7a4254110b3b89f0cba5d252f => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:49.896560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:49.910747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38a6e9-4967-4d29-aeaa-316648d91c8a service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:49.952516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:49.953152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:49.953611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:49.995481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] MFA Rules not processed for user `a0a8950e247041d8be4fdfda5e2122fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:49.997607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:50.058136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:50.058863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:50.059137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:50.059406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] PATH_INFO: `/v3/projects/4c25b4509ad7457bad4a2e5e0bc59add` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:50.060110 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:50.061756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c25b4509ad7457bad4a2e5e0bc59add)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:50.063901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:50.115537 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2025/4053] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:27:50.131133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:50.136214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:50.228073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c25b4509ad7457bad4a2e5e0bc59add', 'request_id': 'req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:50.247546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c25b4509ad7457bad4a2e5e0bc59add', 'request_id': 'req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:50.293002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa20680-c887-4305-a7f8-6f12813259d4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:50.376938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c25b4509ad7457bad4a2e5e0bc59add', 'request_id': 'req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:50.395119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] The token cache is being invalidate because project 4c25b4509ad7457bad4a2e5e0bc59add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:27:50.396248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:50.397649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-604dec92-7ed5-4dd6-b42a-ce68c0bb3f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:27:50.403982 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2029/4054] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:27:49 2022] DELETE /identity/v3/projects/4c25b4509ad7457bad4a2e5e0bc59add => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:50.405754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080e37d-7452-447e-867b-a11fd672ef6b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:50.406070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080e37d-7452-447e-867b-a11fd672ef6b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:50.406454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080e37d-7452-447e-867b-a11fd672ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:50.413533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:50.414189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:50.414466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:50.414739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:50.421628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:50.448600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e080e37d-7452-447e-867b-a11fd672ef6b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:50.452435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e080e37d-7452-447e-867b-a11fd672ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:50.595803 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:50.614388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:50.623216 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2030/4055] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:27:50.625331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:50.626148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4467d-8ade-4064-bc70-d53bbf51b3fe None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:50.626456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4467d-8ade-4064-bc70-d53bbf51b3fe None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:50.626889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4467d-8ade-4064-bc70-d53bbf51b3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:50.639732 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2026/4056] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:27:50.670948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a4e4467d-8ade-4064-bc70-d53bbf51b3fe None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:50.672187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a4e4467d-8ade-4064-bc70-d53bbf51b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:50.695285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2031/4057] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:50.701083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:50.717723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0539-a168-4ee3-93a3-149ec55ab57c service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:50.724867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:50.725674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:50.726109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:50.727034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:50.727794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:27:50.728214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:50.731309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:50.754000 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2027/4058] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:27:50.754918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4467d-8ade-4064-bc70-d53bbf51b3fe None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:50.766083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4467d-8ade-4064-bc70-d53bbf51b3fe None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:50.778739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:50.779421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:50.779706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:50.779980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:50.780617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:50.785177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:50.931300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:50.931513 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2032/4059] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:27:50 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:27:50.945369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99561a0-6b9e-4544-8391-f7dbaf037210 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:51.096381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:51.096381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:51.096952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:51.097039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:51.097690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:51.099734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:51.218853 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2028/4060] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:27:50 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:27:51.223305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:51.239131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf2b34-5135-478d-93cb-364fe0b57e86 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:51.250339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:51.250997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:51.252449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:51.252754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:51.253422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:51.257567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:51.272394 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2033/4061] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:27:51.276491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:51.289107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6d9bb-d165-4dae-b81c-5d44f5ebf415 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:51.312307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303cfb1-0c28-4334-8c88-941c9c2aba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:51.312942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303cfb1-0c28-4334-8c88-941c9c2aba0c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:51.313223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303cfb1-0c28-4334-8c88-941c9c2aba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:51.313498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303cfb1-0c28-4334-8c88-941c9c2aba0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:51.314208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303cfb1-0c28-4334-8c88-941c9c2aba0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:51.316202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303cfb1-0c28-4334-8c88-941c9c2aba0c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:51.350437 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2029/4062] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:27:51.351901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:51.376433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6501a2-7999-4005-b630-b8171c11ff9f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:51.390711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fae52-3149-415e-ad57-ada7e26f7695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:51.391408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fae52-3149-415e-ad57-ada7e26f7695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:51.391699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fae52-3149-415e-ad57-ada7e26f7695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:51.391980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fae52-3149-415e-ad57-ada7e26f7695 admin admin] PATH_INFO: `/v3/projects/f0e82c5d57e54c3ba4d310bcb96b4e2a/users/9945803bd26745a8b3ccb508f7cd2a38/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:51.423955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fae52-3149-415e-ad57-ada7e26f7695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e82c5d57e54c3ba4d310bcb96b4e2a, user_id=9945803bd26745a8b3ccb508f7cd2a38, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:51.426734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fae52-3149-415e-ad57-ada7e26f7695 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:51.628772 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2034/4063] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:27:51 2022] PUT /identity/v3/projects/f0e82c5d57e54c3ba4d310bcb96b4e2a/users/9945803bd26745a8b3ccb508f7cd2a38/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:27:51.639208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:51.639502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:51.639773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:51.704373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] MFA Rules not processed for user `9945803bd26745a8b3ccb508f7cd2a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:51.706348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:51.852035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2030/4064] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:51.866038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:51.866377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:51.866702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:51.911362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] MFA Rules not processed for user `9945803bd26745a8b3ccb508f7cd2a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:51.912936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:51.920056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:51.921563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:51.957819 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2035/4065] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:52.095220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7250-3021-4b32-aec1-bc92c3a46bac None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:52.136196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:52.136853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:52.137138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:52.137461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:52.145821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:52.180970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:52.185595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:52.216749 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2031/4066] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:52.442705 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:52.754548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:52.756077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:53.005025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44e09d-7f7b-4ab5-b335-f08e8755136d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:53.017277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:53.018501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:53.018911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:53.019557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:53.061497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:53.064492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:53.092645 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2036/4067] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:53.132383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:53.134198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:53.231914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54eaaf-503f-481c-9872-1ec8b6a4917f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:53.240610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279add31-dabf-4ec9-af1d-4238f72fbb9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:53.241699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279add31-dabf-4ec9-af1d-4238f72fbb9b service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:53.242250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279add31-dabf-4ec9-af1d-4238f72fbb9b service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:53.242986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279add31-dabf-4ec9-af1d-4238f72fbb9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:53.248511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-279add31-dabf-4ec9-af1d-4238f72fbb9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:53.298125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279add31-dabf-4ec9-af1d-4238f72fbb9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:53.299902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279add31-dabf-4ec9-af1d-4238f72fbb9b service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:53.335177 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2032/4068] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:53.449111 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:53.914832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:53.931615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e46a-6c51-430a-beb0-14c83aa90b5a service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:53.940832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:53.942393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:53.942973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:53.943553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:53.946398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:53.988744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:54.007404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:54.027762 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2037/4069] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:54.101186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:54.101543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:54.101917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:54.162688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:54.174685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] MFA Rules not processed for user `9945803bd26745a8b3ccb508f7cd2a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:54.180257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:54.185098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307fa47-a81d-4caf-94ab-3b6ea4181964 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:54.199352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5139c11-3881-4213-a218-3fcf18974fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:54.200122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139c11-3881-4213-a218-3fcf18974fc5 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:54.200649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139c11-3881-4213-a218-3fcf18974fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:54.202150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139c11-3881-4213-a218-3fcf18974fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:54.210092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e5139c11-3881-4213-a218-3fcf18974fc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:54.216951 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2033/4070] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:54.378940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5139c11-3881-4213-a218-3fcf18974fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:54.380083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5139c11-3881-4213-a218-3fcf18974fc5 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:54.393958 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:27:54.406441 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2038/4071] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:55.215856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:55.219613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:55.247000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94d35-14fb-4d2a-b479-2f6fa8af7d00 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:55.274375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:55.274375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:55.290986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:55.291951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:55.301134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:55.362592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:55.364055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:55.410644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2034/4072] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:27:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:27:58.766729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3543-1745-4235-b6ea-67ec43b3f7d1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:58.767250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3543-1745-4235-b6ea-67ec43b3f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:58.767250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3543-1745-4235-b6ea-67ec43b3f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:58.819228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0f3c3543-1745-4235-b6ea-67ec43b3f7d1 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:58.821050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0f3c3543-1745-4235-b6ea-67ec43b3f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:58.976571 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2039/4073] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:27:58.991595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:27:58.993816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:59.155759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96e73-7e10-4feb-8c7c-bbcf725e1a3c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:27:59.169886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727340-57de-49ea-9a92-58da40e1dede service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:27:59.170954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727340-57de-49ea-9a92-58da40e1dede service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:59.171485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727340-57de-49ea-9a92-58da40e1dede service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:59.171952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727340-57de-49ea-9a92-58da40e1dede service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:59.192959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727340-57de-49ea-9a92-58da40e1dede service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:27:59.194832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727340-57de-49ea-9a92-58da40e1dede service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:27:59.228338 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2035/4074] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:27:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:27:59.703814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe0d8-2a4e-41ed-b5bf-e158f0a9e564 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:27:59.704104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe0d8-2a4e-41ed-b5bf-e158f0a9e564 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:27:59.704422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe0d8-2a4e-41ed-b5bf-e158f0a9e564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:27:59.730555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e74fe0d8-2a4e-41ed-b5bf-e158f0a9e564 None None] MFA Rules not processed for user `a0a8950e247041d8be4fdfda5e2122fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:27:59.732017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e74fe0d8-2a4e-41ed-b5bf-e158f0a9e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:27:59.946710 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2040/4075] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:01.631852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b25d1-c367-4e69-9da6-85d10541c3cb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:01.632798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b25d1-c367-4e69-9da6-85d10541c3cb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:01.633276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b25d1-c367-4e69-9da6-85d10541c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:01.729596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-542b25d1-c367-4e69-9da6-85d10541c3cb None None] MFA Rules not processed for user `05ceb97b88e9411abd0d5882bf05027a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:01.731035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-542b25d1-c367-4e69-9da6-85d10541c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:01.969607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:01.970498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:01.970937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:01.971100 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2036/4076] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:02.009258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] MFA Rules not processed for user `05ceb97b88e9411abd0d5882bf05027a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:02.011012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:02.032509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2041/4077] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:02.119608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b25d1-c367-4e69-9da6-85d10541c3cb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:02.149273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b25d1-c367-4e69-9da6-85d10541c3cb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:02.166656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86db41d-aa4c-4b46-b226-f1174eb48fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:02.167598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db41d-aa4c-4b46-b226-f1174eb48fa2 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:02.169185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db41d-aa4c-4b46-b226-f1174eb48fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:02.183051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db41d-aa4c-4b46-b226-f1174eb48fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:02.211034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86db41d-aa4c-4b46-b226-f1174eb48fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:02.214773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86db41d-aa4c-4b46-b226-f1174eb48fa2 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:02.237381 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2037/4078] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:28:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:28:05.207756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:05.209929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:05.338535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138f5a-6c69-4ee0-91e8-83c8da177db4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:05.350072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:05.352622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:05.354451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:05.355184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] PATH_INFO: `/v3/users/41385299140b4a55acf024c3293eb4fb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:05.357048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41385299140b4a55acf024c3293eb4fb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:05.360014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:05.646150 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:05.649607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41385299140b4a55acf024c3293eb4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:05.674690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41385299140b4a55acf024c3293eb4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:05.677033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41385299140b4a55acf024c3293eb4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:05.770602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41385299140b4a55acf024c3293eb4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:05.771536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41385299140b4a55acf024c3293eb4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:05.823895 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2042/4079] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:28:05 2022] DELETE /identity/v3/users/41385299140b4a55acf024c3293eb4fb => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:28:05.829151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:05.829659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:05.829827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:05.843171 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:05.903708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:05.904972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:06.119432 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2038/4080] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:06.132387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:06.137271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:06.276341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f31624-0a78-4c87-af10-4c123e17c8d0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:06.286029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301207c-496a-473f-94a2-e8850a7b711f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:06.287028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301207c-496a-473f-94a2-e8850a7b711f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:06.292315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301207c-496a-473f-94a2-e8850a7b711f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:06.292791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301207c-496a-473f-94a2-e8850a7b711f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:06.320786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301207c-496a-473f-94a2-e8850a7b711f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:06.321103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301207c-496a-473f-94a2-e8850a7b711f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:06.367671 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2043/4081] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:28:06.765268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:06.767420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:06.796638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4591fa-30c3-4405-ae0a-2113a21b80b5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:06.816892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:06.822954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:06.822954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:06.822954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] PATH_INFO: `/v3/projects/cf5d26c065ab4164a86e6f9b0ebf8d5e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:06.822954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5d26c065ab4164a86e6f9b0ebf8d5e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:06.825294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:07.029937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5d26c065ab4164a86e6f9b0ebf8d5e', 'request_id': 'req-014a53a1-2319-4bf6-8585-38abe21d293b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:07.046741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5d26c065ab4164a86e6f9b0ebf8d5e', 'request_id': 'req-014a53a1-2319-4bf6-8585-38abe21d293b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:07.127067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5d26c065ab4164a86e6f9b0ebf8d5e', 'request_id': 'req-014a53a1-2319-4bf6-8585-38abe21d293b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:07.149884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] The token cache is being invalidate because project cf5d26c065ab4164a86e6f9b0ebf8d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:28:07.150491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:07.151846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-014a53a1-2319-4bf6-8585-38abe21d293b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:07.166167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2039/4082] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:06 2022] DELETE /identity/v3/projects/cf5d26c065ab4164a86e6f9b0ebf8d5e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:28:07.171150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635fb3-0d1e-4679-8b44-168ceff3832b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:07.171661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635fb3-0d1e-4679-8b44-168ceff3832b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:07.172177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635fb3-0d1e-4679-8b44-168ceff3832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:07.210087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-91635fb3-0d1e-4679-8b44-168ceff3832b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:07.211566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-91635fb3-0d1e-4679-8b44-168ceff3832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:07.494717 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2044/4083] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:07.496486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab728-e921-4294-922b-c9a317756d3c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:07.496776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab728-e921-4294-922b-c9a317756d3c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:07.497050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab728-e921-4294-922b-c9a317756d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:07.602887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3f9ab728-e921-4294-922b-c9a317756d3c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:07.605092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f9ab728-e921-4294-922b-c9a317756d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:07.631089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2040/4084] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:28:07.635158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91635fb3-0d1e-4679-8b44-168ceff3832b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:07.680509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91635fb3-0d1e-4679-8b44-168ceff3832b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:07.702881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:07.703680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:07.704042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:07.704359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:07.705315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:28:07.708278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:07.710468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:07.758649 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2045/4085] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:28:07.769777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab728-e921-4294-922b-c9a317756d3c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:07.791255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab728-e921-4294-922b-c9a317756d3c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:07.813781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:07.814447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:07.814724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:07.814995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:07.815630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:07.832855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:08.172878 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2041/4086] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:28:07 2022] POST /identity/v3/projects => generated 361 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:28:08.177371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:08.214349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476290c-33b5-4970-bccb-33838bad5c62 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:08.323858 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:08.344968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:08.345595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:08.346942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:08.347239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:08.347944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:08.355416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:08.540188 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2046/4087] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:28:08 2022] POST /identity/v3/users => generated 281 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:28:08.544703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:08.556702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1824460-9b87-4cc6-8570-50a74a7010ef admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:08.562175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:08.562791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:08.563064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:08.563331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:08.563975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:08.565796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:08.599044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2042/4088] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:28:08.603090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:08.620131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a990-40d3-4874-bb93-c3515910310b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:08.632235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4be630-0fe2-4987-8eda-977d4a08e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:08.633009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be630-0fe2-4987-8eda-977d4a08e1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:08.633341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be630-0fe2-4987-8eda-977d4a08e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:08.633680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be630-0fe2-4987-8eda-977d4a08e1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:08.634936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4be630-0fe2-4987-8eda-977d4a08e1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:08.638812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4be630-0fe2-4987-8eda-977d4a08e1ec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:08.673065 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2047/4089] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:28:08.674053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:08.690293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7eb4a-3c06-4805-a132-07c65a91f055 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:08.706840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:08.706840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:08.706840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:08.706840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] PATH_INFO: `/v3/projects/a1cdccdb04b14e379dae32f8ca190716/users/68b4f2b9134c46828a62028900645a21/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:08.748387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cdccdb04b14e379dae32f8ca190716, user_id=68b4f2b9134c46828a62028900645a21, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:08.751263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:08.900625 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2043/4090] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:28:08 2022] PUT /identity/v3/projects/a1cdccdb04b14e379dae32f8ca190716/users/68b4f2b9134c46828a62028900645a21/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:28:08.911298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:08.911444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:08.911895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:09.004776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] MFA Rules not processed for user `68b4f2b9134c46828a62028900645a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:09.016577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:09.378931 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2048/4091] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:09.460266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:09.464891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:09.588216 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:09.702569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d8779-2922-4300-974c-094daf3b6bb7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:09.715250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fea54-2a8a-40bc-a6c2-169c4a192bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:09.716260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fea54-2a8a-40bc-a6c2-169c4a192bbd service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:09.716752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fea54-2a8a-40bc-a6c2-169c4a192bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:09.717218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fea54-2a8a-40bc-a6c2-169c4a192bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:09.753062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fea54-2a8a-40bc-a6c2-169c4a192bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:09.755330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fea54-2a8a-40bc-a6c2-169c4a192bbd service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:09.790525 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2044/4092] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:28:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:28:19.813760 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:20.208000 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=16 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:20.459273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:20.460810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:20.690129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9613b5-9134-42bb-aed5-4daee7adba00 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:20.706867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:20.707518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:20.707842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:20.708060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:20.709931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:20.743983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:20.745587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:20.766434 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2049/4093] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:28:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:28:29.290829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3d0b-c43f-4590-bb47-e380344091d9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:29.299244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3d0b-c43f-4590-bb47-e380344091d9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:29.299244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3d0b-c43f-4590-bb47-e380344091d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:29.360047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9c4f3d0b-c43f-4590-bb47-e380344091d9 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:29.362156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c4f3d0b-c43f-4590-bb47-e380344091d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:29.577729 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2045/4094] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:29.599156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:29.599156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:29.817799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678779d6-6408-4d91-9c1d-a144cf5e9ef5 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:29.824555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:29.825198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:29.825476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:29.825942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:29.839122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:29.840950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:29.876231 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2050/4095] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:28:39.574722 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=38 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:39.856578 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:41.392969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe362579-4df8-4e6e-95cc-63f2bd7e9467 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:41.393594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe362579-4df8-4e6e-95cc-63f2bd7e9467 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:41.393594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe362579-4df8-4e6e-95cc-63f2bd7e9467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:41.482994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fe362579-4df8-4e6e-95cc-63f2bd7e9467 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:41.527393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe362579-4df8-4e6e-95cc-63f2bd7e9467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:41.589118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2046/4096] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:28:41.607237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:41.624514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b293bca-fc77-4c54-9b8d-a26acb290c2b service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:41.650344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:41.650982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:41.658477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:41.659007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:41.717716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:41.725771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:41.759789 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2051/4097] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:28:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:28:45.254248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:45.255025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:45.255025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:45.355099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:45.357314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:45.438572 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2047/4098] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:28:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:45.477224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:45.507393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dad0d-0382-4e07-b45d-6b27efce95fc service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:45.518480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:45.521153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:45.521844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:45.522563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:45.542445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:45.545623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:45.565190 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2052/4099] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:28:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:28:45.947997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:45.950384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:46.185528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ad44b-db29-4a1a-9e16-60f875136bb1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:46.206230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:46.206934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:46.207415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:46.208047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] PATH_INFO: `/v3/users/05ceb97b88e9411abd0d5882bf05027a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:46.210254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ceb97b88e9411abd0d5882bf05027a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:46.213072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:47.518513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ceb97b88e9411abd0d5882bf05027a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:47.561228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ceb97b88e9411abd0d5882bf05027a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:47.562089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ceb97b88e9411abd0d5882bf05027a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:47.718986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ceb97b88e9411abd0d5882bf05027a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:47.723794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ceb97b88e9411abd0d5882bf05027a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:47.786004 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2048/4100] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:28:45 2022] DELETE /identity/v3/users/05ceb97b88e9411abd0d5882bf05027a => generated 0 bytes in 1838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:28:47.920138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:47.921675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:47.940299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ee078-5963-4c19-a3a1-78b3e7bea60c service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:48.089399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03173f-6bb6-4cee-9b6e-0726063001c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:48.090622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03173f-6bb6-4cee-9b6e-0726063001c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:48.091055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03173f-6bb6-4cee-9b6e-0726063001c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:48.094562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03173f-6bb6-4cee-9b6e-0726063001c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:48.096740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2a03173f-6bb6-4cee-9b6e-0726063001c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:48.306163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03173f-6bb6-4cee-9b6e-0726063001c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:48.307634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03173f-6bb6-4cee-9b6e-0726063001c8 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:48.346163 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2053/4101] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:28:49.084319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:49.087639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:49.115134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34a725-25c5-4461-8d43-06ed9abb56a3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:49.138004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:49.138004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:49.138004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:49.138004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] PATH_INFO: `/v3/projects/bddcdc2e1f98450e8b7a6fbbe5a08b7c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:49.145672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=bddcdc2e1f98450e8b7a6fbbe5a08b7c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:49.148199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:49.381836 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:49.434302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'request_id': 'req-5705b8ff-4cbd-4b0a-8728-b474413876ac'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:49.459144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'request_id': 'req-5705b8ff-4cbd-4b0a-8728-b474413876ac'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:49.617376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bddcdc2e1f98450e8b7a6fbbe5a08b7c', 'request_id': 'req-5705b8ff-4cbd-4b0a-8728-b474413876ac'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:49.643507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] The token cache is being invalidate because project bddcdc2e1f98450e8b7a6fbbe5a08b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:28:49.644080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:49.645680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5705b8ff-4cbd-4b0a-8728-b474413876ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:49.649746 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2049/4102] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:28:49 2022] DELETE /identity/v3/projects/bddcdc2e1f98450e8b7a6fbbe5a08b7c => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:28:49.654153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f3df-0234-411f-861a-51a49c19471c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:49.654153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f3df-0234-411f-861a-51a49c19471c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:49.654724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f3df-0234-411f-861a-51a49c19471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:49.787998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c6e8f3df-0234-411f-861a-51a49c19471c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:49.792988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c6e8f3df-0234-411f-861a-51a49c19471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:49.889421 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:49.902438 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2054/4103] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:49.911134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b4d4-d3fc-449f-8c69-0376e90e21b0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:49.911414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b4d4-d3fc-449f-8c69-0376e90e21b0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:49.911851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b4d4-d3fc-449f-8c69-0376e90e21b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:49.933208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-05e7b4d4-d3fc-449f-8c69-0376e90e21b0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:49.934751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-05e7b4d4-d3fc-449f-8c69-0376e90e21b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:49.944200 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2050/4104] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:28:49.949604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8f3df-0234-411f-861a-51a49c19471c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:49.963661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8f3df-0234-411f-861a-51a49c19471c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:49.969091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:49.969948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:49.970465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:49.970940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:49.971790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:28:49.972299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:49.984209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:49.995560 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2055/4105] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:28:49.999571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7b4d4-d3fc-449f-8c69-0376e90e21b0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:50.011543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7b4d4-d3fc-449f-8c69-0376e90e21b0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:50.020545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4408-781e-4ad9-9f4d-34fedd57dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:50.021260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4408-781e-4ad9-9f4d-34fedd57dabf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.021828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4408-781e-4ad9-9f4d-34fedd57dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.022231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4408-781e-4ad9-9f4d-34fedd57dabf admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.023534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b4408-781e-4ad9-9f4d-34fedd57dabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:50.026089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b4408-781e-4ad9-9f4d-34fedd57dabf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:50.230494 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2051/4106] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:28:49 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:28:50.234449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:50.245504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2df56-8810-4fa0-b038-d3246b197a6b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:50.313201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.314013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.314317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.318889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:50.320326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.320696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.321071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.321931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:50.324034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:50.349081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:50.349081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:50.461616 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2052/4107] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:28:50.462873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:50.464445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:50.565096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2056/4108] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:28:50 2022] POST /identity/v3/users => generated 286 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:28:50.566109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:50.590901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c09609-eb61-4963-a927-edc5789a602f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:50.599309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:50.600100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.600511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.600815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.602418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:50.606636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:50.633112 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2057/4109] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:28:50.637257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:50.649707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014026-7674-4582-8660-abf9e8cf2cba admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:50.651708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc11fb-4464-4fa2-bb04-7043836c89d8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:50.655388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:50.656011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.656286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.656556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.657339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:50.658970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:50.664839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a754ee-c9b9-4290-af3b-7761a4749e08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:50.665620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a754ee-c9b9-4290-af3b-7761a4749e08 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.665903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a754ee-c9b9-4290-af3b-7761a4749e08 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.666248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a754ee-c9b9-4290-af3b-7761a4749e08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.678364 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2058/4110] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:28:50.682775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:50.690330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a754ee-c9b9-4290-af3b-7761a4749e08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:50.695839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a754ee-c9b9-4290-af3b-7761a4749e08 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:50.703656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a54a1-9375-4c52-9cd7-a2b7a3d1bf7b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:50.704423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:50.705868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.706485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.707820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] PATH_INFO: `/v3/projects/064a14adc24641ddbde56bfe3b7f3e0f/users/51d8e34a549c44318a3d328fb2014d20/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.718832 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2053/4111] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:28:50.750596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064a14adc24641ddbde56bfe3b7f3e0f, user_id=51d8e34a549c44318a3d328fb2014d20, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:50.753628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:50.842057 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2059/4112] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:28:50 2022] PUT /identity/v3/projects/064a14adc24641ddbde56bfe3b7f3e0f/users/51d8e34a549c44318a3d328fb2014d20/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:28:50.845034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:50.845569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:50.846233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:50.869237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:28:50.870591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:51.011721 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2054/4113] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:28:51.023332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:51.025444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:51.165810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe074c-41be-41aa-a145-66e948e18584 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:51.171145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665526-edce-48c3-b5d4-b67453e74082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:51.171943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665526-edce-48c3-b5d4-b67453e74082 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:51.172218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665526-edce-48c3-b5d4-b67453e74082 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:51.172654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665526-edce-48c3-b5d4-b67453e74082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:51.185536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665526-edce-48c3-b5d4-b67453e74082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:51.187122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665526-edce-48c3-b5d4-b67453e74082 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:51.204711 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2060/4114] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:28:52.126678 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:28:59.401856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:28:59.404669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:28:59.444509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8d5ac-c537-444c-9cc9-dff8683f0161 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:28:59.467929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:28:59.467929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:28:59.467929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:28:59.470201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] PATH_INFO: `/v3/users/9945803bd26745a8b3ccb508f7cd2a38` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:28:59.476172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9945803bd26745a8b3ccb508f7cd2a38)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:28:59.481483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:28:59.914767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9945803bd26745a8b3ccb508f7cd2a38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:59.942396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9945803bd26745a8b3ccb508f7cd2a38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:28:59.945068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9945803bd26745a8b3ccb508f7cd2a38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:00.042473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9945803bd26745a8b3ccb508f7cd2a38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:00.048418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9945803bd26745a8b3ccb508f7cd2a38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:00.088590 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2055/4115] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:28:59 2022] DELETE /identity/v3/users/9945803bd26745a8b3ccb508f7cd2a38 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:00.090254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:00.091083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:00.091535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:00.155674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:00.165618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:00.290574 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:00.449728 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2061/4116] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:00.462083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:00.464279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:00.602041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f749-b5e2-4478-b0a6-62ddadac7d08 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:00.607844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:00.609930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:00.611008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:00.611711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:00.628235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:00.632278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:00.655956 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2056/4117] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:02.702227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:02.704415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:02.726394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962b5e1-1a76-4758-b887-ef9d8ee3ac06 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:02.758693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:02.759437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:02.761117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:02.761407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] PATH_INFO: `/v3/users/69bd8aff49524f19ae950f92d46bd44b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:02.766445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bd8aff49524f19ae950f92d46bd44b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:02.772303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:02.856838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:02.859077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:02.879860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ddbb1-66eb-4ce2-a9e6-519345a4849f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:02.891986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:02.907625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:02.910133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:02.911536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] PATH_INFO: `/v3/projects/f0e82c5d57e54c3ba4d310bcb96b4e2a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:02.916201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e82c5d57e54c3ba4d310bcb96b4e2a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:02.924593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:03.066105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bd8aff49524f19ae950f92d46bd44b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.086130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bd8aff49524f19ae950f92d46bd44b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.087104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bd8aff49524f19ae950f92d46bd44b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.108948 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:03.135995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'request_id': 'req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.150502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'request_id': 'req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.200174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bd8aff49524f19ae950f92d46bd44b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.201044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9566c646-fbc2-4e0b-9cab-c582d3858cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bd8aff49524f19ae950f92d46bd44b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.236008 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2062/4118] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:02 2022] DELETE /identity/v3/users/69bd8aff49524f19ae950f92d46bd44b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:03.291746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e82c5d57e54c3ba4d310bcb96b4e2a', 'request_id': 'req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.310273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] The token cache is being invalidate because project f0e82c5d57e54c3ba4d310bcb96b4e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:03.310384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.311044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6c6063d-b450-4373-99d3-f15aa4b1cf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:03.315941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2057/4119] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:02 2022] DELETE /identity/v3/projects/f0e82c5d57e54c3ba4d310bcb96b4e2a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:03.318435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6c25a-44d4-4117-a77c-72e936065462 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:03.318680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6c25a-44d4-4117-a77c-72e936065462 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:03.319526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6c25a-44d4-4117-a77c-72e936065462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:03.352740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d9c6c25a-44d4-4117-a77c-72e936065462 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:03.353962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d9c6c25a-44d4-4117-a77c-72e936065462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:03.510410 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2063/4120] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:03.511477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ede28-7532-449b-aaa4-9f60c805a1f5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:03.511771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ede28-7532-449b-aaa4-9f60c805a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:03.512049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ede28-7532-449b-aaa4-9f60c805a1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:03.545398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-147ede28-7532-449b-aaa4-9f60c805a1f5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:03.547551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-147ede28-7532-449b-aaa4-9f60c805a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:03.559060 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2058/4121] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:03.563074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6c25a-44d4-4117-a77c-72e936065462 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:03.577632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6c25a-44d4-4117-a77c-72e936065462 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:03.585740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:03.586227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:03.590982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:03.590982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:03.590982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:03.590982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:03.592464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:03.613060 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2064/4122] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:03.614536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ede28-7532-449b-aaa4-9f60c805a1f5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:03.630429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ede28-7532-449b-aaa4-9f60c805a1f5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:03.648724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:03.649132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:03.649447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:03.649721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:03.650957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:03.658021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:03.844835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:03.854760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2059/4123] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:03 2022] POST /identity/v3/projects => generated 359 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:03.858835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa26c3-ae6d-4801-9301-445057f7ac34 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:03.900609 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:03.953268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:03.954332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:03.955266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:03.955765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:03.956640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:03.960457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:04.013053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:04.014835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:04.051124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf8eaa-c5d4-4e01-9dd0-39aa786aef59 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:04.073646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:04.074335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:04.074620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:04.074896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] PATH_INFO: `/v3/projects/a1f4adec8a4749a2bec19e7af0863059` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:04.078817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f4adec8a4749a2bec19e7af0863059)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:04.080967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:04.117435 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2065/4124] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:03 2022] POST /identity/v3/users => generated 280 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:04.137380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:04.163524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e595-f944-4938-a77f-cfa7d365b6c5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:04.189651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:04.192728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:04.193432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:04.194042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:04.199717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:04.205530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:04.235270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2066/4125] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:29:04.243049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:04.288828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ca3-2d0b-4d87-8de8-3d8b8e91a2bc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:04.304550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:04.305512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:04.307083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:04.307585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:04.309024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:04.311170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:04.344481 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2067/4126] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:04.345841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:04.373828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dc2cf-53a5-4bec-9fb4-0fe8fe493de8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:04.381125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f4adec8a4749a2bec19e7af0863059', 'request_id': 'req-0fcd0593-ec8a-402d-b204-fb0a8ddef268'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:04.397794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f4adec8a4749a2bec19e7af0863059', 'request_id': 'req-0fcd0593-ec8a-402d-b204-fb0a8ddef268'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:04.472484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f4adec8a4749a2bec19e7af0863059', 'request_id': 'req-0fcd0593-ec8a-402d-b204-fb0a8ddef268'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:04.492242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] The token cache is being invalidate because project a1f4adec8a4749a2bec19e7af0863059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:04.493399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:04.498089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:04.504525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7246f1-6454-4f01-9309-34b680f4c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:04.504970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7246f1-6454-4f01-9309-34b680f4c384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:04.505235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7246f1-6454-4f01-9309-34b680f4c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:04.505419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2060/4127] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:04 2022] DELETE /identity/v3/projects/a1f4adec8a4749a2bec19e7af0863059 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:04.505530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7246f1-6454-4f01-9309-34b680f4c384 admin admin] PATH_INFO: `/v3/projects/70f42adb7ffa4808b6f18a44ae59cbbe/users/ea94679341e54ef9a821cd827a8ce14b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:04.508305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:04.513307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:04.570477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0593-ec8a-402d-b204-fb0a8ddef268 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:04.574660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7246f1-6454-4f01-9309-34b680f4c384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f42adb7ffa4808b6f18a44ae59cbbe, user_id=ea94679341e54ef9a821cd827a8ce14b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:04.577122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7246f1-6454-4f01-9309-34b680f4c384 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:04.590662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:04.591343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:04.591629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:04.591907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] PATH_INFO: `/v3/users/1631e803fb0e45c18b12e5ed354f932a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:04.594012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1631e803fb0e45c18b12e5ed354f932a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:04.600256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:04.687664 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2068/4128] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:04 2022] PUT /identity/v3/projects/70f42adb7ffa4808b6f18a44ae59cbbe/users/ea94679341e54ef9a821cd827a8ce14b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:04.700329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:04.700618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:04.700897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:04.838043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] MFA Rules not processed for user `ea94679341e54ef9a821cd827a8ce14b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:04.839487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:04.948784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2069/4129] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:05.011891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:05.012542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1631e803fb0e45c18b12e5ed354f932a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.013814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:05.051121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1631e803fb0e45c18b12e5ed354f932a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.053613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1631e803fb0e45c18b12e5ed354f932a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.150150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c08f-fe13-45ea-98d7-3099ab45e922 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:05.163403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1631e803fb0e45c18b12e5ed354f932a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.163403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4723240e-d40f-4bf8-b4f9-7c40df2bd08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1631e803fb0e45c18b12e5ed354f932a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.163571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:05.164399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:05.164762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:05.165922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] PATH_INFO: `/v3/users/ea94679341e54ef9a821cd827a8ce14b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:05.170896 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=76,keystone:DELETE=20,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:05.172087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea94679341e54ef9a821cd827a8ce14b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:05.174519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:05.240407 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2061/4130] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:04 2022] DELETE /identity/v3/users/1631e803fb0e45c18b12e5ed354f932a => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:05.252159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2bff1-4396-409a-9988-5108c53ce574 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:05.252159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2bff1-4396-409a-9988-5108c53ce574 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:05.252159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2bff1-4396-409a-9988-5108c53ce574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:05.385027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-27f2bff1-4396-409a-9988-5108c53ce574 None None] MFA Rules not processed for user `51d8e34a549c44318a3d328fb2014d20`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:05.386320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-27f2bff1-4396-409a-9988-5108c53ce574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:05.519905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea94679341e54ef9a821cd827a8ce14b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.544442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea94679341e54ef9a821cd827a8ce14b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.545090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea94679341e54ef9a821cd827a8ce14b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.570165 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2062/4131] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:05.574355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9fba-ee33-40b5-8b75-8232ea5ddb52 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:05.574994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9fba-ee33-40b5-8b75-8232ea5ddb52 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:05.576758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9fba-ee33-40b5-8b75-8232ea5ddb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:05.606738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-417a9fba-ee33-40b5-8b75-8232ea5ddb52 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:05.613334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-417a9fba-ee33-40b5-8b75-8232ea5ddb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:05.669098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea94679341e54ef9a821cd827a8ce14b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.669891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70d99019-c6ff-4379-84f7-a308b49efe0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea94679341e54ef9a821cd827a8ce14b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:05.707878 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2070/4132] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:05 2022] DELETE /identity/v3/users/ea94679341e54ef9a821cd827a8ce14b => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:05.720755 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2063/4133] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:05.723147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:05.723969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:05.724604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:05.725053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:05.726927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:05.727427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:05.770798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] MFA Rules not processed for user `51d8e34a549c44318a3d328fb2014d20`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:05.770971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:05.770971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:05.771131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:05.889122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2071/4134] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:05.890229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:05.895917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:05.904887 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2064/4135] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:05.904887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:05.916724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.041168 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:06.106140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73073ed6-9752-4bcd-89a0-94107df60699 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:06.113437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:06.114502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.114924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.115440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.148390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f029f9-7d08-4c0b-8996-c0cdebe23465 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:06.165053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:06.166449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.167156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.167514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.170356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.189941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:06.189941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:06.200892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:06.202787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:06.215195 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2072/4137] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:29:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:29:06.216861 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2065/4137] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:06.216861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:06.217397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:06.219754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.221072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.244994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfb130-c063-4598-a2ca-563f1437162e service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:06.253008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:06.254030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.254503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.254951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] PATH_INFO: `/v3/projects/bd5be4344a684d538353d3ed2c7bba00` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.257019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5be4344a684d538353d3ed2c7bba00)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:06.259825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:06.354237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c904e0-6146-452a-8a82-9ae74778911d service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:06.391287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c8b68-a52b-4e35-bbcb-1ad258070aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:06.393342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c8b68-a52b-4e35-bbcb-1ad258070aea service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.400593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5be4344a684d538353d3ed2c7bba00', 'request_id': 'req-823d6278-8613-44f4-b4f1-3c6cae31e209'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:06.408617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c8b68-a52b-4e35-bbcb-1ad258070aea service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.409037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c8b68-a52b-4e35-bbcb-1ad258070aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.416649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5be4344a684d538353d3ed2c7bba00', 'request_id': 'req-823d6278-8613-44f4-b4f1-3c6cae31e209'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:06.441703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c8b68-a52b-4e35-bbcb-1ad258070aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:06.443192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c8b68-a52b-4e35-bbcb-1ad258070aea service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:06.459246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2066/4138] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:06.460972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d86bf-331b-4cce-ba1e-5c6c141627e3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.461346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d86bf-331b-4cce-ba1e-5c6c141627e3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.461592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d86bf-331b-4cce-ba1e-5c6c141627e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.500257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bc3d86bf-331b-4cce-ba1e-5c6c141627e3 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:06.501844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bc3d86bf-331b-4cce-ba1e-5c6c141627e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.571680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5be4344a684d538353d3ed2c7bba00', 'request_id': 'req-823d6278-8613-44f4-b4f1-3c6cae31e209'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:06.582712 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2067/4139] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:06.593461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] The token cache is being invalidate because project bd5be4344a684d538353d3ed2c7bba00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:06.593761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:06.594546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-823d6278-8613-44f4-b4f1-3c6cae31e209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:06.596357 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2073/4140] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:06 2022] DELETE /identity/v3/projects/bd5be4344a684d538353d3ed2c7bba00 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:06.598581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d86bf-331b-4cce-ba1e-5c6c141627e3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:06.608551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a66977-78bc-4c22-b13f-1dabf0e586e2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.614038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a66977-78bc-4c22-b13f-1dabf0e586e2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.614038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a66977-78bc-4c22-b13f-1dabf0e586e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.662924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-98a66977-78bc-4c22-b13f-1dabf0e586e2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:06.664494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98a66977-78bc-4c22-b13f-1dabf0e586e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.751689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d86bf-331b-4cce-ba1e-5c6c141627e3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:06.760748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d0081-dc22-40c2-a06a-45da03af3d31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:06.761365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0081-dc22-40c2-a06a-45da03af3d31 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.761647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0081-dc22-40c2-a06a-45da03af3d31 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.761918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0081-dc22-40c2-a06a-45da03af3d31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.764063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9a3d0081-dc22-40c2-a06a-45da03af3d31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.776884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d0081-dc22-40c2-a06a-45da03af3d31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:06.779003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d0081-dc22-40c2-a06a-45da03af3d31 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:06.798909 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2068/4141] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:29:06.812292 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2074/4142] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:06.822006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa285-a056-46e5-97c4-4273a2600d7c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.823799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa285-a056-46e5-97c4-4273a2600d7c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.823799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa285-a056-46e5-97c4-4273a2600d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.845353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-121fa285-a056-46e5-97c4-4273a2600d7c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:06.847073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-121fa285-a056-46e5-97c4-4273a2600d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:06.867877 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2069/4143] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:06.872433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a66977-78bc-4c22-b13f-1dabf0e586e2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:06.887314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a66977-78bc-4c22-b13f-1dabf0e586e2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:06.892737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:06.893863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.894317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.895060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.896106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:06.896483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:06.898989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:06.916371 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2075/4144] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:06.920664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fa285-a056-46e5-97c4-4273a2600d7c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:06.933704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fa285-a056-46e5-97c4-4273a2600d7c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:06.939821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:06.940455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:06.940732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:06.942084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:06.942340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:06.945304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:07.116053 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2070/4145] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:07.117273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:07.138749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb76d-bac4-41aa-950a-dd5029b51f07 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:07.215373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:07.218313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:07.252939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:07.253693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:07.258871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:07.259363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:07.261354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:07.271665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:07.389621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930637-9719-4f74-ada3-61d18e13b3de admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:07.410692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:07.411629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:07.413813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:07.414150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] PATH_INFO: `/v3/projects/70f42adb7ffa4808b6f18a44ae59cbbe` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:07.420146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f42adb7ffa4808b6f18a44ae59cbbe)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:07.422879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:07.423876 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2076/4146] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:07 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:07.434618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:07.504585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df89548-89ea-4fba-aebf-dd6f36e7522c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:07.537252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:07.540247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:07.544539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:07.545023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:07.550984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:07.562421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:07.605355 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2077/4147] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:07.609206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:07.638902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aaf50-331d-4108-b828-76c1e8a85d85 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:07.704930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f42adb7ffa4808b6f18a44ae59cbbe', 'request_id': 'req-f5816eca-5a5f-4708-b7d1-1276f8586072'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:07.714361 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:07.741279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f42adb7ffa4808b6f18a44ae59cbbe', 'request_id': 'req-f5816eca-5a5f-4708-b7d1-1276f8586072'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:07.751903 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:07.795529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:07.797121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:07.797771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:07.798275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:07.799341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:07.807378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:07.825182 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2078/4148] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:07.827266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:07.853243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b839-ae19-4563-bfcc-3fa8f01daaa6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:07.858673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315dd55-1cc5-44a7-a7c2-4af74a5394e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:07.862243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315dd55-1cc5-44a7-a7c2-4af74a5394e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:07.862243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315dd55-1cc5-44a7-a7c2-4af74a5394e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:07.862243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315dd55-1cc5-44a7-a7c2-4af74a5394e7 admin admin] PATH_INFO: `/v3/projects/9901e62cf4f94f6c9be3ff897caedf19/users/0a92f307441747f29f583ddf004e8f21/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:07.862511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f42adb7ffa4808b6f18a44ae59cbbe', 'request_id': 'req-f5816eca-5a5f-4708-b7d1-1276f8586072'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:07.878676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315dd55-1cc5-44a7-a7c2-4af74a5394e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9901e62cf4f94f6c9be3ff897caedf19, user_id=0a92f307441747f29f583ddf004e8f21, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:07.882460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315dd55-1cc5-44a7-a7c2-4af74a5394e7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:07.908200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] The token cache is being invalidate because project 70f42adb7ffa4808b6f18a44ae59cbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:07.908612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:07.909775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5816eca-5a5f-4708-b7d1-1276f8586072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:07.916011 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2071/4149] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:07 2022] DELETE /identity/v3/projects/70f42adb7ffa4808b6f18a44ae59cbbe => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:07.921969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c01e9-1aca-43d9-9765-5e2b70f220fa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:07.922327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c01e9-1aca-43d9-9765-5e2b70f220fa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:07.922598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c01e9-1aca-43d9-9765-5e2b70f220fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:07.970854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-711c01e9-1aca-43d9-9765-5e2b70f220fa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:07.972105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-711c01e9-1aca-43d9-9765-5e2b70f220fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:07.978352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2079/4150] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:07 2022] PUT /identity/v3/projects/9901e62cf4f94f6c9be3ff897caedf19/users/0a92f307441747f29f583ddf004e8f21/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:07.983384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:07.983661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:07.984682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.025909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:08.027161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:08.146597 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2072/4151] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:08.156397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c48b-a28e-405f-b913-d2cf9b1fb577 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:08.157037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c48b-a28e-405f-b913-d2cf9b1fb577 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:08.157892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c48b-a28e-405f-b913-d2cf9b1fb577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.180926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2080/4152] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:08.205005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0ef8c48b-a28e-405f-b913-d2cf9b1fb577 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:08.206338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ef8c48b-a28e-405f-b913-d2cf9b1fb577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:08.234290 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2073/4153] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:08.235390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:08.237128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c48b-a28e-405f-b913-d2cf9b1fb577 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:08.240048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:08.260002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c48b-a28e-405f-b913-d2cf9b1fb577 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:08.267994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:08.268621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:08.268898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:08.269183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.269825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:08.270156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:08.272940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:08.297968 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2074/4154] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:08.299053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:08.316012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c241c6e-2726-49e3-b4e7-d3682efae20f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:08.324459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ee40c-d4d2-4e26-91e3-b115b0e444f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:08.325293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee40c-d4d2-4e26-91e3-b115b0e444f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:08.325483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee40c-d4d2-4e26-91e3-b115b0e444f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:08.325880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee40c-d4d2-4e26-91e3-b115b0e444f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.327104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ee40c-d4d2-4e26-91e3-b115b0e444f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:08.329222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ee40c-d4d2-4e26-91e3-b115b0e444f0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:08.337384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5cc58-b592-4537-b4f8-6a89da1b933a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:08.340402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:08.341733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:08.342270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:08.342617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.356060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:08.357879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:08.370249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2081/4155] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:08.460592 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2075/4156] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:08 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:08.465068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:08.502780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbaa972-61e4-44d7-a486-b317a51b3a92 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:08.651911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:08.652190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:08.652465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.730938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:08.732245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:08.761866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:08.762519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:08.762794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:08.763157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.763906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:08.767688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:08.884348 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2082/4157] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:08 2022] POST /identity/v3/users => generated 287 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:08.889252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:08.889921 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2076/4158] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:08.916811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42a3d-a29f-414a-8fb3-0a7d9f2704aa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:08.937589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:08.938792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:08.939067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:08.939746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:08.940029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:08.940411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:08.941456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:08.944256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:08.962361 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2083/4159] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:29:08.966480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:09.005019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd557-e656-4158-a092-ccc2cb00e75c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:09.034849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:09.037596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:09.038135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:09.039084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:09.040599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:09.047122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:09.084001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2084/4160] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:29:09.087284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:09.116447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc4da5-6399-40a0-bc0c-d67322abf2b9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:09.131485 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:09.132543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:09.133526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:09.136545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:09.137008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] PATH_INFO: `/v3/projects/3d8842464e7b4c21942922342e477087/users/f3838b2330ea408a89c902d0e5054e80/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:09.153281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d31e5-d4e0-48bb-a6ba-48bd0361e93f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:09.172370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c533b-63f8-4594-9ff1-54be2acaf2eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:09.173610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c533b-63f8-4594-9ff1-54be2acaf2eb service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:09.174191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c533b-63f8-4594-9ff1-54be2acaf2eb service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:09.174674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c533b-63f8-4594-9ff1-54be2acaf2eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:09.206626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c533b-63f8-4594-9ff1-54be2acaf2eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:09.214523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8842464e7b4c21942922342e477087, user_id=f3838b2330ea408a89c902d0e5054e80, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:09.216326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c533b-63f8-4594-9ff1-54be2acaf2eb service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:09.224062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:09.307130 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2077/4161] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:29:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:29:09.320095 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2085/4162] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:09 2022] PUT /identity/v3/projects/3d8842464e7b4c21942922342e477087/users/f3838b2330ea408a89c902d0e5054e80/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:09.332986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7791e-ce7a-42c1-a2b4-ba785cbd8728 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:09.341790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7791e-ce7a-42c1-a2b4-ba785cbd8728 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:09.342173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7791e-ce7a-42c1-a2b4-ba785cbd8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:09.406401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-31b7791e-ce7a-42c1-a2b4-ba785cbd8728 None None] MFA Rules not processed for user `f3838b2330ea408a89c902d0e5054e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:09.407715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-31b7791e-ce7a-42c1-a2b4-ba785cbd8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:09.572014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2078/4163] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:09.575155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:09.666092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3985717-9355-4499-93c9-2f817a7213a1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:09.672023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:09.673808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:09.674240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:09.674571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:09.675265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:09.677616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:09.859314 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2086/4164] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:09 2022] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:09.860277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7791e-ce7a-42c1-a2b4-ba785cbd8728 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:09.878430 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:09.889157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7791e-ce7a-42c1-a2b4-ba785cbd8728 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:09.992916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e55664-504a-4821-bf2a-322d148c0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:09.993968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55664-504a-4821-bf2a-322d148c0fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:09.994570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55664-504a-4821-bf2a-322d148c0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:09.995054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55664-504a-4821-bf2a-322d148c0fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:09.996214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e55664-504a-4821-bf2a-322d148c0fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:09.999200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e55664-504a-4821-bf2a-322d148c0fa5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:10.031642 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:10.110817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:10.111518 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2079/4165] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:09 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:10.130357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee2db6-0356-4e2b-b6f5-cc9076076b4c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:10.158639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:10.159283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:10.159566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:10.159838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:10.160761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:10.162652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:10.184912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e4c7-406f-4c09-bb3d-fa8965188ace None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:10.185379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e4c7-406f-4c09-bb3d-fa8965188ace None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:10.185762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e4c7-406f-4c09-bb3d-fa8965188ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:10.208110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2087/4166] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:10.212246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:10.226228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e022c-871a-48c4-99cd-ae94d2b56561 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:10.232416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:10.233104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:10.233609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:10.233858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] PATH_INFO: `/v3/projects/8c9cd88cd4f748e580ed00993290ef7d/users/2d81d236e732442286e5fc9bf7af9e99/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:10.262431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bfa3e4c7-406f-4c09-bb3d-fa8965188ace None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:10.266977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bfa3e4c7-406f-4c09-bb3d-fa8965188ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:10.280109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cd88cd4f748e580ed00993290ef7d, user_id=2d81d236e732442286e5fc9bf7af9e99, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:10.284456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:10.427274 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2088/4167] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:10 2022] PUT /identity/v3/projects/8c9cd88cd4f748e580ed00993290ef7d/users/2d81d236e732442286e5fc9bf7af9e99/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:10.433704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:10.476946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2080/4168] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:10.497449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3e4c7-406f-4c09-bb3d-fa8965188ace None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:10.668749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3e4c7-406f-4c09-bb3d-fa8965188ace None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:10.733312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67f6f-4b45-48e7-a6e3-3bc2129919bd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:10.755482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:10.761848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:10.762200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:10.762484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:10.763162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:10.768070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:10.802295 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2089/4169] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:10.804233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:10.837387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:10.839197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:10.839727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:10.840216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:10.847795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae910a-cab9-4f2f-8be8-7e3657ca539a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:10.858013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381f633-3230-4c74-9b0e-96a22587ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:10.858534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381f633-3230-4c74-9b0e-96a22587ca23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:10.858646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381f633-3230-4c74-9b0e-96a22587ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:10.859145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381f633-3230-4c74-9b0e-96a22587ca23 admin admin] PATH_INFO: `/v3/projects/8c9cd88cd4f748e580ed00993290ef7d/users/2d81d236e732442286e5fc9bf7af9e99/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:10.862770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381f633-3230-4c74-9b0e-96a22587ca23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cd88cd4f748e580ed00993290ef7d, user_id=2d81d236e732442286e5fc9bf7af9e99, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:10.870720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381f633-3230-4c74-9b0e-96a22587ca23 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:10.904827 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2090/4170] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:10 2022] PUT /identity/v3/projects/8c9cd88cd4f748e580ed00993290ef7d/users/2d81d236e732442286e5fc9bf7af9e99/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:10.907287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710042-340b-4bff-b55d-69c13ab0810f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:10.907981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710042-340b-4bff-b55d-69c13ab0810f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:10.907981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710042-340b-4bff-b55d-69c13ab0810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:10.995940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:10.998396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:11.001116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-44710042-340b-4bff-b55d-69c13ab0810f None None] MFA Rules not processed for user `2d81d236e732442286e5fc9bf7af9e99`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:11.002455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44710042-340b-4bff-b55d-69c13ab0810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:11.022351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2081/4171] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:29:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:29:11.245001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2091/4172] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:11.246233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:11.389293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c49c-3854-40e1-8842-e768b06a6c1e service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:11.415232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:11.417243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:11.417715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:11.418011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:11.420787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:11.423149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:11.564709 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2082/4173] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:29:11 2022] POST /identity/v3/domains => generated 245 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:11.566221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710042-340b-4bff-b55d-69c13ab0810f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:11.587971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710042-340b-4bff-b55d-69c13ab0810f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:11.653047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:11.655157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:11.886495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:11.887238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:11.894156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:11.894156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:11.894156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:11.894156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:11.971396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8be44-9abe-4bbf-b2c7-31a19e4a0415 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:11.998701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:12.000910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:12.009006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:12.009480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] PATH_INFO: `/v3/users/f86e186e88524064b8dca040c1814927` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:12.011490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86e186e88524064b8dca040c1814927)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:12.015743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:12.129764 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2092/4174] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:11 2022] POST /identity/v3/projects => generated 408 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:12.130719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:12.296784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab46925-aaff-4c6a-8142-0fb874388aa4 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:12.307854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329d9ad-7d76-4806-b776-df7cee70dfec tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:12.308497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d9ad-7d76-4806-b776-df7cee70dfec tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:12.308812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d9ad-7d76-4806-b776-df7cee70dfec tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:12.309081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d9ad-7d76-4806-b776-df7cee70dfec tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:12.309849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329d9ad-7d76-4806-b776-df7cee70dfec tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:12.311862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329d9ad-7d76-4806-b776-df7cee70dfec tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:12.387548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86e186e88524064b8dca040c1814927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:12.422642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86e186e88524064b8dca040c1814927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:12.425165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86e186e88524064b8dca040c1814927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:12.454534 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2093/4175] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:12 2022] POST /identity/v3/users => generated 347 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:12.456119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed93093-149a-4d94-9cdf-f30da3f7d6df None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:12.456534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed93093-149a-4d94-9cdf-f30da3f7d6df None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:12.456934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed93093-149a-4d94-9cdf-f30da3f7d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:12.514007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86e186e88524064b8dca040c1814927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:12.514805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86e186e88524064b8dca040c1814927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:12.524237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3ed93093-149a-4d94-9cdf-f30da3f7d6df None None] MFA Rules not processed for user `0a92f307441747f29f583ddf004e8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:12.525467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3ed93093-149a-4d94-9cdf-f30da3f7d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:12.570178 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2083/4176] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:11 2022] DELETE /identity/v3/users/f86e186e88524064b8dca040c1814927 => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:12.576100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:12.583252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:12.685957 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:12.744625 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:12.750267 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2094/4177] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:12.761429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604435a-91bb-41d5-a466-917aca30df4b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:12.763438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227934a-4c9b-48c5-bcec-720ace7a5e86 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:12.763731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227934a-4c9b-48c5-bcec-720ace7a5e86 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:12.764003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227934a-4c9b-48c5-bcec-720ace7a5e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:12.781079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b369226-9eee-4139-b88c-5bdf0ba36f3a tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:12.782025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b369226-9eee-4139-b88c-5bdf0ba36f3a tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:12.782517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b369226-9eee-4139-b88c-5bdf0ba36f3a tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:12.784795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b369226-9eee-4139-b88c-5bdf0ba36f3a tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:12.785716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b369226-9eee-4139-b88c-5bdf0ba36f3a tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:12.790765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b369226-9eee-4139-b88c-5bdf0ba36f3a tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:12.805421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0227934a-4c9b-48c5-bcec-720ace7a5e86 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:12.806682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0227934a-4c9b-48c5-bcec-720ace7a5e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:12.819847 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2084/4178] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:12.824205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:12.828718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:12.829266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:12.872288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] MFA Rules not processed for user `0a92f307441747f29f583ddf004e8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:12.875184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:12.941164 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2095/4179] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:12.944246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227934a-4c9b-48c5-bcec-720ace7a5e86 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:12.967209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227934a-4c9b-48c5-bcec-720ace7a5e86 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:12.979819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3489f0-9184-456d-9645-98010864ba95 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:12.981729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3489f0-9184-456d-9645-98010864ba95 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:12.981959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3489f0-9184-456d-9645-98010864ba95 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:12.983172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3489f0-9184-456d-9645-98010864ba95 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/projects/9b59cb7037b8425eb2c89d7122c09f4c/users/62d413c78ed241a294c7e31d759bfc94/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:12.998942 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2085/4180] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:13.000187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:13.002171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:13.028069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3489f0-9184-456d-9645-98010864ba95 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9b59cb7037b8425eb2c89d7122c09f4c, user_id=62d413c78ed241a294c7e31d759bfc94, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:13.030578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3489f0-9184-456d-9645-98010864ba95 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:13.131155 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2096/4181] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:12 2022] PUT /identity/v3/projects/9b59cb7037b8425eb2c89d7122c09f4c/users/62d413c78ed241a294c7e31d759bfc94/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:13.132750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213bb8-4181-4809-80b7-a5664082b9cb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:13.133162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213bb8-4181-4809-80b7-a5664082b9cb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:13.133561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213bb8-4181-4809-80b7-a5664082b9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:13.172678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c13121-203d-4cc7-a206-4778d6fa932e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:13.217728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4e213bb8-4181-4809-80b7-a5664082b9cb None None] MFA Rules not processed for user `0a92f307441747f29f583ddf004e8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:13.223743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4e213bb8-4181-4809-80b7-a5664082b9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:13.325512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:13.326095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:13.326378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:13.326653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:13.336756 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2097/4182] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:13.338205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9e4f-bb0d-4ac6-95ea-205f8fa7e23c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:13.338491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9e4f-bb0d-4ac6-95ea-205f8fa7e23c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:13.342178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9e4f-bb0d-4ac6-95ea-205f8fa7e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:13.425008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:13.426906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:13.443617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2086/4183] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:13.508546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:13.510330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:13.626311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-651c9e4f-bb0d-4ac6-95ea-205f8fa7e23c None None] MFA Rules not processed for user `62d413c78ed241a294c7e31d759bfc94`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:13.636529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-651c9e4f-bb0d-4ac6-95ea-205f8fa7e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:13.658701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30bab4-a185-48ae-bf4a-a6509640df9b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:13.673757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:13.676702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:13.681421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:13.681421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:13.687724 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2098/4184] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:13.697328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8128f4-c0b3-4c61-8d74-ca52f6ac53b8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:13.697893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8128f4-c0b3-4c61-8d74-ca52f6ac53b8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:13.706034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8128f4-c0b3-4c61-8d74-ca52f6ac53b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:13.706703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:13.706956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:13.732076 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2087/4185] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:13.753070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-da8128f4-c0b3-4c61-8d74-ca52f6ac53b8 None None] MFA Rules not processed for user `62d413c78ed241a294c7e31d759bfc94`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:13.755895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-da8128f4-c0b3-4c61-8d74-ca52f6ac53b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:13.775992 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2099/4186] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:13.779874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:13.808915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b7e5-77e3-4329-93ae-0f55cdfac4df service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:13.832935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d413c78ed241a294c7e31d759bfc94', 'user_domain_id': 'cb68dc45ec49407c9808bb221ccc5ff2', 'system_scope': None, 'project_id': '9b59cb7037b8425eb2c89d7122c09f4c', 'project_domain_id': 'cb68dc45ec49407c9808bb221ccc5ff2', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:13.833671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:13.834136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:13.834752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:13.844666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:13.846915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:13.859275 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2088/4187] 10.222.0.42 () {56 vars in 1284 bytes} [Sun Oct 23 01:29:13 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:13.864423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8128f4-c0b3-4c61-8d74-ca52f6ac53b8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:13.973790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8128f4-c0b3-4c61-8d74-ca52f6ac53b8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:13.981500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:13.982617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:13.983082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:13.983544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/users/62d413c78ed241a294c7e31d759bfc94` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:13.985015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:delete_user(user_id=62d413c78ed241a294c7e31d759bfc94)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:13.992815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:14.026090 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:14.234269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:14.236131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:14.253530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fc88a-0ce7-414f-845f-dee77424c80e tempest-test_project-986801000 tempest-user-142497456] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:14.261560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:14.262603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:14.263229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:14.263864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] PATH_INFO: `/v3/projects/bf35beeccb814ce490d2142b21c2b1c1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:14.265265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf35beeccb814ce490d2142b21c2b1c1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:14.267946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:14.274053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d413c78ed241a294c7e31d759bfc94'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.293456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d413c78ed241a294c7e31d759bfc94'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.294271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d413c78ed241a294c7e31d759bfc94'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.326115 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:14.372130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d413c78ed241a294c7e31d759bfc94'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.372803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d413c78ed241a294c7e31d759bfc94'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.406851 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2100/4188] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:13 2022] DELETE /identity/v3/users/62d413c78ed241a294c7e31d759bfc94 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:14.411011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:14.416003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:14.453089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf35beeccb814ce490d2142b21c2b1c1', 'request_id': 'req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.480468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf35beeccb814ce490d2142b21c2b1c1', 'request_id': 'req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.569664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a08ad2-a3bc-4c62-9b44-b0786331b97b tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:14.572347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf35beeccb814ce490d2142b21c2b1c1', 'request_id': 'req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.594569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] The token cache is being invalidate because project bf35beeccb814ce490d2142b21c2b1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:14.595140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.598324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ccd5403-0e0a-4379-bf3e-ea94aae092d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.601670 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2089/4189] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:14 2022] DELETE /identity/v3/projects/bf35beeccb814ce490d2142b21c2b1c1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:14.606817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba37c-25a2-469c-a5a8-9c1f49229dc8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:14.607899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba37c-25a2-469c-a5a8-9c1f49229dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:14.608367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ba37c-25a2-469c-a5a8-9c1f49229dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:14.667065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1b1ba37c-25a2-469c-a5a8-9c1f49229dc8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:14.670913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1b1ba37c-25a2-469c-a5a8-9c1f49229dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:14.711488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:14.711942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:14.712378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:14.712661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/projects/9b59cb7037b8425eb2c89d7122c09f4c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:14.713896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b59cb7037b8425eb2c89d7122c09f4c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:14.715960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:14.843570 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2090/4190] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:14.851922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb0e7-9202-4633-974e-cea41cab251f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:14.852112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb0e7-9202-4633-974e-cea41cab251f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:14.852283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb0e7-9202-4633-974e-cea41cab251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:14.883526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b59cb7037b8425eb2c89d7122c09f4c', 'request_id': 'req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.895660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dbceb0e7-9202-4633-974e-cea41cab251f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:14.896965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dbceb0e7-9202-4633-974e-cea41cab251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:14.899359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b59cb7037b8425eb2c89d7122c09f4c', 'request_id': 'req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:14.997556 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2091/4191] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:15.001559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb0e7-9202-4633-974e-cea41cab251f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:15.016899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb0e7-9202-4633-974e-cea41cab251f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:15.036178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e156-08f2-45fa-89d0-8ab332fcf506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:15.037158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e156-08f2-45fa-89d0-8ab332fcf506 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.038144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e156-08f2-45fa-89d0-8ab332fcf506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.038733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e156-08f2-45fa-89d0-8ab332fcf506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:15.042550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e156-08f2-45fa-89d0-8ab332fcf506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:15.042550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e156-08f2-45fa-89d0-8ab332fcf506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:15.053249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e156-08f2-45fa-89d0-8ab332fcf506 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:15.065602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b59cb7037b8425eb2c89d7122c09f4c', 'request_id': 'req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:15.085131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2092/4192] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:15.087249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.088366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.088795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:15.096298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] The token cache is being invalidate because project 9b59cb7037b8425eb2c89d7122c09f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:15.096525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:15.098351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:15.101206 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2101/4193] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:14 2022] DELETE /identity/v3/projects/9b59cb7037b8425eb2c89d7122c09f4c => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:15.102012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:15.107149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:15.140755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] MFA Rules not processed for user `0a92f307441747f29f583ddf004e8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:15.141638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140d3c6-c63b-4b9f-aa6b-eab9be8a94b0 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:15.143004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:15.162898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:15.163616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.165387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.165699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:15.166432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:15.168442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:15.310505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2093/4194] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:15.310505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:15.310505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:15.316047 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2102/4195] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:15 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:15.321490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:15.456623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60050e36-daf9-4727-aa3d-c6a0226af247 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:15.516431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50763cdf-d17d-4178-a44d-2d37d0d895cf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:15.521645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:15.522303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.522586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.522861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:15.524155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:15.525648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:15.557581 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:15.590043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:15.591876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.592343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.592760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/domains/cb68dc45ec49407c9808bb221ccc5ff2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:15.594403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cb68dc45ec49407c9808bb221ccc5ff2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:15.597389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:15.633648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:15.634452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:15.679494 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2103/4196] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:15 2022] POST /identity/v3/users => generated 287 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:15.683623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:15.692679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:15.711429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13736adb-5c9b-4c03-b1f7-44970de0e9df admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:15.791351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:15.799472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:15.811769 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2094/4197] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:29:15 2022] PATCH /identity/v3/domains/cb68dc45ec49407c9808bb221ccc5ff2 => generated 246 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:15.815682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:15.818800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:15.819430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.819724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.819978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:15.820692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:15.831934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:15.832796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:15.880204 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2104/4198] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:29:15.889091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:15.897912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:15.954318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccf8d9-2adb-4c5a-ad53-45798586ca7b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:15.966518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9300105-28b6-4f46-88c5-4933cd4a0c21 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:15.992382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d81d236e732442286e5fc9bf7af9e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c9cd88cd4f748e580ed00993290ef7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:15.993054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.998097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.998355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:15.998566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] PATH_INFO: `/v3/domains/cb68dc45ec49407c9808bb221ccc5ff2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:15.998988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:15.999268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:15.999540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:16.000188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:16.001784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:16.045360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cb68dc45ec49407c9808bb221ccc5ff2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:16.045360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:16.049030 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:16.057595 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2105/4199] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:16.061689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:16.083707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.088246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.088728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446088b-def0-4395-8c12-6ae24ef6e9ec admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:16.105998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39d25d-584b-48d0-afaa-4b9b72063927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:16.107271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d25d-584b-48d0-afaa-4b9b72063927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:16.107702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d25d-584b-48d0-afaa-4b9b72063927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:16.108121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d25d-584b-48d0-afaa-4b9b72063927 admin admin] PATH_INFO: `/v3/projects/04fd9a9dbd604f258040490b855a07fc/users/6bbfaa1c32c14d98a417b00663d2ad08/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:16.145022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39d25d-584b-48d0-afaa-4b9b72063927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fd9a9dbd604f258040490b855a07fc, user_id=6bbfaa1c32c14d98a417b00663d2ad08, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:16.148165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39d25d-584b-48d0-afaa-4b9b72063927 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:16.221440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2106/4200] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:16 2022] PUT /identity/v3/projects/04fd9a9dbd604f258040490b855a07fc/users/6bbfaa1c32c14d98a417b00663d2ad08/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:16.233242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:16.233519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:16.233961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:16.257155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2', 'request_id': 'req-28255256-3ec7-4c71-980c-d6faeaac5009'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.285921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2', 'request_id': 'req-28255256-3ec7-4c71-980c-d6faeaac5009'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.303848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] MFA Rules not processed for user `6bbfaa1c32c14d98a417b00663d2ad08`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:16.305099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:16.423107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2', 'request_id': 'req-28255256-3ec7-4c71-980c-d6faeaac5009'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.445654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] The token cache is being invalidate because project cb68dc45ec49407c9808bb221ccc5ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:16.446140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.446649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.447393 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2107/4201] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:16.466461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2', 'request_id': 'req-28255256-3ec7-4c71-980c-d6faeaac5009'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.467254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2', 'request_id': 'req-28255256-3ec7-4c71-980c-d6faeaac5009'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.476968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28255256-3ec7-4c71-980c-d6faeaac5009 tempest-TestDefaultProjectId-1980548789 tempest-TestDefaultProjectId-1980548789-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cb68dc45ec49407c9808bb221ccc5ff2', 'request_id': 'req-28255256-3ec7-4c71-980c-d6faeaac5009'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:16.495869 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2095/4202] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:29:15 2022] DELETE /identity/v3/domains/cb68dc45ec49407c9808bb221ccc5ff2 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:16.502198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:16.506428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:16.566909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:16.567191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:16.567464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:16.603634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] MFA Rules not processed for user `0a92f307441747f29f583ddf004e8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:16.604749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:16.632825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef052ba-3f2b-4461-a5f7-8a6e43b490b3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:16.658296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:16.659353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:16.659817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:16.660099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] PATH_INFO: `/v3/users/f3838b2330ea408a89c902d0e5054e80` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:16.663002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3838b2330ea408a89c902d0e5054e80)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:16.668335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:16.743488 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2096/4203] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:16.744715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:16.746473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:16.975002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57aabd-53e4-495d-9404-f36d4991b853 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:16.999762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ead5b2-3550-4385-8311-9bc2f65e1514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:17.000402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ead5b2-3550-4385-8311-9bc2f65e1514 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:17.001452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ead5b2-3550-4385-8311-9bc2f65e1514 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:17.001452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ead5b2-3550-4385-8311-9bc2f65e1514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:17.012365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-82ead5b2-3550-4385-8311-9bc2f65e1514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:17.021901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3838b2330ea408a89c902d0e5054e80'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:17.042962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ead5b2-3550-4385-8311-9bc2f65e1514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:17.046395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3838b2330ea408a89c902d0e5054e80'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:17.049922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3838b2330ea408a89c902d0e5054e80'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:17.052379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ead5b2-3550-4385-8311-9bc2f65e1514 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:17.083021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2097/4204] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:17.161029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3838b2330ea408a89c902d0e5054e80'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:17.161029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3838b2330ea408a89c902d0e5054e80'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:17.199016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:17.199383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:17.199599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:17.205096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2108/4205] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:16 2022] DELETE /identity/v3/users/f3838b2330ea408a89c902d0e5054e80 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:17.235884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:17.238312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:17.387510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2098/4206] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:17.559679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:17.561505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:17.617315 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:17.640896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:17.643242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:17.731661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977acfa8-9dd6-4e02-a319-75e9fd4b1118 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:17.738540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:17.739183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:17.739461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:17.739734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:17.742506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:17.758950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:17.760604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:17.790192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2109/4207] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:17.818494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72fa7-8c6c-410e-be54-11066b0ae39f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:17.833391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:17.834861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:17.835621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:17.836089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:17.847562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:17.895307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:17.895307 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2099/4208] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:18.742979 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:18.899088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:18.900828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:18.941821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5721-fbf5-42d8-973b-e8b838af44b6 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:18.954599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:18.955800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:18.969347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:18.969347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] PATH_INFO: `/v3/users/6bbfaa1c32c14d98a417b00663d2ad08` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:18.969347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbfaa1c32c14d98a417b00663d2ad08)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:18.969347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:19.119780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:19.121918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:19.142244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc642a-9835-46ea-8467-990adc4bba8b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:19.153091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:19.154411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:19.154619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:19.156765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] PATH_INFO: `/v3/projects/3d8842464e7b4c21942922342e477087` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:19.158818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8842464e7b4c21942922342e477087)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:19.161405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:19.223806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbfaa1c32c14d98a417b00663d2ad08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.244250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbfaa1c32c14d98a417b00663d2ad08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.245131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbfaa1c32c14d98a417b00663d2ad08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.336224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8842464e7b4c21942922342e477087', 'request_id': 'req-5e57aff6-90d5-4a79-8759-5c9839ff9dba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.352628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8842464e7b4c21942922342e477087', 'request_id': 'req-5e57aff6-90d5-4a79-8759-5c9839ff9dba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.355515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbfaa1c32c14d98a417b00663d2ad08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.361021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-968f7884-2c8f-4ca8-ada0-6a80a6d04345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbfaa1c32c14d98a417b00663d2ad08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.408726 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2110/4209] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:18 2022] DELETE /identity/v3/users/6bbfaa1c32c14d98a417b00663d2ad08 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:19.411659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:19.412960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:19.413586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:19.444379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:19.445938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:19.458782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8842464e7b4c21942922342e477087', 'request_id': 'req-5e57aff6-90d5-4a79-8759-5c9839ff9dba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.491027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] The token cache is being invalidate because project 3d8842464e7b4c21942922342e477087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:19.491329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.492761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.496070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2100/4210] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:19 2022] DELETE /identity/v3/projects/3d8842464e7b4c21942922342e477087 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:19.500073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:19.501483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:19.582417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2111/4211] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:19.619156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:19.623480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:19.649743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57aff6-90d5-4a79-8759-5c9839ff9dba admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:19.658277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:19.658928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:19.659207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:19.659481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] PATH_INFO: `/v3/users/2d81d236e732442286e5fc9bf7af9e99` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:19.661139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d81d236e732442286e5fc9bf7af9e99)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:19.663898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:19.758675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c719fa-6648-4390-b2aa-7d48b04443f2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:19.762868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:19.764182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:19.764586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:19.765140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:19.776640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:19.779982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:19.811806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2112/4212] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:19.964228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d81d236e732442286e5fc9bf7af9e99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.995139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d81d236e732442286e5fc9bf7af9e99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:19.995139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d81d236e732442286e5fc9bf7af9e99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:20.133626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d81d236e732442286e5fc9bf7af9e99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:20.134244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d81d236e732442286e5fc9bf7af9e99'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:20.167589 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2101/4213] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:19 2022] DELETE /identity/v3/users/2d81d236e732442286e5fc9bf7af9e99 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:20.962714 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:21.033104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:21.034713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.080160 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:21.145075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a78745-5d31-4efe-964a-97a0d89225e9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:21.238931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:21.241595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.247418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:21.248190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.248567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.249770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.252862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.268502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:21.270567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:21.285584 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2113/4214] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:21.365482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992e56b-73a3-4d29-bed5-10a65387ad87 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:21.382801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:21.383927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.384450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.384956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] PATH_INFO: `/v3/projects/04fd9a9dbd604f258040490b855a07fc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.386546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fd9a9dbd604f258040490b855a07fc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:21.388765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:21.440435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:21.443126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.466181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a936c-6a1c-4418-862e-d1c1f90cb272 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:21.481776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:21.483437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.484812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.485525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] PATH_INFO: `/v3/projects/8c9cd88cd4f748e580ed00993290ef7d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.487743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9cd88cd4f748e580ed00993290ef7d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:21.490612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:21.531934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fd9a9dbd604f258040490b855a07fc', 'request_id': 'req-ae8df27d-3874-4ace-978b-1f583753f232'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.547158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fd9a9dbd604f258040490b855a07fc', 'request_id': 'req-ae8df27d-3874-4ace-978b-1f583753f232'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.670057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fd9a9dbd604f258040490b855a07fc', 'request_id': 'req-ae8df27d-3874-4ace-978b-1f583753f232'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.678221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9cd88cd4f748e580ed00993290ef7d', 'request_id': 'req-9c815f83-7061-4c49-a420-df308e805797'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.715752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] The token cache is being invalidate because project 04fd9a9dbd604f258040490b855a07fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:21.715752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.715944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9cd88cd4f748e580ed00993290ef7d', 'request_id': 'req-9c815f83-7061-4c49-a420-df308e805797'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.716755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae8df27d-3874-4ace-978b-1f583753f232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.724555 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2102/4215] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:21 2022] DELETE /identity/v3/projects/04fd9a9dbd604f258040490b855a07fc => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:21.726330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e72d-9e25-4de8-8afd-688e0aa8fcd9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.727448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e72d-9e25-4de8-8afd-688e0aa8fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.727992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e72d-9e25-4de8-8afd-688e0aa8fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.785857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cd39e72d-9e25-4de8-8afd-688e0aa8fcd9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:21.791055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cd39e72d-9e25-4de8-8afd-688e0aa8fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.819958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9cd88cd4f748e580ed00993290ef7d', 'request_id': 'req-9c815f83-7061-4c49-a420-df308e805797'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.840459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] The token cache is being invalidate because project 8c9cd88cd4f748e580ed00993290ef7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:21.840459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.841218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9c815f83-7061-4c49-a420-df308e805797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:21.843040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2114/4216] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:21 2022] DELETE /identity/v3/projects/8c9cd88cd4f748e580ed00993290ef7d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:21.849032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733a35-c483-4752-a47f-b6a8ee2ccc30 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.849342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733a35-c483-4752-a47f-b6a8ee2ccc30 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.849644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b733a35-c483-4752-a47f-b6a8ee2ccc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.873320 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2103/4217] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:21.883412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f00ee-f9ea-495e-af27-ea4a259d4437 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.883758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f00ee-f9ea-495e-af27-ea4a259d4437 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.884090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f00ee-f9ea-495e-af27-ea4a259d4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.905611 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:21.907112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7b733a35-c483-4752-a47f-b6a8ee2ccc30 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:21.908348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7b733a35-c483-4752-a47f-b6a8ee2ccc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.924862 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2115/4218] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:21.926053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-928f00ee-f9ea-495e-af27-ea4a259d4437 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:21.928161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-928f00ee-f9ea-495e-af27-ea4a259d4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.934104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c64f02-43c4-4424-9363-e392f76c70e7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.934394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c64f02-43c4-4424-9363-e392f76c70e7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.934669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c64f02-43c4-4424-9363-e392f76c70e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.941021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2104/4219] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:21.944828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f00ee-f9ea-495e-af27-ea4a259d4437 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:21.955915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f00ee-f9ea-495e-af27-ea4a259d4437 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:21.966757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:21.968481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:21.968764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:21.970366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:21.971286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-89c64f02-43c4-4424-9363-e392f76c70e7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:21.971760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:21.973272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-89c64f02-43c4-4424-9363-e392f76c70e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:21.976494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:21.980003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:21.985843 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2116/4220] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:21.988762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c64f02-43c4-4424-9363-e392f76c70e7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.003412 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2105/4221] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:29:22.004845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.015242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c64f02-43c4-4424-9363-e392f76c70e7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.023989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b94d-17e8-4358-9f5e-83b5dc1657df admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.024246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.025070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.025356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.025797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.026496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:22.027756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.029214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.035721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.037315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.037784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.038268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.039143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.043465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.045491 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2117/4222] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:22.049526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.075780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd78de8-842b-418d-9acd-b8c638b56a65 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.082066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.083158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.084261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.084833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.085612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.088344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.203788 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2106/4223] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:22 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:22.205584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.237836 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2118/4224] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:22 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:22.242942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.316071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081c111-13a4-477d-8713-5d15a412b5c3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.368679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81cde8-4620-4d2e-bed7-ce1632b2b959 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.374411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.376779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.376779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.376779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.376779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.394481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.399132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.399803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.400240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.400611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.400924 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:22.401805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.404285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.559140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2119/4225] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:22 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:22.566548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.567174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2107/4226] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:22 2022] POST /identity/v3/users => generated 288 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:22.569409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.618354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18649232-ed9b-4eb9-9b0b-8a5feb4760a9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.622302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7e34-68a7-4b94-a140-5ad790b01d12 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.643885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.645712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.646467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.647185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.647906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.648172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.649663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.650074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.652714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.664968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.664968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.668383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.708027 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2108/4227] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:22.713658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.714423 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2120/4228] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:22.718412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.736083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeace9-6414-4c90-bb80-cfdf7d33e655 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.740840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b04ff-a0be-4f76-9f83-b4aac56d4e3f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.750563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.752391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.752391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.752391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.752391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.755197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.757867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.758521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.759305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.759305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.760130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.761941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.788723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2109/4229] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:22.789814 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2121/4230] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:22.794364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.794920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:22.826170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405a05a-8b46-44a3-8f0b-cf21dfdc09ab admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.827662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44708039-eb0b-4125-986f-5a83672e991d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:22.836668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615174d-23e3-4741-a281-1452a4385303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.837369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615174d-23e3-4741-a281-1452a4385303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.838477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615174d-23e3-4741-a281-1452a4385303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.838477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615174d-23e3-4741-a281-1452a4385303 admin admin] PATH_INFO: `/v3/projects/329d7cb10dbf46688477ab15172e1133/users/52f053dcd6da4102a6bdf18c6bd41752/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.839106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8c353-8008-436a-ae10-34b356178acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:22.840227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8c353-8008-436a-ae10-34b356178acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:22.840535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8c353-8008-436a-ae10-34b356178acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:22.840809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8c353-8008-436a-ae10-34b356178acb admin admin] PATH_INFO: `/v3/projects/45aeca90bf6a47059b8c49e588a329dd/users/a9598b0ec24c4cc49c8a2df17640a791/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:22.877091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615174d-23e3-4741-a281-1452a4385303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329d7cb10dbf46688477ab15172e1133, user_id=52f053dcd6da4102a6bdf18c6bd41752, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.881920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8c353-8008-436a-ae10-34b356178acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=45aeca90bf6a47059b8c49e588a329dd, user_id=a9598b0ec24c4cc49c8a2df17640a791, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:22.902264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8c353-8008-436a-ae10-34b356178acb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:22.903620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615174d-23e3-4741-a281-1452a4385303 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:23.012743 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2110/4231] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:22 2022] PUT /identity/v3/projects/329d7cb10dbf46688477ab15172e1133/users/52f053dcd6da4102a6bdf18c6bd41752/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:23.023700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:23.024087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:23.024465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:23.026581 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2122/4232] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:22 2022] PUT /identity/v3/projects/45aeca90bf6a47059b8c49e588a329dd/users/a9598b0ec24c4cc49c8a2df17640a791/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:23.037613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60622e-163c-4147-a33d-2869c5203783 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:23.044633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60622e-163c-4147-a33d-2869c5203783 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:23.044633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60622e-163c-4147-a33d-2869c5203783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:23.095443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] MFA Rules not processed for user `52f053dcd6da4102a6bdf18c6bd41752`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:23.097094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:23.105346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ea60622e-163c-4147-a33d-2869c5203783 None None] MFA Rules not processed for user `a9598b0ec24c4cc49c8a2df17640a791`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:23.108456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea60622e-163c-4147-a33d-2869c5203783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:23.267930 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2123/4233] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:23.272721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60622e-163c-4147-a33d-2869c5203783 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:23.277234 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2111/4234] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:23.293509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:23.295155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:23.395011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60622e-163c-4147-a33d-2869c5203783 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:23.412121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:23.412763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:23.413041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:23.413312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:23.413952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:23.415923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:23.425557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fd45f-101c-4fcc-81a2-5db92ef09edf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:23.434223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:23.435422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:23.435422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:23.435877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:23.448499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:23.450504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:23.465116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2112/4235] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:23.544441 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2124/4236] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:23 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:23.548436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:23.560673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0783-9d27-4f5f-b232-7ca554582d7c service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:23.663398 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:23.687526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:23.688311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:23.688595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:23.688876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:23.689533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:23.693955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:23.853309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2113/4237] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:23 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:23.857290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:23.876334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a2007-3818-4bc0-ba9f-b9bfb65cd0b5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:23.904911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:23.905466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:23.905745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:23.906034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:23.906693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:23.918753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:23.958275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:23.959964 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2125/4238] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:23.980564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e2a0f-f0bb-4bc9-8adf-6693ded308aa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:24.000660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:24.001479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:24.008693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:24.009191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] PATH_INFO: `/v3/projects/2ebe564df91f4c6e8c3b518e9e325214/users/01a6bbd432204031a9afa34bfe5ce32c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:24.036012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebe564df91f4c6e8c3b518e9e325214, user_id=01a6bbd432204031a9afa34bfe5ce32c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:24.040194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:24.100042 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:24.186021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2114/4239] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:23 2022] PUT /identity/v3/projects/2ebe564df91f4c6e8c3b518e9e325214/users/01a6bbd432204031a9afa34bfe5ce32c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:24.188542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:24.241722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768c053-6537-4821-a6c2-beadb4451ca2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:24.393439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668eb27-aeed-4847-9317-a89c22c45e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:24.394100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668eb27-aeed-4847-9317-a89c22c45e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:24.394589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668eb27-aeed-4847-9317-a89c22c45e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:24.394883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668eb27-aeed-4847-9317-a89c22c45e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:24.395699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668eb27-aeed-4847-9317-a89c22c45e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:24.397568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668eb27-aeed-4847-9317-a89c22c45e6f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:24.423225 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2126/4240] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:24.426908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:24.443377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c9517-5c41-4ef6-88e5-b15319e1401b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:24.456063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:24.456946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:24.457417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:24.457799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] PATH_INFO: `/v3/projects/2ebe564df91f4c6e8c3b518e9e325214/users/01a6bbd432204031a9afa34bfe5ce32c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:24.482629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebe564df91f4c6e8c3b518e9e325214, user_id=01a6bbd432204031a9afa34bfe5ce32c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:24.485800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:24.513219 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2115/4241] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:24 2022] PUT /identity/v3/projects/2ebe564df91f4c6e8c3b518e9e325214/users/01a6bbd432204031a9afa34bfe5ce32c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:24.524932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82b70c-82e7-4a1f-87d4-6d710d40f005 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:24.525314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82b70c-82e7-4a1f-87d4-6d710d40f005 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:24.525660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82b70c-82e7-4a1f-87d4-6d710d40f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:24.561926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bd82b70c-82e7-4a1f-87d4-6d710d40f005 None None] MFA Rules not processed for user `01a6bbd432204031a9afa34bfe5ce32c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:24.563724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd82b70c-82e7-4a1f-87d4-6d710d40f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:24.682759 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2127/4242] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:24.687294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:24.702375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03a20a-be85-47e1-af86-7022c8b407c8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:24.714082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:24.714998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:24.715632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:24.729117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:24.730843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:24.735980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:24.879270 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2116/4243] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:24 2022] POST /identity/v3/services => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:24.879438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82b70c-82e7-4a1f-87d4-6d710d40f005 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:24.891950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82b70c-82e7-4a1f-87d4-6d710d40f005 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:24.899914 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:24.916256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:24.917157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:24.917664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:24.918179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:24.919038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:24.921577 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:24.921577 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:29:24.921577 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:29:24.923187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.060807 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2128/4244] 10.222.0.42 () {60 vars in 1213 bytes} [Sun Oct 23 01:29:24 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:25.065422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.083170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380f12-f82b-4987-ac0b-fb9b78a2aaf5 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.099861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.100506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.100789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.101068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.101935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.103700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.230214 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2117/4245] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:25 2022] POST /identity/v3/services => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:25.233608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.248034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6074f5d-67de-48dd-a530-a8ecf64cc0fa tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.290945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.291592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.291894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.292250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.294072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.301511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.464058 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2129/4246] 10.222.0.42 () {60 vars in 1213 bytes} [Sun Oct 23 01:29:25 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:25.469943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.496246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354a39d-3615-40e9-b15e-aad72f182372 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.528013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.528013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.528013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.528258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.528258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.528258 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:25.528258 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:29:25.528258 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:29:25.528258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.544498 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2118/4247] 10.222.0.42 () {58 vars in 1191 bytes} [Sun Oct 23 01:29:25 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:25.548937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.563968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149353f-09ad-4ca3-9cbd-eb10f3e893bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.577569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.578263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.578642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.578982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.579589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=2eef4e25059a456f87f973a56b28ba1b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.580606 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:25.580606 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:29:25.580606 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:29:25.581567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.601707 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2130/4248] 10.222.0.42 () {58 vars in 1290 bytes} [Sun Oct 23 01:29:25 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:25.603625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.614249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832220-964d-4476-83ba-9c3b430c0e95 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.620064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.620818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.621181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.621537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.622250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=2eef4e25059a456f87f973a56b28ba1b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.623340 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:25.623340 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:29:25.623340 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:29:25.624445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.632282 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2119/4249] 10.222.0.42 () {58 vars in 1291 bytes} [Sun Oct 23 01:29:25 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b => generated 0 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 23 01:29:25.637675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.651947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262087-9ec3-40c6-9129-f4e9c1b54981 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.657603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.658760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.659304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.659994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.660789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=2eef4e25059a456f87f973a56b28ba1b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.663130 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:25.663130 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:29:25.663130 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:29:25.664401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.782072 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2131/4250] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:29:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:25.785606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.802505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61dcc1-b37d-48ab-94ac-e29d02579c3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.830532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.831314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.831674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.832077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.832782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.842134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.865489 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2120/4251] 10.222.0.42 () {58 vars in 1191 bytes} [Sun Oct 23 01:29:25 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:25.868836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.885519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46464d7-a6d3-4d50-a292-e828f174be1e tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.909484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.910442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.910839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.911184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.911924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=2eef4e25059a456f87f973a56b28ba1b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.913782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Could not find Endpoint Group: 2eef4e25059a456f87f973a56b28ba1b.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 2eef4e25059a456f87f973a56b28ba1b. Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 23 01:29:25.959161 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 23 01:29:25.960326 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 23 01:29:25.960326 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 23 01:29:25.960326 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 23 01:29:25.960326 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 23 01:29:25.960326 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 2eef4e25059a456f87f973a56b28ba1b. Oct 23 01:29:25.960326 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:29:25.962240 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2132/4252] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:29:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/2eef4e25059a456f87f973a56b28ba1b => generated 120 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:29:25.965654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:25.980837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcd971-5648-4324-9a72-095ca56815bc tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:25.986995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:25.987785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:25.988136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:25.988483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services/ca36fda4f21b4eb58c23c2792e5e98b0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:25.989398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ca36fda4f21b4eb58c23c2792e5e98b0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:25.991777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:26.117511 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2121/4253] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:25 2022] DELETE /identity/v3/services/ca36fda4f21b4eb58c23c2792e5e98b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:26.122806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:26.135948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6433a-8909-4593-8a1d-bbe03099d20a tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:26.156302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:26.157187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:26.157617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:26.158072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:26.159335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:26.161071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:26.279203 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2133/4254] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:26 2022] POST /identity/v3/services => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:26.280837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:26.292606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c36e-7aa5-4e15-9cd6-74d323c5ab3f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:26.319661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:26.320809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:26.321243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:26.321676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:26.322695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:26.324333 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:26.324333 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:29:26.324333 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:29:26.325530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:26.394886 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:26.426034 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2122/4255] 10.222.0.42 () {60 vars in 1213 bytes} [Sun Oct 23 01:29:26 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:26.428963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:26.443707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8987840-f001-4111-818b-d4b8c3550700 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:26.454221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:26.455212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:26.455761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:26.456262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:26.457598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:26.460202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:26.595625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2134/4256] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:26 2022] POST /identity/v3/services => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:26.596810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:26.615302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278f2ca-9f0f-4f3f-a2b0-3f2f6a5a63e9 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:26.656101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:26.656101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:26.656101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:26.656392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/068eae15431e4056bbc7208d05113a6d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:26.656487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=068eae15431e4056bbc7208d05113a6d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:26.657440 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:26.657440 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:29:26.657440 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:29:26.658487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:26.785001 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2123/4257] 10.222.0.42 () {60 vars in 1313 bytes} [Sun Oct 23 01:29:26 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/068eae15431e4056bbc7208d05113a6d => generated 335 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:26.793234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:26.804463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4a594-4309-4243-9e08-723ccf57269f tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:26.810150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:26.811076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:26.811607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:26.812128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services/68ae4de445e9459e8a7b8019cff3c388` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:26.813013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_service(service_id=68ae4de445e9459e8a7b8019cff3c388)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:26.815017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:26.936801 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2135/4258] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:26 2022] DELETE /identity/v3/services/68ae4de445e9459e8a7b8019cff3c388 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:26.940828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:26.957654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e43cd-ba14-4711-a161-c01c00d60f17 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:26.979427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:26.981472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:26.982335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:26.982751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/068eae15431e4056bbc7208d05113a6d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:26.983845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=068eae15431e4056bbc7208d05113a6d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:26.985925 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:29:26.985925 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:29:26.985925 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:29:26.987897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:27.067287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:27.070064 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2124/4259] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:29:26 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/068eae15431e4056bbc7208d05113a6d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:27.091207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39417e84-007b-44a0-b8b0-1e1565e1d0d0 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:27.104930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:27.106663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:27.107185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:27.107703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services/36b9169a05fa4fbeb7fe5ca020d8dea8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:27.108585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_service(service_id=36b9169a05fa4fbeb7fe5ca020d8dea8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:27.119775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:27.279794 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:27.286739 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2136/4260] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:27 2022] DELETE /identity/v3/services/36b9169a05fa4fbeb7fe5ca020d8dea8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:27.292491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:27.309123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9204f7-ba68-476a-9a68-ec733f40f9f2 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:27.345635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:27.346955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:27.347456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:27.347964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/39149df996094937a70a7209dd8a1243` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:27.348962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=39149df996094937a70a7209dd8a1243)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:27.351000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:27.497300 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2125/4261] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:29:27 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/39149df996094937a70a7209dd8a1243 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:27.501948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:27.531993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5bab-afb6-4e1e-88c4-0938e4fd00cb tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:27.560284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b04c1-8748-46b0-92a4-b39bfd475142 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a6bbd432204031a9afa34bfe5ce32c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ebe564df91f4c6e8c3b518e9e325214', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:27.561944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b04c1-8748-46b0-92a4-b39bfd475142 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:27.562450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b04c1-8748-46b0-92a4-b39bfd475142 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:27.563238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b04c1-8748-46b0-92a4-b39bfd475142 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] PATH_INFO: `/v3/services/2ba3a070840e4eff874defd2ec675f35` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:27.564086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b04c1-8748-46b0-92a4-b39bfd475142 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2ba3a070840e4eff874defd2ec675f35)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:27.566731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b04c1-8748-46b0-92a4-b39bfd475142 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:27.670092 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2137/4262] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:27 2022] DELETE /identity/v3/services/2ba3a070840e4eff874defd2ec675f35 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:27.679443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:27.792996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816caad2-2fa6-4ee5-87db-1d715d882eb8 tempest-EndPointGroupsTest-1503431065 tempest-EndPointGroupsTest-1503431065-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:27.816856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:27.817557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:27.818190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:27.818618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] PATH_INFO: `/v3/users/a9598b0ec24c4cc49c8a2df17640a791` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:27.820720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9598b0ec24c4cc49c8a2df17640a791)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:27.823412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:27.905882 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:28.015914 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:28.183610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9598b0ec24c4cc49c8a2df17640a791'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:28.193824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9598b0ec24c4cc49c8a2df17640a791'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:28.195140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9598b0ec24c4cc49c8a2df17640a791'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:28.286393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9598b0ec24c4cc49c8a2df17640a791'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:28.287262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9598b0ec24c4cc49c8a2df17640a791'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:28.314426 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2126/4263] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:27 2022] DELETE /identity/v3/users/a9598b0ec24c4cc49c8a2df17640a791 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:28.319845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:28.319845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:28.320571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:28.341035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:28.342588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:28.411920 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2138/4264] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:28.447984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:28.450504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:28.602992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d021cf-d1a4-4089-a0e8-0a13f4faa686 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:28.614120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b55f3-66f8-4dc6-b5b6-c800091236c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:28.614120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b55f3-66f8-4dc6-b5b6-c800091236c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:28.614120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b55f3-66f8-4dc6-b5b6-c800091236c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:28.614979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b55f3-66f8-4dc6-b5b6-c800091236c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:28.630008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b55f3-66f8-4dc6-b5b6-c800091236c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:28.631647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b55f3-66f8-4dc6-b5b6-c800091236c6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:28.652023 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2127/4265] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:29.030419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:29.032237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:29.049532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817781b-f9dc-4361-9d7e-82be64af749f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:29.054676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:29.055953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:29.056244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:29.056518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] PATH_INFO: `/v3/users/52f053dcd6da4102a6bdf18c6bd41752` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:29.058121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f053dcd6da4102a6bdf18c6bd41752)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:29.060054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:29.261462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f053dcd6da4102a6bdf18c6bd41752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:29.276141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f053dcd6da4102a6bdf18c6bd41752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:29.277218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f053dcd6da4102a6bdf18c6bd41752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:29.368489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f053dcd6da4102a6bdf18c6bd41752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:29.369510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f053dcd6da4102a6bdf18c6bd41752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:29.392924 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2139/4266] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:29 2022] DELETE /identity/v3/users/52f053dcd6da4102a6bdf18c6bd41752 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:29.397022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:29.397524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:29.397603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:29.421416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:29.422982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:29.492825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:29.495828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:29.527780 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2128/4267] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:29.537514 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:29.560061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:29.562705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:29.741681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f37a1-5b19-4486-b556-9f9cf31f5ca2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:29.759446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:29.760247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:29.760592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:29.761397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:29.780755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1ca6c-1f0d-4765-afbd-cc28f208a003 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:29.792751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:29.793463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:29.794383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:29.794582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:29.795053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:29.795516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] PATH_INFO: `/v3/projects/45aeca90bf6a47059b8c49e588a329dd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:29.797140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=45aeca90bf6a47059b8c49e588a329dd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:29.800161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:29.811576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2129/4268] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:29.965176 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:29.987364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45aeca90bf6a47059b8c49e588a329dd', 'request_id': 'req-118a6213-d5ed-4ad9-bf0c-60def82265cf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:29.995100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45aeca90bf6a47059b8c49e588a329dd', 'request_id': 'req-118a6213-d5ed-4ad9-bf0c-60def82265cf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.105120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45aeca90bf6a47059b8c49e588a329dd', 'request_id': 'req-118a6213-d5ed-4ad9-bf0c-60def82265cf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.130969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] The token cache is being invalidate because project 45aeca90bf6a47059b8c49e588a329dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:30.133695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.135666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.139917 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2140/4269] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:29 2022] DELETE /identity/v3/projects/45aeca90bf6a47059b8c49e588a329dd => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:30.143642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:30.164522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df816ba4-6a83-4d64-a6bb-a6e14791f8e8 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:30.328590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:30.329300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:30.329589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:30.329861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] PATH_INFO: `/v3/users/01a6bbd432204031a9afa34bfe5ce32c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:30.331146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a6bbd432204031a9afa34bfe5ce32c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:30.333822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:30.533846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a6bbd432204031a9afa34bfe5ce32c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.541931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a6bbd432204031a9afa34bfe5ce32c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.542803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a6bbd432204031a9afa34bfe5ce32c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.799223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a6bbd432204031a9afa34bfe5ce32c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.800136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ef4b850-557c-4e06-b999-5d6345c180ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a6bbd432204031a9afa34bfe5ce32c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:30.839780 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2130/4270] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:30 2022] DELETE /identity/v3/users/01a6bbd432204031a9afa34bfe5ce32c => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:31.095541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:31.097569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:31.128178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6213-d5ed-4ad9-bf0c-60def82265cf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:31.270189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:31.272174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:31.272531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:31.272814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] PATH_INFO: `/v3/projects/329d7cb10dbf46688477ab15172e1133` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:31.275638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=329d7cb10dbf46688477ab15172e1133)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:31.278116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:31.528000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329d7cb10dbf46688477ab15172e1133', 'request_id': 'req-cdae53ba-d121-4c6b-8b2d-acc050cad22b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:31.548353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329d7cb10dbf46688477ab15172e1133', 'request_id': 'req-cdae53ba-d121-4c6b-8b2d-acc050cad22b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:31.662416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329d7cb10dbf46688477ab15172e1133', 'request_id': 'req-cdae53ba-d121-4c6b-8b2d-acc050cad22b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:31.710809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] The token cache is being invalidate because project 329d7cb10dbf46688477ab15172e1133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:31.711139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:31.715164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cdae53ba-d121-4c6b-8b2d-acc050cad22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:31.719756 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2141/4271] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:31 2022] DELETE /identity/v3/projects/329d7cb10dbf46688477ab15172e1133 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:31.730309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f2852-71fe-46e9-966b-86e58ef0c84b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:31.730309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f2852-71fe-46e9-966b-86e58ef0c84b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:31.730309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f2852-71fe-46e9-966b-86e58ef0c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:31.764496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-530f2852-71fe-46e9-966b-86e58ef0c84b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:31.764496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-530f2852-71fe-46e9-966b-86e58ef0c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:31.884911 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2131/4272] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:31.892901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e5d2-7217-4cc1-929c-b1d61c11d8f1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:31.893259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e5d2-7217-4cc1-929c-b1d61c11d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:31.893538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e5d2-7217-4cc1-929c-b1d61c11d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:31.928147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6224e5d2-7217-4cc1-929c-b1d61c11d8f1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:31.930470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6224e5d2-7217-4cc1-929c-b1d61c11d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:31.943090 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2142/4273] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:31.944304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f2852-71fe-46e9-966b-86e58ef0c84b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:31.954450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f2852-71fe-46e9-966b-86e58ef0c84b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:31.966073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:31.966888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:31.967408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:31.967736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:31.968349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:31.968652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:31.970255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:31.985632 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2132/4274] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:31.989905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e5d2-7217-4cc1-929c-b1d61c11d8f1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.000209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e5d2-7217-4cc1-929c-b1d61c11d8f1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:32.015880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:32.016612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:32.016895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:32.017214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:32.018591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:32.022293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:32.121108 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2143/4275] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:31 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:32.125111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.137358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d352b-c0a6-4a85-b694-9c996d887c2e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:32.236692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:32.237305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:32.237652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:32.237995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:32.238618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:32.241158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:32.349149 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2133/4276] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:32 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:32.350589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.367661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29d4e5-baea-420a-a4e4-4ec5d58d63c0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:32.374618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:32.377462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:32.377462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:32.377462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:32.377462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:32.380511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:32.395269 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2144/4277] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:32.399041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.410321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146aa3-bd9b-41f1-aacd-5a6b32498435 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:32.423730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:32.425468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:32.425468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:32.425468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:32.425710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:32.429181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:32.463121 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2134/4278] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:32.464509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.476367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff90a7-e9f5-409b-86b0-d0ae1f2abb9f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:32.489492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16e7ad-83bf-4540-bfba-f69c3f7fd652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:32.491350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e7ad-83bf-4540-bfba-f69c3f7fd652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:32.491787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e7ad-83bf-4540-bfba-f69c3f7fd652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:32.492206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e7ad-83bf-4540-bfba-f69c3f7fd652 admin admin] PATH_INFO: `/v3/projects/b6df910969eb472b97fb3fe05a3c85d3/users/3b7f0931fbb64e96868a0044b0c6c557/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:32.515530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16e7ad-83bf-4540-bfba-f69c3f7fd652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6df910969eb472b97fb3fe05a3c85d3, user_id=3b7f0931fbb64e96868a0044b0c6c557, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:32.518865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16e7ad-83bf-4540-bfba-f69c3f7fd652 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:32.552188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.554366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:32.572989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bb273-6d97-4f81-93f2-dac991443a90 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:32.581614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:32.582555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:32.583687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:32.584227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] PATH_INFO: `/v3/projects/2ebe564df91f4c6e8c3b518e9e325214` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:32.585885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebe564df91f4c6e8c3b518e9e325214)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:32.589341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:32.662511 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2145/4279] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:32 2022] PUT /identity/v3/projects/b6df910969eb472b97fb3fe05a3c85d3/users/3b7f0931fbb64e96868a0044b0c6c557/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:32.667572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:32.667967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:32.668239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:32.712656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:32.718475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:32.783276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2146/4280] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:32.799663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.801109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:32.824234 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:32.828214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebe564df91f4c6e8c3b518e9e325214', 'request_id': 'req-d830724b-ded0-43c8-8f51-adb3624b246e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:32.838176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebe564df91f4c6e8c3b518e9e325214', 'request_id': 'req-d830724b-ded0-43c8-8f51-adb3624b246e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:32.902740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1751-a796-49f6-8c60-def8cde4db9b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:32.933888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebe564df91f4c6e8c3b518e9e325214', 'request_id': 'req-d830724b-ded0-43c8-8f51-adb3624b246e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:32.949581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] The token cache is being invalidate because project 2ebe564df91f4c6e8c3b518e9e325214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:32.949744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:32.950891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:32.958964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2135/4281] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:32 2022] DELETE /identity/v3/projects/2ebe564df91f4c6e8c3b518e9e325214 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:32.962822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:32.962822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:33.005257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99674f57-462e-4f3b-b43d-4753639649c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.006178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99674f57-462e-4f3b-b43d-4753639649c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.006460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99674f57-462e-4f3b-b43d-4753639649c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.006797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99674f57-462e-4f3b-b43d-4753639649c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.012233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-99674f57-462e-4f3b-b43d-4753639649c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:33.048523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830724b-ded0-43c8-8f51-adb3624b246e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:33.057013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.058188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.058664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.059405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] PATH_INFO: `/v3/users/68b4f2b9134c46828a62028900645a21` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.060962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b4f2b9134c46828a62028900645a21)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.063854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:33.108723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99674f57-462e-4f3b-b43d-4753639649c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.110279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99674f57-462e-4f3b-b43d-4753639649c6 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:33.119986 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2147/4282] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:33.121149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90278-ae55-46f7-9a1a-fdffb13256cd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.121778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90278-ae55-46f7-9a1a-fdffb13256cd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.121778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90278-ae55-46f7-9a1a-fdffb13256cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.155204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-62f90278-ae55-46f7-9a1a-fdffb13256cd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:33.157332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-62f90278-ae55-46f7-9a1a-fdffb13256cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:33.167731 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2148/4283] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:33.177135 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:33.206646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ae71-39cd-4d34-a7ef-fc1ff6c4c398 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.206931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ae71-39cd-4d34-a7ef-fc1ff6c4c398 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.207205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ae71-39cd-4d34-a7ef-fc1ff6c4c398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.263540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-64a5ae71-39cd-4d34-a7ef-fc1ff6c4c398 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:33.265829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-64a5ae71-39cd-4d34-a7ef-fc1ff6c4c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:33.280389 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2149/4284] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:33.286999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ae71-39cd-4d34-a7ef-fc1ff6c4c398 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:33.300584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ae71-39cd-4d34-a7ef-fc1ff6c4c398 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:33.308654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.309536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.310017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.310558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.311391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:33.311866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.313634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:33.350560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b4f2b9134c46828a62028900645a21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:33.350662 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2150/4285] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:33.351272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:33.365463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b4f2b9134c46828a62028900645a21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:33.366547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b4f2b9134c46828a62028900645a21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:33.368304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c16de-50c6-4d00-acff-a116500331f6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:33.376542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.377090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.377367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.377638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.378658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.382933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:33.429051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b4f2b9134c46828a62028900645a21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:33.430152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c40fcda-0c07-4494-a27d-c56f151cb9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b4f2b9134c46828a62028900645a21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:33.459704 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2136/4286] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:32 2022] DELETE /identity/v3/users/68b4f2b9134c46828a62028900645a21 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:33.461347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.461849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.462283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.501165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:33.503286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:33.525958 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2151/4287] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:33 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:33.528895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:33.534523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:33.599612 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2137/4288] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:33.612642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:33.615232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:33.626520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef04f52-9e04-4077-b0d8-ce71b45cc842 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:33.636502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.637124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.637401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.637676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.638417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.640337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:33.693060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215f7ed-3a40-4069-ba32-b52114c5ca6d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:33.795547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.796099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.796378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.796650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.809542 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2152/4289] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:33 2022] POST /identity/v3/users => generated 303 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:33.810512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.812221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:33.813792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:33.827603 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2138/4290] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:33.847731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5070b04-e770-4d5b-a0ce-dd95ccf8a21a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:33.857749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.858521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.858871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.859260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.860992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.864779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:33.881353 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2153/4291] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:33.885616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:33.897348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da793a-8c6a-4609-9363-a0ff3ae8e495 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:33.905507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:33.907187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:33.907474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:33.907745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] PATH_INFO: `/v3/projects/7b8f741fe37049c4a2061b0451170916/users/6cfa75d3da71478398788e5c0a1769b9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:33.934020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8f741fe37049c4a2061b0451170916, user_id=6cfa75d3da71478398788e5c0a1769b9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:33.937297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:34.048344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2139/4292] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:33 2022] PUT /identity/v3/projects/7b8f741fe37049c4a2061b0451170916/users/6cfa75d3da71478398788e5c0a1769b9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:34.055151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:34.085919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b1c08-3cc7-46c4-ac77-1e4d8e51280b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:34.152852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc54397-0ede-4c67-98a4-79a825a400bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:34.153450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc54397-0ede-4c67-98a4-79a825a400bc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.153727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc54397-0ede-4c67-98a4-79a825a400bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.158161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc54397-0ede-4c67-98a4-79a825a400bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.160627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc54397-0ede-4c67-98a4-79a825a400bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:34.165860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc54397-0ede-4c67-98a4-79a825a400bc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:34.185270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2154/4293] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:34.193516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:34.205613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc021b04-e86b-42e9-8a40-50c60d64188f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:34.211629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:34.212649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.213110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.213544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] PATH_INFO: `/v3/projects/7b8f741fe37049c4a2061b0451170916/users/6cfa75d3da71478398788e5c0a1769b9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.217597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8f741fe37049c4a2061b0451170916, user_id=6cfa75d3da71478398788e5c0a1769b9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:34.219105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:34.238761 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2140/4294] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:34 2022] PUT /identity/v3/projects/7b8f741fe37049c4a2061b0451170916/users/6cfa75d3da71478398788e5c0a1769b9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:34.245274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3ff28-ff9b-4385-9a93-b8038d6d8ca1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.245813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3ff28-ff9b-4385-9a93-b8038d6d8ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.246315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3ff28-ff9b-4385-9a93-b8038d6d8ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.283999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fad3ff28-ff9b-4385-9a93-b8038d6d8ca1 None None] MFA Rules not processed for user `6cfa75d3da71478398788e5c0a1769b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:34.285293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fad3ff28-ff9b-4385-9a93-b8038d6d8ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:34.362637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:34.364410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:34.401141 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2155/4295] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:34.402359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3ff28-ff9b-4385-9a93-b8038d6d8ca1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:34.516820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae70729-6858-43a0-8295-f6bfc77ec613 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:34.544787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:34.545785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.547685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.547953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] PATH_INFO: `/v3/projects/a1cdccdb04b14e379dae32f8ca190716` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.552735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cdccdb04b14e379dae32f8ca190716)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:34.559892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:34.565664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3ff28-ff9b-4385-9a93-b8038d6d8ca1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:34.586568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:34.587207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.587488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.587804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.588866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:34.594165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:34.792107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cdccdb04b14e379dae32f8ca190716', 'request_id': 'req-51c03769-329a-4850-a771-b362a00f1445'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:34.797712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cdccdb04b14e379dae32f8ca190716', 'request_id': 'req-51c03769-329a-4850-a771-b362a00f1445'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:34.831847 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2156/4296] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:34 2022] POST /identity/v3/projects => generated 393 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:34.836388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:34.884878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cdccdb04b14e379dae32f8ca190716', 'request_id': 'req-51c03769-329a-4850-a771-b362a00f1445'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:34.903409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] The token cache is being invalidate because project a1cdccdb04b14e379dae32f8ca190716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:34.904875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:34.905924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-51c03769-329a-4850-a771-b362a00f1445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:34.914399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2141/4297] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:34 2022] DELETE /identity/v3/projects/a1cdccdb04b14e379dae32f8ca190716 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:34.919464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b227b6-6435-4b78-8648-9589f1b92764 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.919941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b227b6-6435-4b78-8648-9589f1b92764 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.920853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b227b6-6435-4b78-8648-9589f1b92764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.959371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e0b227b6-6435-4b78-8648-9589f1b92764 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:34.960931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e0b227b6-6435-4b78-8648-9589f1b92764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:34.975938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f001c-1331-452b-9bb9-29dc7c704554 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:34.976618 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2142/4298] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:34.984764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63960-071c-4fab-adeb-bce89e8f76dc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.985158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63960-071c-4fab-adeb-bce89e8f76dc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.985462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63960-071c-4fab-adeb-bce89e8f76dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.987319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:34.988213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:34.989291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:34.989773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:34.991364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:34.993774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.009182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-50c63960-071c-4fab-adeb-bce89e8f76dc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:35.010665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-50c63960-071c-4fab-adeb-bce89e8f76dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:35.019176 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2143/4299] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:35.023900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c63960-071c-4fab-adeb-bce89e8f76dc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.033046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c63960-071c-4fab-adeb-bce89e8f76dc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.044161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.045092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.045507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.045785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.046644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:35.054088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.054088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.063987 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2144/4300] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:29:35.068607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.093667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96034a-0328-467b-b294-d892fbe3e291 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.101814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.102541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.103416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.103704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.104450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.106495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.154484 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2157/4301] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:34 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:35.158577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.160540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:35.174033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1959c-74f5-42d7-aa74-131b83dfe878 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.180004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.180928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.181432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.182029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.183775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.185848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.215913 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2158/4302] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:35.219839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.235769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93cb6-61fb-44b6-b487-1b22c4ae7ef1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.250328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.251340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.251721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.252094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.252913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.255237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.268985 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2145/4303] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:35 2022] POST /identity/v3/projects => generated 405 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:35.269253 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2159/4304] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:35.273767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.276385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.290510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d04439-62ee-429d-86db-379cec8af5b6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.407392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2aef6-6d9e-41f1-9d83-83345eee307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.409448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2aef6-6d9e-41f1-9d83-83345eee307d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.411694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2aef6-6d9e-41f1-9d83-83345eee307d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.412097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2aef6-6d9e-41f1-9d83-83345eee307d admin admin] PATH_INFO: `/v3/projects/d8989220ef78474680f2f32e30cecd58/users/96073650fc5249f5946ab65cfc10cff1/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.416825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9a7e3-130d-4028-8604-c6d023393e57 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.422867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.423877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.424354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.424896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.425720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.429276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.449321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2aef6-6d9e-41f1-9d83-83345eee307d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8989220ef78474680f2f32e30cecd58, user_id=96073650fc5249f5946ab65cfc10cff1, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.452412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2aef6-6d9e-41f1-9d83-83345eee307d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.453901 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:35.556328 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2146/4305] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:35 2022] POST /identity/v3/users => generated 303 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:35.560869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.578172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7146a5-085e-4fdf-9b9f-108e140e5b24 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.604788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.606169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.609005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.609005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.609005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.611428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.630982 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2147/4306] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:35.635777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.637727 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2160/4307] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:35 2022] PUT /identity/v3/projects/d8989220ef78474680f2f32e30cecd58/users/96073650fc5249f5946ab65cfc10cff1/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:35.650303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.650829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.651281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.669355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb98e1-a93d-49e3-be5d-34b14f2e2767 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.834900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.835611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.835899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.836174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.836831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.839070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:35.862605 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2148/4308] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:35.867000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:35.895976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121879b9-8e78-4200-afd4-e4f927cb182b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:35.906991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90184-8ad7-4937-8dbb-c9f967f439db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:35.907826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90184-8ad7-4937-8dbb-c9f967f439db admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:35.908262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90184-8ad7-4937-8dbb-c9f967f439db admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:35.908681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90184-8ad7-4937-8dbb-c9f967f439db admin admin] PATH_INFO: `/v3/projects/d8971f3814084c6aae66ad66f720d700/users/1c32ab72d3274afc86683737289f178d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:35.943561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90184-8ad7-4937-8dbb-c9f967f439db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8971f3814084c6aae66ad66f720d700, user_id=1c32ab72d3274afc86683737289f178d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:35.951430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90184-8ad7-4937-8dbb-c9f967f439db admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:36.017520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] MFA Rules not processed for user `96073650fc5249f5946ab65cfc10cff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:36.018692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:36.086526 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2149/4309] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:35 2022] PUT /identity/v3/projects/d8971f3814084c6aae66ad66f720d700/users/1c32ab72d3274afc86683737289f178d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:36.098510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d663-b26c-42f0-9fd0-564a3fce72f9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:36.098834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d663-b26c-42f0-9fd0-564a3fce72f9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:36.099075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d663-b26c-42f0-9fd0-564a3fce72f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:36.121387 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2161/4310] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:36.136973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:36.139555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:36.158681 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:36.161343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-55d5d663-b26c-42f0-9fd0-564a3fce72f9 None None] MFA Rules not processed for user `1c32ab72d3274afc86683737289f178d`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:36.165352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-55d5d663-b26c-42f0-9fd0-564a3fce72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:36.269788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ee62f-fd3c-4b6e-ac64-4319f549185f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:36.292505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2150/4311] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:36.299028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d663-b26c-42f0-9fd0-564a3fce72f9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:36.336490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:36.337117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:36.337381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:36.338989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:36.340072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:36.421368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d663-b26c-42f0-9fd0-564a3fce72f9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:36.432299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:36.432900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:36.433177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:36.434324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:36.435780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:36.436691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:36.447567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:36.450787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:36.481542 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2162/4312] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:36.591149 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2151/4313] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:36 2022] POST /identity/v3/projects => generated 403 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:36.593906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:36.617865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748552b-633a-4287-aec6-f3a51e421605 service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:36.802707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:36.803659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:36.804123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:36.804592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:36.805407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:36.807558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:37.055877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2163/4314] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:36 2022] POST /identity/v3/users => generated 308 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:37.059672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:37.074529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3cf05-06bc-400b-af41-bc1b871dbf19 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:37.092203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:37.093257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:37.093750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:37.094279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:37.095151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:37.099318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:37.126122 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2152/4315] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:37.132214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:37.146870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda25130-d971-44ec-9b08-6974b628a112 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:37.159614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:37.161918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:37.162406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:37.162611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] PATH_INFO: `/v3/projects/55b447af8f6e4c5d9720f3d0ba805056/users/c98ec6941204485da7c159c2656f77ab/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:37.186805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b447af8f6e4c5d9720f3d0ba805056, user_id=c98ec6941204485da7c159c2656f77ab, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:37.193766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:37.289918 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2164/4316] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:37 2022] PUT /identity/v3/projects/55b447af8f6e4c5d9720f3d0ba805056/users/c98ec6941204485da7c159c2656f77ab/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:37.291526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:37.322543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588996cb-3fcb-4863-9cd8-75c753a61612 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:37.474678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c653d-3f68-46b3-95e4-815ee965bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:37.475425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c653d-3f68-46b3-95e4-815ee965bc26 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:37.475778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c653d-3f68-46b3-95e4-815ee965bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:37.476119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c653d-3f68-46b3-95e4-815ee965bc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:37.476851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c653d-3f68-46b3-95e4-815ee965bc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:37.478574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c653d-3f68-46b3-95e4-815ee965bc26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:37.497827 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2153/4317] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:37.500206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:37.514085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7538-b556-45be-9070-3aa77ce6b57d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:37.526694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:37.527383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:37.527668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:37.527946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] PATH_INFO: `/v3/projects/55b447af8f6e4c5d9720f3d0ba805056/users/c98ec6941204485da7c159c2656f77ab/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:37.537752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b447af8f6e4c5d9720f3d0ba805056, user_id=c98ec6941204485da7c159c2656f77ab, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:37.548918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:37.577404 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2165/4318] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:37 2022] PUT /identity/v3/projects/55b447af8f6e4c5d9720f3d0ba805056/users/c98ec6941204485da7c159c2656f77ab/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:37.587146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb21de-7234-47bc-b086-7a4483bf81db None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:37.587752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb21de-7234-47bc-b086-7a4483bf81db None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:37.592653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb21de-7234-47bc-b086-7a4483bf81db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:37.611022 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:37.650475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-93cb21de-7234-47bc-b086-7a4483bf81db None None] MFA Rules not processed for user `c98ec6941204485da7c159c2656f77ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:37.654416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-93cb21de-7234-47bc-b086-7a4483bf81db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:37.945719 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2154/4319] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:37 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:37.953121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:37.958705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:38.143718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a961d-2673-41e7-9273-4379a0f021d7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:38.152902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02254e3-609a-4085-9738-b6fa18f2f619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:38.155007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02254e3-609a-4085-9738-b6fa18f2f619 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:38.155434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02254e3-609a-4085-9738-b6fa18f2f619 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:38.155707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02254e3-609a-4085-9738-b6fa18f2f619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:38.183862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02254e3-609a-4085-9738-b6fa18f2f619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:38.190319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02254e3-609a-4085-9738-b6fa18f2f619 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:38.216763 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:38.246128 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2166/4320] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:37 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:38.537096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb21de-7234-47bc-b086-7a4483bf81db None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:38.705727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb21de-7234-47bc-b086-7a4483bf81db None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:38.712693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:38.713447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:38.713732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:38.714075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] PATH_INFO: `/v3/users/1c32ab72d3274afc86683737289f178d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:38.715744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c32ab72d3274afc86683737289f178d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:38.718046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:38.950130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c32ab72d3274afc86683737289f178d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:38.965314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c32ab72d3274afc86683737289f178d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:38.966550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c32ab72d3274afc86683737289f178d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:39.062455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c32ab72d3274afc86683737289f178d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:39.063166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c32ab72d3274afc86683737289f178d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:39.092791 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2155/4321] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:38 2022] DELETE /identity/v3/users/1c32ab72d3274afc86683737289f178d => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:39.094637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:39.096549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:39.096993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:39.140301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:39.142125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:39.247211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:39.248759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:39.338766 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2167/4322] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:39.356247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:39.366066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:39.440061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a1eb4-69f8-4133-bfcc-ae430e3b52ad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:39.465439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:39.466160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:39.466441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:39.466712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] PATH_INFO: `/v3/users/6cfa75d3da71478398788e5c0a1769b9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:39.472610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfa75d3da71478398788e5c0a1769b9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:39.472610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:39.631804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290ceb1-8dec-47f0-98ee-b1238cb68a1d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:39.642048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d83af-a155-4028-a03c-45d283f50ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:39.646044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d83af-a155-4028-a03c-45d283f50ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:39.646428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d83af-a155-4028-a03c-45d283f50ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:39.646714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d83af-a155-4028-a03c-45d283f50ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:39.688462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d83af-a155-4028-a03c-45d283f50ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:39.690053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d83af-a155-4028-a03c-45d283f50ffd service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:39.733320 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2168/4323] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:39.784196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfa75d3da71478398788e5c0a1769b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:39.817991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfa75d3da71478398788e5c0a1769b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:39.822759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfa75d3da71478398788e5c0a1769b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:39.954040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfa75d3da71478398788e5c0a1769b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:39.956288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfa75d3da71478398788e5c0a1769b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:40.002083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2156/4324] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:39 2022] DELETE /identity/v3/users/6cfa75d3da71478398788e5c0a1769b9 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:40.007402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:40.007691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:40.007966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:40.041957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:40.043239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:40.099468 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:40.249504 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2169/4325] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:40.288263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:40.289632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:40.498463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb18d-75d7-4ebc-89a3-5920a4a047c2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:40.515313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:40.516154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:40.517639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:40.518038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:40.542173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:40.543878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:40.571487 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2157/4326] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:41.246541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:41.247991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:41.267548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943127-87d3-4264-9361-69a7fa0d87d0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:41.286016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:41.286647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:41.286910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:41.287222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] PATH_INFO: `/v3/projects/d8971f3814084c6aae66ad66f720d700` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:41.296233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8971f3814084c6aae66ad66f720d700)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:41.298203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:41.533652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8971f3814084c6aae66ad66f720d700', 'request_id': 'req-84dca95b-5248-4046-ac12-e4ef31f204a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:41.571661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8971f3814084c6aae66ad66f720d700', 'request_id': 'req-84dca95b-5248-4046-ac12-e4ef31f204a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:41.600163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:41.601773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:41.623891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab48e3-72cf-434e-851a-def5b7a7e750 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:41.677259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8971f3814084c6aae66ad66f720d700', 'request_id': 'req-84dca95b-5248-4046-ac12-e4ef31f204a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:41.701241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] The token cache is being invalidate because project d8971f3814084c6aae66ad66f720d700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:41.703239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:41.708411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:41.712910 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:41.718970 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2170/4327] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:41 2022] DELETE /identity/v3/projects/d8971f3814084c6aae66ad66f720d700 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:41.721452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:41.726318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:41.815505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:41.816529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:41.817055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:41.817579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] PATH_INFO: `/v3/projects/7b8f741fe37049c4a2061b0451170916` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:41.819392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8f741fe37049c4a2061b0451170916)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:41.821733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:41.960011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca95b-5248-4046-ac12-e4ef31f204a6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:41.972262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:41.972846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:41.973665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:41.973938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] PATH_INFO: `/v3/users/c98ec6941204485da7c159c2656f77ab` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:41.979643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98ec6941204485da7c159c2656f77ab)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:41.984035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:42.031723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8f741fe37049c4a2061b0451170916', 'request_id': 'req-14bf423e-c821-429c-8b5a-8e919c649258'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.069055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8f741fe37049c4a2061b0451170916', 'request_id': 'req-14bf423e-c821-429c-8b5a-8e919c649258'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.182548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8f741fe37049c4a2061b0451170916', 'request_id': 'req-14bf423e-c821-429c-8b5a-8e919c649258'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.204473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] The token cache is being invalidate because project 7b8f741fe37049c4a2061b0451170916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:42.204774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.205468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.207061 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2158/4328] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:41 2022] DELETE /identity/v3/projects/7b8f741fe37049c4a2061b0451170916 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:42.211532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:42.213318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:42.290375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98ec6941204485da7c159c2656f77ab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.325002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98ec6941204485da7c159c2656f77ab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.329171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98ec6941204485da7c159c2656f77ab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.428603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98ec6941204485da7c159c2656f77ab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.429808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98ec6941204485da7c159c2656f77ab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.450432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf423e-c821-429c-8b5a-8e919c649258 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:42.456799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:42.457928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:42.458447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:42.459093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] PATH_INFO: `/v3/users/96073650fc5249f5946ab65cfc10cff1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:42.463067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96073650fc5249f5946ab65cfc10cff1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:42.465679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:42.491592 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2171/4329] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:41 2022] DELETE /identity/v3/users/c98ec6941204485da7c159c2656f77ab => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:42.866714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96073650fc5249f5946ab65cfc10cff1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.885299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96073650fc5249f5946ab65cfc10cff1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.886953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96073650fc5249f5946ab65cfc10cff1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.998692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96073650fc5249f5946ab65cfc10cff1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:42.999357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96073650fc5249f5946ab65cfc10cff1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:43.040067 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2159/4330] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:42 2022] DELETE /identity/v3/users/96073650fc5249f5946ab65cfc10cff1 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:43.222783 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:44.139230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:44.144022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:44.244228 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:44.349279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc0df5-64ae-4bbc-97c2-9cfccc51ad12 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:44.497506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:44.498548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:44.498994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:44.499419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] PATH_INFO: `/v3/projects/d8989220ef78474680f2f32e30cecd58` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:44.510571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8989220ef78474680f2f32e30cecd58)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:44.513090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:44.661351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:44.663321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:44.689296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8989220ef78474680f2f32e30cecd58', 'request_id': 'req-ce8a6122-5358-4b46-9466-2c9ace74399c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:44.699242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26042-20b4-4138-9777-41ba22f7a58d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:44.711383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8989220ef78474680f2f32e30cecd58', 'request_id': 'req-ce8a6122-5358-4b46-9466-2c9ace74399c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:44.815748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8989220ef78474680f2f32e30cecd58', 'request_id': 'req-ce8a6122-5358-4b46-9466-2c9ace74399c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:44.838728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] The token cache is being invalidate because project d8989220ef78474680f2f32e30cecd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:44.838728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:44.844551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8a6122-5358-4b46-9466-2c9ace74399c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:44.844551 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2172/4331] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:44 2022] DELETE /identity/v3/projects/d8989220ef78474680f2f32e30cecd58 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:44.846795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea89d0-6f9e-4cbf-9018-ebc8d03902e6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:44.847078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea89d0-6f9e-4cbf-9018-ebc8d03902e6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:44.847352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea89d0-6f9e-4cbf-9018-ebc8d03902e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:44.901665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9aea89d0-6f9e-4cbf-9018-ebc8d03902e6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:44.902950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9aea89d0-6f9e-4cbf-9018-ebc8d03902e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:44.967709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:44.968415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:44.969294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:44.969575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] PATH_INFO: `/v3/projects/55b447af8f6e4c5d9720f3d0ba805056` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:44.970962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b447af8f6e4c5d9720f3d0ba805056)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:44.973815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:45.028537 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2173/4332] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:45.037015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a421ba-4b12-400b-adc7-288ce4c5ea81 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.037375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a421ba-4b12-400b-adc7-288ce4c5ea81 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.037621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a421ba-4b12-400b-adc7-288ce4c5ea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.070155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-47a421ba-4b12-400b-adc7-288ce4c5ea81 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:45.071367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47a421ba-4b12-400b-adc7-288ce4c5ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:45.088409 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2174/4333] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:45.092261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a421ba-4b12-400b-adc7-288ce4c5ea81 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:45.109615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a421ba-4b12-400b-adc7-288ce4c5ea81 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:45.118896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:45.119521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.119797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.120063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.121756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:45.122199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:45.123980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:45.138811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2175/4334] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:45.142937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:45.158598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b447af8f6e4c5d9720f3d0ba805056', 'request_id': 'req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:45.159982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f213a39-0cc0-47e8-87ce-d5dfb31b5bda admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:45.169349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b447af8f6e4c5d9720f3d0ba805056', 'request_id': 'req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:45.258777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72275694-5b14-4edb-ac98-a31823df599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:45.259819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275694-5b14-4edb-ac98-a31823df599c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.260879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275694-5b14-4edb-ac98-a31823df599c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.261426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275694-5b14-4edb-ac98-a31823df599c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.262591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72275694-5b14-4edb-ac98-a31823df599c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:45.268073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72275694-5b14-4edb-ac98-a31823df599c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:45.333730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b447af8f6e4c5d9720f3d0ba805056', 'request_id': 'req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:45.356972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] The token cache is being invalidate because project 55b447af8f6e4c5d9720f3d0ba805056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:45.356972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:45.357921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-38f3bfa2-4be9-4764-96ce-2fc9b8e8765a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:45.361365 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2160/4335] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:44 2022] DELETE /identity/v3/projects/55b447af8f6e4c5d9720f3d0ba805056 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:45.362801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cef4-1aa6-4f35-95de-95d32415d8b4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.365612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cef4-1aa6-4f35-95de-95d32415d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.366080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cef4-1aa6-4f35-95de-95d32415d8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.380393 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2176/4336] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:45 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:45.382872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.384679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.384679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.413216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:45.415052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:45.482973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5dd9cef4-1aa6-4f35-95de-95d32415d8b4 None None] MFA Rules not processed for user `3b7f0931fbb64e96868a0044b0c6c557`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:45.484466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5dd9cef4-1aa6-4f35-95de-95d32415d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:45.498892 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2177/4337] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:45.499811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:45.501939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:45.517000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184bd84-8a5c-4be5-a69d-14c36fa85017 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:45.524036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e75163-0d7e-4a3a-9bc0-302d71074b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:45.525490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75163-0d7e-4a3a-9bc0-302d71074b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.525875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75163-0d7e-4a3a-9bc0-302d71074b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.526276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75163-0d7e-4a3a-9bc0-302d71074b94 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.527310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e75163-0d7e-4a3a-9bc0-302d71074b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:45.529620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e75163-0d7e-4a3a-9bc0-302d71074b94 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:45.576263 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:45.632598 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2178/4338] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:45 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:45.635141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b410ac-de5e-4890-8556-47554b66ad37 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.635615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b410ac-de5e-4890-8556-47554b66ad37 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.637558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b410ac-de5e-4890-8556-47554b66ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.643658 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2161/4339] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:45.644536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cef4-1aa6-4f35-95de-95d32415d8b4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:45.671439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cef4-1aa6-4f35-95de-95d32415d8b4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:45.685431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:45.686361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.686800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.687260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.688092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:45.689879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:45.712947 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2162/4340] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:45.714096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:45.722035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:45.729531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d5b410ac-de5e-4890-8556-47554b66ad37 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:45.737131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d5b410ac-de5e-4890-8556-47554b66ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:45.778459 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2179/4341] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:45.779230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b410ac-de5e-4890-8556-47554b66ad37 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:45.814209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b410ac-de5e-4890-8556-47554b66ad37 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:45.833871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:45.834600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.834886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.844110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] PATH_INFO: `/v3/projects/0e921fbba52a4e7b979832cb70e8068c/users/d487fc9cbafd45ac8e9e4a2b796f9dc5/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.877397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e921fbba52a4e7b979832cb70e8068c, user_id=d487fc9cbafd45ac8e9e4a2b796f9dc5, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:45.884626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:45.950506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cee87-892e-460f-b95e-1f707528d869 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:45.967044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:45.967758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:45.968422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:45.968704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:45.988833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:45.990508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:46.017106 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2163/4342] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:46.017700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:46.049232 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2180/4343] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:45 2022] PUT /identity/v3/projects/0e921fbba52a4e7b979832cb70e8068c/users/d487fc9cbafd45ac8e9e4a2b796f9dc5/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:46.050613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:46.101439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23647000-96b4-46a4-bad1-bc51b0b289c3 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:46.290973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:46.292102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:46.294783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:46.296998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:46.297965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:46.298885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:46.309516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:46.334781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6e04-1756-44b0-848c-a676be238ffe admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:46.345284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2164/4344] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:46.349670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:46.371396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78256c6-1415-49ae-9f37-c0249156525e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:46.376003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:46.376658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:46.386681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:46.387120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:46.387748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:46.388457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:46.389327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:46.389826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:46.390397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:46.391804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:46.397333 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:46.403157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:46.403834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:46.450015 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2181/4345] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:46.450973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:46.484405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3053ee-aa38-4f79-a8aa-7fb3d288d8dd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:46.497301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff31506-fb25-4da6-a4a0-402007a83c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:46.498115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31506-fb25-4da6-a4a0-402007a83c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:46.498400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31506-fb25-4da6-a4a0-402007a83c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:46.498680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31506-fb25-4da6-a4a0-402007a83c9e admin admin] PATH_INFO: `/v3/projects/0e921fbba52a4e7b979832cb70e8068c/users/d487fc9cbafd45ac8e9e4a2b796f9dc5/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:46.505684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff31506-fb25-4da6-a4a0-402007a83c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e921fbba52a4e7b979832cb70e8068c, user_id=d487fc9cbafd45ac8e9e4a2b796f9dc5, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:46.508430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff31506-fb25-4da6-a4a0-402007a83c9e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:46.522521 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2165/4346] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:46 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:46.523823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:46.538283 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2182/4347] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:46 2022] PUT /identity/v3/projects/0e921fbba52a4e7b979832cb70e8068c/users/d487fc9cbafd45ac8e9e4a2b796f9dc5/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:46.548913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1866a4-9ce3-49c1-aeda-aa5b38475e6e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:46.549216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1866a4-9ce3-49c1-aeda-aa5b38475e6e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:46.549461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1866a4-9ce3-49c1-aeda-aa5b38475e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:46.653884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4d1866a4-9ce3-49c1-aeda-aa5b38475e6e None None] MFA Rules not processed for user `d487fc9cbafd45ac8e9e4a2b796f9dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:46.656703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4d1866a4-9ce3-49c1-aeda-aa5b38475e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:46.700906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb9b7b-4754-465a-92e0-23cf7c4bce2e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:46.844659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:46.845642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:46.848750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:46.849071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:46.849839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:46.853740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:46.939451 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2183/4348] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:46.940227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1866a4-9ce3-49c1-aeda-aa5b38475e6e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:46.971821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1866a4-9ce3-49c1-aeda-aa5b38475e6e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:46.984666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:46.985316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:46.985613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:46.985876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:46.986591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:46.988553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:47.004805 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2166/4349] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:46 2022] POST /identity/v3/users => generated 287 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:47.004805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.029384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46db441-e15b-4773-b53a-ae794c509950 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.045720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.050446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.050757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.052248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.055735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:47.064701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:47.098945 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2167/4350] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:47.103486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.118493 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2184/4351] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:46 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:47.122274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.135930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2700ea-31d9-43c8-98f2-8593fa9ac94d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.283495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.284307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.284826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.285274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.286095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:47.289025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:47.339369 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2168/4352] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:47.347311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.353486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1971b0-cdbf-46c2-81ad-546486633d1b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.361012 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:47.366918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.368651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.368651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.368651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.370502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:47.372928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:47.381754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d556d-5533-497a-8420-1f1cf41f283a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.402778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65146ec5-45f2-4b0a-8290-d180b4ce00de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.406434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146ec5-45f2-4b0a-8290-d180b4ce00de admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.406434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146ec5-45f2-4b0a-8290-d180b4ce00de admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.406434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146ec5-45f2-4b0a-8290-d180b4ce00de admin admin] PATH_INFO: `/v3/projects/6dbdcdb20fbd4229906a36956f3897e5/users/54b102f21fd14402b6a3f13574c8535a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.479098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65146ec5-45f2-4b0a-8290-d180b4ce00de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbdcdb20fbd4229906a36956f3897e5, user_id=54b102f21fd14402b6a3f13574c8535a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:47.483118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65146ec5-45f2-4b0a-8290-d180b4ce00de admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:47.514824 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2185/4353] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:47 2022] POST /identity/v3/users => generated 291 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:47.516202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.560061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841969-dece-4a80-8d0e-bea4f47e486f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.578723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.580564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.581633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.587064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.587064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:47.590102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:47.590318 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2169/4354] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:47 2022] PUT /identity/v3/projects/6dbdcdb20fbd4229906a36956f3897e5/users/54b102f21fd14402b6a3f13574c8535a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:47.602200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba075c0-ff3d-4a19-bdff-4e07ceec34a6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.603532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba075c0-ff3d-4a19-bdff-4e07ceec34a6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.604083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba075c0-ff3d-4a19-bdff-4e07ceec34a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.632201 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2186/4355] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:47.633937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.658837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac070-51b5-4f40-8431-985ef586a085 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.679742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3ba075c0-ff3d-4a19-bdff-4e07ceec34a6 None None] MFA Rules not processed for user `54b102f21fd14402b6a3f13574c8535a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:47.685040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3ba075c0-ff3d-4a19-bdff-4e07ceec34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:47.857453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.858120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.858402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.858678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.859334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:47.866696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:47.904758 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2170/4356] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:47.905081 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2187/4357] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:47.910825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.912406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba075c0-ff3d-4a19-bdff-4e07ceec34a6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:47.956135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba075c0-ff3d-4a19-bdff-4e07ceec34a6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.956289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52534df1-efa6-4c97-b7cc-e3362b6cf988 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:47.964106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeafa07-78e6-4808-b45c-bb4fcd42eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.965185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeafa07-78e6-4808-b45c-bb4fcd42eb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.965630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeafa07-78e6-4808-b45c-bb4fcd42eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.968196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeafa07-78e6-4808-b45c-bb4fcd42eb1b admin admin] PATH_INFO: `/v3/projects/d6148e5510a2457cb3ac20beecb50187/users/28e191f99fbb4b999b26e220ca9b2b79/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.974757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:47.975394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:47.975678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:47.975950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:47.976588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:47.994971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:48.025961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeafa07-78e6-4808-b45c-bb4fcd42eb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6148e5510a2457cb3ac20beecb50187, user_id=28e191f99fbb4b999b26e220ca9b2b79, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:48.028795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeafa07-78e6-4808-b45c-bb4fcd42eb1b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:48.113531 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2188/4358] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:47 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:48.117471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:48.143512 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2171/4359] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:47 2022] PUT /identity/v3/projects/d6148e5510a2457cb3ac20beecb50187/users/28e191f99fbb4b999b26e220ca9b2b79/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:48.159052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:48.159884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:48.160565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:48.223168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] MFA Rules not processed for user `28e191f99fbb4b999b26e220ca9b2b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:48.224342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:48.273957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d214-21e5-40c0-b039-1652cfc84109 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:48.404536 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2172/4360] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:48.420439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:48.421783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:48.443468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:48.447702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:48.448074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:48.448359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:48.449036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:48.455708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:48.578525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d435480-33ba-410e-a9b4-4eacfd49a724 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:48.578717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:48.579380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:48.579660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:48.579931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:48.603138 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:48.610692 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2189/4361] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:48 2022] POST /identity/v3/users => generated 291 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:48.612900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:48.644331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084ff3-8603-4671-8a90-0d0f6ef2864f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:48.670902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:48.671572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:48.671851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:48.672122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:48.672817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:48.680200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:48.718210 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2190/4362] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:48.719667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:48.749076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b89c9-61fb-4f53-990f-32427093d0bc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:48.769428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:48.771020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:48.771327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:48.771605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] PATH_INFO: `/v3/projects/e9e6ef046ea94442b214f6487a8c25bf/users/bce4b8debee54afc88e3bc8b014e4708/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:48.839602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:48.839602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:48.840796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e6ef046ea94442b214f6487a8c25bf, user_id=bce4b8debee54afc88e3bc8b014e4708, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:48.840796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:48.841026 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2173/4363] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:48.972119 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2191/4364] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:48 2022] PUT /identity/v3/projects/e9e6ef046ea94442b214f6487a8c25bf/users/bce4b8debee54afc88e3bc8b014e4708/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:49.109382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:49.109382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969a7a9-5eb1-41ca-90eb-3760e8faba3d service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:49.182756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8745e5a-4f2b-4a40-901f-69378152b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:49.186591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8745e5a-4f2b-4a40-901f-69378152b826 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:49.196269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8745e5a-4f2b-4a40-901f-69378152b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:49.197357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8745e5a-4f2b-4a40-901f-69378152b826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:49.200995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8745e5a-4f2b-4a40-901f-69378152b826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:49.208640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8745e5a-4f2b-4a40-901f-69378152b826 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:49.236936 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2174/4365] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:49.240582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:49.256811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69f6c4-ac3c-4e55-a636-d5b156b0e573 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:49.269019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:49.270727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:49.272090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:49.272707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] PATH_INFO: `/v3/projects/e9e6ef046ea94442b214f6487a8c25bf/users/bce4b8debee54afc88e3bc8b014e4708/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:49.277498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e6ef046ea94442b214f6487a8c25bf, user_id=bce4b8debee54afc88e3bc8b014e4708, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:49.288101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:49.326032 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2192/4366] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:49 2022] PUT /identity/v3/projects/e9e6ef046ea94442b214f6487a8c25bf/users/bce4b8debee54afc88e3bc8b014e4708/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:49.333097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bafc8-9fb2-4b0a-a4c0-933b339624df None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:49.333370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bafc8-9fb2-4b0a-a4c0-933b339624df None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:49.333657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bafc8-9fb2-4b0a-a4c0-933b339624df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:49.369362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-363bafc8-9fb2-4b0a-a4c0-933b339624df None None] MFA Rules not processed for user `bce4b8debee54afc88e3bc8b014e4708`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:49.370651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-363bafc8-9fb2-4b0a-a4c0-933b339624df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:49.422491 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:49.524236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2175/4367] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:49.541313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:49.543588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:49.762420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201dbbc-7d9c-4ce2-b6d7-0b89c204277e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:49.771946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:49.778178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:49.778178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:49.778178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:49.818655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:49.818655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:49.840447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2193/4368] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:50.323874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bafc8-9fb2-4b0a-a4c0-933b339624df None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:50.339959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bafc8-9fb2-4b0a-a4c0-933b339624df None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:50.349835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ce10e-b9a5-4d7d-994a-92c91c740a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:50.350745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce10e-b9a5-4d7d-994a-92c91c740a23 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:50.351150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce10e-b9a5-4d7d-994a-92c91c740a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:50.351491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce10e-b9a5-4d7d-994a-92c91c740a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:50.504598 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:50.538694 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:50.551404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce10e-b9a5-4d7d-994a-92c91c740a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:50.553969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce10e-b9a5-4d7d-994a-92c91c740a23 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:50.579860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2176/4369] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:51.109304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:51.317425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b9b7-61d1-47de-acdd-0d669968bd9e service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:51.322399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:51.323128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:51.323458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:51.323733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] PATH_INFO: `/v3/users/d487fc9cbafd45ac8e9e4a2b796f9dc5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:51.324938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d487fc9cbafd45ac8e9e4a2b796f9dc5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:51.327021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:51.594564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd487fc9cbafd45ac8e9e4a2b796f9dc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:51.611711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd487fc9cbafd45ac8e9e4a2b796f9dc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:51.615202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd487fc9cbafd45ac8e9e4a2b796f9dc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:51.681551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd487fc9cbafd45ac8e9e4a2b796f9dc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:51.682404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd487fc9cbafd45ac8e9e4a2b796f9dc5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:51.706791 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2194/4370] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:51 2022] DELETE /identity/v3/users/d487fc9cbafd45ac8e9e4a2b796f9dc5 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:51.711342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30143-ae53-4f63-95bf-1fdf106b3c81 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:51.714765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30143-ae53-4f63-95bf-1fdf106b3c81 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:51.714765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30143-ae53-4f63-95bf-1fdf106b3c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:51.745878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-52d30143-ae53-4f63-95bf-1fdf106b3c81 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:51.750011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-52d30143-ae53-4f63-95bf-1fdf106b3c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:51.776201 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:51.891685 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2177/4371] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:51.904341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:51.906648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:52.012256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751363e-0bf1-4a3a-b85b-2efe7600ba34 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:52.033663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:52.034455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:52.034957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:52.035757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:52.085699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:52.098800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:52.133908 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2195/4372] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:52.558540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7c17-255c-40ce-be57-11699c651d48 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:52.558957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7c17-255c-40ce-be57-11699c651d48 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:52.559595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa7c17-255c-40ce-be57-11699c651d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:52.589066 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:52.603176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-53aa7c17-255c-40ce-be57-11699c651d48 None None] MFA Rules not processed for user `3b7f0931fbb64e96868a0044b0c6c557`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:52.605146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53aa7c17-255c-40ce-be57-11699c651d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:52.745964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2178/4373] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:52.974082 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:53.185761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:53.193237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:53.226335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4e4a-04be-4e33-8608-00c1bc8ba4f7 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:53.232953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:53.246824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:53.246824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:53.246824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] PATH_INFO: `/v3/projects/0e921fbba52a4e7b979832cb70e8068c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:53.246824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e921fbba52a4e7b979832cb70e8068c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:53.246824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:53.445781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e921fbba52a4e7b979832cb70e8068c', 'request_id': 'req-41cf7fda-7da5-4f1f-b463-28e281c00b71'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:53.452255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e921fbba52a4e7b979832cb70e8068c', 'request_id': 'req-41cf7fda-7da5-4f1f-b463-28e281c00b71'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:53.547564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e921fbba52a4e7b979832cb70e8068c', 'request_id': 'req-41cf7fda-7da5-4f1f-b463-28e281c00b71'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:53.566302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] The token cache is being invalidate because project 0e921fbba52a4e7b979832cb70e8068c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:53.566588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:53.569427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:53.571947 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2196/4374] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:53 2022] DELETE /identity/v3/projects/0e921fbba52a4e7b979832cb70e8068c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:53.575700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa7c17-255c-40ce-be57-11699c651d48 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:53.592738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa7c17-255c-40ce-be57-11699c651d48 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:53.695620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:53.696509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:53.696797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:53.697109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] PATH_INFO: `/v3/users/28e191f99fbb4b999b26e220ca9b2b79` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:53.699181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e191f99fbb4b999b26e220ca9b2b79)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:53.702394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:53.730359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:53.731940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:53.755132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf7fda-7da5-4f1f-b463-28e281c00b71 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:53.762124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:53.762867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:53.763148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:53.763416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] PATH_INFO: `/v3/users/51d8e34a549c44318a3d328fb2014d20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:53.765247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d8e34a549c44318a3d328fb2014d20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:53.768184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:54.005458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e191f99fbb4b999b26e220ca9b2b79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.017230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e191f99fbb4b999b26e220ca9b2b79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.018449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e191f99fbb4b999b26e220ca9b2b79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.102519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d8e34a549c44318a3d328fb2014d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.121577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e191f99fbb4b999b26e220ca9b2b79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.122198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d8e34a549c44318a3d328fb2014d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.122734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e191f99fbb4b999b26e220ca9b2b79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.124138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d8e34a549c44318a3d328fb2014d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.163068 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2179/4375] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:53 2022] DELETE /identity/v3/users/28e191f99fbb4b999b26e220ca9b2b79 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:54.213121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d8e34a549c44318a3d328fb2014d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.214331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d8e34a549c44318a3d328fb2014d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:54.256534 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2197/4376] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:29:53 2022] DELETE /identity/v3/users/51d8e34a549c44318a3d328fb2014d20 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:54.271421 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:54.725921 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:55.051028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.051028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:55.057347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.059127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:55.164361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c562c-452f-407f-84a4-6fb4c182ec45 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.171653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.172720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.173101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d4e8c-3d5f-4f0e-958d-6842a242f857 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.173408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.173860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] PATH_INFO: `/v3/projects/064a14adc24641ddbde56bfe3b7f3e0f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.175984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064a14adc24641ddbde56bfe3b7f3e0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.179165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:55.186989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.188495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.189520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.194000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] PATH_INFO: `/v3/projects/d6148e5510a2457cb3ac20beecb50187` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.196754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6148e5510a2457cb3ac20beecb50187)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.200555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:55.313067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064a14adc24641ddbde56bfe3b7f3e0f', 'request_id': 'req-c96b0ee6-fe6e-4350-a469-4c2886b646a6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.331298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064a14adc24641ddbde56bfe3b7f3e0f', 'request_id': 'req-c96b0ee6-fe6e-4350-a469-4c2886b646a6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.379337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6148e5510a2457cb3ac20beecb50187', 'request_id': 'req-a7292f78-19a1-41c5-8181-d5b993c8805f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.385735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6148e5510a2457cb3ac20beecb50187', 'request_id': 'req-a7292f78-19a1-41c5-8181-d5b993c8805f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.404382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064a14adc24641ddbde56bfe3b7f3e0f', 'request_id': 'req-c96b0ee6-fe6e-4350-a469-4c2886b646a6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.418842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] The token cache is being invalidate because project 064a14adc24641ddbde56bfe3b7f3e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:55.419321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.420145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c96b0ee6-fe6e-4350-a469-4c2886b646a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.422964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2180/4377] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:55 2022] DELETE /identity/v3/projects/064a14adc24641ddbde56bfe3b7f3e0f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:55.427831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6872-e9a3-48f3-a3ff-953377ee1bef None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.428275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6872-e9a3-48f3-a3ff-953377ee1bef None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.428619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6872-e9a3-48f3-a3ff-953377ee1bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.449032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-59ca6872-e9a3-48f3-a3ff-953377ee1bef None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:55.450260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-59ca6872-e9a3-48f3-a3ff-953377ee1bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:55.458226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6148e5510a2457cb3ac20beecb50187', 'request_id': 'req-a7292f78-19a1-41c5-8181-d5b993c8805f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.479476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] The token cache is being invalidate because project d6148e5510a2457cb3ac20beecb50187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:29:55.481042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.481042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a7292f78-19a1-41c5-8181-d5b993c8805f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:29:55.482789 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2198/4378] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:29:55 2022] DELETE /identity/v3/projects/d6148e5510a2457cb3ac20beecb50187 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:55.487546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121bbf-631a-4bb0-88a1-b4d1f8db61b0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.488779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121bbf-631a-4bb0-88a1-b4d1f8db61b0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.489262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121bbf-631a-4bb0-88a1-b4d1f8db61b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.512326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-48121bbf-631a-4bb0-88a1-b4d1f8db61b0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:55.513816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-48121bbf-631a-4bb0-88a1-b4d1f8db61b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:55.537812 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2181/4379] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:55.539323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0be11f-090e-4325-a8f9-face7f402ba5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.539619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0be11f-090e-4325-a8f9-face7f402ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.539898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0be11f-090e-4325-a8f9-face7f402ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.567311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6b0be11f-090e-4325-a8f9-face7f402ba5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:55.568819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6b0be11f-090e-4325-a8f9-face7f402ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:55.576974 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2182/4380] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:55.579007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2199/4381] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:55.581128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0be11f-090e-4325-a8f9-face7f402ba5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.590736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0be11f-090e-4325-a8f9-face7f402ba5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.591908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d80ec-2254-4159-9310-5a2a5b8d3cf9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.592265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d80ec-2254-4159-9310-5a2a5b8d3cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.592518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d80ec-2254-4159-9310-5a2a5b8d3cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.596957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.598115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.598398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.598667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.599433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:55.599740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.601324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:55.613802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-eb8d80ec-2254-4159-9310-5a2a5b8d3cf9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:55.615127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2183/4382] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:55.615549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eb8d80ec-2254-4159-9310-5a2a5b8d3cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:55.620356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.627001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2200/4383] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:29:55.628382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d80ec-2254-4159-9310-5a2a5b8d3cf9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.630991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6e07-2aa9-4ca7-b5ef-9b566601d264 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.636514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.637202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.637551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.637890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.638287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d80ec-2254-4159-9310-5a2a5b8d3cf9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.638686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.640631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:55.643401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.644235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.644579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.644915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.645952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:29:55.646401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.648642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:55.667514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2201/4384] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:29:55.668886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.681267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0739d8-73da-4ada-9ee6-83042ef5f2fd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.686250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.686937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.687447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.687783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.688606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.690652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:55.760946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2184/4385] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:55.765485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.801114 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2202/4386] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:55.803444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:55.905627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9437392-ad0f-4632-a454-97c7f990c9e6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.910887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.911560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.911842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.914714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.914714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.915175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:55.932559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df3ae8-c089-43f6-bce3-ce5a3b5093da admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:55.938532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:55.939521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:55.940209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:55.940687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:55.942153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:55.944474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.060653 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2203/4387] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:56.061712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.072366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eeca5-882b-4619-820f-07f90fadde91 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.077079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.082352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.082352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.082352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.082352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.082352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.089933 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2185/4388] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:55 2022] POST /identity/v3/users => generated 283 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:56.091485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.096529 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2204/4389] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:56.098162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.104727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca336eb-a5a6-4519-9041-419759bc037f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.108772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aaac7-c2c1-4d48-b5ee-ed609ac85526 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.111446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.112454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.113009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.113639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.114563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.114739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.115171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.115467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.115726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.116391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.117436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.118069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.130497 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2205/4390] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:56.133338 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2186/4391] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:56.139239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.139501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.149905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485344f-6203-463c-bcdd-70440aac0ce8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.152703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e93f93-db09-42c2-9ebe-09efbb7fc2da admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.154979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10ba5b-c5dd-441d-b2b5-4689f4512b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.155811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ba5b-c5dd-441d-b2b5-4689f4512b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.156238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ba5b-c5dd-441d-b2b5-4689f4512b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.156660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ba5b-c5dd-441d-b2b5-4689f4512b80 admin admin] PATH_INFO: `/v3/projects/7252f8b74838432db9275dbf54a2b6e5/users/a60a6706c7e34ee98f8e941d0ef05ef9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.158161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.158871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.159214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.159628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.160529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.162696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.173631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10ba5b-c5dd-441d-b2b5-4689f4512b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7252f8b74838432db9275dbf54a2b6e5, user_id=a60a6706c7e34ee98f8e941d0ef05ef9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.174263 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2206/4392] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:29:56.176437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10ba5b-c5dd-441d-b2b5-4689f4512b80 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.178556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.181846 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:56.190695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25506050-2305-4d8f-8a1e-ae7bc31a6c41 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.196242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574a84-cca7-4ca1-842d-1192124f95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.196947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574a84-cca7-4ca1-842d-1192124f95db admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.197287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574a84-cca7-4ca1-842d-1192124f95db admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.197683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574a84-cca7-4ca1-842d-1192124f95db admin admin] PATH_INFO: `/v3/projects/e2ee2ea8399e42a5a5cd0d0ddeb192b5/users/77197152ea5040bab602d5381d21341a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.213798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574a84-cca7-4ca1-842d-1192124f95db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee2ea8399e42a5a5cd0d0ddeb192b5, user_id=77197152ea5040bab602d5381d21341a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.216546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574a84-cca7-4ca1-842d-1192124f95db admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.286027 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2207/4393] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:56 2022] PUT /identity/v3/projects/e2ee2ea8399e42a5a5cd0d0ddeb192b5/users/77197152ea5040bab602d5381d21341a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:56.294658 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2187/4394] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:56 2022] PUT /identity/v3/projects/7252f8b74838432db9275dbf54a2b6e5/users/a60a6706c7e34ee98f8e941d0ef05ef9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:29:56.294658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3ec9-d663-4b62-b402-b95f7f7d65bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.294658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3ec9-d663-4b62-b402-b95f7f7d65bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.294658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3ec9-d663-4b62-b402-b95f7f7d65bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.296451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.296730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.297001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.312121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-797d3ec9-d663-4b62-b402-b95f7f7d65bd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:56.313324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-797d3ec9-d663-4b62-b402-b95f7f7d65bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:56.326746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] MFA Rules not processed for user `a60a6706c7e34ee98f8e941d0ef05ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:56.327878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:56.411635 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2188/4395] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:56.420167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2208/4396] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:56.424342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3ec9-d663-4b62-b402-b95f7f7d65bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.426117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.427900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:56.437008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3ec9-d663-4b62-b402-b95f7f7d65bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.443120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.443540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.443886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.444308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.445136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.447552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.512056 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:56.548599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f220a96-ad6e-433a-9112-e950913f8cf9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.553639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.554506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.554807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.555202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.565924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.568063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.579634 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2209/4397] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:56.603587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2189/4398] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:29:56 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:29:56.608792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.618892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e35a-86e8-47eb-840b-3bf2d650dc82 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.688117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.688901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.694218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.694218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.694218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.694218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.858354 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2210/4399] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:29:56 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:29:56.859627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.871291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22b6c8-ba52-4b1b-8117-a52978aaf25a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.876012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.876710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.877197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.877386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.878184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.880011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.891639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2190/4400] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:29:56.895403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.906678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c37ac-55fc-41ab-be0b-42dea2771ec1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.912495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f28e78-db79-4947-a91c-ecdcdb50ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.913318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28e78-db79-4947-a91c-ecdcdb50ad9d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.913698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28e78-db79-4947-a91c-ecdcdb50ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.914102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28e78-db79-4947-a91c-ecdcdb50ad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:56.915029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f28e78-db79-4947-a91c-ecdcdb50ad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:56.917251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f28e78-db79-4947-a91c-ecdcdb50ad9d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:56.935278 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2211/4401] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:29:56.936530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:56.949407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003a6a-72b5-4261-acfc-8422ba4cab64 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:56.964169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:56.965196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:56.965627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:56.965969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] PATH_INFO: `/v3/projects/36a0a7ed14e6499d8f18e358653d4bd8/users/aea3cb0e92d744888479e4cb7085a54f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:57.004377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a0a7ed14e6499d8f18e358653d4bd8, user_id=aea3cb0e92d744888479e4cb7085a54f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:57.007954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:57.109557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2191/4402] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:29:56 2022] PUT /identity/v3/projects/36a0a7ed14e6499d8f18e358653d4bd8/users/aea3cb0e92d744888479e4cb7085a54f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:29:57.110197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db55d4-9f15-4326-9e20-4e5566537eb5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:57.110522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db55d4-9f15-4326-9e20-4e5566537eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:57.110869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db55d4-9f15-4326-9e20-4e5566537eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:57.146995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-61db55d4-9f15-4326-9e20-4e5566537eb5 None None] MFA Rules not processed for user `aea3cb0e92d744888479e4cb7085a54f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:29:57.148631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-61db55d4-9f15-4326-9e20-4e5566537eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:57.314600 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2212/4403] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:29:57.335715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:57.338129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:57.453700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548234c-ce17-47e3-9337-1fb2b2c0fe1c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:57.459013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:57.459929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:57.460666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:57.461039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:57.563725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:57.566004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:57.592864 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2192/4404] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:58.051217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db55d4-9f15-4326-9e20-4e5566537eb5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:58.063525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db55d4-9f15-4326-9e20-4e5566537eb5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:58.072609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:58.072864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:58.073035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:58.073326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:58.094309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:58.095785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:58.119744 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2213/4405] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:29:58.198284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:29:58.199726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:58.280824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958273-21fb-4741-aa38-cc1ad18078c4 service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:29:58.284499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6990bb-3542-4ff4-83b4-443a9fc34be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:29:58.285413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6990bb-3542-4ff4-83b4-443a9fc34be0 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:29:58.285868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6990bb-3542-4ff4-83b4-443a9fc34be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:29:58.286369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6990bb-3542-4ff4-83b4-443a9fc34be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:29:58.288378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ff6990bb-3542-4ff4-83b4-443a9fc34be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:29:58.317345 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:29:58.386229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6990bb-3542-4ff4-83b4-443a9fc34be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:29:58.388097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6990bb-3542-4ff4-83b4-443a9fc34be0 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:29:58.403118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2193/4406] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:29:58.461748 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:00.276488 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:00.584825 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:02.301761 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:02.936651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:02.971146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3c946-4e87-46ae-a66c-b1e527bd4d7a service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:02.984585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:02.987486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:02.993452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:02.994323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] PATH_INFO: `/v3/users/a60a6706c7e34ee98f8e941d0ef05ef9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:03.001484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60a6706c7e34ee98f8e941d0ef05ef9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:03.006254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:03.030687 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:03.261706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60a6706c7e34ee98f8e941d0ef05ef9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:03.274712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60a6706c7e34ee98f8e941d0ef05ef9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:03.275722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60a6706c7e34ee98f8e941d0ef05ef9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:03.366948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60a6706c7e34ee98f8e941d0ef05ef9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:03.373128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60a6706c7e34ee98f8e941d0ef05ef9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:03.405988 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2214/4407] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:30:02 2022] DELETE /identity/v3/users/a60a6706c7e34ee98f8e941d0ef05ef9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:03.410165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:03.410457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:03.410730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:03.432692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:03.436615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:03.520144 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2194/4408] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:03.581031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:03.584112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:03.708676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095dc2d-e1cf-4447-a00b-cb31545bdfcb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:03.720484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:03.721306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:03.721745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:03.722151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:03.749338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:03.749338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:03.767352 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:03.777353 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2215/4409] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:30:04.904546 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:04.936753 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:05.151481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:05.153799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:05.180246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f380f-e201-431e-b382-36dd2fce4c3f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:05.193627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:05.193627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:05.193627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:05.193627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] PATH_INFO: `/v3/projects/7252f8b74838432db9275dbf54a2b6e5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:05.196761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7252f8b74838432db9275dbf54a2b6e5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:05.202144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:05.415974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7252f8b74838432db9275dbf54a2b6e5', 'request_id': 'req-013a968a-0677-4bf1-90b1-3db638080f3d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:05.437551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7252f8b74838432db9275dbf54a2b6e5', 'request_id': 'req-013a968a-0677-4bf1-90b1-3db638080f3d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:05.564690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7252f8b74838432db9275dbf54a2b6e5', 'request_id': 'req-013a968a-0677-4bf1-90b1-3db638080f3d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:05.586123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] The token cache is being invalidate because project 7252f8b74838432db9275dbf54a2b6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:30:05.586492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:05.590932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:05.590932 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2195/4410] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:30:05 2022] DELETE /identity/v3/projects/7252f8b74838432db9275dbf54a2b6e5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:05.593359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:05.608889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749f73-47fd-4b68-8edf-afdce96172b1 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:05.768412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:05.769190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:05.779337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:05.779337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] PATH_INFO: `/v3/users/aea3cb0e92d744888479e4cb7085a54f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:05.780209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea3cb0e92d744888479e4cb7085a54f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:05.782456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:06.057227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea3cb0e92d744888479e4cb7085a54f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:06.077708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea3cb0e92d744888479e4cb7085a54f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:06.079530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea3cb0e92d744888479e4cb7085a54f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:06.136198 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:06.172213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea3cb0e92d744888479e4cb7085a54f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:06.172968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea3cb0e92d744888479e4cb7085a54f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:06.218012 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2216/4411] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:30:05 2022] DELETE /identity/v3/users/aea3cb0e92d744888479e4cb7085a54f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:06.740763 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:07.295513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:07.297012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:07.329292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a968a-0677-4bf1-90b1-3db638080f3d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:07.502984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:07.503988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:07.504602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:07.505139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] PATH_INFO: `/v3/projects/36a0a7ed14e6499d8f18e358653d4bd8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:07.515436 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:07.516752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a0a7ed14e6499d8f18e358653d4bd8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:07.521041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:07.642454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:07.644010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:07.676642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1ea5-c21d-4d8b-b67d-216f38e68525 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:07.695991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:07.696653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:07.696932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:07.697204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] PATH_INFO: `/v3/users/4ba4975d23874879b779282e5b9cecb0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:07.700980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba4975d23874879b779282e5b9cecb0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:07.702999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:07.757882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a0a7ed14e6499d8f18e358653d4bd8', 'request_id': 'req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:07.775516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a0a7ed14e6499d8f18e358653d4bd8', 'request_id': 'req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:07.904103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a0a7ed14e6499d8f18e358653d4bd8', 'request_id': 'req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:07.960484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] The token cache is being invalidate because project 36a0a7ed14e6499d8f18e358653d4bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:30:07.960794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:07.964376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a27b3ee-150a-41dc-9ec5-6ec771cc6cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:07.967478 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2196/4412] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:30:07 2022] DELETE /identity/v3/projects/36a0a7ed14e6499d8f18e358653d4bd8 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:07.976748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432c01-dc13-4bc1-b2dd-f9c5f61b5da7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:07.977842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432c01-dc13-4bc1-b2dd-f9c5f61b5da7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:07.978040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432c01-dc13-4bc1-b2dd-f9c5f61b5da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:08.028067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4d432c01-dc13-4bc1-b2dd-f9c5f61b5da7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:08.029387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4d432c01-dc13-4bc1-b2dd-f9c5f61b5da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:08.116696 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2197/4413] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:08.141244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd1a1c-ff3e-4cca-92ca-690aeffdee8e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:08.143126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd1a1c-ff3e-4cca-92ca-690aeffdee8e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:08.144218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd1a1c-ff3e-4cca-92ca-690aeffdee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:08.161068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba4975d23874879b779282e5b9cecb0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:08.178537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba4975d23874879b779282e5b9cecb0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:08.181809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba4975d23874879b779282e5b9cecb0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:08.211536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-13fd1a1c-ff3e-4cca-92ca-690aeffdee8e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:08.213393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-13fd1a1c-ff3e-4cca-92ca-690aeffdee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:08.232419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2198/4414] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:08.234538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd1a1c-ff3e-4cca-92ca-690aeffdee8e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:08.246648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd1a1c-ff3e-4cca-92ca-690aeffdee8e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:08.257138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:08.257896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:08.258263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:08.258603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:08.259356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:30:08.259727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:08.261591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:08.297550 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2199/4415] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:30:08.299593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba4975d23874879b779282e5b9cecb0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:08.300323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba4975d23874879b779282e5b9cecb0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:08.306866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:08.314906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:08.342738 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2217/4416] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:30:07 2022] DELETE /identity/v3/users/4ba4975d23874879b779282e5b9cecb0 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:30:08.369178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231db9e6-b760-40da-894b-c80e82365e57 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:08.460083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:08.460970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:08.461310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:08.461519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:08.462779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:08.465483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:08.632535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2200/4417] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:30:08 2022] POST /identity/v3/projects => generated 369 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:30:08.636995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:08.652028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cc737-0a31-43b7-bae9-1b23637bf7b8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:08.813395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:08.815016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:08.816177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:08.816668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:08.817586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:08.821595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:08.834839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:08.839074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:08.883244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03714ff-b75b-439b-864f-7c3328f19f06 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:08.891549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:08.893294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:08.894565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:08.896316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] PATH_INFO: `/v3/projects/62a621d00a6b499f921337dda20b66bd` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:08.898471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a621d00a6b499f921337dda20b66bd)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:08.902078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:09.033544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2218/4418] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:30:08 2022] POST /identity/v3/users => generated 285 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:30:09.037885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:09.072348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d073-5d8a-44ec-ab71-178fa18f84b5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:09.099755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:09.100388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.102847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.102847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.102847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:09.129485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:09.150255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a621d00a6b499f921337dda20b66bd', 'request_id': 'req-33c37bdf-3fd8-4749-baa7-a39cf2af3789'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:09.168325 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2219/4419] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:30:09.172533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:09.201091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc6e96-c53e-4570-9ed6-5a457760a6fc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:09.211535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a621d00a6b499f921337dda20b66bd', 'request_id': 'req-33c37bdf-3fd8-4749-baa7-a39cf2af3789'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:09.313013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:09.313665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.314182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.314530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.315337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:09.320116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:09.334756 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2220/4420] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:30:09.339015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:09.344360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a621d00a6b499f921337dda20b66bd', 'request_id': 'req-33c37bdf-3fd8-4749-baa7-a39cf2af3789'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:09.359990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fe33-cc1b-44db-8595-3975bb9508f7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:09.377218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1568d-9160-4b95-b426-b4ca8a2c978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:09.383471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1568d-9160-4b95-b426-b4ca8a2c978c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.383471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1568d-9160-4b95-b426-b4ca8a2c978c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.383471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1568d-9160-4b95-b426-b4ca8a2c978c admin admin] PATH_INFO: `/v3/projects/caebc10a936b4a0f8df19711eb84e6c8/users/4de71a142524452bb3c6d32533dffc8f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.384140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] The token cache is being invalidate because project 62a621d00a6b499f921337dda20b66bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:30:09.384942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:09.386082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33c37bdf-3fd8-4749-baa7-a39cf2af3789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:09.389018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2201/4421] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:30:08 2022] DELETE /identity/v3/projects/62a621d00a6b499f921337dda20b66bd => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:30:09.394183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644de3c-323d-43ce-8920-f0ae36cd2e64 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.395046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644de3c-323d-43ce-8920-f0ae36cd2e64 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.395529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644de3c-323d-43ce-8920-f0ae36cd2e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.419872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1568d-9160-4b95-b426-b4ca8a2c978c admin admin] RBAC: Authorizing `identity:create_grant(project_id=caebc10a936b4a0f8df19711eb84e6c8, user_id=4de71a142524452bb3c6d32533dffc8f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:09.421818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1568d-9160-4b95-b426-b4ca8a2c978c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:09.448094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6644de3c-323d-43ce-8920-f0ae36cd2e64 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:09.449302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6644de3c-323d-43ce-8920-f0ae36cd2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:09.463679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2202/4422] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:30:09.474222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d539-6d43-4827-8f3c-6b7dc4920d3b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.476167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d539-6d43-4827-8f3c-6b7dc4920d3b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.476606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992d539-6d43-4827-8f3c-6b7dc4920d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.523893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3992d539-6d43-4827-8f3c-6b7dc4920d3b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:09.525443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3992d539-6d43-4827-8f3c-6b7dc4920d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:09.545927 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2203/4423] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:09.550683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d539-6d43-4827-8f3c-6b7dc4920d3b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:09.573311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992d539-6d43-4827-8f3c-6b7dc4920d3b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:09.581996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:09.582689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.582969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.583247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.583950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:30:09.584302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:09.585962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:09.590846 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2221/4424] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:30:09 2022] PUT /identity/v3/projects/caebc10a936b4a0f8df19711eb84e6c8/users/4de71a142524452bb3c6d32533dffc8f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:09.603793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.604416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.605085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.610599 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2204/4425] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:30:09.615993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:09.635774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c00344-5408-427d-97e9-7df57c864743 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:09.673341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] MFA Rules not processed for user `4de71a142524452bb3c6d32533dffc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:09.675483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:09.744352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:09.746364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:09.746900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:09.747391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:09.748785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:09.752263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:09.841725 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2222/4426] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:30:09.871933 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:09.901164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:09.914068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:09.917241 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:09.938176 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2205/4427] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:30:09 2022] POST /identity/v3/projects => generated 383 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:30:09.940695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:10.109388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c760901-a212-4c9d-a507-25ba17fc721b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:10.160982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb186d-c7e7-4e14-bc12-bced942e0826 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:10.194037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:10.194688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.199751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.200074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.200768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:10.207774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:10.299130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a96648-2821-4040-a446-d77ecb35f121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:10.300310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96648-2821-4040-a446-d77ecb35f121 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.300815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96648-2821-4040-a446-d77ecb35f121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.301279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96648-2821-4040-a446-d77ecb35f121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.350535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2206/4428] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:30:09 2022] POST /identity/v3/users => generated 292 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:30:10.354454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:10.388231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526c5c-af7d-4fe4-9cbf-2aa39dacbdb9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:10.399933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:10.400655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.401005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.401374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.402202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:10.403925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:10.450113 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2207/4429] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:30:10.453074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:10.499246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aad8d-4b39-41ea-9d01-100241474f97 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:10.501776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a96648-2821-4040-a446-d77ecb35f121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:10.506729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a96648-2821-4040-a446-d77ecb35f121 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:10.516817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:10.517543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.517847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.518145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.523238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:10.528785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:10.537525 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2223/4430] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:30:10.555771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761c34-c8b3-4be9-b7fc-e73c83c889fd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.556055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761c34-c8b3-4be9-b7fc-e73c83c889fd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.556326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761c34-c8b3-4be9-b7fc-e73c83c889fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.559172 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:10.587443 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2208/4431] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:30:10.593332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:10.599960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8f761c34-c8b3-4be9-b7fc-e73c83c889fd None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:10.601249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f761c34-c8b3-4be9-b7fc-e73c83c889fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:10.616748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b5d0d-aea1-404d-839b-00b687fb90c8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:10.642326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb49322-c9bf-4a54-8084-11f13894a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:10.642326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49322-c9bf-4a54-8084-11f13894a930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.642326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49322-c9bf-4a54-8084-11f13894a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.642326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49322-c9bf-4a54-8084-11f13894a930 admin admin] PATH_INFO: `/v3/projects/6edb27d1224244809ecbb55ac953c645/users/0c65e7ab0b544d9ebdac8bc2129d051a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.665170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb49322-c9bf-4a54-8084-11f13894a930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edb27d1224244809ecbb55ac953c645, user_id=0c65e7ab0b544d9ebdac8bc2129d051a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:10.668213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb49322-c9bf-4a54-8084-11f13894a930 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:10.693250 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2224/4432] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:10.694754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c6213-10bd-4ef6-a3ba-db16f4b5f996 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.695222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c6213-10bd-4ef6-a3ba-db16f4b5f996 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.695790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c6213-10bd-4ef6-a3ba-db16f4b5f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.717005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-698c6213-10bd-4ef6-a3ba-db16f4b5f996 None None] MFA Rules not processed for user `1864708a7b2f4223bc8f0015c765eb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:10.718248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-698c6213-10bd-4ef6-a3ba-db16f4b5f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:10.767849 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2209/4433] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:30:10 2022] PUT /identity/v3/projects/6edb27d1224244809ecbb55ac953c645/users/0c65e7ab0b544d9ebdac8bc2129d051a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:10.771316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1084-d1b9-4d3e-9226-87c89f19d908 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.771316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1084-d1b9-4d3e-9226-87c89f19d908 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.771316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1084-d1b9-4d3e-9226-87c89f19d908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.811913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-558d1084-d1b9-4d3e-9226-87c89f19d908 None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:10.813696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-558d1084-d1b9-4d3e-9226-87c89f19d908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:10.849199 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2225/4434] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:10.851064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:10.851621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:10.852183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:10.891221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:10.892736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:10.954178 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2210/4435] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:11.019535 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2226/4436] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:11.043779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d1084-d1b9-4d3e-9226-87c89f19d908 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:11.180130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d1084-d1b9-4d3e-9226-87c89f19d908 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:11.184003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3903-1baf-4aa0-96a3-891e25db6f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:11.184626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3903-1baf-4aa0-96a3-891e25db6f4a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:11.185204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3903-1baf-4aa0-96a3-891e25db6f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:11.194796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3903-1baf-4aa0-96a3-891e25db6f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:11.197351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3903-1baf-4aa0-96a3-891e25db6f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:11.198899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3903-1baf-4aa0-96a3-891e25db6f4a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:11.219342 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2211/4437] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:30:11.304551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:11.306768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:11.463414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29681873-aaac-4bb8-ab10-3f844af4894a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:11.484219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:11.484998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:11.486243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:11.488440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:11.508746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:11.517833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:11.531778 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2227/4438] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:30:12.939588 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:13.407290 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:15.546931 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:16.464687 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:17.812128 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:18.556081 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:20.553161 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:20.867038 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=19,keystone:SELECT=76,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:22.834859 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:23.661516 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:23.782315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c2624-6c15-4481-8acc-3b63d0d58483 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:23.782315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c2624-6c15-4481-8acc-3b63d0d58483 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:23.782705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c2624-6c15-4481-8acc-3b63d0d58483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:23.855022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-115c2624-6c15-4481-8acc-3b63d0d58483 None None] MFA Rules not processed for user `0c65e7ab0b544d9ebdac8bc2129d051a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:23.859527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-115c2624-6c15-4481-8acc-3b63d0d58483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:24.001727 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2212/4439] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:24.020234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:24.021717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:24.047980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1c944-41d1-4b92-ac2f-8f1eef32d829 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:24.058283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:24.058921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:24.059196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:24.059468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:24.079950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:24.082448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:24.106189 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2228/4440] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:30:25.994670 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:26.152350 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:28.253146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87bf3a-1fc1-4fc8-8ddc-cd39575d26e2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:28.254999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87bf3a-1fc1-4fc8-8ddc-cd39575d26e2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:28.256238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87bf3a-1fc1-4fc8-8ddc-cd39575d26e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:28.284120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bc87bf3a-1fc1-4fc8-8ddc-cd39575d26e2 None None] MFA Rules not processed for user `0c65e7ab0b544d9ebdac8bc2129d051a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:28.285750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bc87bf3a-1fc1-4fc8-8ddc-cd39575d26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:28.306775 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2213/4441] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:29.684329 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:31.353013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:31.354835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:31.393950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ce929-c511-4923-a68a-d73b8a2df53d service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:31.399511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db0977-4c74-4a50-87d8-a934a39122c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:31.400272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db0977-4c74-4a50-87d8-a934a39122c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:31.400547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db0977-4c74-4a50-87d8-a934a39122c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:31.400814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db0977-4c74-4a50-87d8-a934a39122c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:31.403298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-25db0977-4c74-4a50-87d8-a934a39122c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:31.427561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db0977-4c74-4a50-87d8-a934a39122c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:31.432540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db0977-4c74-4a50-87d8-a934a39122c7 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:31.455873 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2229/4442] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:30:33.656278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87bf3a-1fc1-4fc8-8ddc-cd39575d26e2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:33.671492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87bf3a-1fc1-4fc8-8ddc-cd39575d26e2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:33.689264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:33.694277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:33.694277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:33.694277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:33.694277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:33.716297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:33.718403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:33.738718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2214/4443] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:30:36.086945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aab91-16d3-46f2-8cae-5573786c818b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:36.088147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aab91-16d3-46f2-8cae-5573786c818b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:36.088644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aab91-16d3-46f2-8cae-5573786c818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:36.149387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a83aab91-16d3-46f2-8cae-5573786c818b None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:36.157356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a83aab91-16d3-46f2-8cae-5573786c818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:36.191338 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2230/4444] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:38.498257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:38.500928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:38.765959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d892e-21a5-42c4-ab4a-8ecaea4a6569 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:38.771956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:38.772985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:38.773424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:38.773848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:38.775960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:38.792393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:38.794105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:38.810810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2215/4445] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:30:39.062764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561679a-9aa0-49f1-b26a-fe876dc9d65c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:39.063282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561679a-9aa0-49f1-b26a-fe876dc9d65c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:39.065476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561679a-9aa0-49f1-b26a-fe876dc9d65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:39.101719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:39.108988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d561679a-9aa0-49f1-b26a-fe876dc9d65c None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:39.110634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d561679a-9aa0-49f1-b26a-fe876dc9d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:39.121502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f0b3e-c766-478d-887c-9448625de164 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:39.131526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:39.132036 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2231/4446] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:39.132643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:39.133123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:39.133564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:39.136144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:39.165217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:39.171266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:39.226097 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2216/4447] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:30:40.307571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561679a-9aa0-49f1-b26a-fe876dc9d65c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:40.324644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561679a-9aa0-49f1-b26a-fe876dc9d65c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:40.331342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:40.333047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:40.333497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:40.333965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:40.336498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:40.352878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:40.354753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:40.366332 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2232/4448] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:30:49.197587 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=82 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:50.361270 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:52.363614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:52.365763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:52.385062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303e14a-121d-4cd3-99cc-6a542aff4c23 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:52.399536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:52.399536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:52.399536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:52.399536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] PATH_INFO: `/v3/users/0a92f307441747f29f583ddf004e8f21` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:52.399897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a92f307441747f29f583ddf004e8f21)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:52.399897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:52.720265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a92f307441747f29f583ddf004e8f21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:52.727616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a92f307441747f29f583ddf004e8f21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:52.728379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a92f307441747f29f583ddf004e8f21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:52.879948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a92f307441747f29f583ddf004e8f21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:52.880691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-28f60853-1a62-4c10-ba72-5fae7c6116eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a92f307441747f29f583ddf004e8f21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:52.904589 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2217/4449] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:30:52 2022] DELETE /identity/v3/users/0a92f307441747f29f583ddf004e8f21 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:53.183468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:53.201074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21598b5-1858-4379-be4d-63e820a37e5e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:53.296528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:53.297434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:53.297887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:53.299140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] PATH_INFO: `/v3/projects/9901e62cf4f94f6c9be3ff897caedf19` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:53.300675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9901e62cf4f94f6c9be3ff897caedf19)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:53.303437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:53.505089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9901e62cf4f94f6c9be3ff897caedf19', 'request_id': 'req-3569a17a-f0af-4e86-98b8-da6773dec7fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:53.514219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9901e62cf4f94f6c9be3ff897caedf19', 'request_id': 'req-3569a17a-f0af-4e86-98b8-da6773dec7fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:53.614152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9901e62cf4f94f6c9be3ff897caedf19', 'request_id': 'req-3569a17a-f0af-4e86-98b8-da6773dec7fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:53.629182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] The token cache is being invalidate because project 9901e62cf4f94f6c9be3ff897caedf19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:30:53.630429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:53.631344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3569a17a-f0af-4e86-98b8-da6773dec7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:30:53.633664 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2233/4450] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:30:53 2022] DELETE /identity/v3/projects/9901e62cf4f94f6c9be3ff897caedf19 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:53.638795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0954-9672-4ff4-906d-588fdb2e493c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:53.639783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0954-9672-4ff4-906d-588fdb2e493c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:53.640456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0954-9672-4ff4-906d-588fdb2e493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:53.664094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c09e0954-9672-4ff4-906d-588fdb2e493c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:53.665781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c09e0954-9672-4ff4-906d-588fdb2e493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:53.733608 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2218/4451] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:53.742095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a97e06-77ed-4c76-8f82-0250603083fd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:53.742555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a97e06-77ed-4c76-8f82-0250603083fd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:53.742949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a97e06-77ed-4c76-8f82-0250603083fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:53.782429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-70a97e06-77ed-4c76-8f82-0250603083fd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:53.784584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-70a97e06-77ed-4c76-8f82-0250603083fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:53.806771 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2234/4452] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:53.812147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0954-9672-4ff4-906d-588fdb2e493c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:53.822290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0954-9672-4ff4-906d-588fdb2e493c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:53.830102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:53.830979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:53.831688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:53.832131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:53.832933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:30:53.833398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:53.836214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:53.858624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2219/4453] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:30:53.863169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a97e06-77ed-4c76-8f82-0250603083fd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:53.884788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a97e06-77ed-4c76-8f82-0250603083fd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:53.892623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:53.893590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:53.894239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:53.894799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:53.895680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:53.897877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:54.068531 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2235/4454] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:30:53 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:30:54.074267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:54.086638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac96d4f-72e1-4dfe-a12f-15a4362a0f82 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:54.164167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:54.164803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:54.165083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:54.165414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:54.166106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:54.168032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:54.178345 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:54.282805 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2220/4455] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:30:54 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:30:54.286977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:54.298781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15671-3076-4b8b-a04a-3ebc3cde543a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:54.304207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:54.304826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:54.305272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:54.306304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:54.306304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:54.307612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:54.318839 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2236/4456] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:30:54.322961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:54.332929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef699-d938-44c2-b570-aa998fadfeb4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:54.337645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950351e-738c-4af6-8001-465e85f31f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:54.338280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950351e-738c-4af6-8001-465e85f31f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:54.338560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950351e-738c-4af6-8001-465e85f31f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:54.338831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950351e-738c-4af6-8001-465e85f31f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:54.339468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950351e-738c-4af6-8001-465e85f31f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:54.341048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950351e-738c-4af6-8001-465e85f31f46 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:54.351903 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2221/4457] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:30:54.356125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:54.370203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca15a9-f2bd-4e1b-9029-80a7326decb6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:54.371210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:54.371863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:54.372181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:54.372408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] PATH_INFO: `/v3/projects/aa4e3018a6ca477c9a1d7215ad98d9e9/users/bb03047092f64e2abbf78e9db1a06e0a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:54.391367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4e3018a6ca477c9a1d7215ad98d9e9, user_id=bb03047092f64e2abbf78e9db1a06e0a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:54.391367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:54.523316 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2237/4458] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:30:54 2022] PUT /identity/v3/projects/aa4e3018a6ca477c9a1d7215ad98d9e9/users/bb03047092f64e2abbf78e9db1a06e0a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:30:54.524799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76ced-f0f6-42ee-8729-22b0eba1e260 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:54.525079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76ced-f0f6-42ee-8729-22b0eba1e260 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:54.525400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76ced-f0f6-42ee-8729-22b0eba1e260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:54.552613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3cc76ced-f0f6-42ee-8729-22b0eba1e260 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:30:54.554170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3cc76ced-f0f6-42ee-8729-22b0eba1e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:54.627003 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2222/4459] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:30:54.637148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:30:54.639109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:30:54.660286 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:30:54.698877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8a75-370d-49be-8590-d3083f9a0ef6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:30:54.702500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:30:54.703133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:30:54.703439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:30:54.703746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:30:54.712882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:30:54.714340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:30:54.724686 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2238/4460] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:03.033453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bf07-81c1-4fd7-9d17-d9a143e33855 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:03.033453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bf07-81c1-4fd7-9d17-d9a143e33855 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:03.033453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bf07-81c1-4fd7-9d17-d9a143e33855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:03.081920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9502bf07-81c1-4fd7-9d17-d9a143e33855 None None] MFA Rules not processed for user `bb03047092f64e2abbf78e9db1a06e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:03.083412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9502bf07-81c1-4fd7-9d17-d9a143e33855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:03.204550 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2223/4461] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:03.220403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:03.221945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:03.406841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033b66-7f39-4c16-8166-877c2fab1801 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:03.441784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:03.441784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:03.441784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:03.441784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:03.451305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:03.453708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:03.469480 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2239/4462] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:05.364171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2f35-56d4-4ccf-84d4-ea591e81d9df None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:05.364703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2f35-56d4-4ccf-84d4-ea591e81d9df None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:05.364703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2f35-56d4-4ccf-84d4-ea591e81d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:05.392426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-07af2f35-56d4-4ccf-84d4-ea591e81d9df None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:05.394645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-07af2f35-56d4-4ccf-84d4-ea591e81d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:05.489735 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2224/4463] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:07.231957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:07.233587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:07.364112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11495470-389e-43f3-8d98-57756f3d569a service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:07.370979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:07.371604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:07.371889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:07.372641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:07.375391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:07.390894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:07.397119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:07.408191 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2240/4464] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:08.442523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef54e7-17f4-427a-94d0-0f991ca65479 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:08.443532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef54e7-17f4-427a-94d0-0f991ca65479 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:08.443975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef54e7-17f4-427a-94d0-0f991ca65479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:08.501340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9aef54e7-17f4-427a-94d0-0f991ca65479 None None] MFA Rules not processed for user `bb03047092f64e2abbf78e9db1a06e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:08.502854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9aef54e7-17f4-427a-94d0-0f991ca65479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:08.529240 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2225/4465] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:10.402761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:10.406272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:10.453653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c75740-3788-4a05-8236-adde18b3c9bf service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:10.477411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:10.478356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:10.478822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:10.479351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] PATH_INFO: `/v3/users/3b7f0931fbb64e96868a0044b0c6c557` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:10.487562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7f0931fbb64e96868a0044b0c6c557)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:10.489722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:10.823323 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:10.843418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7f0931fbb64e96868a0044b0c6c557'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:10.865167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7f0931fbb64e96868a0044b0c6c557'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:10.866288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7f0931fbb64e96868a0044b0c6c557'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:10.965142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7f0931fbb64e96868a0044b0c6c557'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:10.966133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7f0931fbb64e96868a0044b0c6c557'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:11.011483 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2241/4466] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:31:10 2022] DELETE /identity/v3/users/3b7f0931fbb64e96868a0044b0c6c557 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:11.842384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef54e7-17f4-427a-94d0-0f991ca65479 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:11.879067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef54e7-17f4-427a-94d0-0f991ca65479 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:11.894361 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:12.071878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:12.072639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:12.073153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:12.073435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:12.079940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:12.248455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:12.256298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:12.280193 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2226/4467] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:12.522311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:12.523817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:12.590790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:12.592428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:12.707814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b1352-008a-4fc8-a923-cca0e6589ecb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:12.724242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:12.726233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:12.726707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:12.732295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] PATH_INFO: `/v3/projects/b6df910969eb472b97fb3fe05a3c85d3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:12.737209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6df910969eb472b97fb3fe05a3c85d3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:12.739415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:12.760620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881d93-c3b9-44a2-ad98-c134def7da92 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:12.771230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753ff66-5ab5-4f23-bc63-92d912ef20ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:12.774205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ff66-5ab5-4f23-bc63-92d912ef20ae service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:12.774205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ff66-5ab5-4f23-bc63-92d912ef20ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:12.774205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ff66-5ab5-4f23-bc63-92d912ef20ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:12.776821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b753ff66-5ab5-4f23-bc63-92d912ef20ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:12.803171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753ff66-5ab5-4f23-bc63-92d912ef20ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:12.804805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753ff66-5ab5-4f23-bc63-92d912ef20ae service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:12.832607 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2227/4468] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:13.009500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6df910969eb472b97fb3fe05a3c85d3', 'request_id': 'req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:13.026594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6df910969eb472b97fb3fe05a3c85d3', 'request_id': 'req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:13.152741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6df910969eb472b97fb3fe05a3c85d3', 'request_id': 'req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:13.172065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] The token cache is being invalidate because project b6df910969eb472b97fb3fe05a3c85d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:31:13.172407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:13.175766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9bba641-2fdf-4446-86f0-66b7e4fd31f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:13.179133 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2242/4469] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:31:12 2022] DELETE /identity/v3/projects/b6df910969eb472b97fb3fe05a3c85d3 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:13.184140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd643688-cdb3-4668-92ba-7c230b4175e6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:13.184688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd643688-cdb3-4668-92ba-7c230b4175e6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:13.184688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd643688-cdb3-4668-92ba-7c230b4175e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:13.227032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fd643688-cdb3-4668-92ba-7c230b4175e6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:13.230879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fd643688-cdb3-4668-92ba-7c230b4175e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:13.326119 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:13.423752 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2228/4470] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:13.424140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e8ac-e149-4192-b86a-5e06a0c5ec3d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:13.424557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e8ac-e149-4192-b86a-5e06a0c5ec3d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:13.427183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e8ac-e149-4192-b86a-5e06a0c5ec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:13.477267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-be70e8ac-e149-4192-b86a-5e06a0c5ec3d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:13.484615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-be70e8ac-e149-4192-b86a-5e06a0c5ec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:13.512556 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2243/4471] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:13.519213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd643688-cdb3-4668-92ba-7c230b4175e6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:13.551526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd643688-cdb3-4668-92ba-7c230b4175e6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:13.562864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:13.563503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:13.563785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:13.564059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:13.564723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:31:13.565026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:13.566989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:13.581407 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2229/4472] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:31:13.586217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70e8ac-e149-4192-b86a-5e06a0c5ec3d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:13.599697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70e8ac-e149-4192-b86a-5e06a0c5ec3d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:13.613388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:13.614643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:13.620371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:13.620371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:13.620371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:13.620371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:13.781670 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2244/4473] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:31:13 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:31:13.786007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:13.799689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7ed5e-f837-43c4-a06d-0db95aa4b551 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:13.903101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:13.904032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:13.904562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:13.905006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:13.906966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:13.919925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:14.038017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2230/4474] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:31:13 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:31:14.041911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:14.056421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bff13-b3dd-4e6d-bf5c-ff659286dd3f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:14.068124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:14.068860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:14.069208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:14.069554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:14.070377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:14.073838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:14.098008 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:14.119233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:14.120298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2245/4475] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:31:14.144674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ff00f-bcea-4341-8950-b90c8211cdfe admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:14.156021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc3f6-667f-4dc3-a390-7d744acddf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:14.156601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc3f6-667f-4dc3-a390-7d744acddf3e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:14.156958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc3f6-667f-4dc3-a390-7d744acddf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:14.157139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc3f6-667f-4dc3-a390-7d744acddf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:14.157798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fc3f6-667f-4dc3-a390-7d744acddf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:14.166830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fc3f6-667f-4dc3-a390-7d744acddf3e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:14.182651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:14.184661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2231/4476] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:31:14.201334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb0ed9-6dc6-4f7d-a00f-20d494303a77 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:14.227432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:14.228126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:14.228553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:14.228833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] PATH_INFO: `/v3/projects/842dcab8b48c43d7963a538d914b0b22/users/634bed7898c24baca6ba00392d49eea1/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:14.274734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842dcab8b48c43d7963a538d914b0b22, user_id=634bed7898c24baca6ba00392d49eea1, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:14.277628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:14.384472 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2246/4477] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:31:14 2022] PUT /identity/v3/projects/842dcab8b48c43d7963a538d914b0b22/users/634bed7898c24baca6ba00392d49eea1/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:14.390836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:14.390836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:14.390836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:14.470947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:14.472836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:14.662100 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2232/4478] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:14.684724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:14.694926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:14.898999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aacc5-16cc-4c3b-96f8-0d31c5d0c495 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:14.911080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb3d4-bcf1-4ff8-b805-a75ca57639f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:14.916391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb3d4-bcf1-4ff8-b805-a75ca57639f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:14.916821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb3d4-bcf1-4ff8-b805-a75ca57639f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:14.917101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb3d4-bcf1-4ff8-b805-a75ca57639f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:14.950319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeb3d4-bcf1-4ff8-b805-a75ca57639f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:14.953616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeb3d4-bcf1-4ff8-b805-a75ca57639f9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:14.981260 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2247/4479] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:22.664409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:22.666072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:22.794308 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:22.835578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffb671-ce44-4e9a-b861-4da746a5f618 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:22.859358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2485db-cee1-42b5-8812-61b301d16de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:22.860072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2485db-cee1-42b5-8812-61b301d16de3 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:22.860359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2485db-cee1-42b5-8812-61b301d16de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:22.860639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2485db-cee1-42b5-8812-61b301d16de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:22.862784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0d2485db-cee1-42b5-8812-61b301d16de3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:22.887254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2485db-cee1-42b5-8812-61b301d16de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:22.888873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2485db-cee1-42b5-8812-61b301d16de3 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:22.921907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2233/4480] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:25.711177 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:27.633087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:27.634236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:27.634681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:27.671095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:27.672827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:27.781580 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2248/4481] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:27.792364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a3958-f240-419f-928d-cbf87528950a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:27.793327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a3958-f240-419f-928d-cbf87528950a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:27.793751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a3958-f240-419f-928d-cbf87528950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:27.823020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c02a3958-f240-419f-928d-cbf87528950a None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:27.823718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c02a3958-f240-419f-928d-cbf87528950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:27.836160 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2234/4482] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:27.866796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:27.868220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:27.908934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148e64-9c59-428e-9346-d65bfb57b2cd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:27.917732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934eb9a-3949-49ce-9fe6-3a4756f44d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:27.924378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934eb9a-3949-49ce-9fe6-3a4756f44d66 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:27.934292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934eb9a-3949-49ce-9fe6-3a4756f44d66 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:27.934632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934eb9a-3949-49ce-9fe6-3a4756f44d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:27.951003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934eb9a-3949-49ce-9fe6-3a4756f44d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:27.958370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934eb9a-3949-49ce-9fe6-3a4756f44d66 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:27.996444 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2249/4483] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:32.315820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:32.317035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:32.317308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:32.353394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:32.360755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:32.555960 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2235/4484] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:32.613763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:32.614759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:32.615247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:32.694909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:32.696387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:32.793417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2250/4485] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:33.058428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:33.061823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:33.217256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d6f8e-a562-4eaa-9ad6-fa5fbcde4ae2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:33.287329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:33.288157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:33.288355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:33.288637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:33.351585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:33.352548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:33.413287 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2236/4486] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:31:37.198854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:37.200354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:37.222591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301d11-f458-47e8-89b5-3ee964577812 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:37.236309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:37.236653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:37.236998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:37.237270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] PATH_INFO: `/v3/users/a0a8950e247041d8be4fdfda5e2122fa` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:37.238492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a8950e247041d8be4fdfda5e2122fa)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:37.246781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:37.567655 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:37.579184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a8950e247041d8be4fdfda5e2122fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:37.605114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a8950e247041d8be4fdfda5e2122fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:37.606538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a8950e247041d8be4fdfda5e2122fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:37.757713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a8950e247041d8be4fdfda5e2122fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:37.758439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7f8a27eb-c986-43ee-8ed5-0b3b39fcd660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a8950e247041d8be4fdfda5e2122fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:37.792582 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2251/4487] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:31:37 2022] DELETE /identity/v3/users/a0a8950e247041d8be4fdfda5e2122fa => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:38.729042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:38.750631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c063f0-9e20-4404-9767-b111960a6e5b service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:38.863059 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:38.887629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:38.888306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:38.888622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:38.888900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] PATH_INFO: `/v3/projects/2db2a6834ec144418eb2cf222302fdb2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:38.891310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db2a6834ec144418eb2cf222302fdb2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:38.893293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:39.084330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db2a6834ec144418eb2cf222302fdb2', 'request_id': 'req-78d82df8-e4f7-4a51-88c2-48821b9bba87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:39.090529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db2a6834ec144418eb2cf222302fdb2', 'request_id': 'req-78d82df8-e4f7-4a51-88c2-48821b9bba87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:39.238631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db2a6834ec144418eb2cf222302fdb2', 'request_id': 'req-78d82df8-e4f7-4a51-88c2-48821b9bba87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:39.281188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] The token cache is being invalidate because project 2db2a6834ec144418eb2cf222302fdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:31:39.282315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:39.288043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-78d82df8-e4f7-4a51-88c2-48821b9bba87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:39.291464 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2237/4488] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:31:38 2022] DELETE /identity/v3/projects/2db2a6834ec144418eb2cf222302fdb2 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:39.297957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21dd2e-1050-4c6e-bf91-b8c1c8091095 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:39.298502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21dd2e-1050-4c6e-bf91-b8c1c8091095 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:39.298629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21dd2e-1050-4c6e-bf91-b8c1c8091095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:39.339947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-eb21dd2e-1050-4c6e-bf91-b8c1c8091095 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:39.343607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eb21dd2e-1050-4c6e-bf91-b8c1c8091095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:39.495831 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2252/4489] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:39.504534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4e11-9ee6-4366-a01a-fbaf3a3f2dee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:39.505060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4e11-9ee6-4366-a01a-fbaf3a3f2dee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:39.510254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4e11-9ee6-4366-a01a-fbaf3a3f2dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:39.598857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c72e4e11-9ee6-4366-a01a-fbaf3a3f2dee None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:39.600091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c72e4e11-9ee6-4366-a01a-fbaf3a3f2dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:39.619510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2238/4490] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:31:39.624332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21dd2e-1050-4c6e-bf91-b8c1c8091095 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:39.642797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21dd2e-1050-4c6e-bf91-b8c1c8091095 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:39.652744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:39.654224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:39.654540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:39.654819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:39.655503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:31:39.655813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:39.657547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:39.691535 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2253/4491] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:31:39.692956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4e11-9ee6-4366-a01a-fbaf3a3f2dee None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:39.715415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4e11-9ee6-4366-a01a-fbaf3a3f2dee None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:39.721373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:39.722724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:39.723018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:39.723756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:39.724569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:39.726535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:39.853781 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2239/4492] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:31:39 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:31:39.858367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:39.876802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd353c-6627-45fb-837d-6083adf9249c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:40.135633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:40.136415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:40.136693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:40.136963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:40.141400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:40.148726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:40.252657 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2254/4493] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:31:39 2022] POST /identity/v3/users => generated 284 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:31:40.253878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:40.272258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8266a36-4c54-4792-9dea-fb41539d4a3a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:40.284015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:40.287180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:40.287864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:40.288149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:40.289999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:40.293943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:40.321597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:40.324371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:40.351479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2240/4494] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:31:40.353535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:40.386162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459a82-0407-4c8d-9076-b7053c1aa7f7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:40.408313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:40.408957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:40.409235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:40.410530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:40.410901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:40.425334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:40.465348 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2241/4495] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:31:40.472114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:40.478765 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:40.507145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc7fd6-6979-4fe5-a829-7860fedec36b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:40.522969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:40.523657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:40.523932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:40.531496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] PATH_INFO: `/v3/projects/3b051b0da0ab45ffa64c7b8b32465a20/users/96d3d3c6a02244888eebb6e70eaac4ee/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:40.585869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b051b0da0ab45ffa64c7b8b32465a20, user_id=96d3d3c6a02244888eebb6e70eaac4ee, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:40.591312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:40.593406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5d7c-ad2f-49a3-916e-2b49fd2784b6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:40.615725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179abedb-2d13-4864-b4f2-b836552f0cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:40.617407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abedb-2d13-4864-b4f2-b836552f0cc5 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:40.617694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abedb-2d13-4864-b4f2-b836552f0cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:40.618446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abedb-2d13-4864-b4f2-b836552f0cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:40.624211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-179abedb-2d13-4864-b4f2-b836552f0cc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:40.661012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179abedb-2d13-4864-b4f2-b836552f0cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:40.663690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179abedb-2d13-4864-b4f2-b836552f0cc5 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:40.698414 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2255/4496] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:31:40.726077 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2242/4497] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:31:40 2022] PUT /identity/v3/projects/3b051b0da0ab45ffa64c7b8b32465a20/users/96d3d3c6a02244888eebb6e70eaac4ee/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:40.731023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:40.731842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:40.732797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:40.761329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:40.764386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:40.949263 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2256/4498] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:41.323744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:41.326117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:41.500354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4bfa-4b50-4327-9377-97af1aaa146d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:41.508211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:41.508858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:41.509135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:41.509404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:41.549321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:41.550926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:41.582594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2243/4499] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:42.077636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:42.079410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:42.376543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e4741-b21d-4a54-aeca-9e2ed8d921dd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:42.390531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934a4af-7922-426d-bed9-7ced7be3ae21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:42.391165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a4af-7922-426d-bed9-7ced7be3ae21 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:42.391447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a4af-7922-426d-bed9-7ced7be3ae21 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:42.391719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a4af-7922-426d-bed9-7ced7be3ae21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:42.400262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0934a4af-7922-426d-bed9-7ced7be3ae21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:42.439642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934a4af-7922-426d-bed9-7ced7be3ae21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:42.441199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934a4af-7922-426d-bed9-7ced7be3ae21 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:42.486463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2257/4500] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:48.297711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:48.299206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:48.330398 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:48.341167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab691c63-569f-4b86-a18f-6cad00510fe5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:48.360458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:48.363154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:48.364688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:48.365145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] PATH_INFO: `/v3/users/54b102f21fd14402b6a3f13574c8535a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:48.370726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b102f21fd14402b6a3f13574c8535a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:48.377397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:48.713494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b102f21fd14402b6a3f13574c8535a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:48.727015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b102f21fd14402b6a3f13574c8535a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:48.728024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b102f21fd14402b6a3f13574c8535a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:48.837022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b102f21fd14402b6a3f13574c8535a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:48.837900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b102f21fd14402b6a3f13574c8535a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:48.881512 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2244/4501] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:31:48 2022] DELETE /identity/v3/users/54b102f21fd14402b6a3f13574c8535a => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:48.886061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:48.886898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:48.887330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:48.938683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:48.942501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:49.057592 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:49.093342 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2258/4502] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:49.297303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:49.299137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:49.456730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040b391-58bb-4880-9cac-e68b36d13175 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:49.460507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:49.461139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:49.461419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:49.461921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:49.499333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:49.501518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:49.521763 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2245/4503] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:51.433400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:51.437046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:51.459420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e50f-6b0f-4690-83e3-338673591ffd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:51.471749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:51.472466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:51.472715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:51.473045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] PATH_INFO: `/v3/projects/6dbdcdb20fbd4229906a36956f3897e5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:51.475484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbdcdb20fbd4229906a36956f3897e5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:51.477692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:51.977251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbdcdb20fbd4229906a36956f3897e5', 'request_id': 'req-e6f7a45e-c689-4b14-8c63-9295189b4032'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:51.984118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbdcdb20fbd4229906a36956f3897e5', 'request_id': 'req-e6f7a45e-c689-4b14-8c63-9295189b4032'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.079463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbdcdb20fbd4229906a36956f3897e5', 'request_id': 'req-e6f7a45e-c689-4b14-8c63-9295189b4032'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.102968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] The token cache is being invalidate because project 6dbdcdb20fbd4229906a36956f3897e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:31:52.103801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.105338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.107559 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2259/4504] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:31:51 2022] DELETE /identity/v3/projects/6dbdcdb20fbd4229906a36956f3897e5 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:52.119235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:52.130987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e5a7-a58f-49bd-b720-ac6924b29feb service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:52.251345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:52.255691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:52.256672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:52.258235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] PATH_INFO: `/v3/users/bce4b8debee54afc88e3bc8b014e4708` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:52.263232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce4b8debee54afc88e3bc8b014e4708)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:52.270431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:52.341579 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:52.537544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce4b8debee54afc88e3bc8b014e4708'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.553501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce4b8debee54afc88e3bc8b014e4708'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.554493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce4b8debee54afc88e3bc8b014e4708'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.683287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce4b8debee54afc88e3bc8b014e4708'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.684706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b4202893-a208-40e5-967d-3b1832c9976b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce4b8debee54afc88e3bc8b014e4708'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:52.739313 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2246/4505] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:31:52 2022] DELETE /identity/v3/users/bce4b8debee54afc88e3bc8b014e4708 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:54.776183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:54.784151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:54.846134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7a45e-c689-4b14-8c63-9295189b4032 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:55.011645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:55.013457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:55.013457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:55.013845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] PATH_INFO: `/v3/projects/e9e6ef046ea94442b214f6487a8c25bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:55.020670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e6ef046ea94442b214f6487a8c25bf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:55.023182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:55.206731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e6ef046ea94442b214f6487a8c25bf', 'request_id': 'req-f24b8039-f126-4bb4-bbcf-381551b419e3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:55.226725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e6ef046ea94442b214f6487a8c25bf', 'request_id': 'req-f24b8039-f126-4bb4-bbcf-381551b419e3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:55.369142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e6ef046ea94442b214f6487a8c25bf', 'request_id': 'req-f24b8039-f126-4bb4-bbcf-381551b419e3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:55.398745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] The token cache is being invalidate because project e9e6ef046ea94442b214f6487a8c25bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:31:55.399034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:55.400029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f24b8039-f126-4bb4-bbcf-381551b419e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:31:55.409144 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2260/4506] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:31:54 2022] DELETE /identity/v3/projects/e9e6ef046ea94442b214f6487a8c25bf => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:55.410498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991019b6-1034-40c8-9f69-a5429135ffd7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:55.410955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991019b6-1034-40c8-9f69-a5429135ffd7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:55.411245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991019b6-1034-40c8-9f69-a5429135ffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:55.472373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-991019b6-1034-40c8-9f69-a5429135ffd7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:55.475483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-991019b6-1034-40c8-9f69-a5429135ffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:55.596021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3333-1d36-4d9a-be0f-c291e812b039 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:55.596303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3333-1d36-4d9a-be0f-c291e812b039 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:55.596576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3333-1d36-4d9a-be0f-c291e812b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:55.616471 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:55.675382 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2247/4507] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:55.686697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b91c3333-1d36-4d9a-be0f-c291e812b039 None None] MFA Rules not processed for user `96d3d3c6a02244888eebb6e70eaac4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:55.686697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b91c3333-1d36-4d9a-be0f-c291e812b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:55.688014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4959e-2fe4-440f-b20f-ec87db3df976 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:55.688299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4959e-2fe4-440f-b20f-ec87db3df976 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:55.688567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4959e-2fe4-440f-b20f-ec87db3df976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:55.761581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-85e4959e-2fe4-440f-b20f-ec87db3df976 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:55.763596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-85e4959e-2fe4-440f-b20f-ec87db3df976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:55.783845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2248/4508] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:55.788093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4959e-2fe4-440f-b20f-ec87db3df976 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:55.812049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4959e-2fe4-440f-b20f-ec87db3df976 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:55.823412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:55.824717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:55.825790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:55.826354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:55.827501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:31:55.828035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:55.829924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:55.836842 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2261/4509] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:31:55.859558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2249/4510] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:31:55.864787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3333-1d36-4d9a-be0f-c291e812b039 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:55.893435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3333-1d36-4d9a-be0f-c291e812b039 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:55.903504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:55.903504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:55.905133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:55.905420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:55.906295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:55.908347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:56.042806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2262/4511] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:31:55 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:31:56.048314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:56.078846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263101-c959-485f-8bb8-d23dcca45f5e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:56.089907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:56.089907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:56.190955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:56.193140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:56.193140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:56.193140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:56.193140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:56.196115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:56.268316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cec10a-9ef6-4b1d-b98a-2291f922ac5f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:56.292355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:56.293549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:56.294451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:56.294781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:56.321958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2250/4512] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:31:56 2022] POST /identity/v3/users => generated 282 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:31:56.326081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:56.357335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a60145-d7a2-4c00-a314-e58c2b9cedca admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:56.372734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:56.373771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:56.375532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:56.376339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:56.385125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:56.390279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:56.399832 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:56.428388 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2251/4513] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:31:56.439683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:56.483161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a0b3-91f1-401d-94ef-418e0311b825 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:56.500875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f8a12-56f4-472d-9833-f50ec142d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:56.501681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8a12-56f4-472d-9833-f50ec142d6df admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:56.501967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8a12-56f4-472d-9833-f50ec142d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:56.502403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8a12-56f4-472d-9833-f50ec142d6df admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:56.503063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f8a12-56f4-472d-9833-f50ec142d6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:56.504621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:56.506253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:56.508820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f8a12-56f4-472d-9833-f50ec142d6df admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:56.521338 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2263/4514] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:56.529595 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2252/4515] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:31:56.533536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:56.548627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d225bd6-4ef6-48d3-8632-71d7a62d644f service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:56.560609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:56.561784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:56.562264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:56.562652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] PATH_INFO: `/v3/projects/954a5fc7582e46ccb4c72ddf6d36f26f/users/e84a0f64c56e4febb898cf4078aed434/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:56.567630 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:56.617684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954a5fc7582e46ccb4c72ddf6d36f26f, user_id=e84a0f64c56e4febb898cf4078aed434, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:56.620609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:56.745650 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2264/4516] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:31:56 2022] PUT /identity/v3/projects/954a5fc7582e46ccb4c72ddf6d36f26f/users/e84a0f64c56e4febb898cf4078aed434/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:56.747519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a18ef-95d3-4d02-a287-cfb6b1beb6a7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:56.747810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a18ef-95d3-4d02-a287-cfb6b1beb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:56.748083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a18ef-95d3-4d02-a287-cfb6b1beb6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:56.802664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-972a18ef-95d3-4d02-a287-cfb6b1beb6a7 None None] MFA Rules not processed for user `e84a0f64c56e4febb898cf4078aed434`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:56.802905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-972a18ef-95d3-4d02-a287-cfb6b1beb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:56.968763 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2253/4517] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:31:56.972870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:57.106458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740b9ee-58d6-45e5-bb15-f0941c1f3251 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:57.112392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:57.113281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:57.113713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:57.114242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:57.115038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:57.117187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:57.246024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2265/4518] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:31:56 2022] POST /identity/v3/projects => generated 365 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:31:57.250846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a18ef-95d3-4d02-a287-cfb6b1beb6a7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:57.278277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a18ef-95d3-4d02-a287-cfb6b1beb6a7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:57.462163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:57.463657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:57.465114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:57.467411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:57.468391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:57.473117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:57.576792 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2254/4519] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:31:57 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:31:57.582036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:57.609157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80d9b-8791-4b6e-ad2d-77d2352eaab4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:57.621271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:57.622578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:57.623014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:57.623608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:57.624610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:57.628636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:57.655740 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2266/4520] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:31:57.660705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:57.682753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfc7ac-2e00-4b34-8e18-ef49397c0225 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:57.691196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:57.692883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:57.693537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:57.694038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] PATH_INFO: `/v3/projects/106174739c8f42bebec4a05d02847d20/users/1cdd495f59394d8292128a1f4ae2b931/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:57.722090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106174739c8f42bebec4a05d02847d20, user_id=1cdd495f59394d8292128a1f4ae2b931, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:57.728383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:57.845213 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2255/4521] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:31:57 2022] PUT /identity/v3/projects/106174739c8f42bebec4a05d02847d20/users/1cdd495f59394d8292128a1f4ae2b931/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:31:57.851932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:57.866306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d538f-46b7-48c2-bd55-01a0a532d278 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:58.056872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec42543-fd1a-4bcf-991f-1678071b4e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:58.057575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42543-fd1a-4bcf-991f-1678071b4e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:58.062587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42543-fd1a-4bcf-991f-1678071b4e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:58.062872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42543-fd1a-4bcf-991f-1678071b4e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:58.063608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec42543-fd1a-4bcf-991f-1678071b4e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:58.065200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec42543-fd1a-4bcf-991f-1678071b4e96 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:58.089681 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2267/4522] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:31:58.095041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:58.112729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5fd0-ac06-4a4d-a536-f7a59786b5c4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:58.122109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:58.122109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:58.122109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:58.122109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] PATH_INFO: `/v3/projects/106174739c8f42bebec4a05d02847d20/users/1cdd495f59394d8292128a1f4ae2b931/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:58.131236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106174739c8f42bebec4a05d02847d20, user_id=1cdd495f59394d8292128a1f4ae2b931, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:58.133945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:58.187469 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2256/4523] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:31:58 2022] PUT /identity/v3/projects/106174739c8f42bebec4a05d02847d20/users/1cdd495f59394d8292128a1f4ae2b931/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:31:58.189165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb473-7b4d-4149-a746-5508bd743be1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:58.189659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb473-7b4d-4149-a746-5508bd743be1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:58.190147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb473-7b4d-4149-a746-5508bd743be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:58.252420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a8bdb473-7b4d-4149-a746-5508bd743be1 None None] MFA Rules not processed for user `1cdd495f59394d8292128a1f4ae2b931`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:58.254147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a8bdb473-7b4d-4149-a746-5508bd743be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:58.376721 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:58.437609 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2268/4524] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:58.453000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:58.455009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:58.514730 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:31:58.589517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f9f33-a802-4f60-9971-a8b933e6e443 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:58.603190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:58.604481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:58.604765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:58.606856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:58.629410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:58.633619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:58.661262 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2257/4525] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:31:58.816157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:58.816596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:58.817121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:58.846330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] MFA Rules not processed for user `0c65e7ab0b544d9ebdac8bc2129d051a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:31:58.847741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:31:58.920266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:31:58.937903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9aec6-dd0d-4d8d-a092-768ed4a2761b service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:31:58.958519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793494-02d9-4915-93de-10ff45bc7d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:31:58.959320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793494-02d9-4915-93de-10ff45bc7d56 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:31:58.959742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793494-02d9-4915-93de-10ff45bc7d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:31:58.960114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793494-02d9-4915-93de-10ff45bc7d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:31:58.987721 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2269/4526] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:31:59.139896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83793494-02d9-4915-93de-10ff45bc7d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:31:59.146449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83793494-02d9-4915-93de-10ff45bc7d56 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:31:59.162695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2258/4527] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:32:00.556882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:00.558583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:00.713036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be4356-f70b-43d2-b9e9-bda81e00ff80 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:00.719938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78661dcb-44a4-48a0-a37f-114a25bc4ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:00.720577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78661dcb-44a4-48a0-a37f-114a25bc4ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:00.725365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78661dcb-44a4-48a0-a37f-114a25bc4ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:00.725783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78661dcb-44a4-48a0-a37f-114a25bc4ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:00.734445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78661dcb-44a4-48a0-a37f-114a25bc4ce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:00.777958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78661dcb-44a4-48a0-a37f-114a25bc4ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:00.777958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78661dcb-44a4-48a0-a37f-114a25bc4ce5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:00.791840 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2270/4528] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:32:01.556950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475152d-4c33-471a-ac65-1526e3aa9ea2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:01.557816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475152d-4c33-471a-ac65-1526e3aa9ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:01.558211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475152d-4c33-471a-ac65-1526e3aa9ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:01.607399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4475152d-4c33-471a-ac65-1526e3aa9ea2 None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:01.610969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4475152d-4c33-471a-ac65-1526e3aa9ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:01.698324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2259/4529] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:02.422524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:02.423067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:02.423067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:02.457265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:02.459085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:02.614714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2271/4530] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:03.114098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5c355-c706-4704-b4e9-da8d75897e11 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:03.114652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5c355-c706-4704-b4e9-da8d75897e11 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:03.114945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5c355-c706-4704-b4e9-da8d75897e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:03.139927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c1c5c355-c706-4704-b4e9-da8d75897e11 None None] MFA Rules not processed for user `96d3d3c6a02244888eebb6e70eaac4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:03.142248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c1c5c355-c706-4704-b4e9-da8d75897e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:03.232519 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2260/4531] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:05.091750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:05.094900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:05.146345 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:05.202301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd686-d15e-4e39-ae74-3768c027014b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:05.213682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:05.214827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:05.215366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:05.215917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] PATH_INFO: `/v3/users/4de71a142524452bb3c6d32533dffc8f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:05.217370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de71a142524452bb3c6d32533dffc8f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:05.220165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:05.534661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de71a142524452bb3c6d32533dffc8f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:05.560437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de71a142524452bb3c6d32533dffc8f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:05.563117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de71a142524452bb3c6d32533dffc8f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:05.701363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de71a142524452bb3c6d32533dffc8f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:05.702038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de71a142524452bb3c6d32533dffc8f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:05.736669 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2272/4532] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:32:05 2022] DELETE /identity/v3/users/4de71a142524452bb3c6d32533dffc8f => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:05.741338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:05.741816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:05.741900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:05.778872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:05.780106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:05.811791 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:05.919724 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2261/4533] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:32:05.929896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:05.931614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:06.019049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d717835-2a1d-4cb8-bd0c-55c8063bae77 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:06.027589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ccd1b-1ef3-4a4f-b531-5b0430b7a84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:06.028529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ccd1b-1ef3-4a4f-b531-5b0430b7a84a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:06.028808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ccd1b-1ef3-4a4f-b531-5b0430b7a84a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:06.029077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ccd1b-1ef3-4a4f-b531-5b0430b7a84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:06.041875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ccd1b-1ef3-4a4f-b531-5b0430b7a84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:06.043754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ccd1b-1ef3-4a4f-b531-5b0430b7a84a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:06.067916 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2273/4534] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:32:06.427115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:06.429008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:06.465845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc8f53-ced0-42be-92b5-fd09f92afa49 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:06.482653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:06.483954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:06.484771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:06.485317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] PATH_INFO: `/v3/projects/caebc10a936b4a0f8df19711eb84e6c8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:06.487017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caebc10a936b4a0f8df19711eb84e6c8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:06.489412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:06.704102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caebc10a936b4a0f8df19711eb84e6c8', 'request_id': 'req-9608b570-8fbe-4da1-984c-68c0c63e01b4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:06.713533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caebc10a936b4a0f8df19711eb84e6c8', 'request_id': 'req-9608b570-8fbe-4da1-984c-68c0c63e01b4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:06.825916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caebc10a936b4a0f8df19711eb84e6c8', 'request_id': 'req-9608b570-8fbe-4da1-984c-68c0c63e01b4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:06.864283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] The token cache is being invalidate because project caebc10a936b4a0f8df19711eb84e6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:32:06.864568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:06.865440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9608b570-8fbe-4da1-984c-68c0c63e01b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:06.867439 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2262/4535] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:32:06 2022] DELETE /identity/v3/projects/caebc10a936b4a0f8df19711eb84e6c8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:06.872533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bda36-8c26-420e-8a99-b1e0959df8f9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:06.873015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bda36-8c26-420e-8a99-b1e0959df8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:06.873113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bda36-8c26-420e-8a99-b1e0959df8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:06.913666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ce9bda36-8c26-420e-8a99-b1e0959df8f9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:06.914999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce9bda36-8c26-420e-8a99-b1e0959df8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:07.073413 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:07.110268 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2274/4536] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:07.112039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825955db-4b4a-4d1c-b853-106f1305b28f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.112332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825955db-4b4a-4d1c-b853-106f1305b28f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.112610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825955db-4b4a-4d1c-b853-106f1305b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:07.153051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-825955db-4b4a-4d1c-b853-106f1305b28f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:07.154716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-825955db-4b4a-4d1c-b853-106f1305b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:07.164597 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2263/4537] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:07.170564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bda36-8c26-420e-8a99-b1e0959df8f9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:07.181709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bda36-8c26-420e-8a99-b1e0959df8f9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:07.211136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:07.212003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.212288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.212564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:07.213293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:32:07.213601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:07.215482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:07.233955 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2275/4538] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:32:07.237353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825955db-4b4a-4d1c-b853-106f1305b28f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:07.249188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825955db-4b4a-4d1c-b853-106f1305b28f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:07.271280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:07.272557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.273462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.273937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:07.275209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:07.277454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:07.569225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:07.569451 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2264/4539] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:32:07 2022] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:32:07.573327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f023c3-a39e-4f36-93b4-13706f0a52c3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:07.641679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:07.644047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.644047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.644047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:07.644047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:07.645719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:07.751589 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2276/4540] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:32:07 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:32:07.756856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:07.774172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc88f-fb3d-476b-b71f-f46cdd231333 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:07.781367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:07.782381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.782843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.783419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:07.784306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:07.787099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:07.803362 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2265/4541] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:32:07.804264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:07.816730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01f6f-633f-4672-b143-304f367a00d4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:07.822979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10829e2d-ee9c-49d3-b8f3-f9b4a312d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:07.823652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10829e2d-ee9c-49d3-b8f3-f9b4a312d5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.823932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10829e2d-ee9c-49d3-b8f3-f9b4a312d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.824706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10829e2d-ee9c-49d3-b8f3-f9b4a312d5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:07.825611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10829e2d-ee9c-49d3-b8f3-f9b4a312d5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:07.828149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10829e2d-ee9c-49d3-b8f3-f9b4a312d5e6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:07.851463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:07.856946 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2277/4542] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:32:07.865214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569747e-b28a-4951-b679-bc2c8bc02b88 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:07.875610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:07.876686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.876968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.877323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] PATH_INFO: `/v3/projects/97d73f43c13149b3b4fb3518b5cf547f/users/1566725e2a59478db6ba3904fcfebd6c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:07.901520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d73f43c13149b3b4fb3518b5cf547f, user_id=1566725e2a59478db6ba3904fcfebd6c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:07.906225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:07.983510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2266/4543] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:32:07 2022] PUT /identity/v3/projects/97d73f43c13149b3b4fb3518b5cf547f/users/1566725e2a59478db6ba3904fcfebd6c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:07.994252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0c51-b194-4001-b695-87bac98e2f33 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:07.995201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0c51-b194-4001-b695-87bac98e2f33 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:07.995667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf0c51-b194-4001-b695-87bac98e2f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:08.033037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ddaf0c51-b194-4001-b695-87bac98e2f33 None None] MFA Rules not processed for user `1566725e2a59478db6ba3904fcfebd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:08.034612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ddaf0c51-b194-4001-b695-87bac98e2f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:08.177735 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2278/4544] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:08.192632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:08.194900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:08.250843 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:08.276642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77869df-30b3-4a6b-87cd-be7acd4d9fcd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:08.292069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:08.292799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:08.293489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:08.293776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:08.310748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:08.312208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:08.323069 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2267/4545] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:32:16.648158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb5e7-423e-4ff3-93be-1e6bf0fecc1a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:16.648158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb5e7-423e-4ff3-93be-1e6bf0fecc1a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:16.648158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb5e7-423e-4ff3-93be-1e6bf0fecc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:16.655750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1abfb5e7-423e-4ff3-93be-1e6bf0fecc1a None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:16.657217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1abfb5e7-423e-4ff3-93be-1e6bf0fecc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:16.725781 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:16.744335 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2279/4546] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:16.761284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:16.762785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:16.854621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4848f2-f2c0-459e-b849-5949e70ec63a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:16.861272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:16.862143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:16.862518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:16.863391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:16.873357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:16.875080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:16.891884 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2268/4547] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:32:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:32:22.583066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:22.584281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:22.585115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:22.632333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:22.634864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:22.657229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2280/4548] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:32:22.682676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:22.696075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5a88-a95c-49a8-bfce-bd48c148ee32 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:22.706603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78df4-3303-463a-a01b-0e55de0c53c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:22.706603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78df4-3303-463a-a01b-0e55de0c53c5 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:22.706603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78df4-3303-463a-a01b-0e55de0c53c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:22.706603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78df4-3303-463a-a01b-0e55de0c53c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:22.743875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78df4-3303-463a-a01b-0e55de0c53c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:22.757680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78df4-3303-463a-a01b-0e55de0c53c5 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:22.781262 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2269/4549] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:32:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:32:32.610700 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:32.769169 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=46 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:39.251886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:39.251886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:39.521161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60e632-1b28-430b-8192-9ef861ed7faa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:39.533135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:39.535009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:39.535552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:39.537085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:39.542463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:39.574067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:39.575915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:39.629491 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2281/4550] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:32:45.552193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604c5ce-50f8-4e3b-82ec-70ff3d93df45 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:45.553183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604c5ce-50f8-4e3b-82ec-70ff3d93df45 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:45.553755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604c5ce-50f8-4e3b-82ec-70ff3d93df45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:45.579114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7604c5ce-50f8-4e3b-82ec-70ff3d93df45 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:45.581830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7604c5ce-50f8-4e3b-82ec-70ff3d93df45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:45.591337 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2270/4551] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:32:45.608696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:45.638644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbcf87-63dc-47a7-bbea-fa26d2a88285 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:45.653334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1160e7-ae0b-47eb-afb9-fadec2e41454 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:45.653874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1160e7-ae0b-47eb-afb9-fadec2e41454 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:45.654250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:45.654727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1160e7-ae0b-47eb-afb9-fadec2e41454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:45.655765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:45.656114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:45.657137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:45.674820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:45.678040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:45.686652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2c1160e7-ae0b-47eb-afb9-fadec2e41454 None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:45.688491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2c1160e7-ae0b-47eb-afb9-fadec2e41454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:45.702497 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2282/4552] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:32:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:32:45.780093 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2271/4553] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:48.720806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:48.722371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:48.849917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bd758-779a-4365-ae40-2b71dcd1cb4e service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:48.866804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:48.868167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:48.868453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:48.869312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] PATH_INFO: `/v3/users/e84a0f64c56e4febb898cf4078aed434` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:48.871574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84a0f64c56e4febb898cf4078aed434)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:48.875769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:49.110497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84a0f64c56e4febb898cf4078aed434'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:49.127055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84a0f64c56e4febb898cf4078aed434'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:49.127908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84a0f64c56e4febb898cf4078aed434'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:49.183638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84a0f64c56e4febb898cf4078aed434'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:49.184272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84a0f64c56e4febb898cf4078aed434'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:49.196679 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:49.204805 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2283/4554] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:32:48 2022] DELETE /identity/v3/users/e84a0f64c56e4febb898cf4078aed434 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:49.209560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:49.210103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:49.210312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:49.231274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:49.232336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:49.346546 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2272/4555] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:49.357368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:49.358997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:49.427438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c9e7c-a696-44c6-a49f-085b9e180f3b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:49.431012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:49.432572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:49.433005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:49.433579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:49.452120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:49.452120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:49.464698 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2284/4556] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:32:49.990700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:49.992238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:50.006049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb266c4-0568-48b0-ba63-3a581316d4f9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:50.012368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:50.013217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:50.013670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:50.014238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] PATH_INFO: `/v3/projects/954a5fc7582e46ccb4c72ddf6d36f26f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:50.016072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] RBAC: Authorizing `identity:delete_project(project_id=954a5fc7582e46ccb4c72ddf6d36f26f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:50.018620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:50.122167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954a5fc7582e46ccb4c72ddf6d36f26f', 'request_id': 'req-fa9c2f83-3f99-4664-ba50-b72bac5b496c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.127811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954a5fc7582e46ccb4c72ddf6d36f26f', 'request_id': 'req-fa9c2f83-3f99-4664-ba50-b72bac5b496c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.223946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954a5fc7582e46ccb4c72ddf6d36f26f', 'request_id': 'req-fa9c2f83-3f99-4664-ba50-b72bac5b496c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.239799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] The token cache is being invalidate because project 954a5fc7582e46ccb4c72ddf6d36f26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:32:50.240496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.241497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.244041 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2273/4557] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:32:49 2022] DELETE /identity/v3/projects/954a5fc7582e46ccb4c72ddf6d36f26f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:50.260305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:50.262228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ae34e-54da-424d-af02-180392497a96 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:50.325428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:50.326203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:50.326478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:50.326748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] PATH_INFO: `/v3/users/1cdd495f59394d8292128a1f4ae2b931` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:50.327871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdd495f59394d8292128a1f4ae2b931)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:50.329775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:50.512073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdd495f59394d8292128a1f4ae2b931'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.519897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdd495f59394d8292128a1f4ae2b931'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.520626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdd495f59394d8292128a1f4ae2b931'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.601205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdd495f59394d8292128a1f4ae2b931'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.601836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-29f1fb63-54dc-4d12-b56a-e46b52dca9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdd495f59394d8292128a1f4ae2b931'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:50.638122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2285/4558] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:32:50 2022] DELETE /identity/v3/users/1cdd495f59394d8292128a1f4ae2b931 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:51.120268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:51.120268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:51.141689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2f83-3f99-4664-ba50-b72bac5b496c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:51.173549 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:51.267152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:51.268984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:51.271241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:51.271540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] PATH_INFO: `/v3/projects/106174739c8f42bebec4a05d02847d20` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:51.273964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106174739c8f42bebec4a05d02847d20)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:51.276630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:51.446436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106174739c8f42bebec4a05d02847d20', 'request_id': 'req-937f5579-1e45-46c9-9fc7-4d35950d5f74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:51.453619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106174739c8f42bebec4a05d02847d20', 'request_id': 'req-937f5579-1e45-46c9-9fc7-4d35950d5f74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:51.542488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106174739c8f42bebec4a05d02847d20', 'request_id': 'req-937f5579-1e45-46c9-9fc7-4d35950d5f74'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:51.564441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] The token cache is being invalidate because project 106174739c8f42bebec4a05d02847d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:32:51.564816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:51.565642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-937f5579-1e45-46c9-9fc7-4d35950d5f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:51.572829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95302e6-e4ec-441d-b59a-5612dd694605 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:51.573360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95302e6-e4ec-441d-b59a-5612dd694605 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:51.573360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95302e6-e4ec-441d-b59a-5612dd694605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:51.576574 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2274/4559] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:32:51 2022] DELETE /identity/v3/projects/106174739c8f42bebec4a05d02847d20 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:51.595602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c95302e6-e4ec-441d-b59a-5612dd694605 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:51.596799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c95302e6-e4ec-441d-b59a-5612dd694605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:51.616103 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:51.676934 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2286/4560] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:51.686744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ff63-748c-499f-ad15-055c9ae708f4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:51.687032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ff63-748c-499f-ad15-055c9ae708f4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:51.691579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ff63-748c-499f-ad15-055c9ae708f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:51.711711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2e52ff63-748c-499f-ad15-055c9ae708f4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:51.714254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e52ff63-748c-499f-ad15-055c9ae708f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:51.732325 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2275/4561] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:51.736864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95302e6-e4ec-441d-b59a-5612dd694605 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:51.747457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95302e6-e4ec-441d-b59a-5612dd694605 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:51.754954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:51.755653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:51.756124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:51.756479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:51.757205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:32:51.757576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:51.767173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:51.789457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52ff63-748c-499f-ad15-055c9ae708f4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:51.795780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2287/4562] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:32:51.802307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52ff63-748c-499f-ad15-055c9ae708f4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:51.808038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:51.810363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:51.810654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:51.810930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:51.811734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:51.813639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:51.934787 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2276/4563] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:32:51 2022] POST /identity/v3/projects => generated 409 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:32:51.939084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:51.951493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3523-6dd9-41c3-aeb9-b6710161aad4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.051516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.052242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.052622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.052993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.053730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.055774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.157258 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2288/4564] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:32:51 2022] POST /identity/v3/users => generated 305 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:32:52.158605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:52.169484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92594018-df73-4a96-9011-51d1ab88e91d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.174799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.175442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.175720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.176241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.176897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.178608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.189855 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2277/4565] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:32:52.194314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:52.205427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62df24-d051-4023-9ad7-8387f0941aac admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.210550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e741884-9163-4e39-9d96-3b71d9fd89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.211183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741884-9163-4e39-9d96-3b71d9fd89b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.211540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741884-9163-4e39-9d96-3b71d9fd89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.211957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741884-9163-4e39-9d96-3b71d9fd89b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.213210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e741884-9163-4e39-9d96-3b71d9fd89b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.214895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e741884-9163-4e39-9d96-3b71d9fd89b6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.230987 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2289/4566] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:32:52.232439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:52.243159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2f86f-8d1b-40b6-bf7a-e2cebaf0c91b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.249743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.250788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.251253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.251730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] PATH_INFO: `/v3/projects/8bea1b24c8fb45ac9bf33f0f4cb6b17c/users/270c8c4d0124488bbb10a5526d559ef3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.270407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bea1b24c8fb45ac9bf33f0f4cb6b17c, user_id=270c8c4d0124488bbb10a5526d559ef3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.274538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.361583 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2278/4567] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:32:52 2022] PUT /identity/v3/projects/8bea1b24c8fb45ac9bf33f0f4cb6b17c/users/270c8c4d0124488bbb10a5526d559ef3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:52.372157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511533cc-2987-4e6c-99df-a0c052fb4cc2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.372442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511533cc-2987-4e6c-99df-a0c052fb4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.372717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511533cc-2987-4e6c-99df-a0c052fb4cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.401961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-511533cc-2987-4e6c-99df-a0c052fb4cc2 None None] MFA Rules not processed for user `270c8c4d0124488bbb10a5526d559ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:52.403221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-511533cc-2987-4e6c-99df-a0c052fb4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:52.480120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2290/4568] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:52 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:52.485076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:52.537036 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:52.550633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e109a0a-f4f7-4afe-9641-745c9c70e6d7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.555619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.556313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.556590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.556858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.557490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.559404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.695646 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2279/4569] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:32:52 2022] POST /identity/v3/projects => generated 409 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:32:52.700149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511533cc-2987-4e6c-99df-a0c052fb4cc2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:52.711099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511533cc-2987-4e6c-99df-a0c052fb4cc2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.720958 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:52.769771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.770453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.770770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.771050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.771693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.773613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.918594 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2291/4570] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:32:52 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:32:52.919907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:52.930429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12809e-eb09-4c89-8c41-0b02e3a71f04 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.934934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.935541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.935811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.936075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.936837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.938453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.949471 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2280/4571] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:32:52.953775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:52.964497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b94f3-3e4a-47a0-827d-321f05b9e65b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:52.969292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:52.969950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:52.970270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:52.970543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] PATH_INFO: `/v3/projects/c94091f245024be183c28c6958154e0f/users/a46fb3c408564d86bd376e2abd3aaecc/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:52.986699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94091f245024be183c28c6958154e0f, user_id=a46fb3c408564d86bd376e2abd3aaecc, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:52.989807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:52.999914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:53.001828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:53.018827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b3608-f7e8-421d-a030-ec1db7dffb9e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:53.025693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:53.026325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:53.026641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:53.030646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] PATH_INFO: `/v3/users/1566725e2a59478db6ba3904fcfebd6c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:53.030646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1566725e2a59478db6ba3904fcfebd6c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:53.030646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:53.102805 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2292/4572] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:32:52 2022] PUT /identity/v3/projects/c94091f245024be183c28c6958154e0f/users/a46fb3c408564d86bd376e2abd3aaecc/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:53.106775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:53.184307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f83fee-83f9-4afc-89f4-9b585ea56322 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:53.190270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:53.191019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:53.191394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:53.191792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:53.192544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:53.194920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:53.208406 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2293/4573] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:32:53.212019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:53.223716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695611-8a74-40ef-a257-4b46d29411bd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:53.230257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc822e-dc99-479a-b34e-e8c0bbdc4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:53.231440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc822e-dc99-479a-b34e-e8c0bbdc4773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:53.231440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc822e-dc99-479a-b34e-e8c0bbdc4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:53.231765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc822e-dc99-479a-b34e-e8c0bbdc4773 admin admin] PATH_INFO: `/v3/projects/c94091f245024be183c28c6958154e0f/users/a46fb3c408564d86bd376e2abd3aaecc/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:53.234626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc822e-dc99-479a-b34e-e8c0bbdc4773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94091f245024be183c28c6958154e0f, user_id=a46fb3c408564d86bd376e2abd3aaecc, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:53.236708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc822e-dc99-479a-b34e-e8c0bbdc4773 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:53.249130 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2294/4574] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:32:53 2022] PUT /identity/v3/projects/c94091f245024be183c28c6958154e0f/users/a46fb3c408564d86bd376e2abd3aaecc/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:32:53.260320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:53.260697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:53.261050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:53.286362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1566725e2a59478db6ba3904fcfebd6c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:53.295824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] MFA Rules not processed for user `a46fb3c408564d86bd376e2abd3aaecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:53.297116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:53.299729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1566725e2a59478db6ba3904fcfebd6c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:53.300550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1566725e2a59478db6ba3904fcfebd6c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:53.378828 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:53.382086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1566725e2a59478db6ba3904fcfebd6c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:53.383219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b2a5b594-e65c-4eb4-8635-30fcfaf41b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1566725e2a59478db6ba3904fcfebd6c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:53.407120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2295/4575] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:32:53.416494 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2281/4576] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:32:52 2022] DELETE /identity/v3/users/1566725e2a59478db6ba3904fcfebd6c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:53.420644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:53.420644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:53.423880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:53.424418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:53.425007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:53.459891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:53.462608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:53.512702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c69c-df8a-411a-8024-cfcd98a50346 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:53.558744 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2282/4577] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:53.567744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:53.568368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:53.568561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:53.568701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:53.568897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:53.570072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:53.617596 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:53.643018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd03cf0-90ca-42ea-b3df-4c853d02ef96 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:53.647473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:53.648176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:53.648319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:53.648532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:53.648718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:53.655900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:53.660250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:53.661698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:53.671737 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2296/4578] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:32:53.673064 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2283/4579] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:32:54.001160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.003852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:54.030748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07194b7b-5d86-462a-bf55-19a34ab83913 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.036096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.036758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.037039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.037315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] PATH_INFO: `/v3/projects/97d73f43c13149b3b4fb3518b5cf547f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.039156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d73f43c13149b3b4fb3518b5cf547f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.041809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:54.126253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.127690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:54.140540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6a6b-03ca-4f9e-a3f3-aa61ff40b661 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.147054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd495e64-8c01-4832-b79d-a4fba540dea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.147054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd495e64-8c01-4832-b79d-a4fba540dea7 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.147054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd495e64-8c01-4832-b79d-a4fba540dea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.147054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd495e64-8c01-4832-b79d-a4fba540dea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.147418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd495e64-8c01-4832-b79d-a4fba540dea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:54.188443 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:54.189868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d73f43c13149b3b4fb3518b5cf547f', 'request_id': 'req-2aea04ad-e666-4cc4-9274-e8b07745dbf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:54.196240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d73f43c13149b3b4fb3518b5cf547f', 'request_id': 'req-2aea04ad-e666-4cc4-9274-e8b07745dbf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:54.221688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd495e64-8c01-4832-b79d-a4fba540dea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.221688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd495e64-8c01-4832-b79d-a4fba540dea7 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:54.229576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2284/4580] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:32:54.275565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d73f43c13149b3b4fb3518b5cf547f', 'request_id': 'req-2aea04ad-e666-4cc4-9274-e8b07745dbf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:54.290687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] The token cache is being invalidate because project 97d73f43c13149b3b4fb3518b5cf547f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:32:54.290975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:54.291708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2aea04ad-e666-4cc4-9274-e8b07745dbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:32:54.293371 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2297/4581] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:32:54 2022] DELETE /identity/v3/projects/97d73f43c13149b3b4fb3518b5cf547f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:54.303584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5c4fd-b57c-46da-a145-b99d7e9e6d1c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.304099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5c4fd-b57c-46da-a145-b99d7e9e6d1c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.304185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5c4fd-b57c-46da-a145-b99d7e9e6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.336193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7ea5c4fd-b57c-46da-a145-b99d7e9e6d1c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:54.338187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7ea5c4fd-b57c-46da-a145-b99d7e9e6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:54.403660 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2285/4582] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:54.414655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653210a6-b5d4-4f05-af11-eaec20157aca None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.415024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653210a6-b5d4-4f05-af11-eaec20157aca None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.415311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653210a6-b5d4-4f05-af11-eaec20157aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.436175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-653210a6-b5d4-4f05-af11-eaec20157aca None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:54.437361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-653210a6-b5d4-4f05-af11-eaec20157aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:54.445442 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2298/4583] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:54.451066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5c4fd-b57c-46da-a145-b99d7e9e6d1c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.460746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5c4fd-b57c-46da-a145-b99d7e9e6d1c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.466255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.466963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.467301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.467582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.468226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:32:54.468523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.470173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:54.483032 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2286/4584] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:32:54.487154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653210a6-b5d4-4f05-af11-eaec20157aca None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.498536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653210a6-b5d4-4f05-af11-eaec20157aca None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.503230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.503799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.504077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.504345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.504975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.506959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:54.595693 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2299/4585] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:32:54 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:32:54.599910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.609996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17f98-4146-4f9a-bbef-4bf93fcfccaa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.670633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.671258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.671540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.671959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.672727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.674859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:54.701728 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:32:54.843342 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2287/4586] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:32:54 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:32:54.844093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.854636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a46ca-16c3-46be-a745-b56ed84956a5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.859642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.860318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.860660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.861016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.861701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.863312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:54.874876 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2300/4587] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:32:54.878830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.890132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b069a5-0363-4170-9c21-3a360248315d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.895359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da9b31-7727-4274-8b81-d29c1635b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.896084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9b31-7727-4274-8b81-d29c1635b6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.896372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9b31-7727-4274-8b81-d29c1635b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.896642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9b31-7727-4274-8b81-d29c1635b6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.897279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da9b31-7727-4274-8b81-d29c1635b6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.898884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da9b31-7727-4274-8b81-d29c1635b6a2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:54.916473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:54.921814 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2288/4588] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:32:54.927583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c320e-1915-4fe5-881f-205a013512c9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:54.932983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:54.933739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:54.934144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:54.941176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] PATH_INFO: `/v3/projects/460fd1a27be74bf08b002a8200380491/users/3aa074c0227e45d791ab727ba6647c0f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:54.953399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460fd1a27be74bf08b002a8200380491, user_id=3aa074c0227e45d791ab727ba6647c0f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:54.956078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:55.062646 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2301/4589] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:32:54 2022] PUT /identity/v3/projects/460fd1a27be74bf08b002a8200380491/users/3aa074c0227e45d791ab727ba6647c0f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:32:55.073395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03262-eaad-4a4f-b311-3ab886c7f87e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:55.073681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03262-eaad-4a4f-b311-3ab886c7f87e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:55.073959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03262-eaad-4a4f-b311-3ab886c7f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:55.101377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e8f03262-eaad-4a4f-b311-3ab886c7f87e None None] MFA Rules not processed for user `3aa074c0227e45d791ab727ba6647c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:55.102615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e8f03262-eaad-4a4f-b311-3ab886c7f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:55.169315 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2289/4590] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:55.186092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:55.188894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:55.253225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd657ad-e48b-4ef8-a07f-dfec66c09814 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:55.257319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:55.258540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:55.258540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:55.258540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:55.269825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:55.272178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:55.282823 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2302/4591] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:32:56.525776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e798-40b6-4f28-8c81-360836e9aba4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:56.526305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e798-40b6-4f28-8c81-360836e9aba4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:56.526402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e798-40b6-4f28-8c81-360836e9aba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:56.547087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ba04e798-40b6-4f28-8c81-360836e9aba4 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:32:56.548301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba04e798-40b6-4f28-8c81-360836e9aba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:56.604898 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2290/4592] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:32:56.620877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:32:56.622850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:32:56.709540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fd64f-d4f0-42b8-9984-941aea30abc9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:32:56.715466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bd6ab-30e3-450e-a64e-b97efe056368 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:32:56.716079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd6ab-30e3-450e-a64e-b97efe056368 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:32:56.716358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd6ab-30e3-450e-a64e-b97efe056368 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:32:56.716630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd6ab-30e3-450e-a64e-b97efe056368 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:32:56.725839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bd6ab-30e3-450e-a64e-b97efe056368 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:32:56.728392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bd6ab-30e3-450e-a64e-b97efe056368 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:32:56.738694 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2303/4593] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:32:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:33:06.598430 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=1,keystone:SELECT=64 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:06.737678 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:09.875922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:09.876446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:09.878034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:09.915433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:09.915613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:10.026936 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2291/4594] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:11.836806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:11.837298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:11.837423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:11.900112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] MFA Rules not processed for user `77197152ea5040bab602d5381d21341a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:11.901304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:12.134278 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2304/4595] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:12.554298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:12.557344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:12.611094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:12.612486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:12.759246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db218c77-1cf3-425b-955f-48f8b55fbb64 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:12.790474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374e4d5-19a2-4e97-8e21-332ed8bdd552 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:12.791161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e4d5-19a2-4e97-8e21-332ed8bdd552 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:12.792100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e4d5-19a2-4e97-8e21-332ed8bdd552 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:12.792100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e4d5-19a2-4e97-8e21-332ed8bdd552 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:12.834147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f374e4d5-19a2-4e97-8e21-332ed8bdd552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:12.854605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dc4b3-2501-4cbf-9a4b-1a2efd7bb625 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:12.861551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:12.862688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:12.863202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:12.863723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] PATH_INFO: `/v3/users/270c8c4d0124488bbb10a5526d559ef3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:12.866540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270c8c4d0124488bbb10a5526d559ef3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:12.869690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:12.879029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374e4d5-19a2-4e97-8e21-332ed8bdd552 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:12.880790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374e4d5-19a2-4e97-8e21-332ed8bdd552 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:12.899702 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2292/4596] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:13.378594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270c8c4d0124488bbb10a5526d559ef3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:13.403852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270c8c4d0124488bbb10a5526d559ef3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:13.419542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270c8c4d0124488bbb10a5526d559ef3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:13.502941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270c8c4d0124488bbb10a5526d559ef3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:13.503891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7e4c7bd1-48aa-4227-be3a-f9a9e65e9814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270c8c4d0124488bbb10a5526d559ef3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:13.557545 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2305/4597] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:33:12 2022] DELETE /identity/v3/users/270c8c4d0124488bbb10a5526d559ef3 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:13.561862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:13.562371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:13.562474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:13.607602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a35f-b3b3-464c-a273-f8ade87b2e2d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:13.607602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a35f-b3b3-464c-a273-f8ade87b2e2d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:13.607602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a35f-b3b3-464c-a273-f8ade87b2e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:13.635783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:13.637320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:13.648194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4f07a35f-b3b3-464c-a273-f8ade87b2e2d None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:13.649998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f07a35f-b3b3-464c-a273-f8ade87b2e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:13.753148 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:13.823914 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2293/4598] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:13.868567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:13.870150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:13.918447 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:13.943224 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2306/4599] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:13.957622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ac0c4-53a1-4f82-87ba-8300e815e8d0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:13.968425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:13.969235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:13.969605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:13.969986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:14.003034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:14.005816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:14.040597 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2294/4600] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:15.163082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a35f-b3b3-464c-a273-f8ade87b2e2d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:15.175317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a35f-b3b3-464c-a273-f8ade87b2e2d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:15.180398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:15.181348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:15.181790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:15.186631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:15.186631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:15.200814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:15.202798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:15.235372 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2307/4601] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:15.513379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:15.513379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:15.533858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58411-cecd-49f0-97d3-b8c9143b5df2 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:15.543979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:15.546915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:15.547476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:15.548791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] PATH_INFO: `/v3/projects/8bea1b24c8fb45ac9bf33f0f4cb6b17c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:15.551747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bea1b24c8fb45ac9bf33f0f4cb6b17c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:15.556009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:15.728611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bea1b24c8fb45ac9bf33f0f4cb6b17c', 'request_id': 'req-fdf78cad-45b8-43c6-a575-cfe0909b0e91'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:15.748281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bea1b24c8fb45ac9bf33f0f4cb6b17c', 'request_id': 'req-fdf78cad-45b8-43c6-a575-cfe0909b0e91'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:15.881504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bea1b24c8fb45ac9bf33f0f4cb6b17c', 'request_id': 'req-fdf78cad-45b8-43c6-a575-cfe0909b0e91'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:15.904852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] The token cache is being invalidate because project 8bea1b24c8fb45ac9bf33f0f4cb6b17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:33:15.905224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:15.907827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:15.912545 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2295/4602] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:33:15 2022] DELETE /identity/v3/projects/8bea1b24c8fb45ac9bf33f0f4cb6b17c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:15.918853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:15.965592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465e3b-8e97-4d2d-b048-7f541cd53f7d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:16.204211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:16.204878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:16.205161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:16.205612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] PATH_INFO: `/v3/users/a46fb3c408564d86bd376e2abd3aaecc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:16.209699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46fb3c408564d86bd376e2abd3aaecc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:16.212425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:16.571164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46fb3c408564d86bd376e2abd3aaecc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:16.596521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46fb3c408564d86bd376e2abd3aaecc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:16.599113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46fb3c408564d86bd376e2abd3aaecc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:16.701588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46fb3c408564d86bd376e2abd3aaecc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:16.702357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea5d18dd-ca71-4c85-a7ec-69353cafb44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46fb3c408564d86bd376e2abd3aaecc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:16.776821 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2308/4603] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:33:15 2022] DELETE /identity/v3/users/a46fb3c408564d86bd376e2abd3aaecc => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:18.035516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:18.037285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:18.090218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78cad-45b8-43c6-a575-cfe0909b0e91 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:18.226083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:18.227523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:18.227848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:18.228296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] PATH_INFO: `/v3/projects/c94091f245024be183c28c6958154e0f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:18.229702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94091f245024be183c28c6958154e0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:18.232340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:18.426344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94091f245024be183c28c6958154e0f', 'request_id': 'req-6911296e-3c9e-4f77-8112-629afaff58fc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:18.427703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94091f245024be183c28c6958154e0f', 'request_id': 'req-6911296e-3c9e-4f77-8112-629afaff58fc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:18.434988 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:18.508435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94091f245024be183c28c6958154e0f', 'request_id': 'req-6911296e-3c9e-4f77-8112-629afaff58fc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:18.537170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] The token cache is being invalidate because project c94091f245024be183c28c6958154e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:33:18.551838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:18.554222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6911296e-3c9e-4f77-8112-629afaff58fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:18.564233 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2296/4604] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:33:18 2022] DELETE /identity/v3/projects/c94091f245024be183c28c6958154e0f => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:18.568891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f959f8a-15b5-4205-8a36-47b0933f860a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:18.569367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f959f8a-15b5-4205-8a36-47b0933f860a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:18.569490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f959f8a-15b5-4205-8a36-47b0933f860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:18.626592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6f959f8a-15b5-4205-8a36-47b0933f860a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:18.629169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6f959f8a-15b5-4205-8a36-47b0933f860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:18.730627 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:18.801437 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2309/4605] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:18.803181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797033-3aa9-4ca8-bf2b-e9ac9647ec31 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:18.803566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797033-3aa9-4ca8-bf2b-e9ac9647ec31 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:18.804489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10797033-3aa9-4ca8-bf2b-e9ac9647ec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:18.850782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-10797033-3aa9-4ca8-bf2b-e9ac9647ec31 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:18.850782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-10797033-3aa9-4ca8-bf2b-e9ac9647ec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:18.874239 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2297/4606] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:18.878614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f959f8a-15b5-4205-8a36-47b0933f860a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:18.904425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f959f8a-15b5-4205-8a36-47b0933f860a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:18.911455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:18.915213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:18.915420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:18.915706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:18.916780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:33:18.917300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:18.928006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:18.949887 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2310/4607] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:33:18.954073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797033-3aa9-4ca8-bf2b-e9ac9647ec31 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:18.969322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10797033-3aa9-4ca8-bf2b-e9ac9647ec31 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:18.983694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:18.985131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:18.985571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:18.985848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:18.986600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:18.991089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:19.117484 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2298/4608] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:33:18 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:19.121680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:19.137653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d104-dfb7-49aa-bc77-0f08332b5805 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:19.215589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:19.219558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:19.220010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:19.220436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:19.221111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:19.226425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:19.381924 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2311/4609] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:33:19 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:19.388265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:19.418401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016accd-709c-4af8-a3f3-18b6fba88e80 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:19.448539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:19.450905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:19.455726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:19.457814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:19.461833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:19.473037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:19.538309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2299/4610] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:19.542692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:19.556396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27862ce0-b0b5-4a33-baf4-2ba33119fffc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:19.569458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c2f12-3181-41dc-90a1-3b4c729e0c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:19.570201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2f12-3181-41dc-90a1-3b4c729e0c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:19.570483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2f12-3181-41dc-90a1-3b4c729e0c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:19.570977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2f12-3181-41dc-90a1-3b4c729e0c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:19.571878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c2f12-3181-41dc-90a1-3b4c729e0c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:19.573669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c2f12-3181-41dc-90a1-3b4c729e0c18 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:19.604178 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2312/4611] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:19.605096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:19.632699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671d0b-5550-4f9d-ba4f-3ebd10ec3696 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:19.660381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:19.661237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:19.661521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:19.661800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] PATH_INFO: `/v3/projects/c57e1b8d18934be3b97d332eab05ae8c/users/8f46fef6fc114ffe87f2ff70a3a4e708/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:19.722124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57e1b8d18934be3b97d332eab05ae8c, user_id=8f46fef6fc114ffe87f2ff70a3a4e708, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:19.732503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:19.878918 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2300/4612] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:33:19 2022] PUT /identity/v3/projects/c57e1b8d18934be3b97d332eab05ae8c/users/8f46fef6fc114ffe87f2ff70a3a4e708/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:33:19.890364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4a83-13fa-4413-af73-6f63b7a5ba56 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:19.891155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4a83-13fa-4413-af73-6f63b7a5ba56 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:19.891793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4a83-13fa-4413-af73-6f63b7a5ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:19.963452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-202a4a83-13fa-4413-af73-6f63b7a5ba56 None None] MFA Rules not processed for user `8f46fef6fc114ffe87f2ff70a3a4e708`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:19.966617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-202a4a83-13fa-4413-af73-6f63b7a5ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:20.207428 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2313/4613] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:20.219606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:20.222063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:20.363500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed14077-3b27-4da8-97a5-b23ff003359f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:20.372578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410996c-eb94-4b9d-83a5-26ec41ba6159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:20.373872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410996c-eb94-4b9d-83a5-26ec41ba6159 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:20.374559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410996c-eb94-4b9d-83a5-26ec41ba6159 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:20.375049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410996c-eb94-4b9d-83a5-26ec41ba6159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:20.387059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410996c-eb94-4b9d-83a5-26ec41ba6159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:20.389048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410996c-eb94-4b9d-83a5-26ec41ba6159 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:20.408698 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2301/4614] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:20.455534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4a83-13fa-4413-af73-6f63b7a5ba56 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:20.549143 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:20.621535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4a83-13fa-4413-af73-6f63b7a5ba56 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:20.634328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:20.643985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:20.645844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:20.648006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] PATH_INFO: `/v3/users/8f46fef6fc114ffe87f2ff70a3a4e708` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:20.656109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f46fef6fc114ffe87f2ff70a3a4e708)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:20.660903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:21.137341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f46fef6fc114ffe87f2ff70a3a4e708'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:21.151563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f46fef6fc114ffe87f2ff70a3a4e708'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:21.152695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f46fef6fc114ffe87f2ff70a3a4e708'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:21.285059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f46fef6fc114ffe87f2ff70a3a4e708'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:21.285059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f46fef6fc114ffe87f2ff70a3a4e708'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:21.349510 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2314/4615] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:33:20 2022] DELETE /identity/v3/users/8f46fef6fc114ffe87f2ff70a3a4e708 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:21.354679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:21.355205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:21.355205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:21.397856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:21.402265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:21.601873 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2302/4616] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:21.661787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:21.663417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:21.790764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3818b1-a7fa-4aac-94b4-7ea7b32951d0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:21.796440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0f5a8-f3c1-464b-b84f-c70394d2810b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:21.797845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0f5a8-f3c1-464b-b84f-c70394d2810b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:21.798280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0f5a8-f3c1-464b-b84f-c70394d2810b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:21.798624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0f5a8-f3c1-464b-b84f-c70394d2810b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:21.815094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0f5a8-f3c1-464b-b84f-c70394d2810b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:21.816538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0f5a8-f3c1-464b-b84f-c70394d2810b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:21.829124 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2315/4617] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:23.610790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:23.612496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:23.636473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8b454-2810-404e-a34f-70136f339c1f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:23.645319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:23.646314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:23.646775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:23.647244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] PATH_INFO: `/v3/projects/c57e1b8d18934be3b97d332eab05ae8c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:23.649523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57e1b8d18934be3b97d332eab05ae8c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:23.651862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:23.793916 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:23.846878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57e1b8d18934be3b97d332eab05ae8c', 'request_id': 'req-cb35f285-6451-4808-9c59-e28552c654d5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:23.883658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57e1b8d18934be3b97d332eab05ae8c', 'request_id': 'req-cb35f285-6451-4808-9c59-e28552c654d5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:23.973009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57e1b8d18934be3b97d332eab05ae8c', 'request_id': 'req-cb35f285-6451-4808-9c59-e28552c654d5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:24.004622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] The token cache is being invalidate because project c57e1b8d18934be3b97d332eab05ae8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:33:24.004622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:24.004622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cb35f285-6451-4808-9c59-e28552c654d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:24.005545 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2303/4618] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:33:23 2022] DELETE /identity/v3/projects/c57e1b8d18934be3b97d332eab05ae8c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:24.012212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa054-7f25-477b-9b01-99ad72948fe1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.013085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa054-7f25-477b-9b01-99ad72948fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.013610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa054-7f25-477b-9b01-99ad72948fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.051317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-168fa054-7f25-477b-9b01-99ad72948fe1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:24.052549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-168fa054-7f25-477b-9b01-99ad72948fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:24.159083 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:24.182118 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2316/4619] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:24.192012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aca91-c042-427a-a333-81134ccb400c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.192708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aca91-c042-427a-a333-81134ccb400c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.193186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aca91-c042-427a-a333-81134ccb400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.255694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2e8aca91-c042-427a-a333-81134ccb400c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:24.260793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e8aca91-c042-427a-a333-81134ccb400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:24.285655 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2304/4620] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:24.290568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa054-7f25-477b-9b01-99ad72948fe1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:24.310108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa054-7f25-477b-9b01-99ad72948fe1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:24.321797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:24.322511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.322793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.323066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.324320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:33:24.324739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:24.326398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:24.346336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2317/4621] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:33:24.350183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aca91-c042-427a-a333-81134ccb400c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:24.382005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aca91-c042-427a-a333-81134ccb400c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:24.407329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:24.410938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.413156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.413435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.416926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:24.420258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:24.525198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2305/4622] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:33:24 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:24.525842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:24.537591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263926f-c3ea-4c66-a6dc-4694efdfbda2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:24.635924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:24.636575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.636855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.637129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.637886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:24.641139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:24.829808 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2318/4623] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:33:24 2022] POST /identity/v3/users => generated 287 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:33:24.834718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:24.851141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650a70f-938d-4303-b6bb-3a2b95974639 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:24.867527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:24.868149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.868424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.868690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.869331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:24.871133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:24.890021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2306/4624] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:24.890981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:24.902987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84473a-c547-41ee-a37a-c94cb5776fc2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:24.908458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c8f2-b0f7-457f-9154-60cad63534b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:24.909171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c8f2-b0f7-457f-9154-60cad63534b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.909513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c8f2-b0f7-457f-9154-60cad63534b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.909847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c8f2-b0f7-457f-9154-60cad63534b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.912900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c8f2-b0f7-457f-9154-60cad63534b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:24.912900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c8f2-b0f7-457f-9154-60cad63534b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:24.925760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2319/4625] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:24.931289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:24.942857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f53c6-f72f-4779-bc9f-77f22e53180b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:24.951729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:24.952466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:24.952735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:24.953003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] PATH_INFO: `/v3/projects/b4943f393f1f48b7b036dcff442e5f5c/users/267f0ea4e43642eaaad707c06a27d6bf/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:24.968537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4943f393f1f48b7b036dcff442e5f5c, user_id=267f0ea4e43642eaaad707c06a27d6bf, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:24.971635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:25.071718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2307/4626] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:33:24 2022] PUT /identity/v3/projects/b4943f393f1f48b7b036dcff442e5f5c/users/267f0ea4e43642eaaad707c06a27d6bf/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:25.082942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f621aa2-240d-441a-95b1-4446bc6e2123 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:25.083731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f621aa2-240d-441a-95b1-4446bc6e2123 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:25.083731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f621aa2-240d-441a-95b1-4446bc6e2123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:25.118525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8f621aa2-240d-441a-95b1-4446bc6e2123 None None] MFA Rules not processed for user `267f0ea4e43642eaaad707c06a27d6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:25.139864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f621aa2-240d-441a-95b1-4446bc6e2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:25.229643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2320/4627] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:25.241192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:25.243913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:25.335920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1b4c2-b411-44f2-bdd2-88ab7e1022fc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:25.340855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d36536-f2fd-4b9c-bf5e-7e86b03cc178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:25.343244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d36536-f2fd-4b9c-bf5e-7e86b03cc178 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:25.343803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d36536-f2fd-4b9c-bf5e-7e86b03cc178 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:25.344259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d36536-f2fd-4b9c-bf5e-7e86b03cc178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:25.355830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d36536-f2fd-4b9c-bf5e-7e86b03cc178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:25.361260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d36536-f2fd-4b9c-bf5e-7e86b03cc178 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:25.369297 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2308/4628] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:25.395756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f621aa2-240d-441a-95b1-4446bc6e2123 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:25.523619 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:25.544971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f621aa2-240d-441a-95b1-4446bc6e2123 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:25.552463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:25.553045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:25.553423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:25.553762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] PATH_INFO: `/v3/users/267f0ea4e43642eaaad707c06a27d6bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:25.555776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267f0ea4e43642eaaad707c06a27d6bf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:25.558084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:25.810164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267f0ea4e43642eaaad707c06a27d6bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:25.819203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267f0ea4e43642eaaad707c06a27d6bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:25.820361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267f0ea4e43642eaaad707c06a27d6bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:25.943845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267f0ea4e43642eaaad707c06a27d6bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:25.945907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267f0ea4e43642eaaad707c06a27d6bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:25.969683 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2321/4629] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:33:25 2022] DELETE /identity/v3/users/267f0ea4e43642eaaad707c06a27d6bf => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:25.975056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:25.981218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:25.981218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:25.998930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:26.000429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:26.051000 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:26.066578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2309/4630] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:33:26.074942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:26.076356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:26.176923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1362-f6eb-42ed-9a24-665eee7fb6a2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:26.181167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0aa8-1a1f-458b-9c69-864a424738b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:26.183053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0aa8-1a1f-458b-9c69-864a424738b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:26.183684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0aa8-1a1f-458b-9c69-864a424738b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:26.184194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0aa8-1a1f-458b-9c69-864a424738b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:26.211320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0aa8-1a1f-458b-9c69-864a424738b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:26.212903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0aa8-1a1f-458b-9c69-864a424738b0 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:26.235028 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2322/4631] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:33:27.700609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:27.702140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:27.722752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925948c6-1372-4c06-9b4d-11dc6ee868b5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:27.755817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:27.756827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:27.758328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:27.760649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] PATH_INFO: `/v3/projects/b4943f393f1f48b7b036dcff442e5f5c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:27.763380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4943f393f1f48b7b036dcff442e5f5c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:27.766146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:27.980913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4943f393f1f48b7b036dcff442e5f5c', 'request_id': 'req-7a91831e-7695-46ed-85b1-26dd016f48db'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:28.006929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4943f393f1f48b7b036dcff442e5f5c', 'request_id': 'req-7a91831e-7695-46ed-85b1-26dd016f48db'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:28.199533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4943f393f1f48b7b036dcff442e5f5c', 'request_id': 'req-7a91831e-7695-46ed-85b1-26dd016f48db'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:28.222539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] The token cache is being invalidate because project b4943f393f1f48b7b036dcff442e5f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:33:28.222833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:28.223790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a91831e-7695-46ed-85b1-26dd016f48db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:28.226489 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2310/4632] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:33:27 2022] DELETE /identity/v3/projects/b4943f393f1f48b7b036dcff442e5f5c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:28.234795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ba3e-2911-4de8-bae5-eef55e6cbe25 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:28.234795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ba3e-2911-4de8-bae5-eef55e6cbe25 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:28.234795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ba3e-2911-4de8-bae5-eef55e6cbe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:28.286910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-abd7ba3e-2911-4de8-bae5-eef55e6cbe25 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:28.288130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-abd7ba3e-2911-4de8-bae5-eef55e6cbe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:28.431040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2323/4633] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:28.435896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf0a53-0f4d-4d9a-803b-60cbdf682e10 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:28.436224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf0a53-0f4d-4d9a-803b-60cbdf682e10 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:28.436462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf0a53-0f4d-4d9a-803b-60cbdf682e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:28.489794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e9bf0a53-0f4d-4d9a-803b-60cbdf682e10 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:28.494612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e9bf0a53-0f4d-4d9a-803b-60cbdf682e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:28.525713 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2311/4634] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:28.529742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ba3e-2911-4de8-bae5-eef55e6cbe25 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:28.549966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ba3e-2911-4de8-bae5-eef55e6cbe25 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:28.564610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:28.566099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:28.566564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:28.567640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:28.571174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:33:28.571728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:28.575232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:28.593052 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:28.607550 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2324/4635] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:33:28.611166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf0a53-0f4d-4d9a-803b-60cbdf682e10 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:28.625079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf0a53-0f4d-4d9a-803b-60cbdf682e10 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:28.645706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:28.646944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:28.647404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:28.648546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:28.649405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:28.651683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:28.885341 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2312/4636] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:33:28 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:28.889735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:28.909061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854b54-5075-41ea-87c3-57f6a727db0e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:29.130605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:29.131244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:29.131523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:29.131796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:29.149275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:29.149275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:29.312781 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2325/4637] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:33:28 2022] POST /identity/v3/users => generated 287 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:29.325308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:29.340564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03899e4d-af3e-4f70-b111-bd5c6966fd19 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:29.353293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:29.359684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:29.359684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:29.359684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:29.359684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:29.361250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:29.394303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2313/4638] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:29.403745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:29.416472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb827e3-6107-43bb-a310-d242c3de7b3c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:29.424810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c79b8-850c-45be-a7f6-096e424d72ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:29.426342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c79b8-850c-45be-a7f6-096e424d72ea admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:29.426724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c79b8-850c-45be-a7f6-096e424d72ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:29.431480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c79b8-850c-45be-a7f6-096e424d72ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:29.431480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c79b8-850c-45be-a7f6-096e424d72ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:29.433761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c79b8-850c-45be-a7f6-096e424d72ea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:29.461052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:29.470692 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2326/4639] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:29.473604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f43e3-24fa-4408-82dc-7b21b223444d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:29.493901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:29.496337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:29.496953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:29.497399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] PATH_INFO: `/v3/projects/ef4c34c1a48140f8ae5a69fa0abb2bc7/users/be1759290b0b4034ad9d312abb95ef46/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:29.535528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4c34c1a48140f8ae5a69fa0abb2bc7, user_id=be1759290b0b4034ad9d312abb95ef46, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:29.539249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:29.659081 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2314/4640] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:33:29 2022] PUT /identity/v3/projects/ef4c34c1a48140f8ae5a69fa0abb2bc7/users/be1759290b0b4034ad9d312abb95ef46/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:29.665965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519735b-4d2b-4b1c-b008-bb448f49e84f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:29.667787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519735b-4d2b-4b1c-b008-bb448f49e84f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:29.668250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519735b-4d2b-4b1c-b008-bb448f49e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:29.696661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7519735b-4d2b-4b1c-b008-bb448f49e84f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:29.698275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7519735b-4d2b-4b1c-b008-bb448f49e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:29.799624 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2327/4641] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:29.810000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:29.814227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:29.937786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e9d2-3481-4244-a221-7eedd8de32b9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:29.942913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:29.944363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:29.944864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:29.945143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:29.971536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:29.975190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:29.996860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2315/4642] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:33:34.261686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:34.262762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:34.263342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:34.294374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:34.296287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:34.417549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:34.417549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:34.422307 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2328/4643] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:34.474960 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:34.622871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e692-89a7-4e39-9c59-1292fd9b3632 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:34.636703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:34.638209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:34.642748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:34.643363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:34.665471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:34.670639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:34.692165 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2316/4644] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:33:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:33:35.800596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:35.803117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:35.859661 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:36.008160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:36.009719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:36.014688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc0863-bfc2-4937-9c56-60a7a455229d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:36.044141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:36.044790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:36.045073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:36.054295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:36.062284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf294b-f77e-475c-9d93-174b9a92c55a service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:36.065033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:36.090020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:36.091622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:36.096448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:36.096938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] PATH_INFO: `/v3/users/96d3d3c6a02244888eebb6e70eaac4ee` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:36.102503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d3d3c6a02244888eebb6e70eaac4ee)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:36.111902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:36.126646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:36.133322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:36.168872 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2329/4645] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:36.387994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d3d3c6a02244888eebb6e70eaac4ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:36.406361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d3d3c6a02244888eebb6e70eaac4ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:36.407789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d3d3c6a02244888eebb6e70eaac4ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:36.502486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d3d3c6a02244888eebb6e70eaac4ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:36.503408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8a094f29-15a8-4b9d-a704-1bcdcfe787de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d3d3c6a02244888eebb6e70eaac4ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:36.573904 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2317/4646] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:33:36 2022] DELETE /identity/v3/users/96d3d3c6a02244888eebb6e70eaac4ee => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:38.022152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:38.038491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e0a4-b6a7-49cb-a535-a9911af20cd5 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:38.231007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:38.232109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:38.232599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:38.233107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] PATH_INFO: `/v3/projects/3b051b0da0ab45ffa64c7b8b32465a20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:38.242854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b051b0da0ab45ffa64c7b8b32465a20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:38.245306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:38.462441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b051b0da0ab45ffa64c7b8b32465a20', 'request_id': 'req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:38.476794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b051b0da0ab45ffa64c7b8b32465a20', 'request_id': 'req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:38.587880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b051b0da0ab45ffa64c7b8b32465a20', 'request_id': 'req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:38.608882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] The token cache is being invalidate because project 3b051b0da0ab45ffa64c7b8b32465a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:33:38.609225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:38.610056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c8c2a0d-c98e-4e6d-adc8-bf916a8066ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:33:38.611660 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2330/4647] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:33:38 2022] DELETE /identity/v3/projects/3b051b0da0ab45ffa64c7b8b32465a20 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:38.617342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb257-fb28-424b-ba98-d17c29a7bc7b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:38.618796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb257-fb28-424b-ba98-d17c29a7bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:38.619259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb257-fb28-424b-ba98-d17c29a7bc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:38.689457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-327fb257-fb28-424b-ba98-d17c29a7bc7b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:38.695238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-327fb257-fb28-424b-ba98-d17c29a7bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:38.869113 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2318/4648] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:33:38.875441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a41e4-b506-490c-b523-8efad67df778 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:38.875740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a41e4-b506-490c-b523-8efad67df778 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:38.878901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a41e4-b506-490c-b523-8efad67df778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:38.915912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-815a41e4-b506-490c-b523-8efad67df778 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:38.919962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-815a41e4-b506-490c-b523-8efad67df778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:38.944267 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2331/4649] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:38.949332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb257-fb28-424b-ba98-d17c29a7bc7b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:38.964573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb257-fb28-424b-ba98-d17c29a7bc7b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:38.978996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:38.979966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:38.980403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:38.980685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:38.981645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:33:38.981954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:38.985395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:39.014972 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2319/4650] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:33:39.017338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a41e4-b506-490c-b523-8efad67df778 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:39.033069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a41e4-b506-490c-b523-8efad67df778 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:39.044021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:39.044215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:39.044628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:39.045205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:39.046218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:39.049742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:39.253690 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2332/4651] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:33:39 2022] POST /identity/v3/projects => generated 389 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:39.263205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:39.275463 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:39.281625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b7e79-2079-4907-825a-eef622d2b169 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:39.442412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:39.443357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:39.443936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:39.445836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:39.447028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:39.449121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:39.649884 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2320/4652] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:33:39 2022] POST /identity/v3/users => generated 295 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:33:39.652975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:39.668027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda609-2b3f-4e6a-8d4e-f837289d5f64 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:39.676652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:39.677736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:39.679235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:39.679235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:39.679235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:39.681538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:39.712638 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2333/4653] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:39.716851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:39.755180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0202ec-b82c-4866-9d5f-a9e9d062adcb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:39.796339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee321f-a1d3-4ed9-958c-611d73633e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:39.797524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee321f-a1d3-4ed9-958c-611d73633e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:39.801080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee321f-a1d3-4ed9-958c-611d73633e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:39.801364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee321f-a1d3-4ed9-958c-611d73633e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:39.802093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee321f-a1d3-4ed9-958c-611d73633e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:39.815443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee321f-a1d3-4ed9-958c-611d73633e60 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:39.887588 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2321/4654] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:39.893439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:39.910456 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:39.921542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396679e-e5f8-4672-896a-8c403b8f0209 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:39.931100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:39.932066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:39.932471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:39.933001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] PATH_INFO: `/v3/projects/7defb846e6a24a0aadb9de6de5439b8a/users/b118116bb0734e8496aaa1446e871d7e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:39.989697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7defb846e6a24a0aadb9de6de5439b8a, user_id=b118116bb0734e8496aaa1446e871d7e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:40.000922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:40.125297 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2334/4655] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:33:39 2022] PUT /identity/v3/projects/7defb846e6a24a0aadb9de6de5439b8a/users/b118116bb0734e8496aaa1446e871d7e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:40.127165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ea0cc-b64d-4998-b8fa-0f32aa9d3c38 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:40.127639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ea0cc-b64d-4998-b8fa-0f32aa9d3c38 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:40.128287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ea0cc-b64d-4998-b8fa-0f32aa9d3c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:40.187679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-171ea0cc-b64d-4998-b8fa-0f32aa9d3c38 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:40.193416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-171ea0cc-b64d-4998-b8fa-0f32aa9d3c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:40.388259 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2322/4656] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:40.425535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:40.427628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:40.630580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa500154-a40f-43ed-a91f-d44023a2c574 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:40.643589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82241ba5-91a7-43bd-a931-d98fa37fc428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:40.644224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241ba5-91a7-43bd-a931-d98fa37fc428 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:40.644505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241ba5-91a7-43bd-a931-d98fa37fc428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:40.645405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241ba5-91a7-43bd-a931-d98fa37fc428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:40.668414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82241ba5-91a7-43bd-a931-d98fa37fc428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:40.670533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82241ba5-91a7-43bd-a931-d98fa37fc428 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:40.693334 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2335/4657] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:33:42.113600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229964-b963-46dc-b9d2-37549878c60f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:42.114246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229964-b963-46dc-b9d2-37549878c60f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:42.114246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229964-b963-46dc-b9d2-37549878c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:42.167060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-47229964-b963-46dc-b9d2-37549878c60f None None] MFA Rules not processed for user `0c65e7ab0b544d9ebdac8bc2129d051a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:42.168457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-47229964-b963-46dc-b9d2-37549878c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:42.350405 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2323/4658] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:48.095363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:48.095942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:48.095942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:48.198337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] MFA Rules not processed for user `be1759290b0b4034ad9d312abb95ef46`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:48.204186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:48.516097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47229964-b963-46dc-b9d2-37549878c60f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:48.526713 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2336/4659] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:48.530883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:48.540253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:48.540404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47229964-b963-46dc-b9d2-37549878c60f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:48.547948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:48.550782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:48.553555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:48.554510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:48.559179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:48.574722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1e79e-38e1-4f00-95ec-f15ed6d78459 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:48.583438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:48.584871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:48.586325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:48.586838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:48.587683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:48.592798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:48.604252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:48.610299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:48.681885 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2324/4660] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:33:48.787085 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2337/4661] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:33:48 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:48.791105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:48.805138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed266a-2526-4e63-a334-767e22161f12 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:48.838906 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:48.968744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:48.970466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:48.972011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:48.973263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:48.975891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:48.979973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:49.119111 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2325/4662] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:33:48 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:33:49.120367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:49.136696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89665675-c5d8-466a-9553-1bf8944f3fa7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:49.155881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:49.156659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:49.159680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:49.160245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:49.162340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:49.165321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:49.214796 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2338/4663] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:49.218778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:49.231074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c348720-9f0f-4971-8bdc-dd21356e1046 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:49.246944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:49.247637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:49.247917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:49.248192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] PATH_INFO: `/v3/projects/95ad91db941b42d3804257fe2c7c325c/users/ef5aac3e1bda4a54846e674ffd1449d8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:49.297209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ad91db941b42d3804257fe2c7c325c, user_id=ef5aac3e1bda4a54846e674ffd1449d8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:49.300416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:49.396102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2326/4664] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:33:49 2022] PUT /identity/v3/projects/95ad91db941b42d3804257fe2c7c325c/users/ef5aac3e1bda4a54846e674ffd1449d8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:33:49.399230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:49.428392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91180-be71-40ec-857d-7092e391fd46 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:49.580180 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:33:49.651664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084abe9-e0da-4f42-b439-56fe1158ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:49.652691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084abe9-e0da-4f42-b439-56fe1158ec2a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:49.654303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084abe9-e0da-4f42-b439-56fe1158ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:49.654832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084abe9-e0da-4f42-b439-56fe1158ec2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:49.655754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084abe9-e0da-4f42-b439-56fe1158ec2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:49.657618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084abe9-e0da-4f42-b439-56fe1158ec2a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:49.688470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:33:49.689192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2339/4665] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:33:49.705806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9b24-5445-4320-bb9f-d7638b5dd6ea admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:33:49.718471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32046c63-0b81-44a6-bb52-93a66baa4528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:33:49.723901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32046c63-0b81-44a6-bb52-93a66baa4528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:49.723901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32046c63-0b81-44a6-bb52-93a66baa4528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:49.723901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32046c63-0b81-44a6-bb52-93a66baa4528 admin admin] PATH_INFO: `/v3/projects/95ad91db941b42d3804257fe2c7c325c/users/ef5aac3e1bda4a54846e674ffd1449d8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:49.727662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32046c63-0b81-44a6-bb52-93a66baa4528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ad91db941b42d3804257fe2c7c325c, user_id=ef5aac3e1bda4a54846e674ffd1449d8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:33:49.731003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32046c63-0b81-44a6-bb52-93a66baa4528 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:33:49.783573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2327/4666] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:33:49 2022] PUT /identity/v3/projects/95ad91db941b42d3804257fe2c7c325c/users/ef5aac3e1bda4a54846e674ffd1449d8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:33:54.616370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:33:54.617230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:33:54.617658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:33:54.667822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:33:54.670553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:33:54.825776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2340/4667] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:33:59.778834 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=37,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:04.804898 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=37 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:06.211317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e767d-20d3-4183-b499-2bd78d6bfe4c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:06.211852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e767d-20d3-4183-b499-2bd78d6bfe4c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:06.211852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e767d-20d3-4183-b499-2bd78d6bfe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:06.244197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-509e767d-20d3-4183-b499-2bd78d6bfe4c None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:06.245687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-509e767d-20d3-4183-b499-2bd78d6bfe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:06.332525 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2328/4668] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:06.347984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:06.350704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:06.553762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c1895-7214-4927-8a0c-89af9ba9072c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:06.567969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba222111-f3f6-40a1-a1ae-6dc36ad42def service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:06.577374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba222111-f3f6-40a1-a1ae-6dc36ad42def service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:06.577893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba222111-f3f6-40a1-a1ae-6dc36ad42def service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:06.578337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba222111-f3f6-40a1-a1ae-6dc36ad42def service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:06.591861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba222111-f3f6-40a1-a1ae-6dc36ad42def service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:06.594283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba222111-f3f6-40a1-a1ae-6dc36ad42def service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:06.620051 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2341/4669] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:34:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:09.113347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf80c-8f1f-4427-9411-340ee43c4d70 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:09.113347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf80c-8f1f-4427-9411-340ee43c4d70 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:09.113347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdf80c-8f1f-4427-9411-340ee43c4d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:09.191626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fafdf80c-8f1f-4427-9411-340ee43c4d70 None None] MFA Rules not processed for user `b118116bb0734e8496aaa1446e871d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:09.197813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fafdf80c-8f1f-4427-9411-340ee43c4d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:09.376124 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2329/4670] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:09.384375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:09.384988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:09.384988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:09.443471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] MFA Rules not processed for user `b118116bb0734e8496aaa1446e871d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:09.444700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:09.457825 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2342/4671] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:09.770875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:09.771473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:09.774590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:09.822317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] MFA Rules not processed for user `ef5aac3e1bda4a54846e674ffd1449d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:09.823719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:09.928102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:09.929669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:09.947439 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2330/4672] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:10.049680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aea46-d142-4e77-8b36-1b1951188dfa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:10.059189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:10.060509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:10.061817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:10.062391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] PATH_INFO: `/v3/users/1864708a7b2f4223bc8f0015c765eb0f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:10.065438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1864708a7b2f4223bc8f0015c765eb0f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:10.069550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:10.131489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:10.132936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:10.200761 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:10.316117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1864708a7b2f4223bc8f0015c765eb0f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:10.348293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1864708a7b2f4223bc8f0015c765eb0f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:10.351871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1864708a7b2f4223bc8f0015c765eb0f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:10.381206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddb34e-60a3-47b3-a8e0-96efd22e4f0c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:10.389430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d2b5-e1a7-4aa4-9278-3be3f1c427d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:10.390379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d2b5-e1a7-4aa4-9278-3be3f1c427d5 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:10.390887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d2b5-e1a7-4aa4-9278-3be3f1c427d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:10.391525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d2b5-e1a7-4aa4-9278-3be3f1c427d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:10.402831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d2b5-e1a7-4aa4-9278-3be3f1c427d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:10.406056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d2b5-e1a7-4aa4-9278-3be3f1c427d5 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:10.420282 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2331/4673] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:34:10.422200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320732-401e-45ac-beee-cbe75689389f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:10.422710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320732-401e-45ac-beee-cbe75689389f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:10.423255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320732-401e-45ac-beee-cbe75689389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:10.447131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cc320732-401e-45ac-beee-cbe75689389f None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:10.448792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc320732-401e-45ac-beee-cbe75689389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:10.464788 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2332/4674] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:10.501894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320732-401e-45ac-beee-cbe75689389f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:10.510293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1864708a7b2f4223bc8f0015c765eb0f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:10.511460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1864708a7b2f4223bc8f0015c765eb0f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:10.554603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320732-401e-45ac-beee-cbe75689389f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:10.569309 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2343/4675] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:09 2022] DELETE /identity/v3/users/1864708a7b2f4223bc8f0015c765eb0f => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:10.574242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:10.574882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:10.575161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:10.575433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:10.579539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:10.615964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:10.619752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:10.641242 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2333/4676] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:34:10.751296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:10.753145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:10.761122 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:10.927705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27900-78d4-4657-adc9-5e0babb60ad7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:10.945458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61bca7-0941-45e2-bf06-c9a92e77bedc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:10.946792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61bca7-0941-45e2-bf06-c9a92e77bedc service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:10.947298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61bca7-0941-45e2-bf06-c9a92e77bedc service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:10.947849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61bca7-0941-45e2-bf06-c9a92e77bedc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:10.953463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8d61bca7-0941-45e2-bf06-c9a92e77bedc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:11.170433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61bca7-0941-45e2-bf06-c9a92e77bedc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:11.174367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61bca7-0941-45e2-bf06-c9a92e77bedc service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:11.203256 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2344/4677] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:11.474538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:11.476706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:11.521840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598272-4cfe-4c12-88bf-a8ff6a0387a9 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:11.597705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:11.600099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:11.601168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:11.602253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] PATH_INFO: `/v3/projects/4464938aec13451f910daa714d060e46` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:11.605005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4464938aec13451f910daa714d060e46)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:11.607578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:11.787130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4464938aec13451f910daa714d060e46', 'request_id': 'req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:11.793414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4464938aec13451f910daa714d060e46', 'request_id': 'req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:11.900721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4464938aec13451f910daa714d060e46', 'request_id': 'req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:11.930311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] The token cache is being invalidate because project 4464938aec13451f910daa714d060e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:11.930604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:11.931672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75be7575-6b07-4ce7-b5da-1e17e5cfcc15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:11.933908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2334/4678] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:11 2022] DELETE /identity/v3/projects/4464938aec13451f910daa714d060e46 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:11.941149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ab11-dd8d-41da-903f-158691771b20 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:11.941700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ab11-dd8d-41da-903f-158691771b20 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:11.941700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ab11-dd8d-41da-903f-158691771b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:11.978202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-87f2ab11-dd8d-41da-903f-158691771b20 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:11.980614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-87f2ab11-dd8d-41da-903f-158691771b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:12.099995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.100277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.100547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.107557 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2345/4679] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:12.116866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acc55-e0a4-4f53-be3a-02ddfbae4dcc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.117405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acc55-e0a4-4f53-be3a-02ddfbae4dcc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.117856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acc55-e0a4-4f53-be3a-02ddfbae4dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.147076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:12.147499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-629acc55-e0a4-4f53-be3a-02ddfbae4dcc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:12.148579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:12.149200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-629acc55-e0a4-4f53-be3a-02ddfbae4dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:12.160405 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2346/4680] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:12.165650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acc55-e0a4-4f53-be3a-02ddfbae4dcc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:12.179814 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:12.197855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acc55-e0a4-4f53-be3a-02ddfbae4dcc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:12.212651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:12.216067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.219500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.219500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.219736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:34:12.219873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:12.225482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:12.258621 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2347/4681] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:34:12.259733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:12.284147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44055bd-c270-430a-8a05-b4c234a36c28 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:12.295046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:12.296960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.299158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.300320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.301022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:12.307481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:12.311254 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2335/4682] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:34:12.323871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:12.325425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:12.471271 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:12.481244 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2348/4683] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:12 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:12.498038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:12.524357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bc1a0-53b4-4175-8601-da7101a4c6d5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:12.677384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:12.681614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.682982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.683668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.710094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af453b23-b273-4b0c-9ad9-d5de6d94fcfa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:12.730176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:12.731170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.731753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.732241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.733574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:12.741610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:12.822162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:12.823857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:12.837129 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2336/4684] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:34:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:12.874094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2349/4685] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:34:12 2022] POST /identity/v3/users => generated 283 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:12.879274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:12.894778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdd5c9-c49d-45a1-bd1d-d868c83cfd0d service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:12.900543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:12.901097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.901372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.901678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.902360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:12.904988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:12.938214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:12.940992 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2337/4686] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:12.966218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502328a-f6bc-4c98-954d-3441faa3dc0f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:12.979694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a1472-e738-4126-8bdd-d3c2266f7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:12.980605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1472-e738-4126-8bdd-d3c2266f7fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:12.981036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1472-e738-4126-8bdd-d3c2266f7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:12.981474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a1472-e738-4126-8bdd-d3c2266f7fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:12.982509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a1472-e738-4126-8bdd-d3c2266f7fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:12.984463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a1472-e738-4126-8bdd-d3c2266f7fcb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:13.015014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:13.015730 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2350/4687] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:13.032296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af918e09-0676-42ca-b89b-b4b150d8d657 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:13.045301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:13.046005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:13.046294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:13.046590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] PATH_INFO: `/v3/projects/faf1f084782445f7ae458be3affd5a9f/users/673eeef9813649b09b80c8506f6d804e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:13.088159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf1f084782445f7ae458be3affd5a9f, user_id=673eeef9813649b09b80c8506f6d804e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:13.090926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:13.232482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2338/4688] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:13 2022] PUT /identity/v3/projects/faf1f084782445f7ae458be3affd5a9f/users/673eeef9813649b09b80c8506f6d804e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:13.247582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:13.247972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:13.248214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:13.294479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] MFA Rules not processed for user `673eeef9813649b09b80c8506f6d804e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:13.295964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:13.499238 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2351/4689] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:13.516580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:13.518634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:13.650058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae02c9-37b8-480d-b933-5e3495e58aee admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:13.658450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42910-a628-4925-ad77-328ff23e043c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:13.660866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42910-a628-4925-ad77-328ff23e043c service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:13.661625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42910-a628-4925-ad77-328ff23e043c service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:13.665422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42910-a628-4925-ad77-328ff23e043c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:13.693751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42910-a628-4925-ad77-328ff23e043c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:13.695591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42910-a628-4925-ad77-328ff23e043c service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:13.734322 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2339/4690] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:15.086786 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:16.605914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:16.608330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:16.750996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92a928-bd13-45e3-82b8-a9eb59722263 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:16.757958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:16.758621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:16.758883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:16.759155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:16.761909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:16.791246 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:16.798456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:16.803864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:16.839321 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2352/4691] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:19.181561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4876e-2b04-420b-b884-b5c204cfb383 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:19.182391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4876e-2b04-420b-b884-b5c204cfb383 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:19.182844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4876e-2b04-420b-b884-b5c204cfb383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:19.210164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-43a4876e-2b04-420b-b884-b5c204cfb383 None None] MFA Rules not processed for user `be1759290b0b4034ad9d312abb95ef46`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:19.211639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-43a4876e-2b04-420b-b884-b5c204cfb383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:19.305396 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2340/4692] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:21.996150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:21.997600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:22.030750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f710dc-8010-440e-91cb-23b6efb0aecd service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:22.041078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:22.041735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:22.042103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:22.042377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:22.044230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:22.062120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:22.063795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:22.076695 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2353/4693] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:22.298658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb37e4-ad70-446e-81dc-9ae06eacd6c2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:22.299700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb37e4-ad70-446e-81dc-9ae06eacd6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:22.300230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb37e4-ad70-446e-81dc-9ae06eacd6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:22.325948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-33cb37e4-ad70-446e-81dc-9ae06eacd6c2 None None] MFA Rules not processed for user `bb03047092f64e2abbf78e9db1a06e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:22.327868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-33cb37e4-ad70-446e-81dc-9ae06eacd6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:22.393868 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2341/4694] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:32.077463 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:32.386628 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:34.002208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:34.004190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:34.104598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f507b-71a5-4d3a-858c-27ee07defa01 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:34.118796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:34.120430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:34.120975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:34.121475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] PATH_INFO: `/v3/users/77197152ea5040bab602d5381d21341a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:34.123023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77197152ea5040bab602d5381d21341a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:34.126521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:34.412033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77197152ea5040bab602d5381d21341a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:34.432168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77197152ea5040bab602d5381d21341a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:34.432958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77197152ea5040bab602d5381d21341a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:34.500373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77197152ea5040bab602d5381d21341a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:34.501045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-79265ca1-9052-4fd5-a711-41415c61e3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77197152ea5040bab602d5381d21341a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:34.567158 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2354/4695] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:34 2022] DELETE /identity/v3/users/77197152ea5040bab602d5381d21341a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:35.069450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb37e4-ad70-446e-81dc-9ae06eacd6c2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:35.089615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb37e4-ad70-446e-81dc-9ae06eacd6c2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:35.166339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:35.167235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:35.167902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:35.168225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] PATH_INFO: `/v3/projects/e2ee2ea8399e42a5a5cd0d0ddeb192b5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:35.169585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ee2ea8399e42a5a5cd0d0ddeb192b5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:35.171727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:35.318170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'request_id': 'req-bdbf2f73-a165-44e6-af47-791b894d386f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:35.329526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'request_id': 'req-bdbf2f73-a165-44e6-af47-791b894d386f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:35.448538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ee2ea8399e42a5a5cd0d0ddeb192b5', 'request_id': 'req-bdbf2f73-a165-44e6-af47-791b894d386f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:35.480852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] The token cache is being invalidate because project e2ee2ea8399e42a5a5cd0d0ddeb192b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:35.489883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:35.491396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bdbf2f73-a165-44e6-af47-791b894d386f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:35.496122 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2342/4696] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:35 2022] DELETE /identity/v3/projects/e2ee2ea8399e42a5a5cd0d0ddeb192b5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:35.510425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3739e-d7b8-4967-bdb0-98bf8eac69cf None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:35.510923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3739e-d7b8-4967-bdb0-98bf8eac69cf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:35.511031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3739e-d7b8-4967-bdb0-98bf8eac69cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:35.542903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-51a3739e-d7b8-4967-bdb0-98bf8eac69cf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:35.544688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-51a3739e-d7b8-4967-bdb0-98bf8eac69cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:35.713633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd9b0-1404-4ced-976e-241c52d64cf8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:35.713919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd9b0-1404-4ced-976e-241c52d64cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:35.714233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd9b0-1404-4ced-976e-241c52d64cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:35.717619 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2355/4697] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:34:35.751100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-813bd9b0-1404-4ced-976e-241c52d64cf8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:35.752686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-813bd9b0-1404-4ced-976e-241c52d64cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:35.776611 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2343/4698] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:35.779181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3739e-d7b8-4967-bdb0-98bf8eac69cf None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:35.809064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3739e-d7b8-4967-bdb0-98bf8eac69cf None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:35.819831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:35.820832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:35.821118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:35.821489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:35.822257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:34:35.822603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:35.824150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:35.850704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2356/4699] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:34:35.852261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bd9b0-1404-4ced-976e-241c52d64cf8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:35.863562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bd9b0-1404-4ced-976e-241c52d64cf8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:35.872676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:35.873301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:35.873576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:35.873844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:35.874526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:35.876479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:36.023638 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2344/4700] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:35 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:36.025377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:36.039189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5adc33-91ab-41f3-9faf-ba46b8ad7c6e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:36.043892 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:36.175731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:36.177189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:36.177478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:36.177755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:36.178504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:36.185689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:36.317903 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2357/4701] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:34:36 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:36.320267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:36.335404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092762b1-7e3d-4903-a96e-e577505bb900 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:36.342553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:36.343506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:36.343970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:36.344796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:36.345589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:36.347529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:36.374446 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2345/4702] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:36.376015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:36.398676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126a9bd-74be-4be7-9474-165bfc650124 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:36.404168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936eac-3f05-4505-9f21-7b17f71b9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:36.404943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936eac-3f05-4505-9f21-7b17f71b9aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:36.405287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936eac-3f05-4505-9f21-7b17f71b9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:36.406978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936eac-3f05-4505-9f21-7b17f71b9aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:36.408696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b936eac-3f05-4505-9f21-7b17f71b9aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:36.411485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b936eac-3f05-4505-9f21-7b17f71b9aa2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:36.431806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2358/4703] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:36.433134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:36.447330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f584d-5660-45d8-b631-efec4445164e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:36.454750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:36.455524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:36.455851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:36.456132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] PATH_INFO: `/v3/projects/1d2e19014343446983be90161093da1e/users/1fbe31a386e34c728d9305e59da1d752/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:36.483351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2e19014343446983be90161093da1e, user_id=1fbe31a386e34c728d9305e59da1d752, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:36.486669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:36.586944 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2346/4704] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:36 2022] PUT /identity/v3/projects/1d2e19014343446983be90161093da1e/users/1fbe31a386e34c728d9305e59da1d752/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:36.592011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:36.592538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:36.592714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:36.613606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:36.615001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:36.678999 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2359/4705] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:36.691524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:36.694527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:36.735474 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:36.773875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f7ac6-95bd-48ef-b2c9-39c0f76158aa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:36.778180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9e5dc-730f-47a1-9ec7-373b41e886ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:36.783741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e5dc-730f-47a1-9ec7-373b41e886ae service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:36.784039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e5dc-730f-47a1-9ec7-373b41e886ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:36.784314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e5dc-730f-47a1-9ec7-373b41e886ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:36.797045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9e5dc-730f-47a1-9ec7-373b41e886ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:36.798608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9e5dc-730f-47a1-9ec7-373b41e886ae service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:36.814408 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2347/4706] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:37.832182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:37.834223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:37.860255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b5e96-a6e3-4f21-9b61-10f9c318cb25 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:37.872738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:37.872738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:37.873105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:37.873226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] PATH_INFO: `/v3/users/673eeef9813649b09b80c8506f6d804e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:37.877897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=673eeef9813649b09b80c8506f6d804e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:37.879940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:38.248314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673eeef9813649b09b80c8506f6d804e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:38.263799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673eeef9813649b09b80c8506f6d804e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:38.266628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673eeef9813649b09b80c8506f6d804e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:38.334104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673eeef9813649b09b80c8506f6d804e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:38.334659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673eeef9813649b09b80c8506f6d804e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:38.359553 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:38.390241 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2360/4707] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:37 2022] DELETE /identity/v3/users/673eeef9813649b09b80c8506f6d804e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:34:38.393067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:38.395497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:38.395497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:38.440033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:38.448438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:38.564318 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2348/4708] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:38.605939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:38.607666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:38.756071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375a90-768c-4fc5-8f15-77fc5734ac3c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:38.762383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874449ff-4743-46ed-8f82-ce22766d2559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:38.763489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874449ff-4743-46ed-8f82-ce22766d2559 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:38.767352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874449ff-4743-46ed-8f82-ce22766d2559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:38.767352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874449ff-4743-46ed-8f82-ce22766d2559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:38.787204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874449ff-4743-46ed-8f82-ce22766d2559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:38.791297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874449ff-4743-46ed-8f82-ce22766d2559 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:38.815419 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2361/4709] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:34:39.513149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:39.515796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:39.549455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53b3d-17c1-4c63-b3c0-78f9de6a791d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:39.575313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:39.576384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:39.576834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:39.577299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] PATH_INFO: `/v3/projects/faf1f084782445f7ae458be3affd5a9f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:39.578676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf1f084782445f7ae458be3affd5a9f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:39.580779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:39.750227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf1f084782445f7ae458be3affd5a9f', 'request_id': 'req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:39.759177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf1f084782445f7ae458be3affd5a9f', 'request_id': 'req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:39.871225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf1f084782445f7ae458be3affd5a9f', 'request_id': 'req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:39.895577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] The token cache is being invalidate because project faf1f084782445f7ae458be3affd5a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:39.895871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:39.896565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7b45a0e7-3c87-4324-bd2a-80f2f386f41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:39.903035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2349/4710] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:39 2022] DELETE /identity/v3/projects/faf1f084782445f7ae458be3affd5a9f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:39.905253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78bdc-3679-427a-b1e5-374749c38c49 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:39.905743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78bdc-3679-427a-b1e5-374749c38c49 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:39.905850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78bdc-3679-427a-b1e5-374749c38c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:39.942674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aef78bdc-3679-427a-b1e5-374749c38c49 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:39.943914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aef78bdc-3679-427a-b1e5-374749c38c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:40.072540 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2362/4711] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:40.081100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5528b19-7b26-4b3a-bacf-14e51e2017f1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:40.082091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5528b19-7b26-4b3a-bacf-14e51e2017f1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:40.082210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5528b19-7b26-4b3a-bacf-14e51e2017f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:40.116357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b5528b19-7b26-4b3a-bacf-14e51e2017f1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:40.117811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b5528b19-7b26-4b3a-bacf-14e51e2017f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:40.134807 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2350/4712] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:40.135373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78bdc-3679-427a-b1e5-374749c38c49 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:40.145551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78bdc-3679-427a-b1e5-374749c38c49 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:40.152963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:40.153729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:40.154160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:40.154530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:40.155293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:34:40.155694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:40.157389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:40.171103 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2363/4713] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:34:40.175436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5528b19-7b26-4b3a-bacf-14e51e2017f1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:40.193900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5528b19-7b26-4b3a-bacf-14e51e2017f1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:40.201311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:40.202568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:40.203070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:40.203634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:40.204654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:40.207080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:40.275244 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2351/4714] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:40 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:40.279007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:40.289553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4f90-c256-4135-b259-0e8f8338d51e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:40.449643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:40.450461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:40.450841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:40.451804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:40.452980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:40.467845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:40.645217 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2364/4715] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:34:40 2022] POST /identity/v3/users => generated 285 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:34:40.649446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:40.666624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcca67-8b4c-4d70-9a58-30f4f17b1637 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:40.678609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:40.679354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:40.679719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:40.680074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:40.681058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:40.682841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:40.702857 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2352/4716] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:40.707815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:40.730550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2fb7-9524-41ff-8a9b-d90cccedc288 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:40.735728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e4ac0-8047-49bf-8ea4-1ae71db67d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:40.736475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e4ac0-8047-49bf-8ea4-1ae71db67d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:40.736829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e4ac0-8047-49bf-8ea4-1ae71db67d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:40.737170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e4ac0-8047-49bf-8ea4-1ae71db67d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:40.738543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e4ac0-8047-49bf-8ea4-1ae71db67d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:40.743929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e4ac0-8047-49bf-8ea4-1ae71db67d73 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:40.763786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2365/4717] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:40.776225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:40.789540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695843e-b6f2-46a3-a353-bad717129612 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:40.796756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:40.802448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:40.803166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:40.803692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] PATH_INFO: `/v3/projects/1b7fdd16e90b4efb8d703b541c64a5cb/users/fcdb9a99d93a4ac3a4f80f0972439b07/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:40.826364 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:40.836079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7fdd16e90b4efb8d703b541c64a5cb, user_id=fcdb9a99d93a4ac3a4f80f0972439b07, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:40.837714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:40.992380 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2353/4718] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:40 2022] PUT /identity/v3/projects/1b7fdd16e90b4efb8d703b541c64a5cb/users/fcdb9a99d93a4ac3a4f80f0972439b07/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:41.004462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139a60-c6e2-4427-b133-ff5a2343bf31 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:41.005011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139a60-c6e2-4427-b133-ff5a2343bf31 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:41.005011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139a60-c6e2-4427-b133-ff5a2343bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:41.029309 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:41.085399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1a139a60-c6e2-4427-b133-ff5a2343bf31 None None] MFA Rules not processed for user `fcdb9a99d93a4ac3a4f80f0972439b07`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:41.086729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1a139a60-c6e2-4427-b133-ff5a2343bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:41.295324 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2366/4719] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:41.300037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:41.478095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26bee-5dff-4977-80de-ef06ddfc1423 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:41.492313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:41.493003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:41.493280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:41.493555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:41.494229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:41.496143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:41.618397 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2354/4720] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:41 2022] POST /identity/v3/projects => generated 369 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:41.622828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139a60-c6e2-4427-b133-ff5a2343bf31 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:41.645685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139a60-c6e2-4427-b133-ff5a2343bf31 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:41.757739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:41.758759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:41.760797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:41.761305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:41.763336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:41.767804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:41.870588 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2367/4721] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:34:41 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:41.874343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:41.891175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428baa91-0727-45fc-aac6-e00155f1ea83 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:41.904702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:41.906498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:41.907055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:41.907757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:41.910685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:41.922337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:41.947441 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2355/4722] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:41.950981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:41.968594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c5f5-e7f4-4fe8-82e7-db4aeff52e1e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:41.978782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:41.979488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:41.979775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:41.980058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] PATH_INFO: `/v3/projects/a7dc51c3635b43bd88cc4832a3537772/users/516bdee7d9da4a1a9ffa340e70456ca0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:42.010046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc51c3635b43bd88cc4832a3537772, user_id=516bdee7d9da4a1a9ffa340e70456ca0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:42.012637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:42.169874 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2368/4723] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:41 2022] PUT /identity/v3/projects/a7dc51c3635b43bd88cc4832a3537772/users/516bdee7d9da4a1a9ffa340e70456ca0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:34:42.173890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:42.196230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530b7a-0bfa-4577-8ad0-b1eb20e1bc55 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:42.428723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a6909-91a9-459c-ad30-a65790bd9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:42.429396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6909-91a9-459c-ad30-a65790bd9c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:42.429661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6909-91a9-459c-ad30-a65790bd9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:42.430419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a6909-91a9-459c-ad30-a65790bd9c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:42.435049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a6909-91a9-459c-ad30-a65790bd9c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:42.435049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a6909-91a9-459c-ad30-a65790bd9c4f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:42.465064 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2356/4724] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:42.469644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:42.485342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dbe39-7223-4bee-abe3-c96914ffb464 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:42.500084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:42.501059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:42.501661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:42.502253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] PATH_INFO: `/v3/projects/a7dc51c3635b43bd88cc4832a3537772/users/516bdee7d9da4a1a9ffa340e70456ca0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:42.507165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc51c3635b43bd88cc4832a3537772, user_id=516bdee7d9da4a1a9ffa340e70456ca0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:42.514094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:42.537198 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2369/4725] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:42 2022] PUT /identity/v3/projects/a7dc51c3635b43bd88cc4832a3537772/users/516bdee7d9da4a1a9ffa340e70456ca0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:42.547440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432734c-9203-4c1f-aac4-4f954e1a9df3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:42.547722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432734c-9203-4c1f-aac4-4f954e1a9df3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:42.547997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432734c-9203-4c1f-aac4-4f954e1a9df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:42.606540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0432734c-9203-4c1f-aac4-4f954e1a9df3 None None] MFA Rules not processed for user `516bdee7d9da4a1a9ffa340e70456ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:42.608075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0432734c-9203-4c1f-aac4-4f954e1a9df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:42.705068 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:42.763408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:42.771497 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2357/4726] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:42.776621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98329b2-6e18-4e4d-afc5-fced0b29c842 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:42.781911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:42.783500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:42.783882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:42.784251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:42.785359 n-d-master-1 devstack@keystone.service[81936]: WARNING oslo_log.versionutils [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 23 01:34:42.785958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:42.790287 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:34:42.790287 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:34:42.790287 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:34:42.790287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:42.905514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2370/4727] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:34:42 2022] POST /identity/v3/policies => generated 229 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:42.910613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432734c-9203-4c1f-aac4-4f954e1a9df3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:42.923571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432734c-9203-4c1f-aac4-4f954e1a9df3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:42.941469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:42.942485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:42.942995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:42.943433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies/3ed35768161543ee94a6fac5af786ad8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:42.944582 n-d-master-1 devstack@keystone.service[81937]: WARNING oslo_log.versionutils [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 23 01:34:42.947488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=3ed35768161543ee94a6fac5af786ad8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:42.948756 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:34:42.948756 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:34:42.948756 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:34:42.956066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.131441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.133961 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2358/4728] 10.222.0.42 () {60 vars in 1252 bytes} [Sun Oct 23 01:34:42 2022] PATCH /identity/v3/policies/3ed35768161543ee94a6fac5af786ad8 => generated 236 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:34:43.142577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4ec41-fe1b-47dc-954b-e43aa16f15bc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.148870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.148870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.149377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.149914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies/3ed35768161543ee94a6fac5af786ad8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.151071 n-d-master-1 devstack@keystone.service[81936]: WARNING oslo_log.versionutils [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 23 01:34:43.152123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=3ed35768161543ee94a6fac5af786ad8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.154399 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:34:43.154399 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:34:43.154399 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:34:43.155709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.169135 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2371/4729] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:34:43 2022] GET /identity/v3/policies/3ed35768161543ee94a6fac5af786ad8 => generated 236 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:34:43.176838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.189926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dca52-b930-4272-a7c7-53012e3c5b24 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.196747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.197502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.197843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.198282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies/3ed35768161543ee94a6fac5af786ad8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.202030 n-d-master-1 devstack@keystone.service[81937]: WARNING oslo_log.versionutils [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 23 01:34:43.202030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3ed35768161543ee94a6fac5af786ad8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.202030 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:34:43.202030 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:34:43.202030 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:34:43.203623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.273533 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2359/4730] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:43 2022] DELETE /identity/v3/policies/3ed35768161543ee94a6fac5af786ad8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:43.280764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.298023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8999d-06b5-4ef0-b4e2-39ef28448a88 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.307251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.308260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.312491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.312491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.312491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.317851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.421426 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2372/4731] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:34:43 2022] POST /identity/v3/policies => generated 228 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:43.432114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.445402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68740-91ec-4ab3-aab2-5e0315fc58cc tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.452502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.453417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.453888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.454846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.455782 n-d-master-1 devstack@keystone.service[81937]: WARNING oslo_log.versionutils [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 23 01:34:43.458413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.459907 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:34:43.459907 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:34:43.459907 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:34:43.461193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.604610 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2360/4732] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:34:43 2022] POST /identity/v3/policies => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:43.608935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.639635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ebbb9-2b78-4857-ad1a-28e8ca441326 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.652900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.653548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.654476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.654863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.656759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.659584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.712177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.718186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:43.763423 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:43.778015 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2373/4733] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:34:43 2022] POST /identity/v3/policies => generated 228 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:43.781884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.809311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e947-3e72-4295-80c7-8d39262c5bfd tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.817358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.818366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.818889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.819166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.819957 n-d-master-1 devstack@keystone.service[81936]: WARNING oslo_log.versionutils [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 23 01:34:43.820504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.821763 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:34:43.821763 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:34:43.821763 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:34:43.822708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.833412 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2374/4734] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:34:43 2022] GET /identity/v3/policies => generated 761 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:34:43.839348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.850812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42072e-dde0-4fb4-bfda-c9075d56fee7 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.858647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.859320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.859597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.859869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies/c1388e8d30db4944b8e4442f15cb05f2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.860654 n-d-master-1 devstack@keystone.service[81936]: WARNING oslo_log.versionutils [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 23 01:34:43.861212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c1388e8d30db4944b8e4442f15cb05f2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.862520 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:34:43.862520 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:34:43.862520 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:34:43.866418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:43.866518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4c2cb-067c-47bd-b87c-5889bb41448a tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.872740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.876221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.877658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.879208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.882162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:43.949167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2375/4735] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:43 2022] DELETE /identity/v3/policies/c1388e8d30db4944b8e4442f15cb05f2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:43.950453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:43.980934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efca9d-daa3-4060-9afa-b8e69633c283 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:43.990102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:43.990773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:43.991055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:43.991329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies/eaf75c6cd572415db005ec4ea8b3997b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:43.992526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=eaf75c6cd572415db005ec4ea8b3997b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:43.994541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:44.054831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:44.056590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:44.073294 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2361/4736] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:44.134803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2376/4737] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:43 2022] DELETE /identity/v3/policies/eaf75c6cd572415db005ec4ea8b3997b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:44.140342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:44.161397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1840b-fdfe-4a70-a063-1091599351f1 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:44.208131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d1d9-676e-411f-b067-1a5498dde900 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '516bdee7d9da4a1a9ffa340e70456ca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7dc51c3635b43bd88cc4832a3537772', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:44.208687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d1d9-676e-411f-b067-1a5498dde900 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:44.208976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d1d9-676e-411f-b067-1a5498dde900 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:44.216483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d1d9-676e-411f-b067-1a5498dde900 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] PATH_INFO: `/v3/policies/8091f3e98f724c6f848df9c25af3e9a4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:44.216483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d1d9-676e-411f-b067-1a5498dde900 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8091f3e98f724c6f848df9c25af3e9a4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:44.216483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d1d9-676e-411f-b067-1a5498dde900 tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:44.364746 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2362/4738] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:44 2022] DELETE /identity/v3/policies/8091f3e98f724c6f848df9c25af3e9a4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:44.369024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:44.546628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082408b3-b366-4c97-9ca6-befac64747bf tempest-PoliciesTestJSON-1894290614 tempest-PoliciesTestJSON-1894290614-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:44.560430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:44.561338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:44.561781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:44.562234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] PATH_INFO: `/v3/users/fcdb9a99d93a4ac3a4f80f0972439b07` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:44.563633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcdb9a99d93a4ac3a4f80f0972439b07)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:44.565773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:44.872106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcdb9a99d93a4ac3a4f80f0972439b07'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:44.894143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcdb9a99d93a4ac3a4f80f0972439b07'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:44.895036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcdb9a99d93a4ac3a4f80f0972439b07'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:44.965103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcdb9a99d93a4ac3a4f80f0972439b07'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:44.970241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcdb9a99d93a4ac3a4f80f0972439b07'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:45.050696 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2377/4739] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:44 2022] DELETE /identity/v3/users/fcdb9a99d93a4ac3a4f80f0972439b07 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:45.055213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:45.055739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:45.055739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:45.107927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:45.109794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:45.167601 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:45.227225 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2363/4740] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:45.250559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:45.255070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:45.353577 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:45.391572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fda09-06a3-4c14-9f69-0a95b326562a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:45.406904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:45.407690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:45.407806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:45.408144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:45.451948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:45.462869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:45.524352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2378/4741] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:46.840055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:46.845309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:46.875806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9247d-87ad-4888-9ede-6b09ab40759b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:46.888188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:46.891350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:46.891350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:46.891350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] PATH_INFO: `/v3/users/b118116bb0734e8496aaa1446e871d7e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:46.891350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b118116bb0734e8496aaa1446e871d7e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:46.894768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:47.193771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b118116bb0734e8496aaa1446e871d7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:47.207692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b118116bb0734e8496aaa1446e871d7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:47.212643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b118116bb0734e8496aaa1446e871d7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:47.299334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b118116bb0734e8496aaa1446e871d7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:47.301097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b118116bb0734e8496aaa1446e871d7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:47.334592 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2364/4742] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:46 2022] DELETE /identity/v3/users/b118116bb0734e8496aaa1446e871d7e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:47.729030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:47.731299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:47.754796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850d8ce-77c6-4df1-b128-c375ab1c2922 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:48.013663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:48.019683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:48.020023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:48.020306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] PATH_INFO: `/v3/projects/1b7fdd16e90b4efb8d703b541c64a5cb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:48.022772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7fdd16e90b4efb8d703b541c64a5cb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:48.025290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:48.207395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7fdd16e90b4efb8d703b541c64a5cb', 'request_id': 'req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.219645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7fdd16e90b4efb8d703b541c64a5cb', 'request_id': 'req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.297220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:48.297664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:48.317339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7fdd16e90b4efb8d703b541c64a5cb', 'request_id': 'req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.325697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07132d-d75f-4a89-b539-119e3f09145f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:48.347901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] The token cache is being invalidate because project 1b7fdd16e90b4efb8d703b541c64a5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:48.350432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.352763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.365520 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2379/4743] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:47 2022] DELETE /identity/v3/projects/1b7fdd16e90b4efb8d703b541c64a5cb => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:48.367242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:48.370689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:48.561517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:48.568640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:48.568640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:48.568640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] PATH_INFO: `/v3/projects/7defb846e6a24a0aadb9de6de5439b8a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:48.568640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7defb846e6a24a0aadb9de6de5439b8a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:48.568640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:48.602842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314b15c-5cb6-45cf-bbf4-7e44d0910b7d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:48.620467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:48.622319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:48.624151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:48.624651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] PATH_INFO: `/v3/users/516bdee7d9da4a1a9ffa340e70456ca0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:48.626208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516bdee7d9da4a1a9ffa340e70456ca0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:48.629774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:48.669835 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:48.829419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7defb846e6a24a0aadb9de6de5439b8a', 'request_id': 'req-a1a0dce1-3903-445e-96ff-0782de640fce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.832174 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:48.866616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7defb846e6a24a0aadb9de6de5439b8a', 'request_id': 'req-a1a0dce1-3903-445e-96ff-0782de640fce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.941051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516bdee7d9da4a1a9ffa340e70456ca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.957369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516bdee7d9da4a1a9ffa340e70456ca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:48.960132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516bdee7d9da4a1a9ffa340e70456ca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:49.008582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7defb846e6a24a0aadb9de6de5439b8a', 'request_id': 'req-a1a0dce1-3903-445e-96ff-0782de640fce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:49.047356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] The token cache is being invalidate because project 7defb846e6a24a0aadb9de6de5439b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:49.051776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:49.054357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a1a0dce1-3903-445e-96ff-0782de640fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:49.063093 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2365/4744] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:48 2022] DELETE /identity/v3/projects/7defb846e6a24a0aadb9de6de5439b8a => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:49.064755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78748988-e12e-4616-83bd-38a1614c7d70 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:49.065554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78748988-e12e-4616-83bd-38a1614c7d70 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:49.066035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78748988-e12e-4616-83bd-38a1614c7d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:49.117263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516bdee7d9da4a1a9ffa340e70456ca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:49.118069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5d9db263-b547-4b71-839a-0d7a9e9c7bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516bdee7d9da4a1a9ffa340e70456ca0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:49.127388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-78748988-e12e-4616-83bd-38a1614c7d70 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:49.139621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-78748988-e12e-4616-83bd-38a1614c7d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:49.186049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2380/4745] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:48 2022] DELETE /identity/v3/users/516bdee7d9da4a1a9ffa340e70456ca0 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:34:49.275898 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2366/4746] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:49.283740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b233-71f1-4bd8-ae2e-7359c63bbec2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:49.284561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b233-71f1-4bd8-ae2e-7359c63bbec2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:49.285044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b233-71f1-4bd8-ae2e-7359c63bbec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:49.332431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2fb1b233-71f1-4bd8-ae2e-7359c63bbec2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:49.333863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2fb1b233-71f1-4bd8-ae2e-7359c63bbec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:49.451756 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2381/4747] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:49.456302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78748988-e12e-4616-83bd-38a1614c7d70 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:49.508019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78748988-e12e-4616-83bd-38a1614c7d70 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:49.516685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:49.517798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:49.519157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:49.520892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:49.521820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:34:49.522408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:49.524865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:49.608830 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2367/4748] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:34:49.615257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1b233-71f1-4bd8-ae2e-7359c63bbec2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:49.632889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1b233-71f1-4bd8-ae2e-7359c63bbec2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:49.659309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:49.659939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:49.660210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:49.660546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:49.661111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:49.670372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:49.812238 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2382/4749] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:49 2022] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:49.818002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:49.836003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff51d1-0b26-4c58-b1b1-238fb44b4de8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:49.927468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:49.928366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:49.928742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:49.930352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:49.931707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:49.953154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:50.060788 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2368/4750] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:34:49 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:50.064577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:50.089227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7e9ed-1f46-4f95-b6d7-db9ec6963f4d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:50.108962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:50.109591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:50.109867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:50.110678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:50.111380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:50.115682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:50.153779 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2383/4751] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:50.154797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:50.175540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d1329-4b93-414c-b635-0c5e7171d0c6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:50.198299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8dde4-17d5-4bdb-81e1-96b60e13e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:50.198951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8dde4-17d5-4bdb-81e1-96b60e13e579 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:50.199236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8dde4-17d5-4bdb-81e1-96b60e13e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:50.199510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8dde4-17d5-4bdb-81e1-96b60e13e579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:50.200264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8dde4-17d5-4bdb-81e1-96b60e13e579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:50.206141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8dde4-17d5-4bdb-81e1-96b60e13e579 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:50.256074 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2369/4752] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:34:50.260287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:50.277366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69443fc-159d-4259-9fbb-71e67e339c0b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:50.292717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:50.297021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:50.297021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:50.298660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] PATH_INFO: `/v3/projects/566c1cfeb26f4afb83ef844be75073d8/users/bcaf572331dd405995c4c62d2f63b7f3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:50.362668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566c1cfeb26f4afb83ef844be75073d8, user_id=bcaf572331dd405995c4c62d2f63b7f3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:50.368787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:50.457220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2384/4753] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:50 2022] PUT /identity/v3/projects/566c1cfeb26f4afb83ef844be75073d8/users/bcaf572331dd405995c4c62d2f63b7f3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:50.462385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:50.462908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:50.462908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:50.494674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:50.496804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:50.587276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:50.589455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:50.625554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2370/4754] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:50.641653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:50.643530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:50.755402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ba95c-3bed-455a-aaf0-4034bb7c84fc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:50.763933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc752-4d4e-4c45-803c-c3905ced0c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:50.769959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc752-4d4e-4c45-803c-c3905ced0c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:50.769959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc752-4d4e-4c45-803c-c3905ced0c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:50.770402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc752-4d4e-4c45-803c-c3905ced0c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:50.793601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c424c-c6a6-4923-9f4b-aebc84567b33 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:50.807923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc752-4d4e-4c45-803c-c3905ced0c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:50.809699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc752-4d4e-4c45-803c-c3905ced0c11 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:50.828096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:50.828774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:50.829056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:50.829329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] PATH_INFO: `/v3/projects/a7dc51c3635b43bd88cc4832a3537772` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:50.831489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7dc51c3635b43bd88cc4832a3537772)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:50.833405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:50.844236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2371/4755] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:34:50.850454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7723-12de-4b8d-9d2d-2f5cffb20a0f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:50.850454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7723-12de-4b8d-9d2d-2f5cffb20a0f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:50.850454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7723-12de-4b8d-9d2d-2f5cffb20a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:50.945679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-830d7723-12de-4b8d-9d2d-2f5cffb20a0f None None] MFA Rules not processed for user `1fbe31a386e34c728d9305e59da1d752`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:50.949904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-830d7723-12de-4b8d-9d2d-2f5cffb20a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:51.067317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7dc51c3635b43bd88cc4832a3537772', 'request_id': 'req-214e5386-0d7e-455d-995b-92779faf1bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:51.098805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7dc51c3635b43bd88cc4832a3537772', 'request_id': 'req-214e5386-0d7e-455d-995b-92779faf1bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:51.160667 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:51.160895 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2372/4756] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:51.192019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7dc51c3635b43bd88cc4832a3537772', 'request_id': 'req-214e5386-0d7e-455d-995b-92779faf1bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:51.194911 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:51.219965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] The token cache is being invalidate because project a7dc51c3635b43bd88cc4832a3537772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:51.220239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:51.222735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-214e5386-0d7e-455d-995b-92779faf1bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:51.226892 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2385/4757] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:50 2022] DELETE /identity/v3/projects/a7dc51c3635b43bd88cc4832a3537772 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:34:51.231998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a049-64fb-4d99-b57b-e019a273eb33 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:51.232666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a049-64fb-4d99-b57b-e019a273eb33 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:51.236638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a049-64fb-4d99-b57b-e019a273eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:51.281944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8807a049-64fb-4d99-b57b-e019a273eb33 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:51.284146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8807a049-64fb-4d99-b57b-e019a273eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:51.428778 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2373/4758] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:34:51.438158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d0d8-cb4b-462e-a605-df22a4d371ad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:51.438506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d0d8-cb4b-462e-a605-df22a4d371ad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:51.438786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d0d8-cb4b-462e-a605-df22a4d371ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:51.485036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a301d0d8-cb4b-462e-a605-df22a4d371ad None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:51.493005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a301d0d8-cb4b-462e-a605-df22a4d371ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:51.519688 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2386/4759] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:51.523536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a049-64fb-4d99-b57b-e019a273eb33 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:51.540363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a049-64fb-4d99-b57b-e019a273eb33 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:51.555061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:51.555704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:51.555987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:51.559076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:51.559768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:34:51.560082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:51.565173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:51.610592 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2374/4760] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:34:51.610701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301d0d8-cb4b-462e-a605-df22a4d371ad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:51.625349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301d0d8-cb4b-462e-a605-df22a4d371ad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:51.638903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:51.641234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:51.642487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:51.642840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:51.645761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:51.652605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:51.826284 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2387/4761] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:51 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:51.831409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:51.849011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47764ea6-ffc6-43b9-8f8f-1910951776f7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:52.068652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:52.068652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:52.068652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:52.068652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:52.069023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:52.069023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:52.218568 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2375/4762] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:34:51 2022] POST /identity/v3/users => generated 292 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:52.219673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:52.235824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edeaf1-1b16-4789-a58e-19c59efee460 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:52.253870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:52.254806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:52.255259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:52.255732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:52.256573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:52.275318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:52.319110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:52.333857 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2388/4763] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:34:52.337508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e23756-9753-44cb-b390-7c37bd6c356e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:52.351604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e051b3-7c0e-428e-9237-d9bc99dd88f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:52.352764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e051b3-7c0e-428e-9237-d9bc99dd88f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:52.353005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e051b3-7c0e-428e-9237-d9bc99dd88f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:52.353270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e051b3-7c0e-428e-9237-d9bc99dd88f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:52.354027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e051b3-7c0e-428e-9237-d9bc99dd88f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:52.357852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e051b3-7c0e-428e-9237-d9bc99dd88f1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:52.389277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:52.406415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92f9e-29d7-4cfb-a75b-55fc2d34f260 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:52.407504 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2376/4764] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:52.422066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:52.422757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:52.423030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:52.429756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] PATH_INFO: `/v3/projects/3a9ceed68bf24494b636c23ea910cd0b/users/e16bbb8db13c47848f772034631f5f1c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:52.491611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9ceed68bf24494b636c23ea910cd0b, user_id=e16bbb8db13c47848f772034631f5f1c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:52.494735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:52.522581 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:52.622617 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2389/4765] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:52 2022] PUT /identity/v3/projects/3a9ceed68bf24494b636c23ea910cd0b/users/e16bbb8db13c47848f772034631f5f1c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:34:52.636879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ade3a-c685-4e3d-acfd-601cd4389f1c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:52.641361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ade3a-c685-4e3d-acfd-601cd4389f1c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:52.641361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ade3a-c685-4e3d-acfd-601cd4389f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:52.735835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8e0ade3a-c685-4e3d-acfd-601cd4389f1c None None] MFA Rules not processed for user `e16bbb8db13c47848f772034631f5f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:52.738108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8e0ade3a-c685-4e3d-acfd-601cd4389f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:52.950254 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2377/4766] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:52.950759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:53.096846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3dcb-ed4e-4ffa-87eb-da7f4eba3f31 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:53.108577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:53.109214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:53.109498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:53.109776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:53.110451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:53.113473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:53.136298 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:53.232732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:53.232960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:53.233194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:53.254355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:53.255583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:53.290158 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2390/4767] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:52 2022] POST /identity/v3/projects => generated 385 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:53.291231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:53.344847 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2378/4768] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:34:53.377199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:53.379135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:53.396264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6aaa-e33f-4e0a-b4c0-e0bb34386bd8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:53.408163 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:53.412708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:53.413588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:53.414652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:53.415022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:53.415841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:53.419593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:53.514410 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2391/4769] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:34:53 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:34:53.516361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:53.525487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98747350-5533-4fd8-a388-b865b5ffbff0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:53.545188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b94057-4d5c-4325-bdc4-fd28469bbe1d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:53.572656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:53.573422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:53.573706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:53.573997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:53.574680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:53.576439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:53.604080 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2392/4770] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:53.616278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:53.641193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:53.642169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:53.642376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:53.642790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:53.666434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b52cb3-eab7-4aaa-bcbc-34eedd6d6f33 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:53.690270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:53.694465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:53.697854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:53.699304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] PATH_INFO: `/v3/projects/33ba46440bb9474fa6f59e758f6ee247/users/e32da5a7ccf6420e9bf129f180ec110f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:53.746809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ba46440bb9474fa6f59e758f6ee247, user_id=e32da5a7ccf6420e9bf129f180ec110f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:53.757436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:53.768845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:53.773051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:53.794116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2379/4771] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:34:53.860585 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2393/4772] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:53 2022] PUT /identity/v3/projects/33ba46440bb9474fa6f59e758f6ee247/users/e32da5a7ccf6420e9bf129f180ec110f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:53.864684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:53.893386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962469e-13c2-45d6-9a34-474f60aa8e7d service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:54.035286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626df04-3064-4a87-900e-20be6305186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:54.037043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626df04-3064-4a87-900e-20be6305186d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:54.039706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626df04-3064-4a87-900e-20be6305186d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:54.040486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626df04-3064-4a87-900e-20be6305186d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:54.042775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626df04-3064-4a87-900e-20be6305186d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:54.053122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626df04-3064-4a87-900e-20be6305186d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:54.086012 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2380/4773] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:34:54.094468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:54.112765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393028-2865-4f6b-8639-ab0ef567bd27 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:54.124775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:54.125957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:54.128194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:54.128761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] PATH_INFO: `/v3/projects/33ba46440bb9474fa6f59e758f6ee247/users/e32da5a7ccf6420e9bf129f180ec110f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:54.134881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ba46440bb9474fa6f59e758f6ee247, user_id=e32da5a7ccf6420e9bf129f180ec110f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:54.143272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:54.177056 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2394/4774] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:34:54 2022] PUT /identity/v3/projects/33ba46440bb9474fa6f59e758f6ee247/users/e32da5a7ccf6420e9bf129f180ec110f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:34:54.187771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe47e38-486a-4759-ada9-dece565ba5ea None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:54.188088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe47e38-486a-4759-ada9-dece565ba5ea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:54.188397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe47e38-486a-4759-ada9-dece565ba5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:54.275586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8fe47e38-486a-4759-ada9-dece565ba5ea None None] MFA Rules not processed for user `e32da5a7ccf6420e9bf129f180ec110f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:54.278453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8fe47e38-486a-4759-ada9-dece565ba5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:54.441171 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2381/4775] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:54.446913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:54.478847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14cab5-a9b1-4f46-8688-b94d248a8908 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:54.490717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32da5a7ccf6420e9bf129f180ec110f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33ba46440bb9474fa6f59e758f6ee247', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:54.492571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:54.493027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:54.493492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:54.494481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:54.496601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:54.672679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2395/4776] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:34:54 2022] POST /identity/v3/projects => generated 360 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:34:54.677852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe47e38-486a-4759-ada9-dece565ba5ea None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:54.879614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe47e38-486a-4759-ada9-dece565ba5ea None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:54.898111 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:55.031727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e16bbb8db13c47848f772034631f5f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a9ceed68bf24494b636c23ea910cd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:55.032853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:55.033231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:55.033636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] PATH_INFO: `/v3/projects/5d3b60687c964fbaa14160a8f059f787` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:55.051985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] RBAC: Authorizing `identity:delete_project(project_id=5d3b60687c964fbaa14160a8f059f787)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 23 01:34:55.090708 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 23 01:34:55.092249 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:34:55.093763 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2382/4777] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:54 2022] DELETE /identity/v3/projects/5d3b60687c964fbaa14160a8f059f787 => generated 136 bytes in 420 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:34:55.099101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:55.273851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fdd59-5773-4894-acff-9773e059b7a8 tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:55.285589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e32da5a7ccf6420e9bf129f180ec110f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33ba46440bb9474fa6f59e758f6ee247', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:55.288845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:55.288845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:55.288845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] PATH_INFO: `/v3/projects/5d3b60687c964fbaa14160a8f059f787` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:55.293619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d3b60687c964fbaa14160a8f059f787)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:55.303698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:55.489801 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:55.542251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3b60687c964fbaa14160a8f059f787', 'request_id': 'req-b0bda9b9-aa4d-47c7-879b-2851c85202dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:55.568634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3b60687c964fbaa14160a8f059f787', 'request_id': 'req-b0bda9b9-aa4d-47c7-879b-2851c85202dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:55.676191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3b60687c964fbaa14160a8f059f787', 'request_id': 'req-b0bda9b9-aa4d-47c7-879b-2851c85202dd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:55.701259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] The token cache is being invalidate because project 5d3b60687c964fbaa14160a8f059f787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:55.701648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:55.728932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0bda9b9-aa4d-47c7-879b-2851c85202dd tempest-ProjectsNegativeTestJSON-1780994456 tempest-ProjectsNegativeTestJSON-1780994456-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:55.742311 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2396/4778] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:55 2022] DELETE /identity/v3/projects/5d3b60687c964fbaa14160a8f059f787 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:55.743709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:55.745674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:55.836728 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:55.896598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c46d3-a040-4000-9070-a7fab72b9bee tempest-ProjectsNegativeTestJSON-517377247 tempest-ProjectsNegativeTestJSON-517377247-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:56.025902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:56.026757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:56.027101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:56.030085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] PATH_INFO: `/v3/users/e16bbb8db13c47848f772034631f5f1c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:56.041229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16bbb8db13c47848f772034631f5f1c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:56.048644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:56.319829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16bbb8db13c47848f772034631f5f1c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:56.360814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16bbb8db13c47848f772034631f5f1c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:56.361627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16bbb8db13c47848f772034631f5f1c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:56.464189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16bbb8db13c47848f772034631f5f1c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:56.464838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16bbb8db13c47848f772034631f5f1c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:56.541283 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2383/4779] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:55 2022] DELETE /identity/v3/users/e16bbb8db13c47848f772034631f5f1c => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:56.545456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:56.545962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:56.546485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:56.619367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:34:56.629080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:56.897438 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2397/4780] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:34:56.927623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:56.929275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:57.192750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acd234-89ae-45a3-9130-c0a3a3346bea admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:57.207335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:57.208211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:57.208595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:57.208969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:57.226264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:57.228025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:57.260085 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2384/4781] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:34:58.845184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:58.849224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:34:58.900113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c7747-a258-455b-a43c-26efb9e4e828 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:58.907996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:58.917844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:58.920477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:58.921008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] PATH_INFO: `/v3/projects/3a9ceed68bf24494b636c23ea910cd0b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:58.923547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9ceed68bf24494b636c23ea910cd0b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:58.932625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:59.154657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9ceed68bf24494b636c23ea910cd0b', 'request_id': 'req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.177237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9ceed68bf24494b636c23ea910cd0b', 'request_id': 'req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.254514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9ceed68bf24494b636c23ea910cd0b', 'request_id': 'req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.272096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] The token cache is being invalidate because project 3a9ceed68bf24494b636c23ea910cd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:34:59.279598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.287227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.293035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:34:59.295115 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2398/4782] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:34:58 2022] DELETE /identity/v3/projects/3a9ceed68bf24494b636c23ea910cd0b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:34:59.316509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95c63d-6da6-4c5c-b2b6-c31ae6d9443b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:34:59.349682 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:34:59.532380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:34:59.534345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:34:59.536424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:34:59.537751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] PATH_INFO: `/v3/users/e32da5a7ccf6420e9bf129f180ec110f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:34:59.539240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32da5a7ccf6420e9bf129f180ec110f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:34:59.541708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:34:59.871244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32da5a7ccf6420e9bf129f180ec110f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.895176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32da5a7ccf6420e9bf129f180ec110f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.899905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32da5a7ccf6420e9bf129f180ec110f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.997072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32da5a7ccf6420e9bf129f180ec110f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:34:59.997734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-68b4eaa0-232c-4240-bbbe-f0d80c6d4baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32da5a7ccf6420e9bf129f180ec110f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:00.038007 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2385/4783] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:34:59 2022] DELETE /identity/v3/users/e32da5a7ccf6420e9bf129f180ec110f => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:03.924823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:03.927910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:03.952167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32d8fb-abe6-4bf9-b987-3a066d82efd3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:03.996027 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:04.173254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:04.173956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:04.174261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:04.174790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] PATH_INFO: `/v3/projects/33ba46440bb9474fa6f59e758f6ee247` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:04.185022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ba46440bb9474fa6f59e758f6ee247)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:04.192179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:04.457444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ba46440bb9474fa6f59e758f6ee247', 'request_id': 'req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:04.509921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ba46440bb9474fa6f59e758f6ee247', 'request_id': 'req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:04.602666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ba46440bb9474fa6f59e758f6ee247', 'request_id': 'req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:04.630276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] The token cache is being invalidate because project 33ba46440bb9474fa6f59e758f6ee247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:04.630810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:04.635990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9e1fd34-0af3-4f47-bfb9-a70571fbf32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:04.648855 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2399/4784] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:03 2022] DELETE /identity/v3/projects/33ba46440bb9474fa6f59e758f6ee247 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:04.650392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d37-2e9a-4a11-85b9-20bb9261ccc3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:04.650883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d37-2e9a-4a11-85b9-20bb9261ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:04.650987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d37-2e9a-4a11-85b9-20bb9261ccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:04.738676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5b799d37-2e9a-4a11-85b9-20bb9261ccc3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:04.739924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b799d37-2e9a-4a11-85b9-20bb9261ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:04.949557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2386/4785] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:05.072996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf37666-9671-417c-9112-8f87e58d725b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:05.074410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf37666-9671-417c-9112-8f87e58d725b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:05.074898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf37666-9671-417c-9112-8f87e58d725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:05.097927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fcf37666-9671-417c-9112-8f87e58d725b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:05.099569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fcf37666-9671-417c-9112-8f87e58d725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:05.111910 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2400/4786] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:05.112859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799d37-2e9a-4a11-85b9-20bb9261ccc3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:05.124257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799d37-2e9a-4a11-85b9-20bb9261ccc3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:05.131318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:05.133321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:05.133888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:05.134454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:05.135392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:05.135920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:05.138083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:05.156183 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2387/4787] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:05.167261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf37666-9671-417c-9112-8f87e58d725b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:05.183437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf37666-9671-417c-9112-8f87e58d725b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:05.196739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:05.205683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:05.208476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:05.208862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:05.209669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:05.215563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:05.269827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:05.272184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:05.297853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1013bc4-be2b-40fd-9f0e-b398eec3a92d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:05.308501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:05.310509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:05.312060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:05.313207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] PATH_INFO: `/v3/users/1fbe31a386e34c728d9305e59da1d752` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:05.315468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbe31a386e34c728d9305e59da1d752)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:05.322237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:05.359085 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:05.372929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2401/4788] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:05 2022] POST /identity/v3/projects => generated 369 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:05.377044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:05.514422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6da9-071a-4260-b730-ced3bf21ae06 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:05.533746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:05.533746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:05.533746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:05.533746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:05.534204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:05.535654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:05.646027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbe31a386e34c728d9305e59da1d752'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:05.675000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbe31a386e34c728d9305e59da1d752'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:05.676650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbe31a386e34c728d9305e59da1d752'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:05.772748 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2402/4789] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:05 2022] POST /identity/v3/users => generated 285 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:05.780214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:05.784993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbe31a386e34c728d9305e59da1d752'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:05.785898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbe31a386e34c728d9305e59da1d752'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:05.807107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004ac10-ff11-4ac3-bdcf-f834cd857e93 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:05.826738 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2388/4790] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:05 2022] DELETE /identity/v3/users/1fbe31a386e34c728d9305e59da1d752 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:05.832225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:05.832225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:05.835168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:05.836934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:05.841048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:05.851321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:05.877490 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:05.908782 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2403/4791] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:05.912211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:05.914028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:06.080261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c962fd-1023-4e01-a7ac-3c2a18916b23 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:06.087278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:06.087912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:06.088491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:06.088768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:06.089427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:06.091903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:06.117482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2389/4792] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:06.118316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:06.140103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d49959-50e2-4524-bbd8-33512efac87e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:06.154311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f2fd-82ed-44b8-8dea-fd2e60053561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:06.155089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f2fd-82ed-44b8-8dea-fd2e60053561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:06.155368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f2fd-82ed-44b8-8dea-fd2e60053561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:06.155639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f2fd-82ed-44b8-8dea-fd2e60053561 admin admin] PATH_INFO: `/v3/projects/75a0c121f1b34c85ba768be2f8e7a3d7/users/67a9951e10194951ad8a6f519d2543f8/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:06.205443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f2fd-82ed-44b8-8dea-fd2e60053561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a0c121f1b34c85ba768be2f8e7a3d7, user_id=67a9951e10194951ad8a6f519d2543f8, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:06.207321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f2fd-82ed-44b8-8dea-fd2e60053561 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:06.328409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:06.331225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:06.334315 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2404/4793] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:06 2022] PUT /identity/v3/projects/75a0c121f1b34c85ba768be2f8e7a3d7/users/67a9951e10194951ad8a6f519d2543f8/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:06.344724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476802-bafb-4dc4-a624-81868230f262 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:06.345014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476802-bafb-4dc4-a624-81868230f262 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:06.345425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81476802-bafb-4dc4-a624-81868230f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:06.388350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51469dc7-db00-4459-ac19-f3e0bff6d360 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:06.425731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-81476802-bafb-4dc4-a624-81868230f262 None None] MFA Rules not processed for user `67a9951e10194951ad8a6f519d2543f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:06.428053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-81476802-bafb-4dc4-a624-81868230f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:06.557464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:06.558137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:06.569856 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2405/4794] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:06.574317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476802-bafb-4dc4-a624-81868230f262 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:06.589134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:06.593126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] PATH_INFO: `/v3/projects/1d2e19014343446983be90161093da1e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:06.595164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81476802-bafb-4dc4-a624-81868230f262 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:06.597185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2e19014343446983be90161093da1e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:06.599445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:06.607350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:06.607987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:06.608269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:06.608545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:06.609190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:06.616184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:06.777641 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2406/4795] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:06 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:06.783448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:06.827705 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:06.887354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2e19014343446983be90161093da1e', 'request_id': 'req-3801586b-9d0d-487c-9f80-b6afc27164a9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:06.927100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2e19014343446983be90161093da1e', 'request_id': 'req-3801586b-9d0d-487c-9f80-b6afc27164a9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:07.014933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c374e38-31a0-4a7c-b81a-4f0724e63950 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.047704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2e19014343446983be90161093da1e', 'request_id': 'req-3801586b-9d0d-487c-9f80-b6afc27164a9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:07.073277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] The token cache is being invalidate because project 1d2e19014343446983be90161093da1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:07.073758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:07.076732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3801586b-9d0d-487c-9f80-b6afc27164a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:07.088356 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2390/4796] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:06 2022] DELETE /identity/v3/projects/1d2e19014343446983be90161093da1e => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:07.090225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c9163-753f-4b02-ab9e-67e4d5f352b9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.090508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c9163-753f-4b02-ab9e-67e4d5f352b9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.090780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c9163-753f-4b02-ab9e-67e4d5f352b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.149582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bf4c9163-753f-4b02-ab9e-67e4d5f352b9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:07.151477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bf4c9163-753f-4b02-ab9e-67e4d5f352b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:07.211939 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:07.235186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.236802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.237340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.238197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.239109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:07.249356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:07.309081 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2391/4797] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:07.319430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3213-0812-4bfb-be52-b94b4085bc7c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.319746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3213-0812-4bfb-be52-b94b4085bc7c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.320070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c3213-0812-4bfb-be52-b94b4085bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.377957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2407/4798] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:06 2022] POST /identity/v3/users => generated 291 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:07.378856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:07.379719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cb5c3213-0812-4bfb-be52-b94b4085bc7c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:07.380568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:07.381580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cb5c3213-0812-4bfb-be52-b94b4085bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:07.413581 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2392/4799] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:07.416754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9624a-2783-435c-9ec5-5772509905db admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.420065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3213-0812-4bfb-be52-b94b4085bc7c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:07.432769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c3213-0812-4bfb-be52-b94b4085bc7c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.436160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.436895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.439788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.439788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.439788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:07.441164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:07.457305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.457933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.458286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.458560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.459221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:07.459525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:07.461141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:07.468436 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2408/4800] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:07.472141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:07.495713 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2393/4801] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:07.500543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:07.504230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406d8cb-b10e-4a7f-ad04-30b05d278a86 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.518723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.519449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.519955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.520367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] PATH_INFO: `/v3/projects/8360f8465d234caca33072fcfbb9a8a9/users/a5817523fda849c48dfc0f289e85de6e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.521649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b9e98-1d80-4c3a-8abf-79f188bf9020 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.541008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.541636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.541920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.542234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.543317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:07.545251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:07.557867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8360f8465d234caca33072fcfbb9a8a9, user_id=a5817523fda849c48dfc0f289e85de6e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:07.562428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:07.637678 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2409/4802] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:07 2022] PUT /identity/v3/projects/8360f8465d234caca33072fcfbb9a8a9/users/a5817523fda849c48dfc0f289e85de6e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:07.641325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:07.670906 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2394/4803] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:07 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:07.676278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:07.864347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6a95c-84ca-4678-a038-24fb80bd70e7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.883267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.883909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.884191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.884467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.885101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:07.888102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:07.915528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aaa03-c64f-40b4-a3f7-4f3be9a5f5f7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.928210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.928587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.928861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.929139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:07.929818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:07.931443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:07.951867 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2410/4804] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:07.958999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:07.980928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd58a99-eb24-4296-b029-ff877cf952a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:07.993287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fae084-a2e9-4fae-9b1d-12c70d29b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:07.996021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fae084-a2e9-4fae-9b1d-12c70d29b998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:07.997473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fae084-a2e9-4fae-9b1d-12c70d29b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:07.997792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fae084-a2e9-4fae-9b1d-12c70d29b998 admin admin] PATH_INFO: `/v3/projects/8360f8465d234caca33072fcfbb9a8a9/users/a5817523fda849c48dfc0f289e85de6e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.003544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fae084-a2e9-4fae-9b1d-12c70d29b998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8360f8465d234caca33072fcfbb9a8a9, user_id=a5817523fda849c48dfc0f289e85de6e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:08.012021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2395/4805] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:07 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:08.013202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:08.014826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fae084-a2e9-4fae-9b1d-12c70d29b998 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:08.047119 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2411/4806] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:07 2022] PUT /identity/v3/projects/8360f8465d234caca33072fcfbb9a8a9/users/a5817523fda849c48dfc0f289e85de6e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:08.050695 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:08.052744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce636251-fe3d-4f7e-8210-dbe1818a9b6b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:08.053121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce636251-fe3d-4f7e-8210-dbe1818a9b6b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:08.053407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce636251-fe3d-4f7e-8210-dbe1818a9b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.056544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80cfe4-94a4-485d-9832-ebc709b58f84 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:08.118505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ce636251-fe3d-4f7e-8210-dbe1818a9b6b None None] MFA Rules not processed for user `a5817523fda849c48dfc0f289e85de6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:08.118505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce636251-fe3d-4f7e-8210-dbe1818a9b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:08.231572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:08.232221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:08.232505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:08.232806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.233478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:08.242194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:08.280510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2396/4807] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:08.281768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:08.304797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9824a1e-fe97-400f-90e9-44ff2cedfc8d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:08.325249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:08.332308 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2412/4808] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:08.332902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:08.332902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:08.332902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.333961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce636251-fe3d-4f7e-8210-dbe1818a9b6b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:08.338833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:08.340560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:08.344561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce636251-fe3d-4f7e-8210-dbe1818a9b6b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:08.365715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:08.366435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:08.366716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:08.366986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.367612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:08.370580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:08.377433 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2397/4809] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:08.379867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:08.400823 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:08.406697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c096-3f99-4813-8185-c20061078019 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:08.423175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801de39-f10a-4167-abd6-6070dff8e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:08.425274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801de39-f10a-4167-abd6-6070dff8e01f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:08.427054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801de39-f10a-4167-abd6-6070dff8e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:08.427454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801de39-f10a-4167-abd6-6070dff8e01f admin admin] PATH_INFO: `/v3/projects/fda052a63a6747d8b8fddfeeba9ec853/users/d1e2aece0e904578aaf05220931c0e6b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.479503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801de39-f10a-4167-abd6-6070dff8e01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda052a63a6747d8b8fddfeeba9ec853, user_id=d1e2aece0e904578aaf05220931c0e6b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:08.487513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801de39-f10a-4167-abd6-6070dff8e01f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:08.511307 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2413/4810] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:35:08 2022] POST /identity/v3/projects => generated 328 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:08.515257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:08.586806 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2398/4811] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:08 2022] PUT /identity/v3/projects/fda052a63a6747d8b8fddfeeba9ec853/users/d1e2aece0e904578aaf05220931c0e6b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:08.592026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c76c89-4196-478c-abe8-4fe90d0d875e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:08.592522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c76c89-4196-478c-abe8-4fe90d0d875e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:08.594814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c76c89-4196-478c-abe8-4fe90d0d875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.683179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-61c76c89-4196-478c-abe8-4fe90d0d875e None None] MFA Rules not processed for user `d1e2aece0e904578aaf05220931c0e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:08.687801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-61c76c89-4196-478c-abe8-4fe90d0d875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:08.699377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031927fa-d445-4a57-b0ea-3a151d5c45e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:08.845888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:08.846565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:08.846853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:08.847131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:08.847800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:08.855457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:08.938671 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2399/4812] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:08.939703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c76c89-4196-478c-abe8-4fe90d0d875e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.003767 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2414/4813] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:08 2022] POST /identity/v3/users => generated 416 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:09.007588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.029016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd0b62-1f29-403a-8610-d2af50ae4d9d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:09.050055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:09.050700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:09.050985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:09.051601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:09.052069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:09.053930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:09.173063 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:09.187797 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2415/4814] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:09 2022] POST /identity/v3/roles => generated 244 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:09.193009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.212017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c76c89-4196-478c-abe8-4fe90d0d875e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:09.215815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3b407-35b4-44f2-b339-b1a36f526a07 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:09.233090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:09.236488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:09.236488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:09.236488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:09.236488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:09.238524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:09.239366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:09.239731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:09.240206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:09.240805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:09.242732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:09.249919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:09.331219 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2416/4815] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:09 2022] POST /identity/v3/roles => generated 247 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:09.334662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.356595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e69a-675f-435a-8563-aaeee564e3df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:09.363322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:09.371756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:09.372485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:09.373007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/51a8df193f7a4f8a8a81aae7c1acfb1e/users/9c6b68ea87b7457b9c3f277a14df77b7/roles/2853247e23ce4652bb200816852e92f3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:09.430265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=51a8df193f7a4f8a8a81aae7c1acfb1e, user_id=9c6b68ea87b7457b9c3f277a14df77b7, role_id=2853247e23ce4652bb200816852e92f3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:09.437177 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2400/4816] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:08 2022] POST /identity/v3/projects => generated 377 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:09.439669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.452671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:09.545153 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2417/4817] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:09 2022] PUT /identity/v3/projects/51a8df193f7a4f8a8a81aae7c1acfb1e/users/9c6b68ea87b7457b9c3f277a14df77b7/roles/2853247e23ce4652bb200816852e92f3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:09.550750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.623602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571986e-6015-4b23-b027-cf615b54ff42 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:09.682062 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:09.737609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0761186-e4a0-42c4-835b-966a0247ce39 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:09.754465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:09.755171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:09.755616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:09.755791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/51a8df193f7a4f8a8a81aae7c1acfb1e/users/9c6b68ea87b7457b9c3f277a14df77b7/roles/15df27c274e9407b8b8408e88b9a1acd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:09.758765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=51a8df193f7a4f8a8a81aae7c1acfb1e, user_id=9c6b68ea87b7457b9c3f277a14df77b7, role_id=15df27c274e9407b8b8408e88b9a1acd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:09.761436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:09.768547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:09.769176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:09.769657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:09.770127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:09.770937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:09.778898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:09.916060 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2418/4818] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:09 2022] PUT /identity/v3/projects/51a8df193f7a4f8a8a81aae7c1acfb1e/users/9c6b68ea87b7457b9c3f277a14df77b7/roles/15df27c274e9407b8b8408e88b9a1acd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:09.920449 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2401/4819] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:09 2022] POST /identity/v3/users => generated 295 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:09.923822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.934630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:09.965657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fd598-1645-4adf-a99b-c913ebd88e87 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:10.104770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae7ea-9c82-49db-92d2-66bc285c5ed9 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:10.118123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d7185-4b1c-44c9-bbcc-789b29d4eb89 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:10.121108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d7185-4b1c-44c9-bbcc-789b29d4eb89 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.121108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d7185-4b1c-44c9-bbcc-789b29d4eb89 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.121108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d7185-4b1c-44c9-bbcc-789b29d4eb89 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.123574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d7185-4b1c-44c9-bbcc-789b29d4eb89 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:10.123918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d7185-4b1c-44c9-bbcc-789b29d4eb89 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:10.151145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:10.157719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.159720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.160094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.161837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:10.164658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:10.197651 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2402/4820] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:09 2022] GET /identity/v3/roles => generated 1893 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:10.202270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:10.226797 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2419/4821] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:09 2022] GET /identity/v3/users => generated 8616 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:10.228465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ebea-9a62-4818-8c85-03abc9dbbd71 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.228784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ebea-9a62-4818-8c85-03abc9dbbd71 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.229394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ebea-9a62-4818-8c85-03abc9dbbd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.231171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471284de-37f5-45b4-9003-e820cf247382 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:10.251776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:10.253879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.257146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.257553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] PATH_INFO: `/v3/projects/5919e94dc47c4a5889825a1d70b5f019/users/64d7d139896a43ff9ab82c81a69c349f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.286489 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:10.302506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5919e94dc47c4a5889825a1d70b5f019, user_id=64d7d139896a43ff9ab82c81a69c349f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:10.307978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:10.405540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2403/4822] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:10 2022] PUT /identity/v3/projects/5919e94dc47c4a5889825a1d70b5f019/users/64d7d139896a43ff9ab82c81a69c349f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:10.406766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:10.414588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9c04ebea-9a62-4818-8c85-03abc9dbbd71 None None] MFA Rules not processed for user `9c6b68ea87b7457b9c3f277a14df77b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:10.427548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9c04ebea-9a62-4818-8c85-03abc9dbbd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:10.544911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33812ced-a5f7-4962-ab65-8763e125352d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:10.554101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:10.555875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.565425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.566127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.568746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:10.582449 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2420/4823] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:10.583272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:10.586286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e73c8-48e5-4a94-bf29-0d4c4175f0cf None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.589652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e73c8-48e5-4a94-bf29-0d4c4175f0cf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.590003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e73c8-48e5-4a94-bf29-0d4c4175f0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.598797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2404/4824] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:10 2022] GET /identity/v3/roles => generated 1893 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:10.603093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:10.636517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bdff7-4884-4669-8d89-53b8a139c91b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:10.659245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:10.661119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-138e73c8-48e5-4a94-bf29-0d4c4175f0cf None None] MFA Rules not processed for user `9c6b68ea87b7457b9c3f277a14df77b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:10.662018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.662483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.663942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-138e73c8-48e5-4a94-bf29-0d4c4175f0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:10.664254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] PATH_INFO: `/v3/projects/5919e94dc47c4a5889825a1d70b5f019/users/64d7d139896a43ff9ab82c81a69c349f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.676596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5919e94dc47c4a5889825a1d70b5f019, user_id=64d7d139896a43ff9ab82c81a69c349f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:10.676596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:10.700393 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2421/4825] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:10.705030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a51a3-f77e-4d76-b90c-13eba26716be None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.705030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a51a3-f77e-4d76-b90c-13eba26716be None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.705030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a51a3-f77e-4d76-b90c-13eba26716be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.722233 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2405/4826] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:10 2022] PUT /identity/v3/projects/5919e94dc47c4a5889825a1d70b5f019/users/64d7d139896a43ff9ab82c81a69c349f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:10.722233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:10.812137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-589a51a3-f77e-4d76-b90c-13eba26716be None None] MFA Rules not processed for user `bcaf572331dd405995c4c62d2f63b7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:10.813906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-589a51a3-f77e-4d76-b90c-13eba26716be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:10.926631 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:10.940262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dfb5a-f581-4d03-aca9-a371732f6e06 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:10.973464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b029e-5484-47c9-aa79-9d78771fa332 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b68ea87b7457b9c3f277a14df77b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a8df193f7a4f8a8a81aae7c1acfb1e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2113205868', 'tempest-NotDelegatedRole-1708354456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:10.973464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b029e-5484-47c9-aa79-9d78771fa332 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:10.973464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b029e-5484-47c9-aa79-9d78771fa332 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:10.974343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b029e-5484-47c9-aa79-9d78771fa332 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:10.974343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b029e-5484-47c9-aa79-9d78771fa332 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] RBAC: Authorizing `identity:create_trust()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:10.974343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b029e-5484-47c9-aa79-9d78771fa332 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:11.020705 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2422/4827] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:11.022804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb7c34-11c5-4d07-a584-8a7c5a69420c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:11.024909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb7c34-11c5-4d07-a584-8a7c5a69420c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:11.025369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb7c34-11c5-4d07-a584-8a7c5a69420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:11.136181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3afb7c34-11c5-4d07-a584-8a7c5a69420c None None] MFA Rules not processed for user `64d7d139896a43ff9ab82c81a69c349f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:11.137735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3afb7c34-11c5-4d07-a584-8a7c5a69420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:11.250013 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2406/4828] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:35:10 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:11.252055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881c7a4-ee5c-4f99-bb08-473e0c7d482d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:11.258794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881c7a4-ee5c-4f99-bb08-473e0c7d482d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:11.260827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881c7a4-ee5c-4f99-bb08-473e0c7d482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:11.297620 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2423/4829] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:11.300912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb7c34-11c5-4d07-a584-8a7c5a69420c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:11.333760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2881c7a4-ee5c-4f99-bb08-473e0c7d482d None None] MFA Rules not processed for user `bcaf572331dd405995c4c62d2f63b7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:11.345797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2881c7a4-ee5c-4f99-bb08-473e0c7d482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:11.378615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2407/4830] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:11.379556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881c7a4-ee5c-4f99-bb08-473e0c7d482d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:11.419382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881c7a4-ee5c-4f99-bb08-473e0c7d482d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:11.432719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:11.433354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:11.433661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:11.433944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:11.434695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:11.440325 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:11.440325 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:35:11.440325 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:35:11.441184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:11.450600 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:11.533005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb7c34-11c5-4d07-a584-8a7c5a69420c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:11.539383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:11.540218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:11.540660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:11.611237 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2408/4831] 10.222.0.42 () {60 vars in 1185 bytes} [Sun Oct 23 01:35:11 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:11.612249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:11.618240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:11.619731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:11.620785 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:11.620785 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:35:11.620785 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:35:11.625957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:11.640595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:11.697444 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2424/4832] 10.222.0.42 () {58 vars in 1155 bytes} [Sun Oct 23 01:35:11 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:11.697884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:11.762215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edfb98-4cb8-4fc8-965a-1a3647bc212b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:11.783805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:11.784472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:11.784846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:11.785067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c52282df06d442fc85ed5f314867f386` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:11.785604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c52282df06d442fc85ed5f314867f386)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:11.791350 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:11.791350 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:35:11.791350 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:35:11.799645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:11.809110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2425/4833] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:35:11 2022] GET /identity/v3/OS-OAUTH1/consumers/c52282df06d442fc85ed5f314867f386 => generated 221 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:11.818033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:11.852748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f53a-a977-4c4b-8404-264482b3d026 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:11.878281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b68ea87b7457b9c3f277a14df77b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a8df193f7a4f8a8a81aae7c1acfb1e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2113205868', 'tempest-NotDelegatedRole-1708354456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:11.879308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:11.895384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:11.895812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] PATH_INFO: `/v3/OS-TRUST/trusts/609b1223599b48a483f29345f7b6e843` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:11.951467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] RBAC: Authorizing `identity:delete_trust(trust_id=609b1223599b48a483f29345f7b6e843)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:11.956931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:12.029225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695190-2700-48fd-93f4-d39dc8222a0d tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:12.056551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:12.063184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:12.063184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:12.063184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:12.100959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:12.102461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:12.138079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '609b1223599b48a483f29345f7b6e843', 'request_id': 'req-c0b05072-1c70-434a-91d2-0f731a234c0b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.138774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '609b1223599b48a483f29345f7b6e843', 'request_id': 'req-c0b05072-1c70-434a-91d2-0f731a234c0b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.140040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '609b1223599b48a483f29345f7b6e843', 'request_id': 'req-c0b05072-1c70-434a-91d2-0f731a234c0b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.149106 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2409/4834] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:12.152058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:12.208629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e86921-a496-4661-b61d-70fa82328622 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:12.233617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:12.234311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:12.234591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:12.234866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c52282df06d442fc85ed5f314867f386` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:12.235553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c52282df06d442fc85ed5f314867f386)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:12.239601 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:12.239601 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:35:12.239601 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:35:12.240367 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2426/4835] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:35:11 2022] DELETE /identity/v3/OS-TRUST/trusts/609b1223599b48a483f29345f7b6e843 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:12.245675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:12.250716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:12.253575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:12.253946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invalidating token cache because consumer c52282df06d442fc85ed5f314867f386 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:12.254732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.256209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.329102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05072-1c70-434a-91d2-0f731a234c0b tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:12.343332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6b68ea87b7457b9c3f277a14df77b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a8df193f7a4f8a8a81aae7c1acfb1e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2113205868', 'tempest-NotDelegatedRole-1708354456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:12.344314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:12.344756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:12.345750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] PATH_INFO: `/v3/OS-TRUST/trusts/609b1223599b48a483f29345f7b6e843` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:12.349856 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Could not find trust: 609b1223599b48a483f29345f7b6e843.: keystone.exception.TrustNotFound: Could not find trust: 609b1223599b48a483f29345f7b6e843. Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 23 01:35:12.383289 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 609b1223599b48a483f29345f7b6e843. Oct 23 01:35:12.384617 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:12.385626 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2427/4836] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:12 2022] GET /identity/v3/OS-TRUST/trusts/609b1223599b48a483f29345f7b6e843 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:12.389030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:12.399190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:12.417735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c52282df06d442fc85ed5f314867f386', 'request_id': 'req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.426689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e8e0-0dce-4406-9fba-660dce5b0ab4 tempest-TrustsV3TestJSON-247668730 tempest-user-1032816002] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:12.440181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:12.440831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:12.441310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:12.441756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/15df27c274e9407b8b8408e88b9a1acd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:12.446935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=15df27c274e9407b8b8408e88b9a1acd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:12.448902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:12.514096 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2410/4837] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:35:12 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c52282df06d442fc85ed5f314867f386 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:12.517244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:12.520624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:12.555660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1ce7-f2fe-432d-a84d-e27f28a8a2a3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:12.566729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:12.568630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:12.568955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:12.569835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:12.572875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:12.577103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:12.642139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 15df27c274e9407b8b8408e88b9a1acd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:12.643049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.662736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:12.662736 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2428/4838] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:12 2022] DELETE /identity/v3/roles/15df27c274e9407b8b8408e88b9a1acd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:12.662736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:12.662736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:12.695664 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2411/4839] 10.222.0.42 () {60 vars in 1185 bytes} [Sun Oct 23 01:35:12 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:12.712117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:12.714937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:12.757715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1482b-37c4-464f-b0e3-1de85f37c8f2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:12.832847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a3757-7518-4c7d-82b8-6fbc97a0365b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:12.857503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:12.858202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:12.858485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:12.858761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/2853247e23ce4652bb200816852e92f3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:12.864514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2853247e23ce4652bb200816852e92f3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:12.866373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:12.988755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:12.988755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:12.990916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:12.991325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:12.993113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=556de10a4a614573814770be1c0d9c55)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:12.996475 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:12.996475 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:35:12.996475 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:35:12.999182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:13.011803 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2412/4840] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:35:12 2022] GET /identity/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55 => generated 220 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:13.016072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:13.036054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423c8fe-d373-4b7e-bd9c-81888ea78ded tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:13.044642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:13.045507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:13.046669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:13.047405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:13.049018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=556de10a4a614573814770be1c0d9c55)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:13.051076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:13.051457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invalidating token cache because consumer 556de10a4a614573814770be1c0d9c55 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:13.051891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.052705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.115677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 2853247e23ce4652bb200816852e92f3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:13.115968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.119964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.126232 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2429/4841] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:12 2022] DELETE /identity/v3/roles/2853247e23ce4652bb200816852e92f3 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:13.127160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:13.130998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:13.178885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '556de10a4a614573814770be1c0d9c55', 'request_id': 'req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.307490 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2413/4842] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:35:13 2022] DELETE /identity/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:13.311672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:13.328445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:13.373859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457426-4eb9-4f51-b871-8bfee7074769 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:13.375756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3f9e2-f0be-4c56-b673-2abb60f75dc2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:13.387424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:13.388837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:13.391086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:13.392155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users/9c6b68ea87b7457b9c3f277a14df77b7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:13.401462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9c6b68ea87b7457b9c3f277a14df77b7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:13.414537 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:13.415090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:13.546218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:13.546218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:13.547141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:13.547597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:13.548466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=556de10a4a614573814770be1c0d9c55)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:13.552928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 23 01:35:13.579992 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 23 01:35:13.581363 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:13.587211 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2414/4843] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:35:13 2022] GET /identity/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55 => generated 74 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:35:13.590050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:13.592549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:13.597300 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:13.637867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d294a-fb89-4fed-9232-c418d806de28 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:13.638845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6b68ea87b7457b9c3f277a14df77b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.652782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:13.653783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:13.655325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:13.657903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:13.658170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6b68ea87b7457b9c3f277a14df77b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.659076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=556de10a4a614573814770be1c0d9c55)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:13.660141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6b68ea87b7457b9c3f277a14df77b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.664553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:13.665925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invalidating token cache because consumer 556de10a4a614573814770be1c0d9c55 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:13.666308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.667926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 23 01:35:13.721905 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 23 01:35:13.723417 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:13.729441 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2415/4844] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:35:13 2022] DELETE /identity/v3/OS-OAUTH1/consumers/556de10a4a614573814770be1c0d9c55 => generated 74 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:35:13.734775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:13.737127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:13.767189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6b68ea87b7457b9c3f277a14df77b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.768107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6b68ea87b7457b9c3f277a14df77b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:13.770765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2f4d-1f1e-43ca-8afc-7dcc834eacab tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:13.786543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:13.788335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:13.790292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:13.792850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:13.794026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:13.815414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:13.818984 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2430/4845] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:13 2022] DELETE /identity/v3/users/9c6b68ea87b7457b9c3f277a14df77b7 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:13.823584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:13.827756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:13.925760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2416/4846] 10.222.0.42 () {60 vars in 1185 bytes} [Sun Oct 23 01:35:13 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:13.929262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:13.940287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:13.977047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d29221-88a1-4e3a-840b-38462c2154cc tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:14.040288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1e7cb-ddfd-4285-8c75-467368712b98 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:14.074675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:14.075340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:14.075623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:14.075896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/51a8df193f7a4f8a8a81aae7c1acfb1e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:14.079963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=51a8df193f7a4f8a8a81aae7c1acfb1e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:14.083530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:14.280421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:14.281470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:14.281470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:14.281750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:14.282528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:14.294661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:14.528203 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2417/4847] 10.222.0.42 () {60 vars in 1185 bytes} [Sun Oct 23 01:35:13 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:14.529155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:14.556592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17dca-ac2b-4228-89a6-4d49b4cdafc6 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:14.656851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a8df193f7a4f8a8a81aae7c1acfb1e', 'request_id': 'req-70700201-26e8-4720-91c0-06f8331b1488'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.679595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a8df193f7a4f8a8a81aae7c1acfb1e', 'request_id': 'req-70700201-26e8-4720-91c0-06f8331b1488'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.694479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:14.698382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:14.698382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:14.698382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:14.698382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:14.698856 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:14.698856 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:35:14.698856 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:35:14.699597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:14.710952 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2418/4848] 10.222.0.42 () {58 vars in 1164 bytes} [Sun Oct 23 01:35:14 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:14.712150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:14.728406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d46de5-f61f-427d-bb93-2b354ff3a62a tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:14.734263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:14.735378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:14.736746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:14.737273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fcb2f216f16f4a79bb83a649f54a8e71` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:14.738188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fcb2f216f16f4a79bb83a649f54a8e71)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:14.747017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:14.747017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invalidating token cache because consumer fcb2f216f16f4a79bb83a649f54a8e71 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:14.747017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.747017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.752279 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:14.841801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a8df193f7a4f8a8a81aae7c1acfb1e', 'request_id': 'req-70700201-26e8-4720-91c0-06f8331b1488'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.862688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] The token cache is being invalidate because project 51a8df193f7a4f8a8a81aae7c1acfb1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:14.863006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.865907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.869850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'fcb2f216f16f4a79bb83a649f54a8e71', 'request_id': 'req-0422a117-20ae-4447-891c-8fca057a2706'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:14.873312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2431/4849] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:13 2022] DELETE /identity/v3/projects/51a8df193f7a4f8a8a81aae7c1acfb1e => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:14.879532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:14.885250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:14.977048 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2419/4850] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:35:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fcb2f216f16f4a79bb83a649f54a8e71 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:14.982416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:14.990278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:15.004140 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:15.041376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422a117-20ae-4447-891c-8fca057a2706 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.054709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.056010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.056010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.056010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5c412136ce7747998966795f7e2b11af` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.056629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5c412136ce7747998966795f7e2b11af)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.058263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.058545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invalidating token cache because consumer 5c412136ce7747998966795f7e2b11af has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:15.058898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:15.074492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:15.142885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700201-26e8-4720-91c0-06f8331b1488 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.162576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.163288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.163926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.166199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.167427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.174963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.201797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5c412136ce7747998966795f7e2b11af', 'request_id': 'req-f241a302-a270-4ddc-813b-1089fe8d4650'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:15.302307 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2420/4851] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:35:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5c412136ce7747998966795f7e2b11af => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:15.308239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:15.311571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:15.333761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241a302-a270-4ddc-813b-1089fe8d4650 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.340436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.341206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.341815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.345599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.345730 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2432/4852] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:35:14 2022] POST /identity/v3/projects => generated 328 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:15.345842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.346181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.346857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:15.352138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:15.457437 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2421/4853] 10.222.0.42 () {60 vars in 1185 bytes} [Sun Oct 23 01:35:15 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:15.459218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:15.493881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e78d9c-a4a3-4e06-8bc6-5e514582dcc3 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.605613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f592c-d02c-483d-b485-1c49183cef00 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.626525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.627665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.629227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.630090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.631447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.638985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.642438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.643592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.645202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.645202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8b3f7c7beb4a4583bfdd38bc872f9139` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.645419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=8b3f7c7beb4a4583bfdd38bc872f9139)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.646548 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:15.646548 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:35:15.646548 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:35:15.647892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.781909 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2422/4854] 10.222.0.42 () {60 vars in 1285 bytes} [Sun Oct 23 01:35:15 2022] PATCH /identity/v3/OS-OAUTH1/consumers/8b3f7c7beb4a4583bfdd38bc872f9139 => generated 220 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:15.788337 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2433/4855] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:15 2022] POST /identity/v3/users => generated 413 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:15.790899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:15.792168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:15.811684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b359845-e02e-4d76-a6a8-a6e429af62b2 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.818444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.821019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.821019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.821019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8b3f7c7beb4a4583bfdd38bc872f9139` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.821019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=8b3f7c7beb4a4583bfdd38bc872f9139)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.822595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599aa36-74cb-4abf-9ee3-8f6eef06f9ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.825631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.839925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.842621 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2423/4856] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:35:15 2022] GET /identity/v3/OS-OAUTH1/consumers/8b3f7c7beb4a4583bfdd38bc872f9139 => generated 220 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:15.842822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.845799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.850448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.850847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:15.851033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.855795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.871510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06986862-3779-47e9-a5c6-d30543851ca0 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:15.881184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64d7d139896a43ff9ab82c81a69c349f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5919e94dc47c4a5889825a1d70b5f019', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:15.890356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:15.892705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:15.894631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8b3f7c7beb4a4583bfdd38bc872f9139` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:15.895992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8b3f7c7beb4a4583bfdd38bc872f9139)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:15.906518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:15.908559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invalidating token cache because consumer 8b3f7c7beb4a4583bfdd38bc872f9139 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:15.908988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:15.912537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:15.976583 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2434/4857] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:15 2022] POST /identity/v3/roles => generated 244 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:15.977592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:15.982301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:16.027767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8b3f7c7beb4a4583bfdd38bc872f9139', 'request_id': 'req-a5c2aa65-3924-422a-a83b-7d3ea6f74929'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:16.029186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a087-d073-4cdd-8012-d4fa92df1479 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:16.068430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:16.069024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:16.069378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:16.069726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:16.070510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:16.072209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:16.093522 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2424/4858] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:35:15 2022] DELETE /identity/v3/OS-OAUTH1/consumers/8b3f7c7beb4a4583bfdd38bc872f9139 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:16.099688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:16.101543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:16.203443 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2435/4859] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:15 2022] POST /identity/v3/roles => generated 245 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:16.205135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:16.256269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4d819-d6c9-42ce-94dc-6ca094c187fa tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:16.274913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:16.275719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:16.276074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:16.276689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/b249d51e95214d8b941983766791326a/users/9634c69146ef455d8bd319a326d9f660/roles/15a2663120c84ae8b015923d835963c1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:16.290428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2aa65-3924-422a-a83b-7d3ea6f74929 tempest-OAUTHConsumersV3Test-1655972410 tempest-OAUTHConsumersV3Test-1655972410-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:16.307443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:16.308148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:16.308405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:16.308637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] PATH_INFO: `/v3/users/d1e2aece0e904578aaf05220931c0e6b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:16.310669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e2aece0e904578aaf05220931c0e6b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:16.310852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b249d51e95214d8b941983766791326a, user_id=9634c69146ef455d8bd319a326d9f660, role_id=15a2663120c84ae8b015923d835963c1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:16.314459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:16.318783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:16.342564 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:16.500193 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2436/4860] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:16 2022] PUT /identity/v3/projects/b249d51e95214d8b941983766791326a/users/9634c69146ef455d8bd319a326d9f660/roles/15a2663120c84ae8b015923d835963c1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:16.504435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:16.655380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e2aece0e904578aaf05220931c0e6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:16.687448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e2aece0e904578aaf05220931c0e6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:16.691008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e2aece0e904578aaf05220931c0e6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:16.762218 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:16.773245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de2887-8d22-4324-b1f3-7acada623c31 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:16.784990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e2aece0e904578aaf05220931c0e6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:16.786019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c58c998e-2ec2-4919-82df-40dec4404574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e2aece0e904578aaf05220931c0e6b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:16.801663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:16.804434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:16.806910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:16.809608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/b249d51e95214d8b941983766791326a/users/9634c69146ef455d8bd319a326d9f660/roles/9d411eaaa3cc4412a72af94d592fea47` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:16.825402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b249d51e95214d8b941983766791326a, user_id=9634c69146ef455d8bd319a326d9f660, role_id=9d411eaaa3cc4412a72af94d592fea47)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:16.828479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:16.846882 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2425/4861] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:16 2022] DELETE /identity/v3/users/d1e2aece0e904578aaf05220931c0e6b => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:16.851755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:16.852050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:16.852331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:16.908088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:16.912016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:16.918678 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2437/4862] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:16 2022] PUT /identity/v3/projects/b249d51e95214d8b941983766791326a/users/9634c69146ef455d8bd319a326d9f660/roles/9d411eaaa3cc4412a72af94d592fea47 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:16.922630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:16.930302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:17.123616 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2426/4863] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:17.134381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:17.136064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:17.236849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dfa3b-7eee-44fc-ba41-21606e6e6db4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:17.271378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062077c-3356-496a-a14f-a893db9a95cd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:17.274761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062077c-3356-496a-a14f-a893db9a95cd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:17.275616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062077c-3356-496a-a14f-a893db9a95cd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:17.276750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062077c-3356-496a-a14f-a893db9a95cd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:17.277666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062077c-3356-496a-a14f-a893db9a95cd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:17.288944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062077c-3356-496a-a14f-a893db9a95cd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:17.305490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c320798-6a22-4004-bb22-528da78ecea6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:17.327139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c1e11-e373-4c03-b1aa-f25059a65e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:17.328610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c1e11-e373-4c03-b1aa-f25059a65e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:17.329603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c1e11-e373-4c03-b1aa-f25059a65e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:17.330063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c1e11-e373-4c03-b1aa-f25059a65e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:17.362383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c1e11-e373-4c03-b1aa-f25059a65e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:17.364144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c1e11-e373-4c03-b1aa-f25059a65e78 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:17.403700 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2427/4864] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:35:17.443948 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2438/4865] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:16 2022] GET /identity/v3/users => generated 8335 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:17.444443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfc801-f9e1-4df5-8277-21d650f8fb97 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:17.445143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfc801-f9e1-4df5-8277-21d650f8fb97 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:17.445520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfc801-f9e1-4df5-8277-21d650f8fb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:17.576615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-39cfc801-f9e1-4df5-8277-21d650f8fb97 None None] MFA Rules not processed for user `9634c69146ef455d8bd319a326d9f660`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:17.587402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-39cfc801-f9e1-4df5-8277-21d650f8fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:17.636422 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:17.846437 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2428/4866] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:17.856712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687ab82-2235-4a33-8be1-5f9422c68fd2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:17.858660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687ab82-2235-4a33-8be1-5f9422c68fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:17.859137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687ab82-2235-4a33-8be1-5f9422c68fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:17.906839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4687ab82-2235-4a33-8be1-5f9422c68fd2 None None] MFA Rules not processed for user `9634c69146ef455d8bd319a326d9f660`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:17.908881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4687ab82-2235-4a33-8be1-5f9422c68fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:17.939615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfc801-f9e1-4df5-8277-21d650f8fb97 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:17.940381 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2439/4867] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:17.954666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfc801-f9e1-4df5-8277-21d650f8fb97 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:17.978201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9634c69146ef455d8bd319a326d9f660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b249d51e95214d8b941983766791326a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1724713555', 'tempest-NotDelegatedRole-61919288'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:17.979795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:17.993061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:17.994313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:17.997238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: Authorizing `identity:create_trust()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:18.000153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:18.326472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2429/4868] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:35:17 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:18.329895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687ab82-2235-4a33-8be1-5f9422c68fd2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:18.339624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687ab82-2235-4a33-8be1-5f9422c68fd2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:18.370598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9634c69146ef455d8bd319a326d9f660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b249d51e95214d8b941983766791326a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1724713555', 'tempest-NotDelegatedRole-61919288'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:18.371237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:18.377827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:18.377827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:18.377827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:18.377827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:18.391929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2440/4869] 10.222.0.42 () {58 vars in 1252 bytes} [Sun Oct 23 01:35:18 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=9634c69146ef455d8bd319a326d9f660 => generated 611 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:18.396095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:18.412014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5eaee-b098-45b3-b38c-015b521a10df tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:18.435516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9634c69146ef455d8bd319a326d9f660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b249d51e95214d8b941983766791326a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1724713555', 'tempest-NotDelegatedRole-61919288'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:18.436344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:18.436631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:18.436904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] PATH_INFO: `/v3/OS-TRUST/trusts/a4da9f3e42ed4c13921cd3a9ada37a28` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:18.457858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: Authorizing `identity:delete_trust(trust_id=a4da9f3e42ed4c13921cd3a9ada37a28)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:18.459487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:18.605377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a4da9f3e42ed4c13921cd3a9ada37a28', 'request_id': 'req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:18.709400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a4da9f3e42ed4c13921cd3a9ada37a28', 'request_id': 'req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:18.712293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a4da9f3e42ed4c13921cd3a9ada37a28', 'request_id': 'req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:18.730921 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2430/4870] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:35:18 2022] DELETE /identity/v3/OS-TRUST/trusts/a4da9f3e42ed4c13921cd3a9ada37a28 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:18.736679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:18.739001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:18.782940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197e603-0263-4ef4-8176-2e3ca9323990 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:18.807194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9634c69146ef455d8bd319a326d9f660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b249d51e95214d8b941983766791326a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1724713555', 'tempest-NotDelegatedRole-61919288'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:18.810691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:18.810973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:18.814747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] PATH_INFO: `/v3/OS-TRUST/trusts/a4da9f3e42ed4c13921cd3a9ada37a28` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Could not find trust: a4da9f3e42ed4c13921cd3a9ada37a28.: keystone.exception.TrustNotFound: Could not find trust: a4da9f3e42ed4c13921cd3a9ada37a28. Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 23 01:35:18.869065 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a4da9f3e42ed4c13921cd3a9ada37a28. Oct 23 01:35:18.870867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:18.880103 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2441/4871] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:18 2022] GET /identity/v3/OS-TRUST/trusts/a4da9f3e42ed4c13921cd3a9ada37a28 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:18.884577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:18.887045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:18.908570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0a8d1-fc32-48bc-8f60-bde3961fbd03 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:18.914821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:18.915796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:18.916183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:18.916568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/9d411eaaa3cc4412a72af94d592fea47` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:18.922445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9d411eaaa3cc4412a72af94d592fea47)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:18.924939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:19.213656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:19.216005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:19.221932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 9d411eaaa3cc4412a72af94d592fea47 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:19.222491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.223389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.227556 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2431/4872] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:18 2022] DELETE /identity/v3/roles/9d411eaaa3cc4412a72af94d592fea47 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:19.231242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:19.232641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:19.255250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9ce74-b80e-474a-8c82-4cd16acd3286 tempest-TrustsV3TestJSON-333773358 tempest-user-938001139] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:19.307723 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:19.397898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81e075-8bbf-43ce-ad23-a663ce4bd570 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:19.411450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:19.412118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:19.412400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:19.412676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/15a2663120c84ae8b015923d835963c1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:19.420477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=15a2663120c84ae8b015923d835963c1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:19.422222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:19.525033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:19.527302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:19.527586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:19.533135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] PATH_INFO: `/v3/projects/fda052a63a6747d8b8fddfeeba9ec853` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:19.538810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda052a63a6747d8b8fddfeeba9ec853)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:19.541375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:19.628254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 15a2663120c84ae8b015923d835963c1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:19.628254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.628254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.630329 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2432/4873] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:19 2022] DELETE /identity/v3/roles/15a2663120c84ae8b015923d835963c1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:19.634365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:19.635862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:19.769320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda052a63a6747d8b8fddfeeba9ec853', 'request_id': 'req-1ca7576c-49e7-44cd-8914-970030333e10'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.783501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda052a63a6747d8b8fddfeeba9ec853', 'request_id': 'req-1ca7576c-49e7-44cd-8914-970030333e10'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.791136 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:19.854911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62932-d28f-4feb-854b-d33de69daee8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:19.869443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda052a63a6747d8b8fddfeeba9ec853', 'request_id': 'req-1ca7576c-49e7-44cd-8914-970030333e10'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.890181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] The token cache is being invalidate because project fda052a63a6747d8b8fddfeeba9ec853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:19.890480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.891499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:19.899599 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2442/4874] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:19 2022] DELETE /identity/v3/projects/fda052a63a6747d8b8fddfeeba9ec853 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:19.909226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:19.912246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:20.001399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:20.002864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:20.004706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:20.004991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users/9634c69146ef455d8bd319a326d9f660` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:20.009490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9634c69146ef455d8bd319a326d9f660)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:20.010726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:20.101559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7576c-49e7-44cd-8914-970030333e10 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:20.108869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:20.109640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:20.110805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:20.111221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] PATH_INFO: `/v3/users/64d7d139896a43ff9ab82c81a69c349f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:20.112800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d7d139896a43ff9ab82c81a69c349f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:20.116690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:20.154123 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:20.184174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9634c69146ef455d8bd319a326d9f660'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.206089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9634c69146ef455d8bd319a326d9f660'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.207755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9634c69146ef455d8bd319a326d9f660'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.310334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9634c69146ef455d8bd319a326d9f660'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.311647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9634c69146ef455d8bd319a326d9f660'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.369874 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2433/4875] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:19 2022] DELETE /identity/v3/users/9634c69146ef455d8bd319a326d9f660 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:20.378461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:20.381793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:20.389338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d7d139896a43ff9ab82c81a69c349f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.418373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d7d139896a43ff9ab82c81a69c349f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.420408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d7d139896a43ff9ab82c81a69c349f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.509407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d7d139896a43ff9ab82c81a69c349f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.510192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7469e60a-721c-4576-b62e-89c82a2896f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d7d139896a43ff9ab82c81a69c349f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:20.561869 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2443/4876] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:19 2022] DELETE /identity/v3/users/64d7d139896a43ff9ab82c81a69c349f => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:20.609447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba0d2e-e193-49db-b1c3-d438d7eed020 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:20.752098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:20.752646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:20.753681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:20.793731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] MFA Rules not processed for user `bb03047092f64e2abbf78e9db1a06e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:20.796033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:20.799804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:20.815424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:20.815754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:20.817352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/b249d51e95214d8b941983766791326a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:20.820748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b249d51e95214d8b941983766791326a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:20.829658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:20.924494 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2444/4877] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:21.090144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b249d51e95214d8b941983766791326a', 'request_id': 'req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:21.104883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b249d51e95214d8b941983766791326a', 'request_id': 'req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:21.113864 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:21.212282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b249d51e95214d8b941983766791326a', 'request_id': 'req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:21.234562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] The token cache is being invalidate because project b249d51e95214d8b941983766791326a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:21.235768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:21.237614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:21.248574 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2434/4878] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:20 2022] DELETE /identity/v3/projects/b249d51e95214d8b941983766791326a => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:21.248888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:21.251087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:21.291826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f9451-9125-4d14-a084-a4fd6f344bc6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:21.341965 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:21.587913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:21.588560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:21.588843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:21.589120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:21.589757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:21.600584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:21.740085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:21.742362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:21.774420 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2445/4879] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:35:21 2022] POST /identity/v3/projects => generated 329 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:21.776385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:21.785193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:21.976624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c77a3e-5b5f-486a-8ccb-4ae94630b3e2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:21.980175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb4843-47b9-4fb4-ad84-f8608235be65 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:22.009449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:22.010619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:22.011136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:22.012075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:22.012999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:22.019475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:22.148300 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2446/4880] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:21 2022] POST /identity/v3/users => generated 413 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:22.149529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:22.151415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:22.155713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:22.156292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:22.158898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] PATH_INFO: `/v3/projects/5919e94dc47c4a5889825a1d70b5f019` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:22.163404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5919e94dc47c4a5889825a1d70b5f019)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:22.166941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:22.190568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd74a2-2dac-4c20-a4b3-0f852aa40d7d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:22.205667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:22.208993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:22.210473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:22.211465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:22.214692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:22.218682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:22.315313 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2447/4881] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:22 2022] POST /identity/v3/roles => generated 244 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:22.316468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:22.346460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1837e-ec97-4523-91d5-d45241d974ed tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:22.378565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5919e94dc47c4a5889825a1d70b5f019', 'request_id': 'req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:22.396716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5919e94dc47c4a5889825a1d70b5f019', 'request_id': 'req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:22.477695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5919e94dc47c4a5889825a1d70b5f019', 'request_id': 'req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:22.501613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:22.501613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:22.501613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:22.512670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:22.513518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:22.514786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] The token cache is being invalidate because project 5919e94dc47c4a5889825a1d70b5f019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:22.515294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:22.517899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c7d7ab3-b6c7-4db3-af0e-68c873caafea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:22.521572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:22.525990 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2435/4882] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:21 2022] DELETE /identity/v3/projects/5919e94dc47c4a5889825a1d70b5f019 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:22.531253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f49558-87f7-4df5-a6c6-05eb2ccd2a3f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:22.532349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f49558-87f7-4df5-a6c6-05eb2ccd2a3f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:22.532968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f49558-87f7-4df5-a6c6-05eb2ccd2a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:22.590265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-67f49558-87f7-4df5-a6c6-05eb2ccd2a3f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:22.596997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-67f49558-87f7-4df5-a6c6-05eb2ccd2a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:22.646046 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:22.653466 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2448/4883] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:22 2022] POST /identity/v3/roles => generated 246 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:22.654747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:22.656473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:22.706423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa437bc-2d87-4273-b883-e89c75e2bfcf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:22.724703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:22.725389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:22.730633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:22.731687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/45cf33d39f9840dba7c156229a189ad4/users/33d16fa2686945798d9017145a75338f/roles/ccdba8577b7b444db7e1d249ff6843c8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:22.769828 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:22.791582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=45cf33d39f9840dba7c156229a189ad4, user_id=33d16fa2686945798d9017145a75338f, role_id=ccdba8577b7b444db7e1d249ff6843c8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:22.800709 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2436/4884] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:22.803232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f3ddb-ff9c-422f-960f-982c63e21f71 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:22.803526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f3ddb-ff9c-422f-960f-982c63e21f71 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:22.803650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:22.805001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f3ddb-ff9c-422f-960f-982c63e21f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:22.885139 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2449/4885] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:22 2022] PUT /identity/v3/projects/45cf33d39f9840dba7c156229a189ad4/users/33d16fa2686945798d9017145a75338f/roles/ccdba8577b7b444db7e1d249ff6843c8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:22.885328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cb4f3ddb-ff9c-422f-960f-982c63e21f71 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:22.890630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cb4f3ddb-ff9c-422f-960f-982c63e21f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:22.892193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:23.149630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2437/4886] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:23.151014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f3ddb-ff9c-422f-960f-982c63e21f71 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:23.179534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f3ddb-ff9c-422f-960f-982c63e21f71 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:23.186511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:23.187339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:23.187934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:23.188533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:23.188969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f73e33-b6ea-41e1-aa08-018ae599b736 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:23.189910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:23.190468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:23.192792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:23.220655 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2438/4887] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:23.223047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:23.224333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:23.225031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:23.225312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:23.225589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/45cf33d39f9840dba7c156229a189ad4/users/33d16fa2686945798d9017145a75338f/roles/32dff4b508f04f6893e8fdc11e54c8e7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:23.237441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=45cf33d39f9840dba7c156229a189ad4, user_id=33d16fa2686945798d9017145a75338f, role_id=32dff4b508f04f6893e8fdc11e54c8e7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:23.240592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:23.248145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5802fea-74c9-4380-b917-f27ced74080e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:23.262670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:23.266813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:23.266813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:23.266813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:23.266813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:23.268694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:23.335056 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2450/4888] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:22 2022] PUT /identity/v3/projects/45cf33d39f9840dba7c156229a189ad4/users/33d16fa2686945798d9017145a75338f/roles/32dff4b508f04f6893e8fdc11e54c8e7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:23.339667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:23.427894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2439/4889] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:23 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:23.432023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:23.617767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b09edd-0de5-40af-8237-2054bc85862c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:23.772133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a598db-141a-4fb8-bfb2-5825fd22615a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:23.772620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a598db-141a-4fb8-bfb2-5825fd22615a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:23.772904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a598db-141a-4fb8-bfb2-5825fd22615a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:23.773175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a598db-141a-4fb8-bfb2-5825fd22615a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:23.773846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a598db-141a-4fb8-bfb2-5825fd22615a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:23.779257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a598db-141a-4fb8-bfb2-5825fd22615a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:23.787147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90cda-04e3-49a7-8224-c4baa7a8fc97 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:23.809503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:23.810379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:23.810480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:23.810778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:23.811303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:23.813281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:23.845244 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2451/4890] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:23 2022] GET /identity/v3/users => generated 8049 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:23.850176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b89f-795f-4bc7-b0b6-62ba4abad82a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:23.850469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b89f-795f-4bc7-b0b6-62ba4abad82a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:23.852763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b89f-795f-4bc7-b0b6-62ba4abad82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:23.938969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2440/4891] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:23 2022] POST /identity/v3/users => generated 283 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:23.942990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:23.962011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695103-a3a2-424a-a6bd-b63910597bb6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:23.968753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6229b89f-795f-4bc7-b0b6-62ba4abad82a None None] MFA Rules not processed for user `33d16fa2686945798d9017145a75338f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:23.972350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6229b89f-795f-4bc7-b0b6-62ba4abad82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:23.976725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:23.977422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:23.977700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:23.978260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:23.978934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:23.980548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:23.990237 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:24.019162 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2441/4892] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:23 2022] GET /identity/v3/roles => generated 1892 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:24.022985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:24.040387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9197632-3f84-4398-bbee-6bfde34176c5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:24.062797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1249aa7-f86d-4115-a2e7-d817af249a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:24.064052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249aa7-f86d-4115-a2e7-d817af249a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:24.064325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249aa7-f86d-4115-a2e7-d817af249a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:24.064594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249aa7-f86d-4115-a2e7-d817af249a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:24.065261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249aa7-f86d-4115-a2e7-d817af249a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:24.066898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249aa7-f86d-4115-a2e7-d817af249a1e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:24.080522 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:24.117172 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2442/4893] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:24 2022] GET /identity/v3/roles => generated 1892 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:24.118521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1e6ff-255c-41a2-ae39-a88127949faf None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:24.119095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1e6ff-255c-41a2-ae39-a88127949faf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:24.119095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1e6ff-255c-41a2-ae39-a88127949faf None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:24.131306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2443/4894] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:35:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:35:24.132189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1e6ff-255c-41a2-ae39-a88127949faf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:24.166665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1e6ff-255c-41a2-ae39-a88127949faf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:24.184740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa8b9-dc46-4314-8e28-c26d9cf0e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:24.185415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa8b9-dc46-4314-8e28-c26d9cf0e16c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:24.185692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa8b9-dc46-4314-8e28-c26d9cf0e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:24.185962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa8b9-dc46-4314-8e28-c26d9cf0e16c admin admin] PATH_INFO: `/v3/projects/60afb699b5ac4a23b730074ae7f122e8/users/3a627acc83764744b38eefbe9f7332de/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:24.219921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa8b9-dc46-4314-8e28-c26d9cf0e16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60afb699b5ac4a23b730074ae7f122e8, user_id=3a627acc83764744b38eefbe9f7332de, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:24.226338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa8b9-dc46-4314-8e28-c26d9cf0e16c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:24.244240 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2452/4895] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:24.245881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99596a-4854-4849-a68d-07d0337fd744 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:24.253244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99596a-4854-4849-a68d-07d0337fd744 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:24.253244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99596a-4854-4849-a68d-07d0337fd744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:24.317266 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2444/4896] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:24 2022] PUT /identity/v3/projects/60afb699b5ac4a23b730074ae7f122e8/users/3a627acc83764744b38eefbe9f7332de/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:24.320704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaca75-ce85-4ad7-8723-fd6bac009ec1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:24.321029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaca75-ce85-4ad7-8723-fd6bac009ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:24.321298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaca75-ce85-4ad7-8723-fd6bac009ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:24.363941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5aeaca75-ce85-4ad7-8723-fd6bac009ec1 None None] MFA Rules not processed for user `33d16fa2686945798d9017145a75338f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:24.365417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5aeaca75-ce85-4ad7-8723-fd6bac009ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:24.404434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bd99596a-4854-4849-a68d-07d0337fd744 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:24.405710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bd99596a-4854-4849-a68d-07d0337fd744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:24.516845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2445/4897] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:24.531284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:24.531562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:24.532370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:24.647282 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2453/4898] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:24.648589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99596a-4854-4849-a68d-07d0337fd744 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:24.676031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99596a-4854-4849-a68d-07d0337fd744 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:24.686513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:24.687357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:24.687667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:24.688222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:24.689083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:create_trust()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:24.690356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:24.691309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] MFA Rules not processed for user `3a627acc83764744b38eefbe9f7332de`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:24.692557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:24.956771 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2454/4899] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:35:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:24.957724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:24.965629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:25.026028 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2446/4900] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:25.032653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.037314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:25.043190 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:25.121733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296a7f8-8c03-4bdc-8f03-4183da82086d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.132342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.133230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.133230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.133459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.144849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a9633-ea23-417c-ba74-d1fa13f5a7bc tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.160110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.160846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.161219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.161589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.168044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:25.188970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.195232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.223659 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2447/4901] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:25.224530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.264415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872ce4-e873-4512-8177-68ec1cd25196 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.274279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.275255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.277342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.277342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.289409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:get_trust(trust_id=91ad1f0503e2492ba943ccb90edd7ae6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.291074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.298414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.300813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.307246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2448/4902] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:25 2022] GET /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6 => generated 859 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:25.307246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.324352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2455/4903] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:25.325484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.351999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5fcdc-ba93-41bf-ad15-057f64b95be4 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.365445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.367009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.367392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.367767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.384575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=91ad1f0503e2492ba943ccb90edd7ae6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.386205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.408841 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:25.409811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2456/4904] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:35:25 2022] GET /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles => generated 371 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:25.411873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.452262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed7df-4e78-4c47-95d7-4b397e23c0b1 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.475903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.478119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.478119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.478119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/ccdba8577b7b444db7e1d249ff6843c8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.496978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:get_role_for_trust(trust_id=91ad1f0503e2492ba943ccb90edd7ae6, role_id=ccdba8577b7b444db7e1d249ff6843c8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.500041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.511128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb8ff9-fca6-4fba-a9b6-33c2f3e20bb5 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.530167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2457/4905] 10.222.0.42 () {58 vars in 1368 bytes} [Sun Oct 23 01:35:25 2022] GET /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/ccdba8577b7b444db7e1d249ff6843c8 => generated 244 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:25.534263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.541568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.553555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.553555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.553555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.553555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.553555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.561773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b07c1-9cb4-4383-83b2-a7274841d564 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.579604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.579604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.579604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.580338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/ccdba8577b7b444db7e1d249ff6843c8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.588840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:get_role_for_trust(trust_id=91ad1f0503e2492ba943ccb90edd7ae6, role_id=ccdba8577b7b444db7e1d249ff6843c8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.591249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.620788 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2458/4906] 10.222.0.42 () {58 vars in 1369 bytes} [Sun Oct 23 01:35:25 2022] HEAD /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/ccdba8577b7b444db7e1d249ff6843c8 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 23 01:35:25.622833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.698260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd4e6-9573-4a41-b948-5a6555bb064d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.704920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.705692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.706182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.706457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/32dff4b508f04f6893e8fdc11e54c8e7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.707629 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2449/4907] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:25 2022] POST /identity/v3/projects => generated 367 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:25.718770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:get_role_for_trust(trust_id=91ad1f0503e2492ba943ccb90edd7ae6, role_id=32dff4b508f04f6893e8fdc11e54c8e7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.723813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.752420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Could not find role: 32dff4b508f04f6893e8fdc11e54c8e7.: keystone.exception.RoleNotFound: Could not find role: 32dff4b508f04f6893e8fdc11e54c8e7. Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:35:25.767009 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 32dff4b508f04f6893e8fdc11e54c8e7. Oct 23 01:35:25.768263 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:25.769008 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2459/4908] 10.222.0.42 () {58 vars in 1368 bytes} [Sun Oct 23 01:35:25 2022] GET /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/32dff4b508f04f6893e8fdc11e54c8e7 => generated 110 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:25.775534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.810780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad99cc-e0c5-43bc-af68-e519e98eea9a tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.890655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9885d-08ae-46a2-8c63-6deb3bfaa7da admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.895446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.895939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.896217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.896493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/32dff4b508f04f6893e8fdc11e54c8e7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.896870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.897601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.898026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.898530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.899477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.903400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.907549 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:25.915289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:get_role_for_trust(trust_id=91ad1f0503e2492ba943ccb90edd7ae6, role_id=32dff4b508f04f6893e8fdc11e54c8e7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.917563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Could not find role: 32dff4b508f04f6893e8fdc11e54c8e7.: keystone.exception.RoleNotFound: Could not find role: 32dff4b508f04f6893e8fdc11e54c8e7. Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:35:25.933330 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 32dff4b508f04f6893e8fdc11e54c8e7. Oct 23 01:35:25.934682 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:25.938715 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2460/4909] 10.222.0.42 () {58 vars in 1369 bytes} [Sun Oct 23 01:35:25 2022] HEAD /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6/roles/32dff4b508f04f6893e8fdc11e54c8e7 => generated 0 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 23 01:35:25.940283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:25.950425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4861c-4860-4251-abbb-100e82344f2d tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:25.956477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:25.958149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:25.958428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:25.958710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:25.968046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorizing `identity:delete_trust(trust_id=91ad1f0503e2492ba943ccb90edd7ae6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:25.970039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:26.133715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '91ad1f0503e2492ba943ccb90edd7ae6', 'request_id': 'req-83649266-5470-42b6-9101-707b1a5926f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:26.135754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '91ad1f0503e2492ba943ccb90edd7ae6', 'request_id': 'req-83649266-5470-42b6-9101-707b1a5926f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:26.136957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '91ad1f0503e2492ba943ccb90edd7ae6', 'request_id': 'req-83649266-5470-42b6-9101-707b1a5926f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:26.145285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2450/4910] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:25 2022] POST /identity/v3/users => generated 290 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:26.146882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:26.148652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:26.208807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540fd5c-def1-4271-9a01-0061ebc69eee admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:26.230585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:26.231220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:26.231499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:26.231770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:26.232423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:26.234162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:26.245808 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2461/4911] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:35:25 2022] DELETE /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:26.249870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:26.254361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:26.264102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2451/4912] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:26 2022] GET /identity/v3/roles => generated 1892 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:26.267326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:26.285393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83649266-5470-42b6-9101-707b1a5926f2 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:26.290465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c3af-66a2-43b1-88a3-04ee86f42560 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:26.291728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33d16fa2686945798d9017145a75338f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45cf33d39f9840dba7c156229a189ad4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-981106264', 'tempest-DelegatedRole-1135220403'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:26.292472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:26.292808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:26.293089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] PATH_INFO: `/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:26.303949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:26.304635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:26.304914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:26.305189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] PATH_INFO: `/v3/projects/9b63a4afc37346069a04a5c1b3988e3a/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Could not find trust: 91ad1f0503e2492ba943ccb90edd7ae6.: keystone.exception.TrustNotFound: Could not find trust: 91ad1f0503e2492ba943ccb90edd7ae6. Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 23 01:35:26.312232 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 91ad1f0503e2492ba943ccb90edd7ae6. Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:26.320284 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2462/4913] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:26 2022] GET /identity/v3/OS-TRUST/trusts/91ad1f0503e2492ba943ccb90edd7ae6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:26.324072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:26.327543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:26.342544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b63a4afc37346069a04a5c1b3988e3a, user_id=15b0c649b16749e4b5fa508f037a3022, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:26.345291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:26.486212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c0a8-c103-4327-97af-a9b35b7bafb8 tempest-TrustsV3TestJSON-1365180865 tempest-user-884951287] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:26.511167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2452/4914] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:26 2022] PUT /identity/v3/projects/9b63a4afc37346069a04a5c1b3988e3a/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:26.515853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:26.678688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529750a2-317e-4cb8-8c32-46505b1d5904 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:26.697805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:26.698728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:26.699211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:26.699667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:26.701266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:26.708433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:26.722013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:26.727771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:26.728056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:26.728342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/32dff4b508f04f6893e8fdc11e54c8e7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:26.738321 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2453/4915] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:26 2022] GET /identity/v3/roles => generated 1892 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:26.738552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=32dff4b508f04f6893e8fdc11e54c8e7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:26.745958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:26.746688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:26.782363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d6dda-838b-478a-8fda-2a76d41137c2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:26.788570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6ad64-d133-4ee9-9c22-71983de64c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:26.789476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ad64-d133-4ee9-9c22-71983de64c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:26.790015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ad64-d133-4ee9-9c22-71983de64c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:26.790470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ad64-d133-4ee9-9c22-71983de64c38 admin admin] PATH_INFO: `/v3/projects/9b63a4afc37346069a04a5c1b3988e3a/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:26.793118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6ad64-d133-4ee9-9c22-71983de64c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b63a4afc37346069a04a5c1b3988e3a, user_id=15b0c649b16749e4b5fa508f037a3022, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:26.796385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6ad64-d133-4ee9-9c22-71983de64c38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:26.899433 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:26.911547 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2454/4916] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:26 2022] PUT /identity/v3/projects/9b63a4afc37346069a04a5c1b3988e3a/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:26.930063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:26.930063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:26.931256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:26.988411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] MFA Rules not processed for user `15b0c649b16749e4b5fa508f037a3022`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:26.988411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:27.061091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 32dff4b508f04f6893e8fdc11e54c8e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:27.061537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:27.063509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:27.069319 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2463/4917] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:26 2022] DELETE /identity/v3/roles/32dff4b508f04f6893e8fdc11e54c8e7 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:27.072482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:27.079823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:27.147562 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:27.241514 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2455/4918] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:27.247483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:27.257472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:27.275434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1bf8b-eea8-4cac-b850-f4ce244d0fdd tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:27.298192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:27.299746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:27.302306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:27.303228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/ccdba8577b7b444db7e1d249ff6843c8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:27.308427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ccdba8577b7b444db7e1d249ff6843c8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:27.311876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:27.422099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7c93-3acd-452b-bf20-538793e1d255 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:27.578130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:27.579429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:27.579709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:27.580004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:27.580793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:27.582872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:27.692089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role ccdba8577b7b444db7e1d249ff6843c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:27.693058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:27.694433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:27.697886 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2464/4919] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:27 2022] DELETE /identity/v3/roles/ccdba8577b7b444db7e1d249ff6843c8 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:27.701852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:27.704853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:27.768259 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2456/4920] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:27 2022] POST /identity/v3/projects => generated 367 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:27.772344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:27.774185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:27.800245 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:27.857580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54164-735b-4fc1-a261-3a5cde80eb06 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:27.896239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d8b8-af73-4ccc-a091-88a4ff689cbf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:27.901594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:27.904124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:27.904498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:27.906039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:27.914922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:27.918432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:27.983638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:27.984441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:27.985433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:27.985765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users/33d16fa2686945798d9017145a75338f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:27.987035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_user(user_id=33d16fa2686945798d9017145a75338f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:27.989434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:28.015592 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2457/4921] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:27 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:28.023410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:28.035939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25620718-48f5-4010-ab0a-2177868078b4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:28.051358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:28.052298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:28.052651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:28.053004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:28.054054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:28.055417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:28.071293 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2458/4922] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:28.077560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:28.088553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda381-8f28-414c-9c2d-3596199a2702 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:28.094700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:28.096956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:28.097248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:28.097524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:28.098502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:28.100242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:28.115399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2459/4923] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:28.119664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:28.131127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0ced3-1db3-4eab-9a50-e90931a28ff4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:28.138192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67af495-0a4c-418b-80fa-0440128a5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:28.139083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af495-0a4c-418b-80fa-0440128a5bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:28.139827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af495-0a4c-418b-80fa-0440128a5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:28.139975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af495-0a4c-418b-80fa-0440128a5bd4 admin admin] PATH_INFO: `/v3/projects/b362f0592bc14f46ac2bac69d26f89d1/users/a63f2c9994a4486c993570e8d9b54d81/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:28.158553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67af495-0a4c-418b-80fa-0440128a5bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b362f0592bc14f46ac2bac69d26f89d1, user_id=a63f2c9994a4486c993570e8d9b54d81, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:28.170284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d16fa2686945798d9017145a75338f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.182964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67af495-0a4c-418b-80fa-0440128a5bd4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:28.186954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d16fa2686945798d9017145a75338f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.188050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d16fa2686945798d9017145a75338f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.273732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d16fa2686945798d9017145a75338f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.274798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d16fa2686945798d9017145a75338f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.280617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2460/4924] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:28 2022] PUT /identity/v3/projects/b362f0592bc14f46ac2bac69d26f89d1/users/a63f2c9994a4486c993570e8d9b54d81/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:28.292628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:28.293241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:28.293648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:28.315106 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2465/4925] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:27 2022] DELETE /identity/v3/users/33d16fa2686945798d9017145a75338f => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:28.316282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:28.318221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:28.333197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] MFA Rules not processed for user `a63f2c9994a4486c993570e8d9b54d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:28.337003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:28.410683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc028df-b4ac-4cb3-af22-118c631c3ee4 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:28.416660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:28.417639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:28.418207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:28.418708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/45cf33d39f9840dba7c156229a189ad4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:28.420124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45cf33d39f9840dba7c156229a189ad4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:28.422463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:28.426471 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2461/4926] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:28.427749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:28.429350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:28.539556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a61a3e-91a2-40e2-a383-617480429a8d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:28.549690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:28.549690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:28.549690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:28.550106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:28.551276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:28.554340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:28.701886 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:28.715623 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2462/4927] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:35:28 2022] POST /identity/v3/domains => generated 276 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:28.715623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:28.770694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cf33d39f9840dba7c156229a189ad4', 'request_id': 'req-b21407f2-4296-4090-b7ca-f781eb5d6933'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.781090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cf33d39f9840dba7c156229a189ad4', 'request_id': 'req-b21407f2-4296-4090-b7ca-f781eb5d6933'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.852383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ebcb-0034-4841-b69c-1cf923d3dc16 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:28.858424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cf33d39f9840dba7c156229a189ad4', 'request_id': 'req-b21407f2-4296-4090-b7ca-f781eb5d6933'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.864979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:28.865622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:28.865904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:28.867615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:28.876857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] The token cache is being invalidate because project 45cf33d39f9840dba7c156229a189ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:28.877425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.878230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:28.881259 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2466/4928] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:28 2022] DELETE /identity/v3/projects/45cf33d39f9840dba7c156229a189ad4 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:28.886966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:28.889436 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:28.890488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:28.890842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:28.896378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.025505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2463/4929] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:28 2022] POST /identity/v3/roles => generated 239 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:29.026476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.030026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:29.067603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8351351-5090-4b36-8c72-e27bcc4efb22 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.081113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21407f2-4296-4090-b7ca-f781eb5d6933 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.083382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.089166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.089166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.089166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/765acb5ab6314012af50496aedde2069/users/a63f2c9994a4486c993570e8d9b54d81/roles/37d21c719e4f41b19b452f721472e04b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.111956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=765acb5ab6314012af50496aedde2069, user_id=a63f2c9994a4486c993570e8d9b54d81, role_id=37d21c719e4f41b19b452f721472e04b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.126561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.218112 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2464/4930] 10.222.0.42 () {60 vars in 1480 bytes} [Sun Oct 23 01:35:29 2022] PUT /identity/v3/domains/765acb5ab6314012af50496aedde2069/users/a63f2c9994a4486c993570e8d9b54d81/roles/37d21c719e4f41b19b452f721472e04b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:29.219432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.221816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.223440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.223724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.225190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.226829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.232182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.360868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2467/4931] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:35:28 2022] POST /identity/v3/projects => generated 329 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:29.365322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.373581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9705fa-5924-41e5-a004-d688a6e2da6b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.449055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.450023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.450478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.450920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.454860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.454860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.524733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeddb8-ae57-46d4-b2ae-11fdaddf34e3 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.549407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.552487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.552487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.552487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.552487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.553947 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2465/4932] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:35:29 2022] POST /identity/v3/domains => generated 277 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:29.554695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.559422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.692501 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:29.703388 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2468/4933] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:29 2022] POST /identity/v3/users => generated 416 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:29.705445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.716360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b833557-e9e2-4523-8d02-67e931ce712c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.722466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.723054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.723430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.723945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.724690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.725179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929c80-3e75-435c-86f8-022dfbc6a785 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.726863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.755582 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:29.805631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.806417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.806520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.806925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.807699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.809470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.814466 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2466/4934] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:29 2022] POST /identity/v3/roles => generated 239 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:29.816702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.832067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6fa39-e05c-4bc6-9579-854e14645ee6 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.840898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.841729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.842724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.842724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.843144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.845676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.904742 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2469/4935] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:29 2022] POST /identity/v3/roles => generated 243 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:29.909450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.921481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c26d4-12cf-47b3-ad4f-7d86b815ebc6 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:29.940389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:29.940389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:29.940389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:29.940664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:29.940664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:29.940664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:29.968512 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2467/4936] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:35:29 2022] POST /identity/v3/groups => generated 326 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:29.970317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:29.983188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1ec04-cb76-4101-b7a2-505f826bd3df tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:30.024792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:30.025016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:30.025267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:30.025466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups/a88f21c7e8f54d2f8138c835befca0c4/users/a63f2c9994a4486c993570e8d9b54d81` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:30.052226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a88f21c7e8f54d2f8138c835befca0c4, user_id=a63f2c9994a4486c993570e8d9b54d81)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:30.054208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:30.084705 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2470/4937] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:29 2022] POST /identity/v3/roles => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:30.085798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:30.108829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19237f69-c0c4-490d-b78d-a697dcce5cfc tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:30.118322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:30.118925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:30.119585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:30.119585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/49eed75340eb4c6eaea116b179e3adde/users/3bfe7e75798143349f7ff5fd7c42b327/roles/6e39fe5ac54845d28015ae4bfaf7c9e0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:30.156879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=49eed75340eb4c6eaea116b179e3adde, user_id=3bfe7e75798143349f7ff5fd7c42b327, role_id=6e39fe5ac54845d28015ae4bfaf7c9e0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:30.159590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:30.195881 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2468/4938] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:35:29 2022] PUT /identity/v3/groups/a88f21c7e8f54d2f8138c835befca0c4/users/a63f2c9994a4486c993570e8d9b54d81 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:30.200097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:30.251031 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2471/4939] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:30 2022] PUT /identity/v3/projects/49eed75340eb4c6eaea116b179e3adde/users/3bfe7e75798143349f7ff5fd7c42b327/roles/6e39fe5ac54845d28015ae4bfaf7c9e0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:30.255784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:30.396797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a897d-71ae-4427-b6de-bc8c547037a3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:30.410779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f51f6-7459-4525-bbd4-a9aea0710a6c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:30.418647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:30.419307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:30.419590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:30.419872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/49eed75340eb4c6eaea116b179e3adde/users/3bfe7e75798143349f7ff5fd7c42b327/roles/b376caa8fe704ac580d33304e712e89a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:30.426741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=49eed75340eb4c6eaea116b179e3adde, user_id=3bfe7e75798143349f7ff5fd7c42b327, role_id=b376caa8fe704ac580d33304e712e89a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:30.436400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:30.473167 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:30.497316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:30.498464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:30.498961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:30.499282 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2472/4940] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:30 2022] PUT /identity/v3/projects/49eed75340eb4c6eaea116b179e3adde/users/3bfe7e75798143349f7ff5fd7c42b327/roles/b376caa8fe704ac580d33304e712e89a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:30.499707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/676be1ccda7b4cd48f294c3467a49713/groups/a88f21c7e8f54d2f8138c835befca0c4/roles/abfdd3f605a44c68ab309876280ea066` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:30.503385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:30.503573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=676be1ccda7b4cd48f294c3467a49713, group_id=a88f21c7e8f54d2f8138c835befca0c4, role_id=abfdd3f605a44c68ab309876280ea066)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:30.507144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:30.607471 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2469/4941] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:30 2022] PUT /identity/v3/domains/676be1ccda7b4cd48f294c3467a49713/groups/a88f21c7e8f54d2f8138c835befca0c4/roles/abfdd3f605a44c68ab309876280ea066 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:30.609032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:30.664579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f19c4-c99f-4589-aade-2f32d5a51d42 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:30.743419 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:30.746098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11832007-52ce-45f2-999c-43c2ab668d48 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:30.754324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:30.755274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:30.756544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:30.757209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:30.759490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:30.763803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:30.780501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6698-313c-435f-8608-5256d4996548 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:30.781163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6698-313c-435f-8608-5256d4996548 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:30.781547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6698-313c-435f-8608-5256d4996548 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:30.781807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6698-313c-435f-8608-5256d4996548 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:30.782562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a6698-313c-435f-8608-5256d4996548 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:30.784528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a6698-313c-435f-8608-5256d4996548 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:30.819902 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2473/4942] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:30 2022] GET /identity/v3/users => generated 8882 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:30.824738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac83bf-a7e6-4c95-8490-7ea20f436274 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:30.825083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac83bf-a7e6-4c95-8490-7ea20f436274 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:30.825425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac83bf-a7e6-4c95-8490-7ea20f436274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:30.849075 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2470/4943] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:35:30 2022] POST /identity/v3/domains => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:30.858828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:30.927056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8dac83bf-a7e6-4c95-8490-7ea20f436274 None None] MFA Rules not processed for user `3bfe7e75798143349f7ff5fd7c42b327`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:30.928464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8dac83bf-a7e6-4c95-8490-7ea20f436274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:31.021281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b3e14-ae4a-44f6-8f59-34e968b824c3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:31.023704 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:31.030686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:31.032414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.034305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.035055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.036711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:31.038977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:31.060907 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2474/4944] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:31.071404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed1214-c5db-4152-bbe4-fe7d2fe89bb5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.071699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed1214-c5db-4152-bbe4-fe7d2fe89bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.072005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed1214-c5db-4152-bbe4-fe7d2fe89bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.094377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c9ed1214-c5db-4152-bbe4-fe7d2fe89bb5 None None] MFA Rules not processed for user `3bfe7e75798143349f7ff5fd7c42b327`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:31.095664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c9ed1214-c5db-4152-bbe4-fe7d2fe89bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:31.107345 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2475/4945] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:31 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:31.108823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed1214-c5db-4152-bbe4-fe7d2fe89bb5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:31.119797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed1214-c5db-4152-bbe4-fe7d2fe89bb5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:31.121378 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2471/4946] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:30 2022] POST /identity/v3/roles => generated 239 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:31.128399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfe7e75798143349f7ff5fd7c42b327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49eed75340eb4c6eaea116b179e3adde', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-449964238', 'tempest-NotDelegatedRole-430162754'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:31.128399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.128399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.128967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.129322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:31.130092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] RBAC: Authorizing `identity:create_trust()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:31.131275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:31.145140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4b544-a40d-499c-8dae-0dd201c5d6dc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:31.170824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:31.172581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.172879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.173156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/caf36642eee04eff9b7fb84679c3cebd/users/a63f2c9994a4486c993570e8d9b54d81/roles/07b635b1e6a049c2b0928bba29da62f7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.192191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=caf36642eee04eff9b7fb84679c3cebd, user_id=a63f2c9994a4486c993570e8d9b54d81, role_id=07b635b1e6a049c2b0928bba29da62f7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:31.194883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 23 01:35:31.248207 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 23 01:35:31.249406 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 23 01:35:31.250920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 23 01:35:31.250920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 23 01:35:31.250920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 23 01:35:31.250920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 23 01:35:31.250920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 23 01:35:31.250920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:31.252959 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2476/4947] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:35:31 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 145 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 23 01:35:31.253871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:31.300910 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2472/4948] 10.222.0.42 () {60 vars in 1480 bytes} [Sun Oct 23 01:35:31 2022] PUT /identity/v3/domains/caf36642eee04eff9b7fb84679c3cebd/users/a63f2c9994a4486c993570e8d9b54d81/roles/07b635b1e6a049c2b0928bba29da62f7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:31.305298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:31.353925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eb329-5d75-4bdf-b7e8-d332d4aaaec8 tempest-TrustsV3TestJSON-1144835606 tempest-user-1360144080] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:31.375772 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:31.380186 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:31.399118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b11b2-bcef-4c7a-bb95-d7366b2b9b13 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:31.409493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:31.410960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.411498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.412011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.413415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:31.416260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:31.434909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:31.435554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.435833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.436105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/b376caa8fe704ac580d33304e712e89a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.437532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b376caa8fe704ac580d33304e712e89a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:31.439284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:31.542549 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2473/4949] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:35:31 2022] POST /identity/v3/domains => generated 276 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:31.545846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:31.654433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role b376caa8fe704ac580d33304e712e89a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:31.654944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:31.656248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:31.661892 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2477/4950] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:31 2022] DELETE /identity/v3/roles/b376caa8fe704ac580d33304e712e89a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:31.663503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010fb5-e3c6-4dd0-a200-76729e14fac1 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:31.665781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:31.667354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:31.775922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:31.776926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.777339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.782526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.782526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:31.782526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:31.823936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1b65-1592-4ebf-a503-83a6a633a2a0 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:31.834375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:31.838268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:31.839006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:31.839581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/6e39fe5ac54845d28015ae4bfaf7c9e0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:31.843427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6e39fe5ac54845d28015ae4bfaf7c9e0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:31.849588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:32.105157 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2474/4951] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:31 2022] POST /identity/v3/roles => generated 240 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:32.105702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:32.110829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:32.206280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 6e39fe5ac54845d28015ae4bfaf7c9e0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:32.206686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:32.208069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:32.210744 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2478/4952] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:31 2022] DELETE /identity/v3/roles/6e39fe5ac54845d28015ae4bfaf7c9e0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:32.211534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:32.233379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:32.265416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b284-2beb-4efb-a468-49341719f2ba tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:32.333939 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:32.361558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:32.362226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:32.362559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:32.362836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:32.366419 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:32.368892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:32.399531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f465c-79ba-4de8-897c-287875446fbe tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:32.416212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:32.416631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:32.416918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:32.417194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:32.417842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:32.419727 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:32.419727 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:35:32.419727 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:35:32.421021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:32.570069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:32.571525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:32.593840 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2475/4953] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:32.596483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:32.597003 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2479/4954] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:35:32 2022] POST /identity/v3/groups => generated 326 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:32.601776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:32.603824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:32.617659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf428-836a-41de-aba2-188ca0216188 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:32.623783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:32.624647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:32.628539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:32.628539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups/56f16c710dca47c590563f0a27c1d350/users/a63f2c9994a4486c993570e8d9b54d81` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:32.634749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=56f16c710dca47c590563f0a27c1d350, user_id=a63f2c9994a4486c993570e8d9b54d81)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:32.636029 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:32.636029 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:35:32.636029 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:35:32.637354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:32.704101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cae696-da8c-432a-8726-a41d23e00d23 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:32.712617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:32.715775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:32.716312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:32.717839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users/3bfe7e75798143349f7ff5fd7c42b327` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:32.720518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3bfe7e75798143349f7ff5fd7c42b327)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:32.724861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:32.780464 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2480/4955] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:35:32 2022] PUT /identity/v3/groups/56f16c710dca47c590563f0a27c1d350/users/a63f2c9994a4486c993570e8d9b54d81 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:32.785183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:32.873366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfe7e75798143349f7ff5fd7c42b327'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:32.891938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfe7e75798143349f7ff5fd7c42b327'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:32.892824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfe7e75798143349f7ff5fd7c42b327'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:32.935920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3daa2-9b65-4d59-8f15-c35f643be32b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:32.966971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfe7e75798143349f7ff5fd7c42b327'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:32.967642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfe7e75798143349f7ff5fd7c42b327'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:32.979506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:32.980117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:32.980399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:32.980673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/637643e6c36d490383bff301fd605b0d/groups/56f16c710dca47c590563f0a27c1d350/roles/32d6eb9a09cd434fb340f5f26a1446fd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:32.986350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=637643e6c36d490383bff301fd605b0d, group_id=56f16c710dca47c590563f0a27c1d350, role_id=32d6eb9a09cd434fb340f5f26a1446fd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:32.989109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:32.998630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2476/4956] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:32 2022] DELETE /identity/v3/users/3bfe7e75798143349f7ff5fd7c42b327 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:33.007782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:33.012537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:33.024158 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:33.061400 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2481/4957] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:32 2022] PUT /identity/v3/domains/637643e6c36d490383bff301fd605b0d/groups/56f16c710dca47c590563f0a27c1d350/roles/32d6eb9a09cd434fb340f5f26a1446fd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:33.066643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:33.070366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:33.127484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1b2c3-5cc5-4c61-b8d2-3040e40c33df tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:33.249420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf98d7-18a2-4ddc-a14c-295f8c17f593 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:33.250240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:33.251237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:33.253737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:33.253737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/49eed75340eb4c6eaea116b179e3adde` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:33.253992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49eed75340eb4c6eaea116b179e3adde)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:33.255078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a63f2c9994a4486c993570e8d9b54d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b362f0592bc14f46ac2bac69d26f89d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:33.255714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:33.255996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:33.256276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] PATH_INFO: `/v3/auth/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:33.256858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:33.257424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:33.258012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:33.291582 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:33.347337 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2482/4958] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:35:33 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:33.348680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:33.350816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:33.393184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49eed75340eb4c6eaea116b179e3adde', 'request_id': 'req-4a317fc1-899f-4733-8256-db8820e03571'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:33.412330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49eed75340eb4c6eaea116b179e3adde', 'request_id': 'req-4a317fc1-899f-4733-8256-db8820e03571'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:33.482706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061d80f-5de3-440a-b878-4468b09ff91b tempest-TokensV3TestJSON-972908422 tempest-TokensV3TestJSON-972908422-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:33.497304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49eed75340eb4c6eaea116b179e3adde', 'request_id': 'req-4a317fc1-899f-4733-8256-db8820e03571'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:33.514981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] The token cache is being invalidate because project 49eed75340eb4c6eaea116b179e3adde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:33.515599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:33.516504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:33.522935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2477/4959] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:33 2022] DELETE /identity/v3/projects/49eed75340eb4c6eaea116b179e3adde => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:33.524405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:33.526032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:33.649588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a317fc1-899f-4733-8256-db8820e03571 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:33.660181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:33.660181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:33.660181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:33.660577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:33.660577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:33.660784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:33.661143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:33.661468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:33.661752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:33.662060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/637643e6c36d490383bff301fd605b0d/groups/56f16c710dca47c590563f0a27c1d350/roles/32d6eb9a09cd434fb340f5f26a1446fd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:33.672933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=637643e6c36d490383bff301fd605b0d, group_id=56f16c710dca47c590563f0a27c1d350, role_id=32d6eb9a09cd434fb340f5f26a1446fd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:33.676034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:33.684980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 32d6eb9a09cd434fb340f5f26a1446fd was removed from group 56f16c710dca47c590563f0a27c1d350 on domain 637643e6c36d490383bff301fd605b0d. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:33.685264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:33.686164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:33.830648 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2483/4960] 10.222.0.42 () {58 vars in 1467 bytes} [Sun Oct 23 01:35:33 2022] DELETE /identity/v3/domains/637643e6c36d490383bff301fd605b0d/groups/56f16c710dca47c590563f0a27c1d350/roles/32d6eb9a09cd434fb340f5f26a1446fd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:33.831704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:33.833057 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2478/4961] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:35:33 2022] POST /identity/v3/projects => generated 329 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:33.834898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:33.836774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:33.842189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:33.997758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffd37b-74b5-462a-a630-73e2ce69f889 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:34.008614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:34.012767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96ee1-ebef-4b16-b4dc-7274e457cb18 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:34.013222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:34.013222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:34.013222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups/56f16c710dca47c590563f0a27c1d350/users/a63f2c9994a4486c993570e8d9b54d81` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:34.017567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=56f16c710dca47c590563f0a27c1d350, user_id=a63f2c9994a4486c993570e8d9b54d81)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:34.022030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:34.092386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:34.093058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:34.093468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:34.094215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:34.097214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:34.131997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a63f2c9994a4486c993570e8d9b54d81'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:34.184439 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:34.264415 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2479/4962] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:35:33 2022] DELETE /identity/v3/groups/56f16c710dca47c590563f0a27c1d350/users/a63f2c9994a4486c993570e8d9b54d81 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:34.265091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:34.269598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:34.290495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:34.298880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:34.323463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2484/4963] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:34.327675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:34.348573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479d2a3-6427-467e-9ed6-524b3a1bfd50 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:34.356310 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:34.419645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9118e3-c659-4221-8bbb-e583b3999fcc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:34.427887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:34.437446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:34.437446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:34.437446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:34.437446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:34.437446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:34.476148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:34.476799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:34.479763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:34.480158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups/56f16c710dca47c590563f0a27c1d350` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:34.481460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_group(group_id=56f16c710dca47c590563f0a27c1d350)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:34.482537 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:35:34.482537 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:35:34.482537 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:35:34.483743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:34.571086 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2480/4964] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:34 2022] POST /identity/v3/users => generated 416 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:34.575680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:34.600524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0fcaf-845a-4c0f-b46b-bbc1ec2a80f8 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:34.616303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:34.618898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:34.620188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:34.620923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:34.622401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:34.625727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:34.702544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2485/4965] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:35:34 2022] DELETE /identity/v3/groups/56f16c710dca47c590563f0a27c1d350 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:34.708478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:34.743450 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2481/4966] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:34 2022] POST /identity/v3/roles => generated 243 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:34.747347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:34.790995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc980a43-6e28-471b-81fd-ceb016f3133a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:34.932748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103d8db-a8bb-46e8-91ee-ec95edc5a9a5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:34.943476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:34.947528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:34.947528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:34.947528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles/32d6eb9a09cd434fb340f5f26a1446fd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:34.947528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_role(role_id=32d6eb9a09cd434fb340f5f26a1446fd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:34.948026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:34.976046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a42c7b-3f57-4fd1-a934-1322975e8beb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:34.976887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42c7b-3f57-4fd1-a934-1322975e8beb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:34.977267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42c7b-3f57-4fd1-a934-1322975e8beb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:34.977658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42c7b-3f57-4fd1-a934-1322975e8beb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:34.978449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a42c7b-3f57-4fd1-a934-1322975e8beb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:34.980366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a42c7b-3f57-4fd1-a934-1322975e8beb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:35.083422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 32d6eb9a09cd434fb340f5f26a1446fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:35.083422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:35.085363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:35.088608 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2482/4967] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:34 2022] POST /identity/v3/roles => generated 246 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:35.088608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:35.088608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:35.088608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:35.090832 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2486/4968] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:34 2022] DELETE /identity/v3/roles/32d6eb9a09cd434fb340f5f26a1446fd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:35.091652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:35.094791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:35.144932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:35.148437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:35.195066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660ac3c-70a4-4012-9a05-56089d68e05f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:35.201056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:35.201898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:35.202215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:35.203058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/59b5c990bb49413a80ea9619c346e0e8/users/d6446aae569448b28464ceabbd3aab8e/roles/74b8709f90f740389d110ba0c7f95868` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:35.225544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=59b5c990bb49413a80ea9619c346e0e8, user_id=d6446aae569448b28464ceabbd3aab8e, role_id=74b8709f90f740389d110ba0c7f95868)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:35.228620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:35.284216 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2483/4969] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:35.285169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:35.287118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:35.305125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2487/4970] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:35 2022] PUT /identity/v3/projects/59b5c990bb49413a80ea9619c346e0e8/users/d6446aae569448b28464ceabbd3aab8e/roles/74b8709f90f740389d110ba0c7f95868 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:35.306290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:35.311120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:35.407882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348979a-90db-41cd-b8c9-2088c523dbb4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:35.413013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17cd2e-9f16-4de6-81d8-f01cf7935676 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:35.422494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:35.422494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:35.423056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:35.423317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:35.508624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:35.510492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:35.520636 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2488/4971] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:35:35.521408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:35.564707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:35.565453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:35.565799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:35.566160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/637643e6c36d490383bff301fd605b0d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:35.567939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=637643e6c36d490383bff301fd605b0d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:35.569793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:35.601002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '637643e6c36d490383bff301fd605b0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:35.601876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '637643e6c36d490383bff301fd605b0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:35.618284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cef45-32bb-4b96-acc8-24044c4c5058 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:35.716186 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:35.737062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:35.737062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:35.737062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:35.737928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/59b5c990bb49413a80ea9619c346e0e8/users/d6446aae569448b28464ceabbd3aab8e/roles/63e3a14a0f2a4359a9823f204f70c646` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:35.738156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '637643e6c36d490383bff301fd605b0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:35.738775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '637643e6c36d490383bff301fd605b0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:35.740577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=59b5c990bb49413a80ea9619c346e0e8, user_id=d6446aae569448b28464ceabbd3aab8e, role_id=63e3a14a0f2a4359a9823f204f70c646)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:35.741904 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2484/4972] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:35 2022] PATCH /identity/v3/domains/637643e6c36d490383bff301fd605b0d => generated 277 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:35.746469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:35.748313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:35.751721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:35.844925 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2489/4973] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:35 2022] PUT /identity/v3/projects/59b5c990bb49413a80ea9619c346e0e8/users/d6446aae569448b28464ceabbd3aab8e/roles/63e3a14a0f2a4359a9823f204f70c646 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:35.852320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:35.852320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:35.855367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169afaed-ba3d-4a5c-8bf0-184d0e7b7aee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:36.012410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef834b-ceb6-438c-be3b-0a8ace5fbdeb tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:36.014788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:36.015643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.016021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.017062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/637643e6c36d490383bff301fd605b0d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.028225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd1691-4595-47af-85b1-860ac11ce56e tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:36.029003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1691-4595-47af-85b1-860ac11ce56e tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.029419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1691-4595-47af-85b1-860ac11ce56e tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.029781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd1691-4595-47af-85b1-860ac11ce56e tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.030654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd1691-4595-47af-85b1-860ac11ce56e tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:36.035289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd1691-4595-47af-85b1-860ac11ce56e tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:36.039904 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:36.045713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=637643e6c36d490383bff301fd605b0d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:36.048005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:36.085845 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2490/4974] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:35 2022] GET /identity/v3/users => generated 8882 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:36.091029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c9ca0-24a1-44a1-b5d6-276a5834fa12 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.091318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c9ca0-24a1-44a1-b5d6-276a5834fa12 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.091678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c9ca0-24a1-44a1-b5d6-276a5834fa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.103077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '637643e6c36d490383bff301fd605b0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.114235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '637643e6c36d490383bff301fd605b0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.183862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c09c9ca0-24a1-44a1-b5d6-276a5834fa12 None None] MFA Rules not processed for user `d6446aae569448b28464ceabbd3aab8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:36.186609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c09c9ca0-24a1-44a1-b5d6-276a5834fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:36.288546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637643e6c36d490383bff301fd605b0d', 'request_id': 'req-abb61135-584b-4b86-a64f-9c041f0a8994'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.310022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637643e6c36d490383bff301fd605b0d', 'request_id': 'req-abb61135-584b-4b86-a64f-9c041f0a8994'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.346138 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2491/4975] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:36.355322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6244-b6f1-4990-aaf2-d164a1e24d90 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.355630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6244-b6f1-4990-aaf2-d164a1e24d90 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.356082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb6244-b6f1-4990-aaf2-d164a1e24d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.392390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-eccb6244-b6f1-4990-aaf2-d164a1e24d90 None None] MFA Rules not processed for user `d6446aae569448b28464ceabbd3aab8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:36.394717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eccb6244-b6f1-4990-aaf2-d164a1e24d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:36.417571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637643e6c36d490383bff301fd605b0d', 'request_id': 'req-abb61135-584b-4b86-a64f-9c041f0a8994'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.437911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] The token cache is being invalidate because project 637643e6c36d490383bff301fd605b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:36.438239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.441732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.457162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '637643e6c36d490383bff301fd605b0d', 'request_id': 'req-abb61135-584b-4b86-a64f-9c041f0a8994'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.459266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '637643e6c36d490383bff301fd605b0d', 'request_id': 'req-abb61135-584b-4b86-a64f-9c041f0a8994'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.465226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '637643e6c36d490383bff301fd605b0d', 'request_id': 'req-abb61135-584b-4b86-a64f-9c041f0a8994'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.475769 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2485/4976] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:35:35 2022] DELETE /identity/v3/domains/637643e6c36d490383bff301fd605b0d => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:36.481060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:36.483940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:36.497530 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2492/4977] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:36.504108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6244-b6f1-4990-aaf2-d164a1e24d90 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:36.517613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb6244-b6f1-4990-aaf2-d164a1e24d90 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:36.532677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:36.533457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.533796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.534097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.534725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:create_trust()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:36.535909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:36.578572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb61135-584b-4b86-a64f-9c041f0a8994 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:36.589640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:36.593079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.593459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.594325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/caf36642eee04eff9b7fb84679c3cebd/users/a63f2c9994a4486c993570e8d9b54d81/roles/07b635b1e6a049c2b0928bba29da62f7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.596678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=caf36642eee04eff9b7fb84679c3cebd, user_id=a63f2c9994a4486c993570e8d9b54d81, role_id=07b635b1e6a049c2b0928bba29da62f7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:36.603681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:36.622972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 07b635b1e6a049c2b0928bba29da62f7 was removed from user a63f2c9994a4486c993570e8d9b54d81 on domain caf36642eee04eff9b7fb84679c3cebd. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:36.623247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.624049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.739967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2486/4978] 10.222.0.42 () {58 vars in 1464 bytes} [Sun Oct 23 01:35:36 2022] DELETE /identity/v3/domains/caf36642eee04eff9b7fb84679c3cebd/users/a63f2c9994a4486c993570e8d9b54d81/roles/07b635b1e6a049c2b0928bba29da62f7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:36.744965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:36.746452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:36.822570 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2493/4979] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:35:36 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:36.827423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:36.830354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:36.842836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f240195-62fb-4ac8-811f-17d093e5ded5 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:36.852216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49938f4-fa0f-47b6-b59f-4a12841cc7ee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:36.865426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:36.867191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.867339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.867593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles/07b635b1e6a049c2b0928bba29da62f7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.873086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_role(role_id=07b635b1e6a049c2b0928bba29da62f7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:36.875114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:36.910824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:36.914345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.914345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.914345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.919407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:get_trust(trust_id=bbfa92c5c73f40f18e885e5d4c195c0e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:36.921569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:36.931908 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2494/4980] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:36 2022] GET /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e => generated 833 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:36.935206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:36.947221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428141c-d3ba-458f-8b36-7047a83f1e29 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:36.951683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:36.952574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:36.953565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:36.953689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:36.959812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=bbfa92c5c73f40f18e885e5d4c195c0e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:36.961292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:36.971412 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2495/4981] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:35:36 2022] GET /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles => generated 370 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:36.977621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 07b635b1e6a049c2b0928bba29da62f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:36.978201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.982550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:36.986604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:36.990607 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2487/4982] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:36 2022] DELETE /identity/v3/roles/07b635b1e6a049c2b0928bba29da62f7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:36.995503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:36.999245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9f887-9e4f-4f25-88be-5316374f7bfe tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.000463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.028798 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:37.059658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.060394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.061289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.061289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/74b8709f90f740389d110ba0c7f95868` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.068272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bbfa92c5c73f40f18e885e5d4c195c0e, role_id=74b8709f90f740389d110ba0c7f95868)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.069894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.077682 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2496/4983] 10.222.0.42 () {58 vars in 1368 bytes} [Sun Oct 23 01:35:36 2022] GET /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/74b8709f90f740389d110ba0c7f95868 => generated 243 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:37.082131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.085767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.098549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc879ae-ec4e-4a05-86a5-e1a513d7b24c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.102199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29761a-93e9-4e26-9830-48bc2650a0cd tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.104483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.105313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.105596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.105875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/caf36642eee04eff9b7fb84679c3cebd` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.107858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=caf36642eee04eff9b7fb84679c3cebd)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.109097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.109696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.114589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.114589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.114589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/74b8709f90f740389d110ba0c7f95868` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.119631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bbfa92c5c73f40f18e885e5d4c195c0e, role_id=74b8709f90f740389d110ba0c7f95868)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.121613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.142514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.143268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.158438 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2497/4984] 10.222.0.42 () {58 vars in 1369 bytes} [Sun Oct 23 01:35:37 2022] HEAD /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/74b8709f90f740389d110ba0c7f95868 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:37.162580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.165297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.181566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1896d-596b-408c-8200-fa76f7015389 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.240754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.241329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.241602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.241870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/63e3a14a0f2a4359a9823f204f70c646` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.248206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bbfa92c5c73f40f18e885e5d4c195c0e, role_id=63e3a14a0f2a4359a9823f204f70c646)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.250385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Could not find role: 63e3a14a0f2a4359a9823f204f70c646.: keystone.exception.RoleNotFound: Could not find role: 63e3a14a0f2a4359a9823f204f70c646. Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:35:37.262973 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 63e3a14a0f2a4359a9823f204f70c646. Oct 23 01:35:37.264412 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:37.264896 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2498/4985] 10.222.0.42 () {58 vars in 1368 bytes} [Sun Oct 23 01:35:37 2022] GET /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/63e3a14a0f2a4359a9823f204f70c646 => generated 110 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:37.266888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.267539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.269150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.271933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.272087 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2488/4986] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:36 2022] PATCH /identity/v3/domains/caf36642eee04eff9b7fb84679c3cebd => generated 276 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:37.275675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.277675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.287388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503e20f-2f00-461f-8e18-3ab36d692f03 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.295990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.297315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.297886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.298386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/63e3a14a0f2a4359a9823f204f70c646` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.308409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bbfa92c5c73f40f18e885e5d4c195c0e, role_id=63e3a14a0f2a4359a9823f204f70c646)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.310361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Could not find role: 63e3a14a0f2a4359a9823f204f70c646.: keystone.exception.RoleNotFound: Could not find role: 63e3a14a0f2a4359a9823f204f70c646. Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:35:37.325048 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 63e3a14a0f2a4359a9823f204f70c646. Oct 23 01:35:37.335648 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:37.335648 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2499/4987] 10.222.0.42 () {58 vars in 1369 bytes} [Sun Oct 23 01:35:37 2022] HEAD /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e/roles/63e3a14a0f2a4359a9823f204f70c646 => generated 0 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:37.340541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.351137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fc928-cc93-4b76-bfb2-3f94c5f7b125 tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.356391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.357166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.357661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.357967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.363961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8854d-c133-4398-b6ba-646172f49d25 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.366420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorizing `identity:delete_trust(trust_id=bbfa92c5c73f40f18e885e5d4c195c0e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.368207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.369118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.370002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.370508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.370886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/caf36642eee04eff9b7fb84679c3cebd` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.384666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=caf36642eee04eff9b7fb84679c3cebd)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.387930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.417450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.418605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.497190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bbfa92c5c73f40f18e885e5d4c195c0e', 'request_id': 'req-0d3c2f37-b339-4008-a2c7-caf3c28a937a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.498246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bbfa92c5c73f40f18e885e5d4c195c0e', 'request_id': 'req-0d3c2f37-b339-4008-a2c7-caf3c28a937a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.498820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'bbfa92c5c73f40f18e885e5d4c195c0e', 'request_id': 'req-0d3c2f37-b339-4008-a2c7-caf3c28a937a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.549469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd', 'request_id': 'req-e3d0da00-161f-425e-9c60-ab92ab95329b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.556770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd', 'request_id': 'req-e3d0da00-161f-425e-9c60-ab92ab95329b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.595715 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2500/4988] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:35:37 2022] DELETE /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:37.599532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.601371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.613885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c2f37-b339-4008-a2c7-caf3c28a937a tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.677229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6446aae569448b28464ceabbd3aab8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59b5c990bb49413a80ea9619c346e0e8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-974377610', 'tempest-NotDelegatedRole-326652713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.678342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.678926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.679422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] PATH_INFO: `/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.680322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd', 'request_id': 'req-e3d0da00-161f-425e-9c60-ab92ab95329b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.695215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] The token cache is being invalidate because project caf36642eee04eff9b7fb84679c3cebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:37.695695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.696504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.706128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd', 'request_id': 'req-e3d0da00-161f-425e-9c60-ab92ab95329b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.706963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd', 'request_id': 'req-e3d0da00-161f-425e-9c60-ab92ab95329b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Could not find trust: bbfa92c5c73f40f18e885e5d4c195c0e.: keystone.exception.TrustNotFound: Could not find trust: bbfa92c5c73f40f18e885e5d4c195c0e. Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 23 01:35:37.708231 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: bbfa92c5c73f40f18e885e5d4c195c0e. Oct 23 01:35:37.709532 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:37.715124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'caf36642eee04eff9b7fb84679c3cebd', 'request_id': 'req-e3d0da00-161f-425e-9c60-ab92ab95329b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.719551 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2501/4989] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:37 2022] GET /identity/v3/OS-TRUST/trusts/bbfa92c5c73f40f18e885e5d4c195c0e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 23 01:35:37.720719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.722843 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2489/4990] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:35:37 2022] DELETE /identity/v3/domains/caf36642eee04eff9b7fb84679c3cebd => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:37.724184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.726268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:37.729769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:37.826322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0da00-161f-425e-9c60-ab92ab95329b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.829411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353e943-6770-449a-b175-27bc8f3c12bc tempest-TrustsV3TestJSON-1558426116 tempest-user-1658883819] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:37.838779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.839690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.840208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.840589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/63e3a14a0f2a4359a9823f204f70c646` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.842405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=63e3a14a0f2a4359a9823f204f70c646)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.844932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.857207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:37.860366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:37.869855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:37.869855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/676be1ccda7b4cd48f294c3467a49713/groups/a88f21c7e8f54d2f8138c835befca0c4/roles/abfdd3f605a44c68ab309876280ea066` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:37.869855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=676be1ccda7b4cd48f294c3467a49713, group_id=a88f21c7e8f54d2f8138c835befca0c4, role_id=abfdd3f605a44c68ab309876280ea066)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:37.869855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:37.879471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role abfdd3f605a44c68ab309876280ea066 was removed from group a88f21c7e8f54d2f8138c835befca0c4 on domain 676be1ccda7b4cd48f294c3467a49713. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:37.880079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:37.882652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:38.012113 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:38.024192 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2490/4991] 10.222.0.42 () {58 vars in 1467 bytes} [Sun Oct 23 01:35:37 2022] DELETE /identity/v3/domains/676be1ccda7b4cd48f294c3467a49713/groups/a88f21c7e8f54d2f8138c835befca0c4/roles/abfdd3f605a44c68ab309876280ea066 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:38.027949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:38.030136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:38.080907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 63e3a14a0f2a4359a9823f204f70c646 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:38.081601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:38.084616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:38.092623 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2502/4992] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:37 2022] DELETE /identity/v3/roles/63e3a14a0f2a4359a9823f204f70c646 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:38.094437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:38.096700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:38.149627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168a170-9e17-4f1b-b120-c2a92572decd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:38.238855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c1e1-fc1a-446c-9114-a5f7931b945f tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:38.246318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:38.248568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:38.248568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:38.248568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/74b8709f90f740389d110ba0c7f95868` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:38.250638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:38.251100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=74b8709f90f740389d110ba0c7f95868)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:38.251348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:38.252630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:38.253613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:38.254178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups/a88f21c7e8f54d2f8138c835befca0c4/users/a63f2c9994a4486c993570e8d9b54d81` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:38.256760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a88f21c7e8f54d2f8138c835befca0c4, user_id=a63f2c9994a4486c993570e8d9b54d81)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:38.262425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:38.395308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a63f2c9994a4486c993570e8d9b54d81'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:38.526505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2491/4993] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:35:38 2022] DELETE /identity/v3/groups/a88f21c7e8f54d2f8138c835befca0c4/users/a63f2c9994a4486c993570e8d9b54d81 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:38.528706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:38.534565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:38.552971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role 74b8709f90f740389d110ba0c7f95868 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:38.553720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:38.555053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:38.559600 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2503/4994] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:38 2022] DELETE /identity/v3/roles/74b8709f90f740389d110ba0c7f95868 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:38.581766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:38.586656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:38.630943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fcf55-07e7-41ea-a7cf-1cb687f911fd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:38.789255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:38.790607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:38.791116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:38.791611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/groups/a88f21c7e8f54d2f8138c835befca0c4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:38.795162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a88f21c7e8f54d2f8138c835befca0c4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:38.798087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:38.832524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0afcff-fe75-418e-be05-f5638e00d656 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:38.841527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:38.842535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:38.844081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:38.844635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users/d6446aae569448b28464ceabbd3aab8e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:38.846649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d6446aae569448b28464ceabbd3aab8e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:38.849170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:39.020417 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2492/4995] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:35:38 2022] DELETE /identity/v3/groups/a88f21c7e8f54d2f8138c835befca0c4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:39.021591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:39.025353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6446aae569448b28464ceabbd3aab8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.028393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:39.035399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6446aae569448b28464ceabbd3aab8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.037654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6446aae569448b28464ceabbd3aab8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.108125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6446aae569448b28464ceabbd3aab8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.109433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6446aae569448b28464ceabbd3aab8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.140736 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2504/4996] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:38 2022] DELETE /identity/v3/users/d6446aae569448b28464ceabbd3aab8e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:39.143762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:39.147670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:39.169688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1a4d1-ec72-4d3d-a00b-bf61b481e322 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:39.240608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119b9fb-05b6-4023-a652-ec38e9e11f64 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:39.246056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:39.247892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:39.247892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:39.247892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles/abfdd3f605a44c68ab309876280ea066` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:39.249235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_role(role_id=abfdd3f605a44c68ab309876280ea066)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:39.251499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:39.271354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:39.272252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:39.272738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:39.273363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:39.281761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:39.304849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:39.306717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:39.310072 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:39.329517 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2493/4997] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:39.356004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role abfdd3f605a44c68ab309876280ea066 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:39.356303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.356975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.358896 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2505/4998] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:39 2022] DELETE /identity/v3/roles/abfdd3f605a44c68ab309876280ea066 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:39.363155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:39.363155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:39.364114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:39.367704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:39.475893 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:39.499125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba99a-72ff-4f93-98d2-13330bc58fd2 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:39.502884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8bea3-9ffc-4f4e-b192-00d613b9c9c9 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:39.521335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:39.521335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:39.521698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:39.524461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/676be1ccda7b4cd48f294c3467a49713` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:39.531399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=676be1ccda7b4cd48f294c3467a49713)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:39.533721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:39.594752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '676be1ccda7b4cd48f294c3467a49713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.596882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '676be1ccda7b4cd48f294c3467a49713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.662019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:39.665850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:39.666253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:39.666599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/59b5c990bb49413a80ea9619c346e0e8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:39.670222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59b5c990bb49413a80ea9619c346e0e8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:39.677910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:39.726786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '676be1ccda7b4cd48f294c3467a49713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.727745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '676be1ccda7b4cd48f294c3467a49713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:39.732378 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2506/4999] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:39 2022] PATCH /identity/v3/domains/676be1ccda7b4cd48f294c3467a49713 => generated 278 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:39.737545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:39.739546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:39.903895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031471d-2cd1-4cbe-be84-a2eb36cbd552 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:40.017947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:40.018818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:40.019093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:40.019479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/676be1ccda7b4cd48f294c3467a49713` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:40.033680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=676be1ccda7b4cd48f294c3467a49713)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:40.036852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:40.041097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b5c990bb49413a80ea9619c346e0e8', 'request_id': 'req-1d405630-95bc-48b2-a3c7-37fe6d3a6382'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.053570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b5c990bb49413a80ea9619c346e0e8', 'request_id': 'req-1d405630-95bc-48b2-a3c7-37fe6d3a6382'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.097087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '676be1ccda7b4cd48f294c3467a49713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.105432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '676be1ccda7b4cd48f294c3467a49713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.201042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b5c990bb49413a80ea9619c346e0e8', 'request_id': 'req-1d405630-95bc-48b2-a3c7-37fe6d3a6382'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.228181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] The token cache is being invalidate because project 59b5c990bb49413a80ea9619c346e0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:40.228614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.229999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d405630-95bc-48b2-a3c7-37fe6d3a6382 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.233118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2494/5000] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:39 2022] DELETE /identity/v3/projects/59b5c990bb49413a80ea9619c346e0e8 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:40.238094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:40.238094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:40.238094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:40.281640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:40.283577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:40.340367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676be1ccda7b4cd48f294c3467a49713', 'request_id': 'req-7c0e62dd-93b0-4505-be07-c8d3169370ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.387141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676be1ccda7b4cd48f294c3467a49713', 'request_id': 'req-7c0e62dd-93b0-4505-be07-c8d3169370ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.397043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2495/5001] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:40.398594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:40.399547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:40.486427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676be1ccda7b4cd48f294c3467a49713', 'request_id': 'req-7c0e62dd-93b0-4505-be07-c8d3169370ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.505624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] The token cache is being invalidate because project 676be1ccda7b4cd48f294c3467a49713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:40.507592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.508334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.537644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '676be1ccda7b4cd48f294c3467a49713', 'request_id': 'req-7c0e62dd-93b0-4505-be07-c8d3169370ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.542652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '676be1ccda7b4cd48f294c3467a49713', 'request_id': 'req-7c0e62dd-93b0-4505-be07-c8d3169370ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.549208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7c0e62dd-93b0-4505-be07-c8d3169370ff tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '676be1ccda7b4cd48f294c3467a49713', 'request_id': 'req-7c0e62dd-93b0-4505-be07-c8d3169370ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:40.562398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2507/5002] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:35:39 2022] DELETE /identity/v3/domains/676be1ccda7b4cd48f294c3467a49713 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:40.568450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:40.569020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:40.570533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:40.573027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd2690-cd50-426e-9219-4f293ee63dab None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:40.624892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] MFA Rules not processed for user `0c65e7ab0b544d9ebdac8bc2129d051a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:40.633427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:40.687517 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:40.709130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:40.709776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:40.710074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:40.710376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:40.712451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:40.716200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:40.744265 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2508/5003] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:40.745245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:40.759634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:40.870544 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2496/5004] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:35:40 2022] POST /identity/v3/projects => generated 328 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:40.874414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:40.879983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:40.932582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cfcc5-5bfe-44d4-93e1-37a5921b9be4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.011449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.012096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.012389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.012725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/765acb5ab6314012af50496aedde2069/users/a63f2c9994a4486c993570e8d9b54d81/roles/37d21c719e4f41b19b452f721472e04b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.015664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=765acb5ab6314012af50496aedde2069, user_id=a63f2c9994a4486c993570e8d9b54d81, role_id=37d21c719e4f41b19b452f721472e04b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.017118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effad70-3034-43fa-a1a5-4c9aa1ef060c tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.018631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.030453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 37d21c719e4f41b19b452f721472e04b was removed from user a63f2c9994a4486c993570e8d9b54d81 on domain 765acb5ab6314012af50496aedde2069. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:41.030813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.031567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.035222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.038350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.038350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.038350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.038350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.039243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.115851 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2509/5005] 10.222.0.42 () {58 vars in 1464 bytes} [Sun Oct 23 01:35:40 2022] DELETE /identity/v3/domains/765acb5ab6314012af50496aedde2069/users/a63f2c9994a4486c993570e8d9b54d81/roles/37d21c719e4f41b19b452f721472e04b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:41.120015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:41.123428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:41.149321 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2497/5006] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:40 2022] POST /identity/v3/users => generated 416 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:41.151842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:41.154189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:41.189080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfced7-6e2d-48b1-9bda-810a4a0c7686 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.253830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eec0c-bde3-4fff-b796-4fa2e36c239f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.261281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.262108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.262451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.262788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles/37d21c719e4f41b19b452f721472e04b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.264288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_role(role_id=37d21c719e4f41b19b452f721472e04b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.266963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.298094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.299350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.299350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.299603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.300284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.302324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.326090 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:41.428305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 37d21c719e4f41b19b452f721472e04b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:41.428814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.429289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.431258 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2510/5007] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:41 2022] DELETE /identity/v3/roles/37d21c719e4f41b19b452f721472e04b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:41.436038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:41.438444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:41.443319 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2498/5008] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:41 2022] POST /identity/v3/roles => generated 243 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:41.448857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:41.450708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:41.468224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f0d55-7654-4153-8a7b-c44222fe9b54 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.521850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c9294-5625-4f39-8c42-bd62c9ed00d3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.528017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.528739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.529098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.529469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/765acb5ab6314012af50496aedde2069` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.531747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=765acb5ab6314012af50496aedde2069)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.533631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.545236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.546184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.546732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.549409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.550633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.552552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.558433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '765acb5ab6314012af50496aedde2069'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.559175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '765acb5ab6314012af50496aedde2069'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.670050 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:41.676212 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2499/5009] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:41 2022] POST /identity/v3/roles => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:41.680578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:41.683796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:41.691252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '765acb5ab6314012af50496aedde2069'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.691929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '765acb5ab6314012af50496aedde2069'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.702520 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2511/5010] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:41 2022] PATCH /identity/v3/domains/765acb5ab6314012af50496aedde2069 => generated 277 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:41.704603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:41.705902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:41.713839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49bab9-a6a8-46e7-88cf-78948ebdf427 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.792401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.793335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.794122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.794604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/6e023e015e6441f4a95ffaa783b40f79/users/2e905fd22db046e0b7fab6a8c1f6a65a/roles/f1d1fea3479441a2a6c7aec98d2f92cb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.800464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63715cbb-f888-4995-84be-26ba9ce6921b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:41.805617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:41.807070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:41.807070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:41.807070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/765acb5ab6314012af50496aedde2069` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:41.818791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e023e015e6441f4a95ffaa783b40f79, user_id=2e905fd22db046e0b7fab6a8c1f6a65a, role_id=f1d1fea3479441a2a6c7aec98d2f92cb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.820286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=765acb5ab6314012af50496aedde2069)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:41.821579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.822506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:41.850273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '765acb5ab6314012af50496aedde2069'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.854780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '765acb5ab6314012af50496aedde2069'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:41.894602 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2500/5011] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:41 2022] PUT /identity/v3/projects/6e023e015e6441f4a95ffaa783b40f79/users/2e905fd22db046e0b7fab6a8c1f6a65a/roles/f1d1fea3479441a2a6c7aec98d2f92cb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:41.900427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:41.902896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:42.047337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765acb5ab6314012af50496aedde2069', 'request_id': 'req-cb42d453-ef6e-48f9-a76b-d6b49616ddee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.059376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765acb5ab6314012af50496aedde2069', 'request_id': 'req-cb42d453-ef6e-48f9-a76b-d6b49616ddee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.065327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01e43-a265-4263-9fdf-c6e644f04f6b tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:42.166155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765acb5ab6314012af50496aedde2069', 'request_id': 'req-cb42d453-ef6e-48f9-a76b-d6b49616ddee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.194434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] The token cache is being invalidate because project 765acb5ab6314012af50496aedde2069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:42.194740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.199127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.219619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '765acb5ab6314012af50496aedde2069', 'request_id': 'req-cb42d453-ef6e-48f9-a76b-d6b49616ddee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.220409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '765acb5ab6314012af50496aedde2069', 'request_id': 'req-cb42d453-ef6e-48f9-a76b-d6b49616ddee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.222940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:42.223718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.224615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.226779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/6e023e015e6441f4a95ffaa783b40f79/users/2e905fd22db046e0b7fab6a8c1f6a65a/roles/c5d166caebba40a88412a9f18f169333` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.228647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '765acb5ab6314012af50496aedde2069', 'request_id': 'req-cb42d453-ef6e-48f9-a76b-d6b49616ddee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.233560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e023e015e6441f4a95ffaa783b40f79, user_id=2e905fd22db046e0b7fab6a8c1f6a65a, role_id=c5d166caebba40a88412a9f18f169333)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:42.233560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:42.242146 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2512/5012] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:35:41 2022] DELETE /identity/v3/domains/765acb5ab6314012af50496aedde2069 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:42.248153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:42.249910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:42.308777 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2501/5013] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:41 2022] PUT /identity/v3/projects/6e023e015e6441f4a95ffaa783b40f79/users/2e905fd22db046e0b7fab6a8c1f6a65a/roles/c5d166caebba40a88412a9f18f169333 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:42.316961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:42.318902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:42.366625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d453-ef6e-48f9-a76b-d6b49616ddee tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:42.496210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:42.496210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.496210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.497261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.497261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:42.497261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:42.507210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7cd5f-7b0f-47ec-b85c-e2e6cd85c75d tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:42.512189 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2513/5014] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:42 2022] GET /identity/v3/roles => generated 1892 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:42.520089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:42.520202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd474103-edb8-40c5-8c8f-cb2516e236bf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:42.520202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd474103-edb8-40c5-8c8f-cb2516e236bf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.520202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd474103-edb8-40c5-8c8f-cb2516e236bf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.520521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd474103-edb8-40c5-8c8f-cb2516e236bf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.520521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd474103-edb8-40c5-8c8f-cb2516e236bf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:42.520521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd474103-edb8-40c5-8c8f-cb2516e236bf tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:42.539580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7369c-13f3-47f7-bf26-89ea4ee6ee31 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:42.554130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:42.555163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.555441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.555700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects/60afb699b5ac4a23b730074ae7f122e8/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.558720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_grant(project_id=60afb699b5ac4a23b730074ae7f122e8, user_id=15b0c649b16749e4b5fa508f037a3022, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:42.561676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:42.618576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2502/5015] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:42 2022] GET /identity/v3/users => generated 8882 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:42.623333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd4b9-8b30-4ec3-81d2-4ce2bd4e0c46 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.623679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd4b9-8b30-4ec3-81d2-4ce2bd4e0c46 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.623997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd4b9-8b30-4ec3-81d2-4ce2bd4e0c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.664220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2514/5016] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:42 2022] PUT /identity/v3/projects/60afb699b5ac4a23b730074ae7f122e8/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:42.668359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:42.741396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-186fd4b9-8b30-4ec3-81d2-4ce2bd4e0c46 None None] MFA Rules not processed for user `2e905fd22db046e0b7fab6a8c1f6a65a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:42.742668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-186fd4b9-8b30-4ec3-81d2-4ce2bd4e0c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:42.814327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710938a-b847-4d5e-8c6e-3a860396525b tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:42.835028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:42.835028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.835028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.835309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.835309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:42.835309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:42.835547 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2503/5017] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:42.845357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0de3-eea7-4901-8ebd-4cb1ee32bbc3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.845636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0de3-eea7-4901-8ebd-4cb1ee32bbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.845916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0de3-eea7-4901-8ebd-4cb1ee32bbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.880244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0ccc0de3-eea7-4901-8ebd-4cb1ee32bbc3 None None] MFA Rules not processed for user `2e905fd22db046e0b7fab6a8c1f6a65a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:42.882987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ccc0de3-eea7-4901-8ebd-4cb1ee32bbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:42.904655 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2515/5018] 10.222.0.42 () {58 vars in 1146 bytes} [Sun Oct 23 01:35:42 2022] GET /identity/v3/auth/projects => generated 822 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:42.904906 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2504/5019] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:42.905699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:42.906215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc0de3-eea7-4901-8ebd-4cb1ee32bbc3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:42.930919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc0de3-eea7-4901-8ebd-4cb1ee32bbc3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:42.931322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56313ca-4155-4510-971f-a4d838be0a5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:42.934951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:42.935737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.935966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.936243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.937458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:create_trust()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:42.938665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:42.940696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:42.943981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:42.945257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:42.946488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects/60afb699b5ac4a23b730074ae7f122e8/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:42.951546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=60afb699b5ac4a23b730074ae7f122e8, user_id=15b0c649b16749e4b5fa508f037a3022, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:42.959005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:42.970124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 084c71d449aa4c209afa646584a16293 was removed from user 15b0c649b16749e4b5fa508f037a3022 on project 60afb699b5ac4a23b730074ae7f122e8. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:42.971403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:42.972420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:43.051533 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:43.087972 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2516/5020] 10.222.0.42 () {58 vars in 1467 bytes} [Sun Oct 23 01:35:42 2022] DELETE /identity/v3/projects/60afb699b5ac4a23b730074ae7f122e8/users/15b0c649b16749e4b5fa508f037a3022/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:43.094363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.096160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:43.115485 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2505/5021] 10.222.0.42 () {60 vars in 1174 bytes} [Sun Oct 23 01:35:42 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:43.116579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.118643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:43.134571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fcf60-bd5e-48c2-8c2a-dd6b0d21b212 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.184388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91753eae-5697-49d3-96a6-c1fcc224d0d5 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.190724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.191815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.192326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.192864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.193827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.196448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.220489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.221173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.221510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.221789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.229001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:get_trust(trust_id=8dcae6e707974e4e9f8e5cbc0dee3059)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.230632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.239198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2506/5022] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:43 2022] GET /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059 => generated 834 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:43.243772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.258175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc6c5-7ddd-429a-9434-20db38f2535d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.258175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.259263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.259263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.259481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.266020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8dcae6e707974e4e9f8e5cbc0dee3059)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.267466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.276212 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2507/5023] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:35:43 2022] GET /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles => generated 370 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:43.279958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.290311 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2517/5024] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:43 2022] POST /identity/v3/users => generated 323 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:43.291451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.293630 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:43.298722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366b73c-1a1a-44c6-8767-c29a52c04cd7 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.304712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.305371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.305757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538002c-18ed-434a-be9d-4d301b215938 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.306352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.306630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/f1d1fea3479441a2a6c7aec98d2f92cb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.312978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.313290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dcae6e707974e4e9f8e5cbc0dee3059, role_id=f1d1fea3479441a2a6c7aec98d2f92cb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.313819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.314085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.314490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.314890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.315183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.318311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.326222 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2508/5025] 10.222.0.42 () {58 vars in 1368 bytes} [Sun Oct 23 01:35:43 2022] GET /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/f1d1fea3479441a2a6c7aec98d2f92cb => generated 243 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:43.329172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.342166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67e3e-a59a-4d52-8501-d37e15edc243 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.348583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.349244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.349521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.349795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/f1d1fea3479441a2a6c7aec98d2f92cb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.357044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dcae6e707974e4e9f8e5cbc0dee3059, role_id=f1d1fea3479441a2a6c7aec98d2f92cb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.359370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.367083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2509/5026] 10.222.0.42 () {58 vars in 1369 bytes} [Sun Oct 23 01:35:43 2022] HEAD /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/f1d1fea3479441a2a6c7aec98d2f92cb => generated 0 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 23 01:35:43.370921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.382145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e4ee9-11e2-4d8a-8be9-072186570713 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.388017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.389449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.389790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.393180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/c5d166caebba40a88412a9f18f169333` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.399215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dcae6e707974e4e9f8e5cbc0dee3059, role_id=c5d166caebba40a88412a9f18f169333)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.401673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Could not find role: c5d166caebba40a88412a9f18f169333.: keystone.exception.RoleNotFound: Could not find role: c5d166caebba40a88412a9f18f169333. Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:35:43.415501 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c5d166caebba40a88412a9f18f169333. Oct 23 01:35:43.416638 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:43.416925 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2510/5027] 10.222.0.42 () {58 vars in 1368 bytes} [Sun Oct 23 01:35:43 2022] GET /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/c5d166caebba40a88412a9f18f169333 => generated 110 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:43.425909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.432718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2518/5028] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:43 2022] POST /identity/v3/projects => generated 362 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:43.436501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.451127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936052c-2080-493f-aaf2-837d03962dc4 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.533258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.534825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.535109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.535394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/c5d166caebba40a88412a9f18f169333` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.541854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8dcae6e707974e4e9f8e5cbc0dee3059, role_id=c5d166caebba40a88412a9f18f169333)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.543652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.554625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac79d-d62a-4336-a7fe-f14b1cb2bba8 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Could not find role: c5d166caebba40a88412a9f18f169333.: keystone.exception.RoleNotFound: Could not find role: c5d166caebba40a88412a9f18f169333. Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 01:35:43.556942 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c5d166caebba40a88412a9f18f169333. Oct 23 01:35:43.558289 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:43.558289 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2511/5029] 10.222.0.42 () {58 vars in 1369 bytes} [Sun Oct 23 01:35:43 2022] HEAD /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059/roles/c5d166caebba40a88412a9f18f169333 => generated 0 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:43.563009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.563372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.563904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.564240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.564566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.571830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.571830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.574154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7f4c-1893-464a-af56-7a1e86fb20a2 tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.579391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.580135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.580504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.580835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.591478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorizing `identity:delete_trust(trust_id=8dcae6e707974e4e9f8e5cbc0dee3059)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.594024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.682052 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2519/5030] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:43 2022] POST /identity/v3/projects => generated 364 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:43.686000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.748974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8dcae6e707974e4e9f8e5cbc0dee3059', 'request_id': 'req-a5e216e6-35dd-4448-ad32-82702562cb4d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:43.760445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad98adb-c646-4b90-be90-dafd49724550 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.768672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.769311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.769593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.769883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.770586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.772210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.845261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8dcae6e707974e4e9f8e5cbc0dee3059', 'request_id': 'req-a5e216e6-35dd-4448-ad32-82702562cb4d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:43.846046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8dcae6e707974e4e9f8e5cbc0dee3059', 'request_id': 'req-a5e216e6-35dd-4448-ad32-82702562cb4d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:43.858949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2512/5031] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:35:43 2022] DELETE /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:43.860193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.862663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:43.882373 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2520/5032] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:35:43 2022] POST /identity/v3/roles => generated 239 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:43.887673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e216e6-35dd-4448-ad32-82702562cb4d tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.891281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:43.892985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:43.918017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faef6d-29e7-40bc-87a1-f6ab6508152f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:43.940518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:43.941332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:43.941680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:43.942049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects/c67ec11bbc0f4d13812368fc176a83ff/users/b2495acdffd54140a299eac418b229a1/roles/42e2b365d769406e8ff5914542eb5e10` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:43.966632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c67ec11bbc0f4d13812368fc176a83ff, user_id=b2495acdffd54140a299eac418b229a1, role_id=42e2b365d769406e8ff5914542eb5e10)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:43.969641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:43.999771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e905fd22db046e0b7fab6a8c1f6a65a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e023e015e6441f4a95ffaa783b40f79', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1028968855', 'tempest-DelegatedRole-570037202'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:44.000544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.000896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.001243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] PATH_INFO: `/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Could not find trust: 8dcae6e707974e4e9f8e5cbc0dee3059.: keystone.exception.TrustNotFound: Could not find trust: 8dcae6e707974e4e9f8e5cbc0dee3059. Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 23 01:35:44.012823 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8dcae6e707974e4e9f8e5cbc0dee3059. Oct 23 01:35:44.014067 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:44.015659 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2513/5033] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:35:43 2022] GET /identity/v3/OS-TRUST/trusts/8dcae6e707974e4e9f8e5cbc0dee3059 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:44.019822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:44.021752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:44.032833 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2521/5034] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:43 2022] PUT /identity/v3/projects/c67ec11bbc0f4d13812368fc176a83ff/users/b2495acdffd54140a299eac418b229a1/roles/42e2b365d769406e8ff5914542eb5e10 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:44.037156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:44.119904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ec3ae-6add-41c7-b65f-3b56d3df09df tempest-TrustsV3TestJSON-415115749 tempest-user-1597745155] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:44.144513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5690b41-2441-47a2-8ce1-343c58071f0e tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:44.154272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2740f-ddf4-4c51-bf22-9e367050a420 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:44.155644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2740f-ddf4-4c51-bf22-9e367050a420 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.156100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2740f-ddf4-4c51-bf22-9e367050a420 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.157037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2740f-ddf4-4c51-bf22-9e367050a420 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects/a67b85f333b248098da174a6536b16d8/users/b2495acdffd54140a299eac418b229a1/roles/42e2b365d769406e8ff5914542eb5e10` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.160076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2740f-ddf4-4c51-bf22-9e367050a420 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a67b85f333b248098da174a6536b16d8, user_id=b2495acdffd54140a299eac418b229a1, role_id=42e2b365d769406e8ff5914542eb5e10)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:44.168751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2740f-ddf4-4c51-bf22-9e367050a420 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:44.203801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:44.204446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.204726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.204998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/c5d166caebba40a88412a9f18f169333` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.206490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5d166caebba40a88412a9f18f169333)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:44.208082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:44.252654 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2522/5035] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:44 2022] PUT /identity/v3/projects/a67b85f333b248098da174a6536b16d8/users/b2495acdffd54140a299eac418b229a1/roles/42e2b365d769406e8ff5914542eb5e10 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:44.261115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042ef4f-c34b-458c-90f4-bdf398a7f469 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.261407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042ef4f-c34b-458c-90f4-bdf398a7f469 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.261718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042ef4f-c34b-458c-90f4-bdf398a7f469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.290674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7042ef4f-c34b-458c-90f4-bdf398a7f469 None None] MFA Rules not processed for user `b2495acdffd54140a299eac418b229a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:44.292178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7042ef4f-c34b-458c-90f4-bdf398a7f469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:44.296983 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2523/5036] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:44 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:35:44.301365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db327b3-a222-4f57-8077-cbdfbc37c386 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.301646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db327b3-a222-4f57-8077-cbdfbc37c386 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.303236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db327b3-a222-4f57-8077-cbdfbc37c386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.318578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2db327b3-a222-4f57-8077-cbdfbc37c386 None None] MFA Rules not processed for user `b2495acdffd54140a299eac418b229a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:44.320219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2db327b3-a222-4f57-8077-cbdfbc37c386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:44.398972 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2524/5037] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 23 01:35:44.403387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db327b3-a222-4f57-8077-cbdfbc37c386 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:44.451733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role c5d166caebba40a88412a9f18f169333 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:44.452401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:44.453377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:44.458577 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2514/5038] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:44 2022] DELETE /identity/v3/roles/c5d166caebba40a88412a9f18f169333 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:44.459459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:44.460961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:44.470093 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:44.478915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db327b3-a222-4f57-8077-cbdfbc37c386 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:44.576334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6c43-319a-4439-8914-947dea8409ff tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:44.588224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:44.589431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.590542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.591840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/roles/f1d1fea3479441a2a6c7aec98d2f92cb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.594699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f1d1fea3479441a2a6c7aec98d2f92cb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:44.597237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:44.598791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f850b-cf7c-4350-8aea-d150e3a003f7 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:44.599522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f850b-cf7c-4350-8aea-d150e3a003f7 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.599843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f850b-cf7c-4350-8aea-d150e3a003f7 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.600121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f850b-cf7c-4350-8aea-d150e3a003f7 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.602789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-be8f850b-cf7c-4350-8aea-d150e3a003f7 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:44.620860 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:44.731952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f850b-cf7c-4350-8aea-d150e3a003f7 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:44.732106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f850b-cf7c-4350-8aea-d150e3a003f7 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:44.766758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invalidating the token cache because role f1d1fea3479441a2a6c7aec98d2f92cb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:44.766758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:44.766758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:44.769086 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2515/5039] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:44 2022] DELETE /identity/v3/roles/f1d1fea3479441a2a6c7aec98d2f92cb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:44.773079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:44.774527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:44.863858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b8e58-18cb-4fef-b6a5-0c75a5dafba2 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:44.873576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:44.873576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.873911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.874332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/users/2e905fd22db046e0b7fab6a8c1f6a65a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.875614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2e905fd22db046e0b7fab6a8c1f6a65a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:44.877721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:44.887930 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2525/5040] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 23 01:35:44 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:44.898998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:44.899309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:44.899559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:44.909660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:44.920645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] MFA Rules not processed for user `b2495acdffd54140a299eac418b229a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:44.921841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:45.055281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e905fd22db046e0b7fab6a8c1f6a65a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.086717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e905fd22db046e0b7fab6a8c1f6a65a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.089872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e905fd22db046e0b7fab6a8c1f6a65a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.101159 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2526/5041] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 23 01:35:45.102230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:45.110132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:45.222033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e905fd22db046e0b7fab6a8c1f6a65a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.224167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e905fd22db046e0b7fab6a8c1f6a65a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.275070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2516/5042] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:44 2022] DELETE /identity/v3/users/2e905fd22db046e0b7fab6a8c1f6a65a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:45.280288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:45.285648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:45.286450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f485b8-01e0-4a58-8412-1d1699e4b415 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:45.328287 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:45.382381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:45.383479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:45.384966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:45.387819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/roles/42e2b365d769406e8ff5914542eb5e10` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:45.391406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_role(role_id=42e2b365d769406e8ff5914542eb5e10)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:45.393404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:45.411702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cebfe-8354-4218-9004-17a1dae1a017 tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:45.427522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5817523fda849c48dfc0f289e85de6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8360f8465d234caca33072fcfbb9a8a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:45.429445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:45.430128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:45.440312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] PATH_INFO: `/v3/projects/6e023e015e6441f4a95ffaa783b40f79` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:45.443576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e023e015e6441f4a95ffaa783b40f79)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:45.445415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:45.620929 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:45.625800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invalidating the token cache because role 42e2b365d769406e8ff5914542eb5e10 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:45.626238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.627442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.631588 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2527/5043] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:45 2022] DELETE /identity/v3/roles/42e2b365d769406e8ff5914542eb5e10 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:45.635546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:45.637045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:45.740365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d206c-2a20-4197-a562-9b506c9067cd tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:45.748882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:45.749706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:45.750011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:45.750288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects/a67b85f333b248098da174a6536b16d8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:45.751541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a67b85f333b248098da174a6536b16d8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:45.762050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:45.827950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e023e015e6441f4a95ffaa783b40f79', 'request_id': 'req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.838899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e023e015e6441f4a95ffaa783b40f79', 'request_id': 'req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.944063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67b85f333b248098da174a6536b16d8', 'request_id': 'req-f571018b-abcb-4cba-9455-c2b4c0982fb3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.952023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67b85f333b248098da174a6536b16d8', 'request_id': 'req-f571018b-abcb-4cba-9455-c2b4c0982fb3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:45.977080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e023e015e6441f4a95ffaa783b40f79', 'request_id': 'req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.015385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] The token cache is being invalidate because project 6e023e015e6441f4a95ffaa783b40f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:46.015984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.016658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.018231 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2517/5044] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:45 2022] DELETE /identity/v3/projects/6e023e015e6441f4a95ffaa783b40f79 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:46.025269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:46.026892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:46.099501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67b85f333b248098da174a6536b16d8', 'request_id': 'req-f571018b-abcb-4cba-9455-c2b4c0982fb3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.118062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] The token cache is being invalidate because project a67b85f333b248098da174a6536b16d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:46.118737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.122309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.127384 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2528/5045] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:45 2022] DELETE /identity/v3/projects/a67b85f333b248098da174a6536b16d8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:46.131785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:46.133772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:46.135212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcdc4b-19d9-45d1-b5aa-f6cf49f5f64a tempest-TrustsV3TestJSON-1919387356 tempest-TrustsV3TestJSON-1919387356-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:46.228557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571018b-abcb-4cba-9455-c2b4c0982fb3 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:46.237892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:46.239678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:46.239678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:46.239678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] PATH_INFO: `/v3/users/67a9951e10194951ad8a6f519d2543f8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:46.240648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a9951e10194951ad8a6f519d2543f8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:46.243358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:46.243553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:46.244247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:46.246026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:46.246388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects/a67b85f333b248098da174a6536b16d8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:46.269565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a67b85f333b248098da174a6536b16d8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:46.273171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Could not find project: a67b85f333b248098da174a6536b16d8.: keystone.exception.ProjectNotFound: Could not find project: a67b85f333b248098da174a6536b16d8. Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 23 01:35:46.307497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a67b85f333b248098da174a6536b16d8. Oct 23 01:35:46.308719 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:46.312088 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2529/5046] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:46 2022] DELETE /identity/v3/projects/a67b85f333b248098da174a6536b16d8 => generated 113 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 23 01:35:46.313207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:46.344254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9d0c-9013-4490-ab30-23a77ca94d80 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:46.363628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:46.364430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:46.364721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:46.365473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/projects/c67ec11bbc0f4d13812368fc176a83ff` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:46.367022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c67ec11bbc0f4d13812368fc176a83ff)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:46.370331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:46.460940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a9951e10194951ad8a6f519d2543f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.470543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a9951e10194951ad8a6f519d2543f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.471631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a9951e10194951ad8a6f519d2543f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.531990 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:46.574069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a9951e10194951ad8a6f519d2543f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.575417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2529aca6-d405-4c1c-9600-f784912457f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a9951e10194951ad8a6f519d2543f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.604780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67ec11bbc0f4d13812368fc176a83ff', 'request_id': 'req-3f4e5978-f737-491d-a54d-140ec5061e5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.612361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67ec11bbc0f4d13812368fc176a83ff', 'request_id': 'req-3f4e5978-f737-491d-a54d-140ec5061e5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.636479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2518/5047] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:46 2022] DELETE /identity/v3/users/67a9951e10194951ad8a6f519d2543f8 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:46.641642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:46.642550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:46.642959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:46.652116 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:46.679151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:46.680265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67ec11bbc0f4d13812368fc176a83ff', 'request_id': 'req-3f4e5978-f737-491d-a54d-140ec5061e5a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.681342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:46.704351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] The token cache is being invalidate because project c67ec11bbc0f4d13812368fc176a83ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:46.704820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.705577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:46.707961 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2530/5048] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:46 2022] DELETE /identity/v3/projects/c67ec11bbc0f4d13812368fc176a83ff => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:46.712144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:46.720107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:46.765789 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2519/5049] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:46.776521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:46.778254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:46.807992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e5978-f737-491d-a54d-140ec5061e5a tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:46.844752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c592bd-0bc4-4306-999e-5364411de3f8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:46.848348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:46.849071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:46.849724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:46.849877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:46.859865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:46.861709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:46.872902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2520/5050] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:35:46.882013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:46.883184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:46.883184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:46.883184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/users/b2495acdffd54140a299eac418b229a1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:46.884453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b2495acdffd54140a299eac418b229a1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:46.886679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:47.062463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2495acdffd54140a299eac418b229a1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.075507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2495acdffd54140a299eac418b229a1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.076256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2495acdffd54140a299eac418b229a1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.158813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2495acdffd54140a299eac418b229a1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.159589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2495acdffd54140a299eac418b229a1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.194168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:47.196403 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2531/5051] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:46 2022] DELETE /identity/v3/users/b2495acdffd54140a299eac418b229a1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:47.206145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb88472-4eb4-4d3f-914d-0cd5e463fb08 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:47.213069 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:47.278494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:47.279240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:47.279581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:47.280092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/637643e6c36d490383bff301fd605b0d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:47.290966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Could not find domain: 637643e6c36d490383bff301fd605b0d.: keystone.exception.DomainNotFound: Could not find domain: 637643e6c36d490383bff301fd605b0d. Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 637643e6c36d490383bff301fd605b0d. Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:47.298043 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:47.299814 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 637643e6c36d490383bff301fd605b0d. Oct 23 01:35:47.301185 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:47.307446 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2521/5052] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:47 2022] PATCH /identity/v3/domains/637643e6c36d490383bff301fd605b0d => generated 112 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 23 01:35:47.307687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:47.308622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:47.323863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b0e2a-2a14-49ec-bf29-46c05f6456bc tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:47.340919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:47.349252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:47.349681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:47.350018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/caf36642eee04eff9b7fb84679c3cebd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:47.362835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Could not find domain: caf36642eee04eff9b7fb84679c3cebd.: keystone.exception.DomainNotFound: Could not find domain: caf36642eee04eff9b7fb84679c3cebd. Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: caf36642eee04eff9b7fb84679c3cebd. Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:47.377100 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:47.383028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: caf36642eee04eff9b7fb84679c3cebd. Oct 23 01:35:47.384686 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:47.386476 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2532/5053] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:47 2022] PATCH /identity/v3/domains/caf36642eee04eff9b7fb84679c3cebd => generated 112 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:47.386924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:47.406214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72346-18f4-4eb6-b95a-870dbf74c480 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:47.418882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:47.419599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:47.419948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:47.420286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/676be1ccda7b4cd48f294c3467a49713` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:47.434749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Could not find domain: 676be1ccda7b4cd48f294c3467a49713.: keystone.exception.DomainNotFound: Could not find domain: 676be1ccda7b4cd48f294c3467a49713. Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 676be1ccda7b4cd48f294c3467a49713. Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:47.447556 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:47.449028 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 676be1ccda7b4cd48f294c3467a49713. Oct 23 01:35:47.450349 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:47.456349 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2522/5054] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:47 2022] PATCH /identity/v3/domains/676be1ccda7b4cd48f294c3467a49713 => generated 112 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:47.456510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:47.470500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896e06e-3891-439b-bc4a-22b044d73a3c tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:47.478690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15b0c649b16749e4b5fa508f037a3022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b63a4afc37346069a04a5c1b3988e3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:47.480814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:47.481168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:47.482472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] PATH_INFO: `/v3/domains/765acb5ab6314012af50496aedde2069` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:47.500938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Could not find domain: 765acb5ab6314012af50496aedde2069.: keystone.exception.DomainNotFound: Could not find domain: 765acb5ab6314012af50496aedde2069. Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 765acb5ab6314012af50496aedde2069. Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:47.507915 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:47.509162 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 765acb5ab6314012af50496aedde2069. Oct 23 01:35:47.510437 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:35:47.512315 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2533/5055] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:35:47 2022] PATCH /identity/v3/domains/765acb5ab6314012af50496aedde2069 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:35:47.513349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:47.515897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:47.641096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f5775-870b-4c19-81a5-c3002de8641f tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:47.656484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:47.657079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:47.657699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:47.657992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] PATH_INFO: `/v3/users/3a627acc83764744b38eefbe9f7332de` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:47.659468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a627acc83764744b38eefbe9f7332de)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:47.661412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:47.721017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:47.722971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:47.765922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda1578-4f14-4dcc-8e2f-2cdec54bd842 tempest-TokensV3TestJSON-163664814 tempest-TokensV3TestJSON-163664814-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:47.792011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:47.796945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:47.797342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:47.797630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] PATH_INFO: `/v3/projects/75a0c121f1b34c85ba768be2f8e7a3d7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:47.801716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a0c121f1b34c85ba768be2f8e7a3d7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:47.808993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:47.817401 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:47.947598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a627acc83764744b38eefbe9f7332de'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.973515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a627acc83764744b38eefbe9f7332de'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.975239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a627acc83764744b38eefbe9f7332de'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.984716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a0c121f1b34c85ba768be2f8e7a3d7', 'request_id': 'req-a093c578-15d9-4eee-8280-5e76f9c99e02'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:47.999936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a0c121f1b34c85ba768be2f8e7a3d7', 'request_id': 'req-a093c578-15d9-4eee-8280-5e76f9c99e02'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.068460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a627acc83764744b38eefbe9f7332de'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.069393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fd64810a-49f8-4c5a-892a-494559f5ff06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a627acc83764744b38eefbe9f7332de'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.090732 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2523/5056] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:47 2022] DELETE /identity/v3/users/3a627acc83764744b38eefbe9f7332de => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:48.095007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:48.095495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:48.095674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:48.117943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:48.119338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:48.153875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a0c121f1b34c85ba768be2f8e7a3d7', 'request_id': 'req-a093c578-15d9-4eee-8280-5e76f9c99e02'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.168935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] The token cache is being invalidate because project 75a0c121f1b34c85ba768be2f8e7a3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:48.169479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.170498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.173066 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2534/5057] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:47 2022] DELETE /identity/v3/projects/75a0c121f1b34c85ba768be2f8e7a3d7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:48.176935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:48.178325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:48.194171 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2524/5058] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:48.208416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:48.211446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:48.294266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093c578-15d9-4eee-8280-5e76f9c99e02 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:48.301658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:48.302487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:48.302764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:48.303083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] PATH_INFO: `/v3/users/a5817523fda849c48dfc0f289e85de6e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:48.304720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5817523fda849c48dfc0f289e85de6e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:48.307521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cccb0-1b55-4c85-b16b-95829e165b2e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:48.312763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:48.314102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:48.314753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:48.315014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:48.315282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:48.328766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:48.331727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:48.349259 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2525/5059] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:35:48.350157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:48.372005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2692-66d3-4be8-aabf-2cd43b7ed6c2 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:48.380499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:48.381306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:48.381688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:48.382114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:48.384402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:48.397822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:48.399322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:48.410639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2526/5060] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:48.570605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5817523fda849c48dfc0f289e85de6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.580196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5817523fda849c48dfc0f289e85de6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.581766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5817523fda849c48dfc0f289e85de6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.696838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5817523fda849c48dfc0f289e85de6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.697459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-261215f5-d74e-48ea-9c3c-efe1b94dbc13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5817523fda849c48dfc0f289e85de6e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:48.716968 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2535/5061] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:48 2022] DELETE /identity/v3/users/a5817523fda849c48dfc0f289e85de6e => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:48.793992 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:49.143592 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:49.430925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:49.446239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44a844-38ea-45ef-9153-df0519723314 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:49.550339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:49.555234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:49.555234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:49.555234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] PATH_INFO: `/v3/projects/8360f8465d234caca33072fcfbb9a8a9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:49.555234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8360f8465d234caca33072fcfbb9a8a9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:49.555234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:49.683144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8360f8465d234caca33072fcfbb9a8a9', 'request_id': 'req-5d730e9a-be6c-4c07-82a2-fcce9029c93d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:49.698336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8360f8465d234caca33072fcfbb9a8a9', 'request_id': 'req-5d730e9a-be6c-4c07-82a2-fcce9029c93d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:49.782756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8360f8465d234caca33072fcfbb9a8a9', 'request_id': 'req-5d730e9a-be6c-4c07-82a2-fcce9029c93d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:49.803138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] The token cache is being invalidate because project 8360f8465d234caca33072fcfbb9a8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:49.803720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:49.805209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:49.808166 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2527/5062] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:49 2022] DELETE /identity/v3/projects/8360f8465d234caca33072fcfbb9a8a9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:49.813588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbbe-36d1-4af2-841b-a65654512a6c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:49.815287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbbe-36d1-4af2-841b-a65654512a6c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:49.815287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dbbe-36d1-4af2-841b-a65654512a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:49.848148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a940dbbe-36d1-4af2-841b-a65654512a6c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:49.849735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a940dbbe-36d1-4af2-841b-a65654512a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:49.909611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:49.911214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:49.947977 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:49.971248 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:50.009580 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2536/5063] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:50.017365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493e074-000d-4f1b-8825-0b761e181e90 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.018210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493e074-000d-4f1b-8825-0b761e181e90 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.020126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493e074-000d-4f1b-8825-0b761e181e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.063894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4493e074-000d-4f1b-8825-0b761e181e90 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:50.067846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4493e074-000d-4f1b-8825-0b761e181e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:50.090927 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2537/5064] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:50.095101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493e074-000d-4f1b-8825-0b761e181e90 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:50.096265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730e9a-be6c-4c07-82a2-fcce9029c93d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:50.110163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:50.110821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.111152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.111430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] PATH_INFO: `/v3/projects/60afb699b5ac4a23b730074ae7f122e8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.116481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493e074-000d-4f1b-8825-0b761e181e90 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:50.116658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=60afb699b5ac4a23b730074ae7f122e8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:50.118960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:50.123679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:50.124893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.125170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.125432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.126119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:50.126417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:50.128618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:50.147053 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2538/5065] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:50.148311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:50.181321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8e878-946a-4fd1-b1a6-9857aa956ee0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:50.197955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:50.198870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.199151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.199523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.200261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:50.202345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:50.285640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60afb699b5ac4a23b730074ae7f122e8', 'request_id': 'req-b0648c45-923a-4c52-8524-a412dd4c31fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:50.292701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60afb699b5ac4a23b730074ae7f122e8', 'request_id': 'req-b0648c45-923a-4c52-8524-a412dd4c31fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:50.340273 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2539/5066] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:50 2022] POST /identity/v3/projects => generated 395 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:50.360842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:50.454232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60afb699b5ac4a23b730074ae7f122e8', 'request_id': 'req-b0648c45-923a-4c52-8524-a412dd4c31fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:50.492629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] The token cache is being invalidate because project 60afb699b5ac4a23b730074ae7f122e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:50.492834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:50.494482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:50.497399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2528/5067] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:49 2022] DELETE /identity/v3/projects/60afb699b5ac4a23b730074ae7f122e8 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:50.501075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:50.504365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:50.510530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd458afa-d461-4a87-b82f-726e972b0e7f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:50.524534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:50.524534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.524534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.524534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.524940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:50.527531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:50.616196 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2540/5068] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:50 2022] POST /identity/v3/users => generated 304 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:50.620314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:50.627897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648c45-923a-4c52-8524-a412dd4c31fb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:50.631102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:50.643280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:50.645153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.647118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.647642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] PATH_INFO: `/v3/users/15b0c649b16749e4b5fa508f037a3022` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.654590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b0c649b16749e4b5fa508f037a3022)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:50.656002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd6cb-3db9-42d5-af08-e40fee7aee02 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:50.656460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:50.665396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:50.666056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.666320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.666593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.667258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:50.668938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:50.698716 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2541/5069] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:50.702345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:50.714445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55449-9b07-4817-a7e1-8dcf54d88c7c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:50.724410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:50.724410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:50.724410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:50.724410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] PATH_INFO: `/v3/projects/c1e60a329b1e4e93a3e6521338a80fc7/users/6c985d419f984564b65cb5c73336ce65/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:50.745583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e60a329b1e4e93a3e6521338a80fc7, user_id=6c985d419f984564b65cb5c73336ce65, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:50.750241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:50.913837 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2542/5070] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:50 2022] PUT /identity/v3/projects/c1e60a329b1e4e93a3e6521338a80fc7/users/6c985d419f984564b65cb5c73336ce65/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:50.917831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:50.961204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b0c649b16749e4b5fa508f037a3022'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:50.971365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b0c649b16749e4b5fa508f037a3022'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:50.972470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b0c649b16749e4b5fa508f037a3022'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:51.007090 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:51.057377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b0c649b16749e4b5fa508f037a3022'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:51.058518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b0c649b16749e4b5fa508f037a3022'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:51.072640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a628-50a8-4dce-80ad-ea03f368b4a7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:51.077769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ae7d-a162-4b81-aee4-be06df84a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:51.078549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ae7d-a162-4b81-aee4-be06df84a454 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:51.078926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ae7d-a162-4b81-aee4-be06df84a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:51.079262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ae7d-a162-4b81-aee4-be06df84a454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:51.079979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ae7d-a162-4b81-aee4-be06df84a454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:51.081825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ae7d-a162-4b81-aee4-be06df84a454 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:51.087650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2529/5071] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:50 2022] DELETE /identity/v3/users/15b0c649b16749e4b5fa508f037a3022 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:51.101384 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2543/5072] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:51.105849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:51.107327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:51.203320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b04e3c-2686-4e5c-a400-3730a758d2bc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:51.226475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:51.226475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:51.226475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:51.226475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] PATH_INFO: `/v3/projects/c1e60a329b1e4e93a3e6521338a80fc7/users/6c985d419f984564b65cb5c73336ce65/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:51.231334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e60a329b1e4e93a3e6521338a80fc7, user_id=6c985d419f984564b65cb5c73336ce65, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:51.235825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:51.274498 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2530/5073] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:51 2022] PUT /identity/v3/projects/c1e60a329b1e4e93a3e6521338a80fc7/users/6c985d419f984564b65cb5c73336ce65/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:51.278114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91994f3-003c-40e4-b966-2ef9894c4621 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:51.278603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91994f3-003c-40e4-b966-2ef9894c4621 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:51.279042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91994f3-003c-40e4-b966-2ef9894c4621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:51.334110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f91994f3-003c-40e4-b966-2ef9894c4621 None None] MFA Rules not processed for user `6c985d419f984564b65cb5c73336ce65`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:51.335561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f91994f3-003c-40e4-b966-2ef9894c4621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:51.443443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:51.451118 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2544/5074] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:51.531751 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:51.566829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f68d2-4174-469a-8dfa-a84e5891f1e3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:51.578655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:51.579559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:51.579559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:51.579839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:51.581038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:51.583028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:51.696801 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2531/5075] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:51 2022] POST /identity/v3/projects => generated 397 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:51.698276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91994f3-003c-40e4-b966-2ef9894c4621 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:51.709917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91994f3-003c-40e4-b966-2ef9894c4621 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:51.801092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:51.804831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:51.804831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:51.804831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:51.804831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:51.805961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:51.908150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:51.916161 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2545/5076] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:51 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:51.919936 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:51.924063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f373ea-f752-4a4f-a1cd-30dfd568eb37 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:51.929322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:51.930071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:51.930402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:51.930731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:51.931705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:51.933377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:51.945817 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2532/5077] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:51.950064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:51.964921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0747f-092c-48b3-b23b-8bb9681cfcf0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:51.968673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09497b6-d1ea-4731-927f-146a79403534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:51.970061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09497b6-d1ea-4731-927f-146a79403534 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:51.970453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09497b6-d1ea-4731-927f-146a79403534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:51.970813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09497b6-d1ea-4731-927f-146a79403534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:51.971649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09497b6-d1ea-4731-927f-146a79403534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:51.973427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09497b6-d1ea-4731-927f-146a79403534 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:51.988506 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2546/5078] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:52.000233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:52.012677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993e67-991e-4af3-879e-6d67fe536029 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:52.019995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:52.021654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:52.022063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:52.022581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] PATH_INFO: `/v3/projects/085d15245cac467a85c503fad95ff839/users/19c52f99ff3f4b20880a1d9f052e04a0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:52.043759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085d15245cac467a85c503fad95ff839, user_id=19c52f99ff3f4b20880a1d9f052e04a0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:52.047888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:52.164785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2533/5079] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:51 2022] PUT /identity/v3/projects/085d15245cac467a85c503fad95ff839/users/19c52f99ff3f4b20880a1d9f052e04a0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:52.178674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:52.178963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:52.179243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:52.223396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] MFA Rules not processed for user `19c52f99ff3f4b20880a1d9f052e04a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:52.224791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:52.361254 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2547/5080] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:52.375773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:52.378102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:52.487418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f494b1d-b7cf-4f9d-a45d-814b7ce86c86 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:52.494786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:52.495667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:52.496116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:52.496556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:52.565883 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:52.608470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:52.609931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:52.661227 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2534/5081] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:53.167133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:53.169469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:53.325084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889a3b8-0c0e-4ff5-ae8d-87480cf2406e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:53.333837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:53.337708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:53.341278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:53.341755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] PATH_INFO: `/v3/projects/9b63a4afc37346069a04a5c1b3988e3a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:53.344832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b63a4afc37346069a04a5c1b3988e3a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:53.348637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:53.449435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:53.450985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:53.481187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf7b6-5119-41b4-97fc-e3ee1b79c8bb service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:53.509098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b63a4afc37346069a04a5c1b3988e3a', 'request_id': 'req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:53.517451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b63a4afc37346069a04a5c1b3988e3a', 'request_id': 'req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:53.584981 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:53.621281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:53.622302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:53.622784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:53.623066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] PATH_INFO: `/v3/users/3aa074c0227e45d791ab727ba6647c0f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:53.626436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa074c0227e45d791ab727ba6647c0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:53.628384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:53.638356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b63a4afc37346069a04a5c1b3988e3a', 'request_id': 'req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:53.657415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] The token cache is being invalidate because project 9b63a4afc37346069a04a5c1b3988e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:53.658143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:53.660756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:53.663334 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2548/5082] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:53 2022] DELETE /identity/v3/projects/9b63a4afc37346069a04a5c1b3988e3a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:53.667877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:53.669879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:53.699930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854dcba-e0cc-4bfe-bd3b-d635b6b0b4ba admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:53.716161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:53.718977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:53.720237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:53.720799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] PATH_INFO: `/v3/users/a63f2c9994a4486c993570e8d9b54d81` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:53.726128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63f2c9994a4486c993570e8d9b54d81)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:53.731579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:53.946032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa074c0227e45d791ab727ba6647c0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:53.959831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa074c0227e45d791ab727ba6647c0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:53.960654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa074c0227e45d791ab727ba6647c0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.030706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63f2c9994a4486c993570e8d9b54d81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.044263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63f2c9994a4486c993570e8d9b54d81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.045152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63f2c9994a4486c993570e8d9b54d81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.058241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa074c0227e45d791ab727ba6647c0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.059494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa074c0227e45d791ab727ba6647c0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.093742 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2535/5083] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:53 2022] DELETE /identity/v3/users/3aa074c0227e45d791ab727ba6647c0f => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:54.095230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:54.098398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:54.147974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63f2c9994a4486c993570e8d9b54d81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.148708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cecea7c3-2664-4528-b591-968cd171ac2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63f2c9994a4486c993570e8d9b54d81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.179401 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:54.181342 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2549/5084] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:53 2022] DELETE /identity/v3/users/a63f2c9994a4486c993570e8d9b54d81 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:54.191676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:54.193028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:54.193410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:54.202426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329efdf2-76fe-4411-a9bd-b5f72e8c9bd5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:54.221327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:54.225784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:54.284175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:54.285831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:54.286542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:54.287025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] PATH_INFO: `/v3/users/6c985d419f984564b65cb5c73336ce65` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:54.288514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c985d419f984564b65cb5c73336ce65)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:54.291228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:54.315422 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2550/5085] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:54.329207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:54.331727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:54.407271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1224f6-5032-4296-adb7-407ca9ef6d0f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:54.410945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758262b0-b022-42e6-bad1-115cff98fccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:54.414222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758262b0-b022-42e6-bad1-115cff98fccf service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:54.414222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758262b0-b022-42e6-bad1-115cff98fccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:54.414222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758262b0-b022-42e6-bad1-115cff98fccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:54.422304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758262b0-b022-42e6-bad1-115cff98fccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:54.424076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758262b0-b022-42e6-bad1-115cff98fccf service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:54.433662 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2551/5086] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:54.550849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c985d419f984564b65cb5c73336ce65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.558187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c985d419f984564b65cb5c73336ce65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.558958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c985d419f984564b65cb5c73336ce65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.668133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c985d419f984564b65cb5c73336ce65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.668814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c985d419f984564b65cb5c73336ce65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:54.697967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2536/5087] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:54 2022] DELETE /identity/v3/users/6c985d419f984564b65cb5c73336ce65 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:54.702478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:54.702813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:54.703088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:54.753070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:54.759492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:54.821063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:54.822680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:54.841800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2552/5088] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:54.859582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:54.861053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:54.920078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec57c1-9afc-4ceb-b49e-74312d4bf70d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:54.925217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:54.925908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:54.926228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:54.926506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] PATH_INFO: `/v3/projects/460fd1a27be74bf08b002a8200380491` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:54.927687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=460fd1a27be74bf08b002a8200380491)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:54.929626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:54.964535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6b329-fc82-4c94-8a60-79a714677c0e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:54.968983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:54.969690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:54.970065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:54.970395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:54.981022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:54.982535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:54.993314 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2553/5089] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:54.994173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:54.995795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:55.009786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d813493-4614-4be0-a791-6f7a36cd95b2 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.019658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:55.020330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.020726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.021031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] PATH_INFO: `/v3/projects/b362f0592bc14f46ac2bac69d26f89d1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.023855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b362f0592bc14f46ac2bac69d26f89d1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:55.025774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:55.042354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460fd1a27be74bf08b002a8200380491', 'request_id': 'req-c1f49600-7dab-4c04-9012-630a557ea32d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.053335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460fd1a27be74bf08b002a8200380491', 'request_id': 'req-c1f49600-7dab-4c04-9012-630a557ea32d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.163582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460fd1a27be74bf08b002a8200380491', 'request_id': 'req-c1f49600-7dab-4c04-9012-630a557ea32d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.184458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] The token cache is being invalidate because project 460fd1a27be74bf08b002a8200380491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:55.185059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.186657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1f49600-7dab-4c04-9012-630a557ea32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.190866 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2537/5090] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:54 2022] DELETE /identity/v3/projects/460fd1a27be74bf08b002a8200380491 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:55.195310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ff89-1996-48ae-8a37-b989a6232b89 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.196183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ff89-1996-48ae-8a37-b989a6232b89 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.196692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ff89-1996-48ae-8a37-b989a6232b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.209416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b362f0592bc14f46ac2bac69d26f89d1', 'request_id': 'req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.215382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b362f0592bc14f46ac2bac69d26f89d1', 'request_id': 'req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.225390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9a00ff89-1996-48ae-8a37-b989a6232b89 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:55.227118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9a00ff89-1996-48ae-8a37-b989a6232b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:55.258568 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:55.305953 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2538/5091] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:55.313178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed845-a6d2-49d8-a7bb-42ff2c8993e5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.313590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed845-a6d2-49d8-a7bb-42ff2c8993e5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.314353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed845-a6d2-49d8-a7bb-42ff2c8993e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.336677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b362f0592bc14f46ac2bac69d26f89d1', 'request_id': 'req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.359758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] The token cache is being invalidate because project b362f0592bc14f46ac2bac69d26f89d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:55.360657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.361339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d23ed845-a6d2-49d8-a7bb-42ff2c8993e5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:55.362955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b110e0ef-5adc-4db7-b6b1-c3219b63c0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.363936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d23ed845-a6d2-49d8-a7bb-42ff2c8993e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:55.366167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2554/5092] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:54 2022] DELETE /identity/v3/projects/b362f0592bc14f46ac2bac69d26f89d1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:55.374940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6c3d-6cc4-4821-bbe5-fa9f1f2da99f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.378081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6c3d-6cc4-4821-bbe5-fa9f1f2da99f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.378081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6c3d-6cc4-4821-bbe5-fa9f1f2da99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.396571 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2539/5093] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:55.400603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed845-a6d2-49d8-a7bb-42ff2c8993e5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:55.419018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed845-a6d2-49d8-a7bb-42ff2c8993e5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.424406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-900b6c3d-6cc4-4821-bbe5-fa9f1f2da99f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:55.425716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-900b6c3d-6cc4-4821-bbe5-fa9f1f2da99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:55.445271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:55.446680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.448286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.448764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.449503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:55.449847 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2555/5094] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:55.450261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:55.452773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:55.458779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba44f0-1ff1-49bc-be6c-5d76f898bf4d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.459070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba44f0-1ff1-49bc-be6c-5d76f898bf4d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.459350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba44f0-1ff1-49bc-be6c-5d76f898bf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.466409 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2540/5095] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:55.477933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:55.482235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-22ba44f0-1ff1-49bc-be6c-5d76f898bf4d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:55.482235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-22ba44f0-1ff1-49bc-be6c-5d76f898bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:55.494120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2556/5096] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:55.495496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7703f-e75b-4db8-9a6e-dd091fed32a9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.496660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba44f0-1ff1-49bc-be6c-5d76f898bf4d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:55.503735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:55.504541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.505033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.505722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.506838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:55.517796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba44f0-1ff1-49bc-be6c-5d76f898bf4d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.517920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:55.518112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:55.518112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.518112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.518112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.518509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:55.518509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:55.519469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:55.541126 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2557/5097] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:55.551630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:55.599017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae6dee-00b2-4eaf-9067-573e9a673dd0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.609701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2541/5098] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:55.617759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:55.617759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:55.618121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:55.618121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.618121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.618121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.618524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:55.618524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:55.663157 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:55.713343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501e7aa-5a22-4b8d-85b6-40cc0259e383 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.720376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:55.721034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.721411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.721567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] PATH_INFO: `/v3/projects/c1e60a329b1e4e93a3e6521338a80fc7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.723134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e60a329b1e4e93a3e6521338a80fc7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:55.725311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:55.744928 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2558/5099] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:55.744928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:55.823147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd10d-900a-4e89-8651-e489e58eafa5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.828752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:55.829230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:55.829802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:55.829802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:55.837536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:55.841695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:55.893703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e60a329b1e4e93a3e6521338a80fc7', 'request_id': 'req-3f42a6fd-402c-4559-a2c7-ded635bf9874'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.899869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e60a329b1e4e93a3e6521338a80fc7', 'request_id': 'req-3f42a6fd-402c-4559-a2c7-ded635bf9874'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:55.972914 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2559/5100] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/users => generated 280 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:55.974630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:55.991488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416cc7-88fb-431b-8d69-d5ba02837811 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:55.996502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e60a329b1e4e93a3e6521338a80fc7', 'request_id': 'req-3f42a6fd-402c-4559-a2c7-ded635bf9874'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.012689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] The token cache is being invalidate because project c1e60a329b1e4e93a3e6521338a80fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:56.012980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.020224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.022443 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2542/5101] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:55 2022] DELETE /identity/v3/projects/c1e60a329b1e4e93a3e6521338a80fc7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:56.023356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.026385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:56.086242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.087010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.087393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.087784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.088839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.090867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.140769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42a6fd-402c-4559-a2c7-ded635bf9874 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.147461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.148364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.148899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.149346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.150235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.152530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.168018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2543/5102] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:56.168930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.170757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:56.183471 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2560/5103] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:55 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:56.185266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.202972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7874fd-17f7-4983-acdd-40d1d36fc8a2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.204845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d9042-e8c9-40ea-b4b7-5ac6ce98f698 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.211132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.212542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.213784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.214694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.215927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.219536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.219536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.219798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] PATH_INFO: `/v3/users/19c52f99ff3f4b20880a1d9f052e04a0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.219907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.220562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c52f99ff3f4b20880a1d9f052e04a0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.223494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.224349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.255246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2561/5104] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:56.258726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.262865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:56.299261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27c0df-00d0-40a2-8127-9b4fcf595bd2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.305559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.307899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.309135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.309601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.310651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.314604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.328263 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2562/5105] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:56.329376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.341621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999fb5-073f-4ee0-85f5-bc8569633b88 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.349665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.351190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.356234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.356833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] PATH_INFO: `/v3/projects/9869b74cfa7741d9b8a98bc25e9f3cc5/users/ccbaed58156741a08c90099b28cb2af4/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.375078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9869b74cfa7741d9b8a98bc25e9f3cc5, user_id=ccbaed58156741a08c90099b28cb2af4, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.377676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.456240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c52f99ff3f4b20880a1d9f052e04a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.470156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c52f99ff3f4b20880a1d9f052e04a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.473258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c52f99ff3f4b20880a1d9f052e04a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.479834 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2563/5106] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:56 2022] PUT /identity/v3/projects/9869b74cfa7741d9b8a98bc25e9f3cc5/users/ccbaed58156741a08c90099b28cb2af4/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:56.480839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.556943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161a41-e869-4375-8d66-06f5a46a036c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.562404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3190b1-d1ba-401e-985c-816cd098645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.563010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3190b1-d1ba-401e-985c-816cd098645a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.563285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3190b1-d1ba-401e-985c-816cd098645a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.563555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3190b1-d1ba-401e-985c-816cd098645a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.564247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3190b1-d1ba-401e-985c-816cd098645a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.565859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3190b1-d1ba-401e-985c-816cd098645a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.575495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c52f99ff3f4b20880a1d9f052e04a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.580565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2564/5107] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:56.584653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c52f99ff3f4b20880a1d9f052e04a0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:56.584793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.584793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.584793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.610796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] MFA Rules not processed for user `ccbaed58156741a08c90099b28cb2af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:56.611591 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2544/5108] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:56 2022] DELETE /identity/v3/users/19c52f99ff3f4b20880a1d9f052e04a0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:56.612002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:56.612925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.614913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:56.699419 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2565/5109] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:56.722643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:56.724827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:56.736446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323447a-758d-48b4-9987-7bbc8c067699 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.744524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.745218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.745498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.745776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] PATH_INFO: `/v3/projects/0a73c1dfdd214cfaaf5d5ef426eadcd6/users/73d8685196ba4e7e9d8babaa5f564f2b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.754789 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:56.787930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a73c1dfdd214cfaaf5d5ef426eadcd6, user_id=73d8685196ba4e7e9d8babaa5f564f2b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.793615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.817821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d72fc-d954-4b6d-b088-84fd697e16b9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:56.821663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb46e69-8804-4dea-a33c-db390d4f7934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:56.822464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46e69-8804-4dea-a33c-db390d4f7934 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.822803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46e69-8804-4dea-a33c-db390d4f7934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.823479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46e69-8804-4dea-a33c-db390d4f7934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.832532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb46e69-8804-4dea-a33c-db390d4f7934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:56.834056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb46e69-8804-4dea-a33c-db390d4f7934 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:56.844083 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2566/5110] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:56.868427 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2545/5111] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:56 2022] PUT /identity/v3/projects/0a73c1dfdd214cfaaf5d5ef426eadcd6/users/73d8685196ba4e7e9d8babaa5f564f2b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:56.879767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:56.880036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:56.880302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:56.916024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] MFA Rules not processed for user `73d8685196ba4e7e9d8babaa5f564f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:56.917490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:57.062539 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2567/5112] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:57.062839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:57.075507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4455a77-8f82-4ce7-82ca-d47a2b5c002c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:57.080608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:57.081497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:57.082138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:57.082835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:57.083788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:create_application_credential(user_id=73d8685196ba4e7e9d8babaa5f564f2b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:57.085285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:57.144975 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:57.247627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:57.249193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:57.307251 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2546/5113] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Oct 23 01:35:57 2022] POST /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials => generated 920 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:57.312030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:57.332289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813aa5-20cc-4a79-8b40-8236794219ce tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:57.344052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:57.345049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:57.345520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:57.345959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules/2f244ca782a44b60a32ca746c9915255` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:57.348327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:delete_access_rule(user_id=73d8685196ba4e7e9d8babaa5f564f2b, access_rule_id=2f244ca782a44b60a32ca746c9915255)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:57.351328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:57.365724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fea1c-46e1-4958-bfdb-ee7fb1a86d89 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:57.371907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:57.372618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:57.372894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:57.373208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] PATH_INFO: `/v3/projects/085d15245cac467a85c503fad95ff839` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:57.374710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=085d15245cac467a85c503fad95ff839)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:57.376982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.delete(ref) Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application yield resource Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application next(self.gen) Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 01:35:57.401616 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise self.value Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application session.commit() Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.session.flush() Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 01:35:57.403154 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application compat.raise_( Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._synchronize( Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise AssertionError( Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 23 01:35:57.404610 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:35:57.407284 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:35:57.409345 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 23 01:35:57.409345 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 23 01:35:57.409345 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 23 01:35:57.409345 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 23 01:35:57.409345 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 23 01:35:57.409345 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:35:57.415387 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2547/5114] 10.222.0.42 () {58 vars in 1362 bytes} [Sun Oct 23 01:35:57 2022] DELETE /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules/2f244ca782a44b60a32ca746c9915255 => generated 89 bytes in 104 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:35:57.416472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:57.419767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:57.464062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fab03-e346-4c29-85ae-514251bb99c5 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:57.471648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:57.472777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:57.473290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:57.473778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] PATH_INFO: `/v3/users/bcaf572331dd405995c4c62d2f63b7f3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:57.475303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcaf572331dd405995c4c62d2f63b7f3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:57.478298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:57.531281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085d15245cac467a85c503fad95ff839', 'request_id': 'req-7fad0b89-5002-463a-9fa9-a1925d7c12ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.536562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085d15245cac467a85c503fad95ff839', 'request_id': 'req-7fad0b89-5002-463a-9fa9-a1925d7c12ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.640348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085d15245cac467a85c503fad95ff839', 'request_id': 'req-7fad0b89-5002-463a-9fa9-a1925d7c12ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.654327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] The token cache is being invalidate because project 085d15245cac467a85c503fad95ff839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:57.655489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.656190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.661153 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2568/5115] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:57 2022] DELETE /identity/v3/projects/085d15245cac467a85c503fad95ff839 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:35:57.661153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:57.674754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:57.721689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcaf572331dd405995c4c62d2f63b7f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.729311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcaf572331dd405995c4c62d2f63b7f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.730092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcaf572331dd405995c4c62d2f63b7f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.741459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad0b89-5002-463a-9fa9-a1925d7c12ff admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:57.745523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46896535-855c-40cd-993a-0e7e8007ce19 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:57.746191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896535-855c-40cd-993a-0e7e8007ce19 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:57.746472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896535-855c-40cd-993a-0e7e8007ce19 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:57.746746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896535-855c-40cd-993a-0e7e8007ce19 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials/08cdd38fd5034bb0ab05d9864bb58c0f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:57.763919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896535-855c-40cd-993a-0e7e8007ce19 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:delete_application_credential(user_id=73d8685196ba4e7e9d8babaa5f564f2b, application_credential_id=08cdd38fd5034bb0ab05d9864bb58c0f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:57.765473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896535-855c-40cd-993a-0e7e8007ce19 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:57.845486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcaf572331dd405995c4c62d2f63b7f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.846842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcaf572331dd405995c4c62d2f63b7f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:57.880114 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2569/5116] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:35:57 2022] DELETE /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials/08cdd38fd5034bb0ab05d9864bb58c0f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:57.880114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec97b4-a598-4303-9191-99789eb451ec None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:57.880114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec97b4-a598-4303-9191-99789eb451ec None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:57.880114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec97b4-a598-4303-9191-99789eb451ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:57.886831 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2548/5117] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:57 2022] DELETE /identity/v3/users/bcaf572331dd405995c4c62d2f63b7f3 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:57.888597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:57.909247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:57.922127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f1ec97b4-a598-4303-9191-99789eb451ec None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:57.923681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f1ec97b4-a598-4303-9191-99789eb451ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:58.006677 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2570/5118] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:58.015566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516239-f164-4057-b977-8d0a0c388fae None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.015865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516239-f164-4057-b977-8d0a0c388fae None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.016196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516239-f164-4057-b977-8d0a0c388fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.033395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441a47-926c-46aa-a43b-6b30bb440c05 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.037836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-34516239-f164-4057-b977-8d0a0c388fae None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:58.039271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-34516239-f164-4057-b977-8d0a0c388fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:58.040665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.041716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.042027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.042312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.043900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:list_access_rules(user_id=73d8685196ba4e7e9d8babaa5f564f2b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.046153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.056258 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2571/5119] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:58.057381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34516239-f164-4057-b977-8d0a0c388fae None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.059041 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2549/5120] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:35:57 2022] GET /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules => generated 369 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:58.059411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.069062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34516239-f164-4057-b977-8d0a0c388fae None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.069588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce86a9-312a-4006-b3ad-6e9cbe8e4647 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.074623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.075254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.075404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.075535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.075813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules/2f244ca782a44b60a32ca746c9915255` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.076827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.077468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:delete_access_rule(user_id=73d8685196ba4e7e9d8babaa5f564f2b, access_rule_id=2f244ca782a44b60a32ca746c9915255)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.077735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.078413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.078991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.079448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:58.079916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.081815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.106907 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2572/5121] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:58.111931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.124852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098f1b6-68ae-4076-af8d-14588eac1e37 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.129772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.130710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.131092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.131499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.132411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.134822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.169590 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2550/5122] 10.222.0.42 () {58 vars in 1362 bytes} [Sun Oct 23 01:35:58 2022] DELETE /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules/2f244ca782a44b60a32ca746c9915255 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:58.171726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.199554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecac2af-d767-47ee-98ce-75b53818191d tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.205050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.206202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.206731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.213394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.215391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:list_access_rules(user_id=73d8685196ba4e7e9d8babaa5f564f2b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.224887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.227956 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2551/5123] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:35:58 2022] GET /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules => generated 158 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:58.232316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.252885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc3890-13e9-4d0d-8c52-e02803f272d8 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.258921 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2573/5124] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:58 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:58.263448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.267548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.268461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.268843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.269262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.270655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:create_application_credential(user_id=73d8685196ba4e7e9d8babaa5f564f2b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.271408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.407181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41e606-8bac-48f8-aedc-c4da237f23a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.412158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.412788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.413071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.413346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.414006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.415967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.480999 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2552/5125] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Oct 23 01:35:58 2022] POST /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials => generated 920 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:58.483626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.505413 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2574/5126] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:58 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:58.510871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.512861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f93cb-bdfc-4bb3-94d6-011469837860 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.532691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a89e2-454f-4166-b7cc-397f4dde2ec5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.546224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.547286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.547914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.548360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.549936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.551580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.568661 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2575/5127] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:58.569884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.594514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f1720-bf77-473b-aeb1-678d9e1d419d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.612786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.613479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.613781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.614098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.614463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.614888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.615146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.615408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.615676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.616898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:list_access_rules(user_id=73d8685196ba4e7e9d8babaa5f564f2b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.618751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.619722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.626535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2553/5128] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:35:58 2022] GET /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules => generated 369 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:58.632319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.639962 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2576/5129] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:35:58.641253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.644042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e36d64-bba4-45c0-ae47-9352d4d3e354 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.648392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8965b-56e1-4186-9dda-3e6da751afd2 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.649035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8965b-56e1-4186-9dda-3e6da751afd2 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.649309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8965b-56e1-4186-9dda-3e6da751afd2 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.649580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8965b-56e1-4186-9dda-3e6da751afd2 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.650541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8965b-56e1-4186-9dda-3e6da751afd2 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:create_application_credential(user_id=73d8685196ba4e7e9d8babaa5f564f2b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.651708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8965b-56e1-4186-9dda-3e6da751afd2 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.662887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410c05-9ff4-4d4f-8291-30d55e7eea4e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.669521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.670392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.670777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.671313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] PATH_INFO: `/v3/projects/66943eaed6014f7dacd491bfb0e5f3ee/users/f28c2fd357a74fc982cb4c0e29b24b2f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.696708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66943eaed6014f7dacd491bfb0e5f3ee, user_id=f28c2fd357a74fc982cb4c0e29b24b2f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.699843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:58.782558 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:58.853087 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2577/5130] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:58 2022] PUT /identity/v3/projects/66943eaed6014f7dacd491bfb0e5f3ee/users/f28c2fd357a74fc982cb4c0e29b24b2f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:58.854228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:58.861651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:58.898910 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2554/5131] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Oct 23 01:35:58 2022] POST /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/application_credentials => generated 919 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:35:58.900165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c20a3-4ccc-4726-bcc7-0b6d028462f1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.900662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c20a3-4ccc-4726-bcc7-0b6d028462f1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.900933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c20a3-4ccc-4726-bcc7-0b6d028462f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.936718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ef6c20a3-4ccc-4726-bcc7-0b6d028462f1 None None] MFA Rules not processed for user `f28c2fd357a74fc982cb4c0e29b24b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:58.938084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ef6c20a3-4ccc-4726-bcc7-0b6d028462f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:58.938213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409d94-2c25-4324-b842-3e986355a055 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:58.943107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:58.943820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:58.944046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:58.944321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] PATH_INFO: `/v3/projects/566c1cfeb26f4afb83ef844be75073d8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:58.945781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566c1cfeb26f4afb83ef844be75073d8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:58.947756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.017418 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:35:59.037540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2555/5132] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:59.038716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c20a3-4ccc-4726-bcc7-0b6d028462f1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.093190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566c1cfeb26f4afb83ef844be75073d8', 'request_id': 'req-022b55dc-a2f3-4cf5-86bd-81aa627d6299'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.102924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566c1cfeb26f4afb83ef844be75073d8', 'request_id': 'req-022b55dc-a2f3-4cf5-86bd-81aa627d6299'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.105301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c20a3-4ccc-4726-bcc7-0b6d028462f1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.161628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d8685196ba4e7e9d8babaa5f564f2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.162428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.162778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.163166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules/f701944a926b43beaf8bc11bd40a14be` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.164382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorizing `identity:get_access_rule(user_id=73d8685196ba4e7e9d8babaa5f564f2b, access_rule_id=f701944a926b43beaf8bc11bd40a14be)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.165924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.172597 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2556/5133] 10.222.0.42 () {58 vars in 1359 bytes} [Sun Oct 23 01:35:59 2022] GET /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b/access_rules/f701944a926b43beaf8bc11bd40a14be => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:35:59.173635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.175617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:59.221960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566c1cfeb26f4afb83ef844be75073d8', 'request_id': 'req-022b55dc-a2f3-4cf5-86bd-81aa627d6299'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.240068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] The token cache is being invalidate because project 566c1cfeb26f4afb83ef844be75073d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:35:59.241059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.241805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f561a-0d42-4b33-80a4-18ff6f3def95 tempest-AccessRulesV3Test-1407198369 tempest-AccessRulesV3Test-1407198369-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.243187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.247239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765b4d3-0d90-481e-8485-417826ad5ecc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.247239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765b4d3-0d90-481e-8485-417826ad5ecc service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.247561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765b4d3-0d90-481e-8485-417826ad5ecc service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.247668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765b4d3-0d90-481e-8485-417826ad5ecc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.251397 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2578/5134] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:35:58 2022] DELETE /identity/v3/projects/566c1cfeb26f4afb83ef844be75073d8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:35:59.252406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.253902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:59.258887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4765b4d3-0d90-481e-8485-417826ad5ecc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:59.328221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765b4d3-0d90-481e-8485-417826ad5ecc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.329811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765b4d3-0d90-481e-8485-417826ad5ecc service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.346731 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2557/5135] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:35:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:35:59.354203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742cff-d9c3-4723-9f0a-7d04e869741a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.354203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742cff-d9c3-4723-9f0a-7d04e869741a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.354203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742cff-d9c3-4723-9f0a-7d04e869741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.370299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b55dc-a2f3-4cf5-86bd-81aa627d6299 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.384062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.384657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.384946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.385220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] PATH_INFO: `/v3/users/73d8685196ba4e7e9d8babaa5f564f2b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.386912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-91742cff-d9c3-4723-9f0a-7d04e869741a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:59.388171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d8685196ba4e7e9d8babaa5f564f2b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.390365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-91742cff-d9c3-4723-9f0a-7d04e869741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:59.394396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.415243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2558/5136] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:35:59.416729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ab3a7-02af-43a4-9d9f-9d35f226d6e6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.417015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ab3a7-02af-43a4-9d9f-9d35f226d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.417288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ab3a7-02af-43a4-9d9f-9d35f226d6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.448987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-934ab3a7-02af-43a4-9d9f-9d35f226d6e6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:35:59.450323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-934ab3a7-02af-43a4-9d9f-9d35f226d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:59.459504 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2559/5137] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:35:59.464564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ab3a7-02af-43a4-9d9f-9d35f226d6e6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.501940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ab3a7-02af-43a4-9d9f-9d35f226d6e6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.507083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.507783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.508126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.509136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.509275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:35:59.509628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.511541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.526022 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2560/5138] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:35:59.530408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.541783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c7d7-5304-4266-a8e0-008675a3ca32 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.549613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.550516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.551104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.559500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.559500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.559500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.687848 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2561/5139] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:35:59 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:59.692081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.753696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d8685196ba4e7e9d8babaa5f564f2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.763518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d8685196ba4e7e9d8babaa5f564f2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.764349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d8685196ba4e7e9d8babaa5f564f2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.787645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedc32a-a405-47af-b888-8089a670b4a3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.792781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.793442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.793735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.794376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.794736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.797181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.851673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d8685196ba4e7e9d8babaa5f564f2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.852321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-811fd341-8863-42f0-86f5-174f81c2f96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d8685196ba4e7e9d8babaa5f564f2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:35:59.886594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2562/5140] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:35:59 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:35:59.891362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.893238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:35:59.919467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87a6a-1b00-4540-8ecd-6a2921b4ea07 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.934131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.934767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.935242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.935406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.936002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.937764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.957692 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2563/5141] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:35:59.958911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:35:59.971304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1072c-2c6b-4e3f-93b7-d326da1c2b01 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:35:59.978201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:35:59.978824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:35:59.979101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:35:59.980011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:35:59.980732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:35:59.982366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:35:59.998025 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2564/5142] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:00.000451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:00.017143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48ba92-6375-4094-a7e4-b5be41d9301c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:00.025425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716a6cd-975f-44ac-8ab3-49715b2d2320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:00.026266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a6cd-975f-44ac-8ab3-49715b2d2320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.026714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a6cd-975f-44ac-8ab3-49715b2d2320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.027090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a6cd-975f-44ac-8ab3-49715b2d2320 admin admin] PATH_INFO: `/v3/projects/02f62c0c345c4470b5807a1861dbe2e0/users/7ac32dce0cd9402d9480285f1e69c143/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.044313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716a6cd-975f-44ac-8ab3-49715b2d2320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f62c0c345c4470b5807a1861dbe2e0, user_id=7ac32dce0cd9402d9480285f1e69c143, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:00.048305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716a6cd-975f-44ac-8ab3-49715b2d2320 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:00.185369 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2579/5143] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:35:59 2022] DELETE /identity/v3/users/73d8685196ba4e7e9d8babaa5f564f2b => generated 0 bytes in 933 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:00.189787 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2565/5144] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:35:59 2022] PUT /identity/v3/projects/02f62c0c345c4470b5807a1861dbe2e0/users/7ac32dce0cd9402d9480285f1e69c143/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:00.191078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.191368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.191641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.207176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8cfb1-1792-492f-baeb-0fab44d31de9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.207714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8cfb1-1792-492f-baeb-0fab44d31de9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.208025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8cfb1-1792-492f-baeb-0fab44d31de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.231307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:00.233501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:00.245307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c9e8cfb1-1792-492f-baeb-0fab44d31de9 None None] MFA Rules not processed for user `7ac32dce0cd9402d9480285f1e69c143`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:00.246604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c9e8cfb1-1792-492f-baeb-0fab44d31de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:00.322022 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2580/5145] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:00.329358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:00.331232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:00.335520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2566/5146] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:00.346396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.350978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.350978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.367864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] MFA Rules not processed for user `7ac32dce0cd9402d9480285f1e69c143`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:00.369167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:00.378004 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2567/5147] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:00.389138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:00.390553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:00.403661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47920-3752-407f-9933-88e2fb01b802 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:00.409269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bc4a5-6703-48a3-8838-b1f9f261279b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:00.410019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc4a5-6703-48a3-8838-b1f9f261279b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.410386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc4a5-6703-48a3-8838-b1f9f261279b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.411795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc4a5-6703-48a3-8838-b1f9f261279b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.444930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc4a5-6703-48a3-8838-b1f9f261279b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:00.446548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc4a5-6703-48a3-8838-b1f9f261279b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:00.464287 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2581/5148] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:00.479887 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:00.512690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f47c4-6c07-4c59-9084-76e199337dde None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:00.523595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fe725-301b-4768-ba4e-33671e6408ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:00.523595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fe725-301b-4768-ba4e-33671e6408ad service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.523595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fe725-301b-4768-ba4e-33671e6408ad service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.524016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fe725-301b-4768-ba4e-33671e6408ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.537066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fe725-301b-4768-ba4e-33671e6408ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:00.540057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fe725-301b-4768-ba4e-33671e6408ad service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:00.579479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2568/5149] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:00.624218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.626173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.626173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.675715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] MFA Rules not processed for user `7ac32dce0cd9402d9480285f1e69c143`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:00.679048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:00.695561 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:00.715738 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2582/5150] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:00.764482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0355-95fa-4351-b284-6649213364ad None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:00.764766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0355-95fa-4351-b284-6649213364ad None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:00.765040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0355-95fa-4351-b284-6649213364ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:00.844117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7acc0355-95fa-4351-b284-6649213364ad None None] MFA Rules not processed for user `7ac32dce0cd9402d9480285f1e69c143`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:00.845350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7acc0355-95fa-4351-b284-6649213364ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:00.863322 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2569/5151] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:01.169117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:01.176894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79339e-859d-4057-bd06-9d57b031cc53 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:01.177418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79339e-859d-4057-bd06-9d57b031cc53 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:01.177529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79339e-859d-4057-bd06-9d57b031cc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:01.178972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:01.211767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47de50-7242-42ea-851d-b804b040d7a7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:01.226787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:01.228225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:01.229767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:01.230201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] PATH_INFO: `/v3/projects/0a73c1dfdd214cfaaf5d5ef426eadcd6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:01.235233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a73c1dfdd214cfaaf5d5ef426eadcd6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:01.238718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:01.244658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1a79339e-859d-4057-bd06-9d57b031cc53 None None] MFA Rules not processed for user `7ac32dce0cd9402d9480285f1e69c143`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:01.245966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a79339e-859d-4057-bd06-9d57b031cc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:01.263758 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2570/5152] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:01.416357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'request_id': 'req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:01.416357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'request_id': 'req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:01.419583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:01.419583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:01.419583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:01.467273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] MFA Rules not processed for user `7ac32dce0cd9402d9480285f1e69c143`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:01.468520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:01.524710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a73c1dfdd214cfaaf5d5ef426eadcd6', 'request_id': 'req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:01.544900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] The token cache is being invalidate because project 0a73c1dfdd214cfaaf5d5ef426eadcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:01.546983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:01.547933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b07b5b5-f784-4b0a-bfae-6586fc4ee213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:01.555557 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2583/5153] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:01 2022] DELETE /identity/v3/projects/0a73c1dfdd214cfaaf5d5ef426eadcd6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:01.578298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d98cb-1aee-4cfb-8e7d-f5602aa83dad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:01.578678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d98cb-1aee-4cfb-8e7d-f5602aa83dad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:01.578958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d98cb-1aee-4cfb-8e7d-f5602aa83dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:01.626665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3f1d98cb-1aee-4cfb-8e7d-f5602aa83dad None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:01.629024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3f1d98cb-1aee-4cfb-8e7d-f5602aa83dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:01.638027 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2571/5154] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:01.669952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:01.675230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:01.747455 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2584/5155] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:01.755256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:01.755897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:01.756419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:01.800400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:01.804505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:01.823140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2585/5156] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:01.824164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:01.824387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c08238-6f1e-475b-afe0-422905446d2c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:01.830044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:01.830872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:01.831557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:01.831973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:01.832127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] PATH_INFO: `/v3/users/7ac32dce0cd9402d9480285f1e69c143` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:01.834742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac32dce0cd9402d9480285f1e69c143)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:01.838580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:01.851636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd82980-4f41-4056-99bd-12e082145348 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:01.870408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:01.871173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:01.871499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:01.871921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] PATH_INFO: `/v3/users/f28c2fd357a74fc982cb4c0e29b24b2f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:01.873463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28c2fd357a74fc982cb4c0e29b24b2f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:01.875457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:02.105346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac32dce0cd9402d9480285f1e69c143'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.117626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac32dce0cd9402d9480285f1e69c143'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.122881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac32dce0cd9402d9480285f1e69c143'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.187007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28c2fd357a74fc982cb4c0e29b24b2f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.199220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28c2fd357a74fc982cb4c0e29b24b2f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.200399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28c2fd357a74fc982cb4c0e29b24b2f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.229637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac32dce0cd9402d9480285f1e69c143'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.230280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac32dce0cd9402d9480285f1e69c143'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.267617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2572/5157] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:01 2022] DELETE /identity/v3/users/7ac32dce0cd9402d9480285f1e69c143 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:02.268544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:02.276323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:02.378285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28c2fd357a74fc982cb4c0e29b24b2f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.379308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a92042d8-ba9f-4825-80c6-70bfad34c227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28c2fd357a74fc982cb4c0e29b24b2f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:02.408957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1478d9-7df4-405f-b2ba-2371e4f50e30 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:02.429794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f2cf6-251f-41d2-975f-2b25fd8e498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:02.432718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2cf6-251f-41d2-975f-2b25fd8e498f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:02.433214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2cf6-251f-41d2-975f-2b25fd8e498f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:02.433638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2cf6-251f-41d2-975f-2b25fd8e498f admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:02.435589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f2cf6-251f-41d2-975f-2b25fd8e498f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:02.437470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f2cf6-251f-41d2-975f-2b25fd8e498f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:02.441791 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:02.443704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f2cf6-251f-41d2-975f-2b25fd8e498f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:02.450754 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2586/5158] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:01 2022] DELETE /identity/v3/users/f28c2fd357a74fc982cb4c0e29b24b2f => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:02.453255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:02.453716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:02.454372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:02.462723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2573/5159] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:02.468681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:02.468681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:02.469011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:02.501083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:02.503720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:02.505182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:02.507306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:02.622500 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:02.666643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2587/5160] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:02.672459 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2574/5161] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:02.683778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:02.693298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:02.703636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:02.705118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:02.715772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449e56a-a420-489e-8fdf-413f63142840 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:02.725698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:02.728470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:02.728873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:02.729254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:02.730045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:02.738523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:02.875714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca82c-5f8e-450c-96ee-f478783d2ce7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:02.913242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:02.913242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:02.913242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:02.913242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:02.914274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:02.916068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:02.943759 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2575/5162] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:02.947185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:02.962959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f4a37-fed4-4b3a-b16d-9463a7c3e008 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:02.970903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:02.975240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:02.975528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:02.975807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:02.990307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:02.991739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:03.003303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2576/5163] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:03.313008 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2588/5164] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:02 2022] POST /identity/v3/projects => generated 393 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:03.314267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:03.324040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925e6c-6e2a-4889-94b7-7d223de42820 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:03.401457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:03.402125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:03.402403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:03.402675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:03.403720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:03.414839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:03.557194 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2577/5165] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:03 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:03.557621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:03.560571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44f41d-f265-48f5-9eef-a2367d3a02fd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:03.571426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:03.572227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:03.572605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:03.572981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:03.573743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:03.578788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:03.635564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2589/5166] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:03.636600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:03.648366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c485b-f0cb-4bcf-8cf2-9badb2a2bce6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:03.664642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:03.672930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:03.672930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:03.672930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:03.672930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:03.672930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:03.699723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2578/5167] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:03.699968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:03.702470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:03.709398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:03.735786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8bc24-6c93-4bcd-8e18-2a02e56cb049 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:03.757196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5644-e833-4f50-87ea-ab8439d40848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:03.758366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5644-e833-4f50-87ea-ab8439d40848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:03.758366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5644-e833-4f50-87ea-ab8439d40848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:03.758825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5644-e833-4f50-87ea-ab8439d40848 admin admin] PATH_INFO: `/v3/projects/4cab62bffb194916995223cda861deeb/users/8aefaea9a03c4d0f988eb20bd241e57b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:03.795610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5644-e833-4f50-87ea-ab8439d40848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cab62bffb194916995223cda861deeb, user_id=8aefaea9a03c4d0f988eb20bd241e57b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:03.803768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b5644-e833-4f50-87ea-ab8439d40848 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:03.876100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98cba5-4e08-48fa-a1b3-6607080c5b37 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:03.884046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:03.885057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:03.885580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:03.886180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:03.888532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:03.922621 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2579/5168] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:03 2022] PUT /identity/v3/projects/4cab62bffb194916995223cda861deeb/users/8aefaea9a03c4d0f988eb20bd241e57b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:03.930815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b22c-70b3-4fc3-8f58-b2f3e85e08df None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:03.931517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b22c-70b3-4fc3-8f58-b2f3e85e08df None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:03.932055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b22c-70b3-4fc3-8f58-b2f3e85e08df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:03.997787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d307b22c-70b3-4fc3-8f58-b2f3e85e08df None None] MFA Rules not processed for user `8aefaea9a03c4d0f988eb20bd241e57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:04.000700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d307b22c-70b3-4fc3-8f58-b2f3e85e08df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:04.035748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:04.041211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:04.059722 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2590/5169] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:04.141068 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2580/5170] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:04.145939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:04.211882 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:04.366522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca41a-92c9-441f-9d0b-877fe80cb2e9 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:04.396877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aae1c1-8762-445c-ba27-ef09db6a822d tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:04.396877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aae1c1-8762-445c-ba27-ef09db6a822d tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:04.398822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aae1c1-8762-445c-ba27-ef09db6a822d tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:04.399925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aae1c1-8762-445c-ba27-ef09db6a822d tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:04.403562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aae1c1-8762-445c-ba27-ef09db6a822d tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:create_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:04.407507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aae1c1-8762-445c-ba27-ef09db6a822d tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:04.484484 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:04.691215 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2591/5171] 10.222.0.42 () {60 vars in 1314 bytes} [Sun Oct 23 01:36:04 2022] POST /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 789 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:04.696073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b22c-70b3-4fc3-8f58-b2f3e85e08df None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:04.714419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b22c-70b3-4fc3-8f58-b2f3e85e08df None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:04.728016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:04.729088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:04.729482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:04.729862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/6f12d0843fe246419cfaf92bc9d9b268` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:04.744885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:get_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=6f12d0843fe246419cfaf92bc9d9b268)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:04.746746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:04.749680 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2581/5172] 10.222.0.42 () {58 vars in 1392 bytes} [Sun Oct 23 01:36:04 2022] GET /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/6f12d0843fe246419cfaf92bc9d9b268 => generated 689 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:04.755783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:04.756359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:04.756833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:04.782895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] MFA Rules not processed for user `8aefaea9a03c4d0f988eb20bd241e57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:04.784528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:04.833676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:04.836757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:04.956046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5317518-3346-47d5-842f-1b7f2cdeb7d7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:04.970122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:04.970122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:04.970122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:04.971475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] PATH_INFO: `/v3/projects/02f62c0c345c4470b5807a1861dbe2e0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:04.972877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f62c0c345c4470b5807a1861dbe2e0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:04.976703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:05.003923 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2592/5173] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 23 01:36:05.006258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:05.011600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:05.028004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc701b21-1528-4c1c-82d9-1f834b6bc2d4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:05.037013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:05.037013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.037013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.037013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] PATH_INFO: `/v3/projects/66943eaed6014f7dacd491bfb0e5f3ee` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.038789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66943eaed6014f7dacd491bfb0e5f3ee)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:05.041145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:05.113205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f62c0c345c4470b5807a1861dbe2e0', 'request_id': 'req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.119554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f62c0c345c4470b5807a1861dbe2e0', 'request_id': 'req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.199294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f62c0c345c4470b5807a1861dbe2e0', 'request_id': 'req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.204797 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:05.220943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] The token cache is being invalidate because project 02f62c0c345c4470b5807a1861dbe2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:05.221283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.222131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.223448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66943eaed6014f7dacd491bfb0e5f3ee', 'request_id': 'req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.225381 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2582/5174] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:04 2022] DELETE /identity/v3/projects/02f62c0c345c4470b5807a1861dbe2e0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:05.238110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:05.242706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:05.249355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66943eaed6014f7dacd491bfb0e5f3ee', 'request_id': 'req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.268079 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:05.359382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66943eaed6014f7dacd491bfb0e5f3ee', 'request_id': 'req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.377701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] The token cache is being invalidate because project 66943eaed6014f7dacd491bfb0e5f3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:05.380958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.383321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f8eed0e-4634-4ee3-9a0e-efed69d2323a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:05.391168 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2593/5175] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:05 2022] DELETE /identity/v3/projects/66943eaed6014f7dacd491bfb0e5f3ee => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:05.394238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaae4c7-6d0b-41ab-bc27-48d86973e9d9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.396386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaae4c7-6d0b-41ab-bc27-48d86973e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.398531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaae4c7-6d0b-41ab-bc27-48d86973e9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.405949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db66cdd-80b5-4ce9-aab5-ade24bda1d97 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:05.441636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bfaae4c7-6d0b-41ab-bc27-48d86973e9d9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:05.447687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bfaae4c7-6d0b-41ab-bc27-48d86973e9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:05.515606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:05.516407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.516796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.517167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/6f12d0843fe246419cfaf92bc9d9b268` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.518852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=6f12d0843fe246419cfaf92bc9d9b268)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:05.520788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:05.566296 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2594/5176] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:05.673001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7700432-d86b-4bab-a388-c42cf4222bd5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.673001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7700432-d86b-4bab-a388-c42cf4222bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.673001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7700432-d86b-4bab-a388-c42cf4222bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.673001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b7700432-d86b-4bab-a388-c42cf4222bd5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:05.673001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b7700432-d86b-4bab-a388-c42cf4222bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:05.673001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2595/5177] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:05.674822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b233e2-6fa8-4b14-96d7-447bf9394f24 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.674822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b233e2-6fa8-4b14-96d7-447bf9394f24 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.674822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b233e2-6fa8-4b14-96d7-447bf9394f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.674822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-31b233e2-6fa8-4b14-96d7-447bf9394f24 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:05.674822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-31b233e2-6fa8-4b14-96d7-447bf9394f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:05.674822 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2596/5178] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:05.675403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.675403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.675403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.681835 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2583/5179] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:36:05 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/6f12d0843fe246419cfaf92bc9d9b268 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:05.682889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:05.699405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:05.702452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3437784-b794-4abb-b88a-57b9384fee00 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:05.705185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:05.711797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:05.712558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.712904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.713416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.714503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:05.714917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:05.717398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:05.725342 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2597/5180] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:05.726552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:05.727999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:05.738127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2584/5181] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:05.746785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:05.746943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48e08e-3fcf-4482-9230-bdcbbb49b783 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:05.750627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:05.751386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.751765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.752268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.752925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691938-1bb5-47fb-931d-7e0532c5e5ae admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:05.754366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:create_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:05.755641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:05.762145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:05.762791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.763072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.763346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.764574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:05.764900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:05.766608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:05.790234 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2585/5182] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:05.791301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:05.805297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a98bd-d6c1-46a1-82d7-f03641473f46 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:05.818726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:05.821003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:05.821003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:05.821003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:05.822707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:05.827447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:05.941999 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2586/5183] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:05 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:05.941999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.004689 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2598/5184] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Oct 23 01:36:05 2022] POST /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 921 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:06.009195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.015054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d033-5025-4f0f-b2c7-6fac7905c132 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.020808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.021254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.021680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.021799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.022463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.023673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b65ea-a49e-4a82-b61d-f30f9147d0b1 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.025571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.029477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.030331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.030815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.031256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.032943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.035547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.124298 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2587/5185] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:05 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:06.124298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.154222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2599/5186] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:06 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:06.156363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.169187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649c2bd-922a-4035-b455-79bd6ce5719c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.196898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6fc2-0e69-4a5d-adb9-cdd45f490455 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.213746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.214435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.215033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.215819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/b5b990ba96a74e4393e465d60d07c940` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.236628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=b5b990ba96a74e4393e465d60d07c940)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.238574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.256154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.256767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.257041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.257307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.257933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.260109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.381896 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2588/5188] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:36:06 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/b5b990ba96a74e4393e465d60d07c940 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:06.388192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2600/5188] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:06 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:06.388369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.388517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.434455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5eb405-af74-48eb-acf0-c67a391497d3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.435601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77bf0f-5441-4790-a616-7c48e4ecf651 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.435723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.435723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.435723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.435723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.436136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.436241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.436241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.436241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.436241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.436665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.436665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.436851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.454304 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2589/5189] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:06.455096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.460811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2601/5190] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:06.461670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.486543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57187800-f4a1-4bde-a58d-8176d866b747 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.499492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.499807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15249af3-fad3-4006-bfae-00660c302f37 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.500130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.500603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.500758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.501294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.502917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.505717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.506561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.512614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.512614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.512614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:create_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.512614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.521819 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2602/5191] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:06.523098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.552675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c47b5-27b3-4529-8f01-9a34182fe524 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.558927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.560824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.561095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.561365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.562035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.563694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.588470 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2603/5192] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:06.589374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.611644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc315c-7f67-400e-9b63-f9f36273f1e1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.626106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.626869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.627143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.627414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] PATH_INFO: `/v3/projects/1e9bd3113b2141b6b7c697737e5c8781/users/025cc6606785417692ae73c7612690e7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.651148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9bd3113b2141b6b7c697737e5c8781, user_id=025cc6606785417692ae73c7612690e7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.653771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.693745 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2590/5193] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Oct 23 01:36:06 2022] POST /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 812 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:06.694971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.703307 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:06.711129 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2604/5194] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:06 2022] PUT /identity/v3/projects/1e9bd3113b2141b6b7c697737e5c8781/users/025cc6606785417692ae73c7612690e7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:06.712272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724afc7a-2492-48bd-adba-a688794d991f tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.713021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.760815 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:06.804437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba442df-9fcd-4d79-9d5a-a4b450a885b4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:06.813626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a85838-07a0-4589-8052-03d6a818df93 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.815423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85838-07a0-4589-8052-03d6a818df93 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.815968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85838-07a0-4589-8052-03d6a818df93 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.816418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a85838-07a0-4589-8052-03d6a818df93 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/7335fcff36b24c129a5ce7d83d82afb7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.818068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:06.818772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.819273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.819625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] PATH_INFO: `/v3/projects/b9976c39e9d94256be3fba141c1ebd97/users/803c776e416a49e3aa689f37bd24740a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.828972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a85838-07a0-4589-8052-03d6a818df93 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=7335fcff36b24c129a5ce7d83d82afb7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.835019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a85838-07a0-4589-8052-03d6a818df93 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.844406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9976c39e9d94256be3fba141c1ebd97, user_id=803c776e416a49e3aa689f37bd24740a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:06.847290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:06.896712 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2605/5195] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:36:06 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/7335fcff36b24c129a5ce7d83d82afb7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:06.898063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066cfd-3708-4e44-b785-a1571b3f0fdc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:06.898349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066cfd-3708-4e44-b785-a1571b3f0fdc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:06.898609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066cfd-3708-4e44-b785-a1571b3f0fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:06.927334 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2591/5196] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:06 2022] PUT /identity/v3/projects/b9976c39e9d94256be3fba141c1ebd97/users/803c776e416a49e3aa689f37bd24740a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:06.928154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:06.937648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7f066cfd-3708-4e44-b785-a1571b3f0fdc None None] MFA Rules not processed for user `025cc6606785417692ae73c7612690e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:06.939059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7f066cfd-3708-4e44-b785-a1571b3f0fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:07.008470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3bc9e-44c8-47d1-8f54-722a9c01cfbd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.013436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde9187-087f-4188-bff2-3b564a37d51b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.014911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9187-087f-4188-bff2-3b564a37d51b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.015304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9187-087f-4188-bff2-3b564a37d51b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.015821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9187-087f-4188-bff2-3b564a37d51b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.016599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde9187-087f-4188-bff2-3b564a37d51b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:create_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.017877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde9187-087f-4188-bff2-3b564a37d51b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.026183 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2606/5197] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:07.031803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.032477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.032732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.066156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] MFA Rules not processed for user `803c776e416a49e3aa689f37bd24740a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:07.067529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:07.136384 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2607/5198] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:07.137031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.138814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:07.224256 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2592/5199] 10.222.0.42 () {60 vars in 1314 bytes} [Sun Oct 23 01:36:06 2022] POST /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 789 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:07.225760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f300f-3426-45d9-be4c-003f56f2469a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.226151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f300f-3426-45d9-be4c-003f56f2469a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.226495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f300f-3426-45d9-be4c-003f56f2469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.235463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e47b8-9f82-4f75-99f2-78ecc6560e1c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.239322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.240019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.240364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.240693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.248664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7b4f300f-3426-45d9-be4c-003f56f2469a None None] MFA Rules not processed for user `803c776e416a49e3aa689f37bd24740a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:07.249868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.250047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7b4f300f-3426-45d9-be4c-003f56f2469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:07.251487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.257521 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2593/5200] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:07.258335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f300f-3426-45d9-be4c-003f56f2469a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.261058 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2608/5201] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:07.270366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f300f-3426-45d9-be4c-003f56f2469a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.271016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.283863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:07.284042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.284042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.284042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.284387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.284387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:create_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.284387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.363385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5472f88-365e-4e1e-9173-3ea41b53bba2 service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.376368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.377216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.382016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.382016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.392968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.397679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.412064 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2609/5202] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:07.472137 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2594/5203] 10.222.0.42 () {60 vars in 1314 bytes} [Sun Oct 23 01:36:07 2022] POST /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 789 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:07.481357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.497026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f17c-4988-4744-a652-4cb8cbc68fa5 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.502673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.503482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.503836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.504166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.504866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:list_application_credentials(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.506695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.524437 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2610/5204] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:36:07 2022] GET /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 1502 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:07.525738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.538483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb9ded-8c45-4b02-b3ed-f8f892ca9277 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.544615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.547345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.547345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.549739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/d0a0eaf7be904815b6be853cf3bf0a0e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.574065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=d0a0eaf7be904815b6be853cf3bf0a0e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.577047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.682314 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2595/5205] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:36:07 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/d0a0eaf7be904815b6be853cf3bf0a0e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:07.689088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.716480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848429-fa2a-465c-9de8-f7bf8707a938 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.734460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.735497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.735956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.736433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/f5ffe9063ce540c2bd67f8d3d4e8bd98` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.750634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=f5ffe9063ce540c2bd67f8d3d4e8bd98)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.753834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.765561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.767654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:07.863336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ff182-0ac2-4b2d-97b2-9a68a3c5aea7 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.871200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2611/5206] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:36:07 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/f5ffe9063ce540c2bd67f8d3d4e8bd98 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:07.871689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.871689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.871983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.872445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.875293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:07.877520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.897145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d86cb-d755-4ba5-ada7-f66655b5589a tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:07.901157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.906915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:07.907549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:07.907832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:07.908105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:07.908658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.908817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:create_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:07.909892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:07.924695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2596/5207] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:07.925745 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:07.926470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:07.965908 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:08.010050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b700-828e-4cc4-a301-ab2f5e5da7f7 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:08.025412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:08.026319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.026697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.026911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] PATH_INFO: `/v3/users/025cc6606785417692ae73c7612690e7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.031642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025cc6606785417692ae73c7612690e7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:08.033819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:08.117136 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2612/5208] 10.222.0.42 () {60 vars in 1314 bytes} [Sun Oct 23 01:36:07 2022] POST /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 788 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:08.119758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:08.129672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cab17-fa0f-4c2b-a402-11e073f97df4 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:08.134659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:08.139542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.140217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.140590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.141447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:create_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:08.142640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:08.314821 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2613/5209] 10.222.0.42 () {60 vars in 1314 bytes} [Sun Oct 23 01:36:08 2022] POST /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials => generated 788 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:08.319798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:08.330507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c465a-b495-4ade-8f1d-8efe724970de tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:08.335162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025cc6606785417692ae73c7612690e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:08.335782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:08.337094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.337094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.337341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.337848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Adding query filter params (name=tempest-application_credential-942429732) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:08.338261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:list_application_credentials(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:08.339906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:08.345155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025cc6606785417692ae73c7612690e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:08.346095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025cc6606785417692ae73c7612690e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:08.352553 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2614/5210] 10.222.0.42 () {58 vars in 1384 bytes} [Sun Oct 23 01:36:08 2022] GET /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials?name=tempest-application_credential-942429732 => generated 885 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:08.356608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:08.374537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fad7-3916-4d3a-82fb-5b4eb90b9f6b tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:08.379415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:08.379415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.379415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.379801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/96c84aaed4a043a492265873a810eda1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.385124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=96c84aaed4a043a492265873a810eda1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:08.387137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:08.433179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025cc6606785417692ae73c7612690e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:08.434521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f423cb5f-6c0c-4c36-9d70-c199d249a6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025cc6606785417692ae73c7612690e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:08.453504 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2597/5211] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:07 2022] DELETE /identity/v3/users/025cc6606785417692ae73c7612690e7 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:08.458017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.458298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.458572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.478886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:08.480104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:08.497191 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2615/5212] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:36:08 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/96c84aaed4a043a492265873a810eda1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:08.503089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:08.504827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:08.518288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55149-3766-4c83-98d7-06b84670d797 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:08.549351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2598/5213] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:08.559064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:08.561859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:08.583550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5bf6b-dc4a-4a69-aacc-96dd79b3ab17 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aefaea9a03c4d0f988eb20bd241e57b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cab62bffb194916995223cda861deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:08.586577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5bf6b-dc4a-4a69-aacc-96dd79b3ab17 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.586577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5bf6b-dc4a-4a69-aacc-96dd79b3ab17 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.586577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5bf6b-dc4a-4a69-aacc-96dd79b3ab17 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/2e4cd4d61d254b2694d7a447bbe9116d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.594220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5bf6b-dc4a-4a69-aacc-96dd79b3ab17 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorizing `identity:delete_application_credential(user_id=8aefaea9a03c4d0f988eb20bd241e57b, application_credential_id=2e4cd4d61d254b2694d7a447bbe9116d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:08.595732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5bf6b-dc4a-4a69-aacc-96dd79b3ab17 tempest-ApplicationCredentialsV3Test-1142191210 tempest-ApplicationCredentialsV3Test-1142191210-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:08.632159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7a1d-f977-4484-b9c0-2fce898946e6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:08.635857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:08.638559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.638945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.639371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.652776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:08.654659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:08.666197 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2599/5214] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:08.725911 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2616/5215] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:36:08 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b/application_credentials/2e4cd4d61d254b2694d7a447bbe9116d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:08.731148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:08.733168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:08.747520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6071-908e-402e-9850-cd3e6df716fb service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:08.753395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:08.756175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:08.756175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:08.756175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] PATH_INFO: `/v3/users/8aefaea9a03c4d0f988eb20bd241e57b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:08.756175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aefaea9a03c4d0f988eb20bd241e57b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:08.758872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:08.914754 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:08.995672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aefaea9a03c4d0f988eb20bd241e57b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.005400 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:09.007686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aefaea9a03c4d0f988eb20bd241e57b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.009071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aefaea9a03c4d0f988eb20bd241e57b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.091422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aefaea9a03c4d0f988eb20bd241e57b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.092171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aefaea9a03c4d0f988eb20bd241e57b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.275265 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2600/5216] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:08 2022] DELETE /identity/v3/users/8aefaea9a03c4d0f988eb20bd241e57b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:09.280455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:09.280733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:09.281006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:09.314847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:09.320051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:09.327605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:09.329537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:09.434596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2617/5217] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:09.444917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:09.446795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:09.533016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740e4b9-87e2-46c3-ac2f-4110cf82c110 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:09.542786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:09.543448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:09.543726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:09.543996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] PATH_INFO: `/v3/projects/1e9bd3113b2141b6b7c697737e5c8781` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:09.550860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9bd3113b2141b6b7c697737e5c8781)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:09.552916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:09.558009 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:09.585465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad545f-2658-40d7-a109-a4c32dfd5838 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:09.592369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd0c8-28cb-4554-beef-957a618e5435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:09.593524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd0c8-28cb-4554-beef-957a618e5435 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:09.594330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd0c8-28cb-4554-beef-957a618e5435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:09.594865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd0c8-28cb-4554-beef-957a618e5435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:09.609920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd0c8-28cb-4554-beef-957a618e5435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:09.612146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd0c8-28cb-4554-beef-957a618e5435 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:09.626342 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2618/5218] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:09.740952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9bd3113b2141b6b7c697737e5c8781', 'request_id': 'req-92207120-aca6-4efc-ba43-fc34e3f22fe6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.759519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9bd3113b2141b6b7c697737e5c8781', 'request_id': 'req-92207120-aca6-4efc-ba43-fc34e3f22fe6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.850936 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:09.873504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9bd3113b2141b6b7c697737e5c8781', 'request_id': 'req-92207120-aca6-4efc-ba43-fc34e3f22fe6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.897551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] The token cache is being invalidate because project 1e9bd3113b2141b6b7c697737e5c8781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:09.898186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.899104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-92207120-aca6-4efc-ba43-fc34e3f22fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:09.904480 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2601/5219] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:09 2022] DELETE /identity/v3/projects/1e9bd3113b2141b6b7c697737e5c8781 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:09.907239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1351ef-8eb7-4710-8fa6-21e8bb9ae7ae None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:09.907239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1351ef-8eb7-4710-8fa6-21e8bb9ae7ae None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:09.907239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1351ef-8eb7-4710-8fa6-21e8bb9ae7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:09.942555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7b1351ef-8eb7-4710-8fa6-21e8bb9ae7ae None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:09.942555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7b1351ef-8eb7-4710-8fa6-21e8bb9ae7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:09.988886 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:10.132287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a4a6c-de12-4711-93ce-44a091258d91 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.132946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a4a6c-de12-4711-93ce-44a091258d91 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.133182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a4a6c-de12-4711-93ce-44a091258d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.134303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2619/5220] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:10.197482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6e7a4a6c-de12-4711-93ce-44a091258d91 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:10.202536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6e7a4a6c-de12-4711-93ce-44a091258d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:10.223344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2602/5221] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:10.228244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1351ef-8eb7-4710-8fa6-21e8bb9ae7ae None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:10.260892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1351ef-8eb7-4710-8fa6-21e8bb9ae7ae None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:10.260892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:10.260892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.260892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.261774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.261774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:10.261774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:10.262704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:10.297115 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2620/5222] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:10.307055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a4a6c-de12-4711-93ce-44a091258d91 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:10.333484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a4a6c-de12-4711-93ce-44a091258d91 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:10.344951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:10.345582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.345988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.346280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.346931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:10.349028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:10.412264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:10.412264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:10.436072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef196cbc-42c5-4c17-b4eb-3e7aa1e33481 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:10.455248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:10.463988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.464272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.464549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] PATH_INFO: `/v3/projects/4cab62bffb194916995223cda861deeb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.476992 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2603/5223] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:10 2022] POST /identity/v3/projects => generated 411 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:10.484852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:10.488662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cab62bffb194916995223cda861deeb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:10.493321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:10.607817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49fde-ecbd-47c7-b752-1cfc540a104d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:10.610915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:10.611913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.612262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.612793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.613501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:10.616604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:10.726010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cab62bffb194916995223cda861deeb', 'request_id': 'req-99248c0f-9f43-4284-8d52-8344e59f80af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:10.733220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cab62bffb194916995223cda861deeb', 'request_id': 'req-99248c0f-9f43-4284-8d52-8344e59f80af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:10.746118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2604/5224] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:10 2022] POST /identity/v3/users => generated 306 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:10.747340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:10.760327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911586-a63c-498a-b885-da630ad61775 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:10.863269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cab62bffb194916995223cda861deeb', 'request_id': 'req-99248c0f-9f43-4284-8d52-8344e59f80af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:10.876852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:10.878034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.878546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.878992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.880006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:10.885065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:10.891505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] The token cache is being invalidate because project 4cab62bffb194916995223cda861deeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:10.891889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:10.892655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-99248c0f-9f43-4284-8d52-8344e59f80af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:10.898049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2621/5225] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:10 2022] DELETE /identity/v3/projects/4cab62bffb194916995223cda861deeb => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:10.900882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68a4c1-fa54-415f-a9d8-d11d0baecd5d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.901408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68a4c1-fa54-415f-a9d8-d11d0baecd5d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.901801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68a4c1-fa54-415f-a9d8-d11d0baecd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.913535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2605/5226] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:10.917666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:10.923443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:10.936739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-df68a4c1-fa54-415f-a9d8-d11d0baecd5d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:10.941953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df68a4c1-fa54-415f-a9d8-d11d0baecd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:10.949232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d534992-3f7d-4e94-9d06-aa5709cd6e40 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:10.959674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:10.962002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.963121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.963415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.964102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:10.965197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2622/5227] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:10.965739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:10.972544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d097bdd-88be-4a9b-b777-fcc3e4a23b8c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:10.972745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d097bdd-88be-4a9b-b777-fcc3e4a23b8c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:10.973104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d097bdd-88be-4a9b-b777-fcc3e4a23b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:10.982800 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2606/5228] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:10.987659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:10.987659 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:11.008383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759a88-3925-4b47-b7a0-e12fcab9142e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.022850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1d021-4142-4bd7-a39f-ca88f2783790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.023617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1d021-4142-4bd7-a39f-ca88f2783790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.027550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1d021-4142-4bd7-a39f-ca88f2783790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.027852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1d021-4142-4bd7-a39f-ca88f2783790 admin admin] PATH_INFO: `/v3/projects/3a857c6cdb414de592feba367a1dbc5e/users/338f80d7d8d942998e0e34fcaccb87af/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.035525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7d097bdd-88be-4a9b-b777-fcc3e4a23b8c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:11.036746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d097bdd-88be-4a9b-b777-fcc3e4a23b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:11.062238 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2623/5229] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:11.062381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1d021-4142-4bd7-a39f-ca88f2783790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a857c6cdb414de592feba367a1dbc5e, user_id=338f80d7d8d942998e0e34fcaccb87af, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.065040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1d021-4142-4bd7-a39f-ca88f2783790 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.066612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d097bdd-88be-4a9b-b777-fcc3e4a23b8c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.084057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d097bdd-88be-4a9b-b777-fcc3e4a23b8c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.089010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.089840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.090390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.090665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.096051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:11.096051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.096051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.107809 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2624/5230] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:36:11.113707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.132633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c0cb-c3ab-4ad6-8276-3aceb9ecf4d1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.139040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.140400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.140730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.141255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.142106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.144289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.166169 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2607/5231] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:10 2022] PUT /identity/v3/projects/3a857c6cdb414de592feba367a1dbc5e/users/338f80d7d8d942998e0e34fcaccb87af/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:11.178868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94cc9b-2ac0-45dc-9444-a31585d4758d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.179292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94cc9b-2ac0-45dc-9444-a31585d4758d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.179710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94cc9b-2ac0-45dc-9444-a31585d4758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.216857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cc94cc9b-2ac0-45dc-9444-a31585d4758d None None] MFA Rules not processed for user `338f80d7d8d942998e0e34fcaccb87af`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:11.219391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc94cc9b-2ac0-45dc-9444-a31585d4758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:11.222538 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:11.268640 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2625/5232] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:11 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:11.273792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.321241 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2608/5233] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:11 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:11.322453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94cc9b-2ac0-45dc-9444-a31585d4758d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.464849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94cc9b-2ac0-45dc-9444-a31585d4758d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.529817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37413c-0a5b-4b23-9a05-f1b46c5c852c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.544123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.555372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.564616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.564616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.564616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.564616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.578276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.579125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.579509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.579879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.581843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.585911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.679226 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2626/5234] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:11 2022] POST /identity/v3/users => generated 290 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:11.694119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.710524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1141ba3-1a7f-435c-a2ef-53867209dcad admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.715871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.716892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.717313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.717705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.718930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.721214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.738038 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2627/5235] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:11.738918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.762446 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2609/5236] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:11 2022] POST /identity/v3/projects => generated 411 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:11.767486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fce9f8-886a-433a-8db1-366b037c2630 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.770634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.884034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.890293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.890293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.890293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.890293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.891674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.914292 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2628/5237] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:11.919166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:11.919322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6d01b-8c8d-4454-8354-d174e5dbc76d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.932325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d30894-232c-4fc9-87b6-b89acfa23827 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:11.932592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.932727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.932979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.933250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.934515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.936497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:11.938424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fa1e8-0597-4c8f-9f62-3caf590d5204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:11.939320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fa1e8-0597-4c8f-9f62-3caf590d5204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:11.939694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fa1e8-0597-4c8f-9f62-3caf590d5204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:11.940169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fa1e8-0597-4c8f-9f62-3caf590d5204 admin admin] PATH_INFO: `/v3/projects/839d67504d2046de9eb563aaf602899b/users/de54b919a5e04ade8d7e29568d88726a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:11.945312 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=11 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:11.960279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fa1e8-0597-4c8f-9f62-3caf590d5204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839d67504d2046de9eb563aaf602899b, user_id=de54b919a5e04ade8d7e29568d88726a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:11.963313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fa1e8-0597-4c8f-9f62-3caf590d5204 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:12.035679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2610/5238] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:11 2022] POST /identity/v3/users => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:12.048879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:12.062015 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2629/5239] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:11 2022] PUT /identity/v3/projects/839d67504d2046de9eb563aaf602899b/users/de54b919a5e04ade8d7e29568d88726a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:12.073505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ffee-e454-46c5-a198-1125d0d0bf5f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.074069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ffee-e454-46c5-a198-1125d0d0bf5f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.074442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ffee-e454-46c5-a198-1125d0d0bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.085784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15240cd4-ba74-4d26-9c00-103569b1f879 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:12.136021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4372ffee-e454-46c5-a198-1125d0d0bf5f None None] MFA Rules not processed for user `de54b919a5e04ade8d7e29568d88726a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:12.137259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4372ffee-e454-46c5-a198-1125d0d0bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:12.163050 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:12.226797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:12.227445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.228322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.228611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.233734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:12.234526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:12.259282 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2611/5240] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:12.260402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:12.274411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59e2cd-c69a-4894-8e5a-f999fbb4f436 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:12.280083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:12.283851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.283851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.283851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] PATH_INFO: `/v3/projects/6d9fc1e1c68f4e96ae98d7407614f5f6/users/5189f4ec0fee422397aa68b0d7ae121c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.340150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9fc1e1c68f4e96ae98d7407614f5f6, user_id=5189f4ec0fee422397aa68b0d7ae121c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:12.343472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:12.346507 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2630/5241] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:12.351621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ffee-e454-46c5-a198-1125d0d0bf5f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:12.362314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ffee-e454-46c5-a198-1125d0d0bf5f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:12.367927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54b919a5e04ade8d7e29568d88726a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '839d67504d2046de9eb563aaf602899b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:12.368681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.369648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.369648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] PATH_INFO: `/v3/domains/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.371227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:12.373163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:12.375206 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2631/5242] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Oct 23 01:36:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:12.379945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:12.394269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba362a-d956-4ce3-8629-586ce27ffdca tempest-DefaultDomainTestJSON-1133693593 tempest-DefaultDomainTestJSON-1133693593-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:12.398934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:12.399668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.406961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.406961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] PATH_INFO: `/v3/users/de54b919a5e04ade8d7e29568d88726a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.406961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de54b919a5e04ade8d7e29568d88726a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:12.406961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:12.462860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2612/5243] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:12 2022] PUT /identity/v3/projects/6d9fc1e1c68f4e96ae98d7407614f5f6/users/5189f4ec0fee422397aa68b0d7ae121c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:12.468213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:12.600281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae8ab2-f0d2-45ad-8956-f6df3962a0fc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:12.611879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:12.612906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.613735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.614241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.615086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:12.617136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:12.633362 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2613/5244] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:12.633362 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:12.634729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:12.647066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82becdc9-bdb9-4d76-b288-1d6ce76bf1f6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:12.652713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fffc6-a213-4537-957e-788b3b13b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:12.653516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fffc6-a213-4537-957e-788b3b13b673 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.654914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fffc6-a213-4537-957e-788b3b13b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.655073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fffc6-a213-4537-957e-788b3b13b673 admin admin] PATH_INFO: `/v3/projects/6d9fc1e1c68f4e96ae98d7407614f5f6/users/5189f4ec0fee422397aa68b0d7ae121c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.657645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fffc6-a213-4537-957e-788b3b13b673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9fc1e1c68f4e96ae98d7407614f5f6, user_id=5189f4ec0fee422397aa68b0d7ae121c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:12.662992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fffc6-a213-4537-957e-788b3b13b673 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:12.685599 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2614/5245] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:12 2022] PUT /identity/v3/projects/6d9fc1e1c68f4e96ae98d7407614f5f6/users/5189f4ec0fee422397aa68b0d7ae121c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:12.687446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.687891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.688028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de54b919a5e04ade8d7e29568d88726a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:12.688167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.696176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de54b919a5e04ade8d7e29568d88726a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:12.697352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de54b919a5e04ade8d7e29568d88726a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:12.739068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] MFA Rules not processed for user `5189f4ec0fee422397aa68b0d7ae121c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:12.741171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:12.776790 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:12.787453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de54b919a5e04ade8d7e29568d88726a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:12.790448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a653a7c8-5956-4deb-a8fe-b181ee5bd2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de54b919a5e04ade8d7e29568d88726a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:12.819361 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2632/5246] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:12 2022] DELETE /identity/v3/users/de54b919a5e04ade8d7e29568d88726a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:12.823064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012df53-7eb2-494c-b7e1-d0a103b7d812 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:12.825541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012df53-7eb2-494c-b7e1-d0a103b7d812 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:12.825541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012df53-7eb2-494c-b7e1-d0a103b7d812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:12.837138 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2615/5247] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:12.844695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:12.846244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:12.848198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f012df53-7eb2-494c-b7e1-d0a103b7d812 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:12.850144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f012df53-7eb2-494c-b7e1-d0a103b7d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:12.932076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae06c-ccdf-45c2-aae6-dbfa741f49b0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:12.934439 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:12.958167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2633/5248] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:12.970252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012df53-7eb2-494c-b7e1-d0a103b7d812 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:13.006438 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:13.007664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:13.008473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:13.008930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:13.009441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:13.033565 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:13.074537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012df53-7eb2-494c-b7e1-d0a103b7d812 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:13.079011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:13.079969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:13.080807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:13.081400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:13.088915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:13.092221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:13.096857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:13.098437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:13.103009 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2616/5249] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:13.103964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:13.113732 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2634/5250] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:13.116531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a122d1-8e9c-4bf2-9aba-143dff3625b8 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:13.128864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb59eb-cc21-492e-85a2-09227ef24a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:13.131107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb59eb-cc21-492e-85a2-09227ef24a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:13.131684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb59eb-cc21-492e-85a2-09227ef24a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:13.131835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb59eb-cc21-492e-85a2-09227ef24a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:13.135579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6aeb59eb-cc21-492e-85a2-09227ef24a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:13.171989 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:13.171989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb59eb-cc21-492e-85a2-09227ef24a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:13.171989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb59eb-cc21-492e-85a2-09227ef24a7a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:13.184637 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2617/5251] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:13.406668 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:13.519386 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:14.109100 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:14.115457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:14.117016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:14.140820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b51c3-7fb5-476f-9789-6b91d3bc228c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:14.149236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:14.149849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:14.150263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:14.150429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] PATH_INFO: `/v3/projects/839d67504d2046de9eb563aaf602899b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:14.151567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=839d67504d2046de9eb563aaf602899b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:14.153489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:14.219220 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:14.290466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839d67504d2046de9eb563aaf602899b', 'request_id': 'req-0fba34f8-66d5-4391-8a39-7c4628132e4f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:14.306339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839d67504d2046de9eb563aaf602899b', 'request_id': 'req-0fba34f8-66d5-4391-8a39-7c4628132e4f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:14.415494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839d67504d2046de9eb563aaf602899b', 'request_id': 'req-0fba34f8-66d5-4391-8a39-7c4628132e4f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:14.438352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] The token cache is being invalidate because project 839d67504d2046de9eb563aaf602899b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:14.439023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:14.440083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fba34f8-66d5-4391-8a39-7c4628132e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:14.445222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2635/5252] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:14 2022] DELETE /identity/v3/projects/839d67504d2046de9eb563aaf602899b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:14.449600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab1eb-434b-405e-b300-9d628ed2f4ce None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:14.450156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab1eb-434b-405e-b300-9d628ed2f4ce None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:14.450297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab1eb-434b-405e-b300-9d628ed2f4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:14.510003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0faab1eb-434b-405e-b300-9d628ed2f4ce None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:14.510003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0faab1eb-434b-405e-b300-9d628ed2f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:14.625906 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2618/5253] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:14.635628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eb668-948f-4198-9548-fb71da582707 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:14.635921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eb668-948f-4198-9548-fb71da582707 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:14.636199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044eb668-948f-4198-9548-fb71da582707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:14.661806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-044eb668-948f-4198-9548-fb71da582707 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:14.662911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-044eb668-948f-4198-9548-fb71da582707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:14.684577 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2636/5254] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:14.685866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab1eb-434b-405e-b300-9d628ed2f4ce None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:14.699165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab1eb-434b-405e-b300-9d628ed2f4ce None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:14.705957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:14.705957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:14.705957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:14.705957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:14.707193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:14.707193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:14.708908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:14.739183 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2619/5255] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:14.743508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044eb668-948f-4198-9548-fb71da582707 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:14.757080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044eb668-948f-4198-9548-fb71da582707 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:14.762868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:14.763620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:14.763948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:14.764290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:14.765111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:14.767371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:14.911350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2637/5256] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:14 2022] POST /identity/v3/projects => generated 399 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:14.914652 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:14.916277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:14.927661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63769a2a-38f8-40c3-952f-062036fa45b3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:14.989570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:14.990249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:14.990600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:14.990876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:14.991520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:14.993584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:15.117764 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2620/5257] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:14 2022] POST /identity/v3/users => generated 306 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:15.119125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:15.130168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5919-fa65-4e6c-8733-634b92a53ce8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:15.150170 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:15.150170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:15.150170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:15.150170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:15.150654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:15.150654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:15.150865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:15.161965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2638/5258] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:15.166575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:15.180440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68704d6-c4b0-4e0c-a3ea-c50919b5e127 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:15.186423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:15.187367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:15.187835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:15.188277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] PATH_INFO: `/v3/projects/78b5548f237e4e63a740ac6f8a0a235b/users/18d88c48c8154dee960b44b9e2c1125e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:15.206702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b5548f237e4e63a740ac6f8a0a235b, user_id=18d88c48c8154dee960b44b9e2c1125e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:15.210569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:15.299639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2621/5259] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:15 2022] PUT /identity/v3/projects/78b5548f237e4e63a740ac6f8a0a235b/users/18d88c48c8154dee960b44b9e2c1125e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:15.303613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:15.314306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90e7bf-e377-4a1f-bf6f-e0745579e02a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:15.377071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbfd14-061e-4d4e-a8e4-2f439eac498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:15.377759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfd14-061e-4d4e-a8e4-2f439eac498a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:15.378453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfd14-061e-4d4e-a8e4-2f439eac498a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:15.378816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbfd14-061e-4d4e-a8e4-2f439eac498a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:15.379681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbfd14-061e-4d4e-a8e4-2f439eac498a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:15.381533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbfd14-061e-4d4e-a8e4-2f439eac498a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:15.396618 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2639/5260] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:15.397729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:15.408734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaa8e0-3463-40e4-bcdf-a921a13a7071 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:15.413677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:15.414296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:15.414578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:15.414847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] PATH_INFO: `/v3/projects/78b5548f237e4e63a740ac6f8a0a235b/users/18d88c48c8154dee960b44b9e2c1125e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:15.416807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b5548f237e4e63a740ac6f8a0a235b, user_id=18d88c48c8154dee960b44b9e2c1125e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:15.420102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:15.431174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2622/5261] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:15 2022] PUT /identity/v3/projects/78b5548f237e4e63a740ac6f8a0a235b/users/18d88c48c8154dee960b44b9e2c1125e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:15.527273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490298-6bea-4647-9cc6-404eb34603ef None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:15.527660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490298-6bea-4647-9cc6-404eb34603ef None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:15.528005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01490298-6bea-4647-9cc6-404eb34603ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:15.562718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-01490298-6bea-4647-9cc6-404eb34603ef None None] MFA Rules not processed for user `18d88c48c8154dee960b44b9e2c1125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:15.564010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-01490298-6bea-4647-9cc6-404eb34603ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:15.716982 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2640/5262] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:15.721496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:15.818189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe23a6-8f7e-4023-931c-05ca587a9fcd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:15.818189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:15.818645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:15.819112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:15.819568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:15.820542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:15.823271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:15.914830 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2623/5263] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:15 2022] POST /identity/v3/projects => generated 399 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:15.915061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01490298-6bea-4647-9cc6-404eb34603ef None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:15.926267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01490298-6bea-4647-9cc6-404eb34603ef None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:16.006529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:16.007461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:16.007745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:16.008017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:16.008734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:16.016899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:16.125012 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2641/5264] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:15 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:16.129575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:16.140765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1338f8-7458-44ff-9d8e-da0bdd757129 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:16.148911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:16.151177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:16.151177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:16.151177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:16.151810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:16.153533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:16.165013 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2624/5265] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:16.169020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:16.180556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260aff9-9981-43c3-a68d-6fb048dfb890 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:16.188344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0995549-0b32-442e-a2a4-079f5c4767d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:16.189077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995549-0b32-442e-a2a4-079f5c4767d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:16.189374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995549-0b32-442e-a2a4-079f5c4767d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:16.189648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995549-0b32-442e-a2a4-079f5c4767d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:16.194338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0995549-0b32-442e-a2a4-079f5c4767d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:16.196047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0995549-0b32-442e-a2a4-079f5c4767d2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:16.212190 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2642/5266] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:16.213154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:16.224145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88e9c-b017-4826-9420-b569817b33c0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:16.231073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:16.232676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:16.233203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:16.233871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] PATH_INFO: `/v3/projects/d08d9fd9887b40c291298cd16cdf96e1/users/67ef731b0efd424ab5f0516a11207884/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:16.256238 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:16.280046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08d9fd9887b40c291298cd16cdf96e1, user_id=67ef731b0efd424ab5f0516a11207884, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:16.283260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:16.408112 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2625/5267] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:16 2022] PUT /identity/v3/projects/d08d9fd9887b40c291298cd16cdf96e1/users/67ef731b0efd424ab5f0516a11207884/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:16.419385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:16.420032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:16.420314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:16.468913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] MFA Rules not processed for user `67ef731b0efd424ab5f0516a11207884`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:16.470559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:16.526822 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:16.593841 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2643/5268] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:16.603665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:16.606007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:16.673781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24a45-a671-44ab-a257-02d01910a90c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:16.677731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679aafb-5195-4251-b8f1-e30157a84ead service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:16.678613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679aafb-5195-4251-b8f1-e30157a84ead service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:16.678949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679aafb-5195-4251-b8f1-e30157a84ead service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:16.679388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679aafb-5195-4251-b8f1-e30157a84ead service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:16.757479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679aafb-5195-4251-b8f1-e30157a84ead service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:16.758958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679aafb-5195-4251-b8f1-e30157a84ead service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:16.768852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2626/5269] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:16 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:16.949010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:16.952056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:17.023174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bce2b-c931-49b6-bba8-a01efc8650ea None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:17.037275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:17.037275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:17.037275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:17.037275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] PATH_INFO: `/v3/users/338f80d7d8d942998e0e34fcaccb87af` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:17.037836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338f80d7d8d942998e0e34fcaccb87af)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:17.037836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:17.204972 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:17.268258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338f80d7d8d942998e0e34fcaccb87af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:17.281526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338f80d7d8d942998e0e34fcaccb87af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:17.282782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338f80d7d8d942998e0e34fcaccb87af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:17.448790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338f80d7d8d942998e0e34fcaccb87af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:17.448790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338f80d7d8d942998e0e34fcaccb87af'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:17.477759 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2644/5270] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:16 2022] DELETE /identity/v3/users/338f80d7d8d942998e0e34fcaccb87af => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:17.498945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:17.499882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:17.501293 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:17.501785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:17.529688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:17.530968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:17.616003 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2627/5271] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:17.626011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:17.627874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:17.704311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9167aa5-3b24-4453-8c25-4f85ce4a0829 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:17.709269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e070-9382-42c0-8598-dce6c6501610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:17.709943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e070-9382-42c0-8598-dce6c6501610 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:17.710270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e070-9382-42c0-8598-dce6c6501610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:17.710547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e070-9382-42c0-8598-dce6c6501610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:17.722212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e070-9382-42c0-8598-dce6c6501610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:17.723702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e070-9382-42c0-8598-dce6c6501610 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:17.734892 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2645/5272] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:17.750232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:17.752078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:17.764176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138572f2-10a2-4b09-85e7-62867a806626 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:17.769331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:17.770100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:17.770454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:17.770836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] PATH_INFO: `/v3/users/18d88c48c8154dee960b44b9e2c1125e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:17.772115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d88c48c8154dee960b44b9e2c1125e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:17.774224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:17.979663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d88c48c8154dee960b44b9e2c1125e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:17.989759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d88c48c8154dee960b44b9e2c1125e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:17.990563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d88c48c8154dee960b44b9e2c1125e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.066400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d88c48c8154dee960b44b9e2c1125e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.067174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d88c48c8154dee960b44b9e2c1125e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.130163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2628/5273] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:17 2022] DELETE /identity/v3/users/18d88c48c8154dee960b44b9e2c1125e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:18.132001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:18.132587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:18.133093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:18.174371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:18.175665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:18.281028 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:18.291807 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2646/5274] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:18.292631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:18.294149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:18.381322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc814-5b25-49c4-b4a1-6e99f1d3bdce admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:18.385219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:18.386018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:18.386711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:18.387200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:18.399884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:18.402529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:18.427712 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2629/5275] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:18.579323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:18.580927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:18.596350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7acb1-ae3d-45c7-b43f-2282099bf8e7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:18.602127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:18.602811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:18.603093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:18.603372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] PATH_INFO: `/v3/projects/3a857c6cdb414de592feba367a1dbc5e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:18.604523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a857c6cdb414de592feba367a1dbc5e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:18.607761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:18.758659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a857c6cdb414de592feba367a1dbc5e', 'request_id': 'req-7d70594e-2002-426f-aef5-3465595ceea0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.770608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a857c6cdb414de592feba367a1dbc5e', 'request_id': 'req-7d70594e-2002-426f-aef5-3465595ceea0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.838398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a857c6cdb414de592feba367a1dbc5e', 'request_id': 'req-7d70594e-2002-426f-aef5-3465595ceea0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.858519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] The token cache is being invalidate because project 3a857c6cdb414de592feba367a1dbc5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:18.860219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.861601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:18.867108 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2647/5276] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:18 2022] DELETE /identity/v3/projects/3a857c6cdb414de592feba367a1dbc5e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:18.871029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:18.882411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9bbd-fc06-4817-b98f-f81dcc761a50 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:18.955103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:18.955757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:18.956047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:18.956320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] PATH_INFO: `/v3/users/5189f4ec0fee422397aa68b0d7ae121c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:18.957596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5189f4ec0fee422397aa68b0d7ae121c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:18.959722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:19.006744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:19.008251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:19.032596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70594e-2002-426f-aef5-3465595ceea0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:19.038629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:19.039434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:19.039773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:19.040160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] PATH_INFO: `/v3/projects/78b5548f237e4e63a740ac6f8a0a235b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:19.041613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b5548f237e4e63a740ac6f8a0a235b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:19.043827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:19.133339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5189f4ec0fee422397aa68b0d7ae121c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.141176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5189f4ec0fee422397aa68b0d7ae121c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.142169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5189f4ec0fee422397aa68b0d7ae121c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.167181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b5548f237e4e63a740ac6f8a0a235b', 'request_id': 'req-cc3069b4-e91c-4110-8745-7be8ea005ab9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.175403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b5548f237e4e63a740ac6f8a0a235b', 'request_id': 'req-cc3069b4-e91c-4110-8745-7be8ea005ab9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.227352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5189f4ec0fee422397aa68b0d7ae121c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.228147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5189f4ec0fee422397aa68b0d7ae121c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.265620 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2630/5277] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:18 2022] DELETE /identity/v3/users/5189f4ec0fee422397aa68b0d7ae121c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:19.283855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b5548f237e4e63a740ac6f8a0a235b', 'request_id': 'req-cc3069b4-e91c-4110-8745-7be8ea005ab9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.301679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] The token cache is being invalidate because project 78b5548f237e4e63a740ac6f8a0a235b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:19.302544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.304463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.307582 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2648/5278] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:19 2022] DELETE /identity/v3/projects/78b5548f237e4e63a740ac6f8a0a235b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:19.312056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:19.313493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:19.402902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23999a6-4454-4f5e-8d6b-48f49e0ef3d6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:19.411111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:19.411778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:19.414339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:19.414905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] PATH_INFO: `/v3/users/67ef731b0efd424ab5f0516a11207884` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:19.416873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ef731b0efd424ab5f0516a11207884)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:19.419760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:19.607656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:19.610360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:19.625655 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:19.657262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ef731b0efd424ab5f0516a11207884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.674392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ef731b0efd424ab5f0516a11207884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.677311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ef731b0efd424ab5f0516a11207884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.717888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3069b4-e91c-4110-8745-7be8ea005ab9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:19.723868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:19.724751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:19.725132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:19.725511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] PATH_INFO: `/v3/projects/6d9fc1e1c68f4e96ae98d7407614f5f6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:19.727153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9fc1e1c68f4e96ae98d7407614f5f6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:19.729897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:19.759785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ef731b0efd424ab5f0516a11207884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.760558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fec4b507-4b39-43b8-bdca-6635d0e1a0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ef731b0efd424ab5f0516a11207884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.799573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2631/5279] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:19 2022] DELETE /identity/v3/users/67ef731b0efd424ab5f0516a11207884 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:19.862945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9fc1e1c68f4e96ae98d7407614f5f6', 'request_id': 'req-fa1bd20a-5da4-4d72-9af1-848ff70f9030'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.876127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9fc1e1c68f4e96ae98d7407614f5f6', 'request_id': 'req-fa1bd20a-5da4-4d72-9af1-848ff70f9030'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.941710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9fc1e1c68f4e96ae98d7407614f5f6', 'request_id': 'req-fa1bd20a-5da4-4d72-9af1-848ff70f9030'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.966736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] The token cache is being invalidate because project 6d9fc1e1c68f4e96ae98d7407614f5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:19.966736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.966736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa1bd20a-5da4-4d72-9af1-848ff70f9030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:19.977819 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2649/5280] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:19 2022] DELETE /identity/v3/projects/6d9fc1e1c68f4e96ae98d7407614f5f6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:19.978872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc44ae-f34d-4c25-a1d7-a0c1b5791577 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:19.979349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc44ae-f34d-4c25-a1d7-a0c1b5791577 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:19.979677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc44ae-f34d-4c25-a1d7-a0c1b5791577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.014269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ecbc44ae-f34d-4c25-a1d7-a0c1b5791577 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:20.015510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ecbc44ae-f34d-4c25-a1d7-a0c1b5791577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:20.158022 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2632/5281] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:20.167578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410f91-43a4-4b1a-ae28-c80bdda456e0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.168395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410f91-43a4-4b1a-ae28-c80bdda456e0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.169234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410f91-43a4-4b1a-ae28-c80bdda456e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.192955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-22410f91-43a4-4b1a-ae28-c80bdda456e0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:20.194232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-22410f91-43a4-4b1a-ae28-c80bdda456e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:20.207853 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2650/5282] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:20.220127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc44ae-f34d-4c25-a1d7-a0c1b5791577 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.223245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc44ae-f34d-4c25-a1d7-a0c1b5791577 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.232942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.233668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.234284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.234802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.236372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:20.236881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.238713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.265542 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2633/5283] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:20.268782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410f91-43a4-4b1a-ae28-c80bdda456e0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.285860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410f91-43a4-4b1a-ae28-c80bdda456e0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.298335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.298335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.298335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.298335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.299123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.299123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.366460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.368297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:20.390409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a6aa3-3170-4667-86d3-5c3a9055294a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.396256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.396969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.397249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.397522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] PATH_INFO: `/v3/projects/d08d9fd9887b40c291298cd16cdf96e1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.399141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08d9fd9887b40c291298cd16cdf96e1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.402112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.415427 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2651/5284] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:20.419807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.501635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb938-1795-49f3-bc70-f1f4c502bec5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.506558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.507170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.507451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.507726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.508357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.510304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.542728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08d9fd9887b40c291298cd16cdf96e1', 'request_id': 'req-a6f13533-c694-4874-a919-457d7730310b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:20.549000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08d9fd9887b40c291298cd16cdf96e1', 'request_id': 'req-a6f13533-c694-4874-a919-457d7730310b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:20.604934 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2652/5285] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:20.608871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.615504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08d9fd9887b40c291298cd16cdf96e1', 'request_id': 'req-a6f13533-c694-4874-a919-457d7730310b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:20.618745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a566f5-9935-43e3-9b72-a6f55f17f05e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.657521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] The token cache is being invalidate because project d08d9fd9887b40c291298cd16cdf96e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:20.657922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:20.658941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6f13533-c694-4874-a919-457d7730310b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:20.662527 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2634/5286] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:20 2022] DELETE /identity/v3/projects/d08d9fd9887b40c291298cd16cdf96e1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:20.666776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdeeed-eea5-4334-be69-90b01e635095 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.667167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdeeed-eea5-4334-be69-90b01e635095 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.669106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdeeed-eea5-4334-be69-90b01e635095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.683329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.684304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.684304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.685038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.685738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.687399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.691862 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:20.692029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4cbdeeed-eea5-4334-be69-90b01e635095 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:20.693333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4cbdeeed-eea5-4334-be69-90b01e635095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:20.700117 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2653/5287] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:20.704747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.706128 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2635/5288] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:20.712039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:20.712579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94bf9-64fd-46e5-858f-3ed55c80bca5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.712925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94bf9-64fd-46e5-858f-3ed55c80bca5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.713302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b94bf9-64fd-46e5-858f-3ed55c80bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.726776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6275-3d78-4411-be6c-ea67d53f1488 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.731989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.732703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.733111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.733385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.733775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-41b94bf9-64fd-46e5-858f-3ed55c80bca5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:20.734035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.735204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-41b94bf9-64fd-46e5-858f-3ed55c80bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:20.735709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.749949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2636/5290] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:20.751211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b94bf9-64fd-46e5-858f-3ed55c80bca5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.752880 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2654/5289] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:20.753775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.764237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b94bf9-64fd-46e5-858f-3ed55c80bca5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.765648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc2ad-57ef-41c4-8a60-04f3506ba716 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.770971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.771585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.771858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.772130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.772775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:20.773076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.779709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f218eda-406f-4cc2-aa08-09c93d61eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.779709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218eda-406f-4cc2-aa08-09c93d61eb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.779709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218eda-406f-4cc2-aa08-09c93d61eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.779709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218eda-406f-4cc2-aa08-09c93d61eb50 admin admin] PATH_INFO: `/v3/projects/32c75fe81e2d4894aa78e91dc323c262/users/30b21338da8c42d7a6c739feb9610f87/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.780257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.804088 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2637/5291] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:20.804460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f218eda-406f-4cc2-aa08-09c93d61eb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c75fe81e2d4894aa78e91dc323c262, user_id=30b21338da8c42d7a6c739feb9610f87, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.804460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f218eda-406f-4cc2-aa08-09c93d61eb50 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.805886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.819820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752755b1-2733-41d4-8672-171ecd2d8734 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:20.825280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:20.826573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.826852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.827125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.827763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:20.829707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:20.884656 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2655/5292] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:20 2022] PUT /identity/v3/projects/32c75fe81e2d4894aa78e91dc323c262/users/30b21338da8c42d7a6c739feb9610f87/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:20.895182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5045-1d4b-4cde-834d-c549bfbe7958 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:20.895478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5045-1d4b-4cde-834d-c549bfbe7958 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:20.895754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5045-1d4b-4cde-834d-c549bfbe7958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:20.923387 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2638/5293] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:20.931002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:20.943070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-de7b5045-1d4b-4cde-834d-c549bfbe7958 None None] MFA Rules not processed for user `30b21338da8c42d7a6c739feb9610f87`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:20.952243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de7b5045-1d4b-4cde-834d-c549bfbe7958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:21.007203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b9153-54af-41d1-b4e2-5e744904f625 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.013180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.014149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.014497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.014705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.015344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.017355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.027564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2656/5294] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:21.032037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b5045-1d4b-4cde-834d-c549bfbe7958 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.042770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b5045-1d4b-4cde-834d-c549bfbe7958 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.049178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.049858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.050235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.050576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.051297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.053405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.056404 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:21.094782 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2639/5295] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:20 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:21.100497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.111443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77519-9df8-4cdd-8e42-be740669583f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.116537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.117274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.117667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.118235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.118982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.120653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.131850 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2640/5296] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:21.136087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.147948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879c27-3b97-4062-bb69-c949a5e5df76 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.153587 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2657/5297] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:21 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:21.157654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.158216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.159184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.159657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.159997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.161068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.162843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.179737 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2641/5298] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:21.181802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.195312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a72838-3198-4cdb-8d02-6c208277da1a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.226657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49399b5d-57ad-4cc7-b34f-60c0a241ea24 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.232865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.233614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.233964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.234363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.235071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.237063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.283500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ff265-7447-47c3-812a-6aa44bb5de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.284294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff265-7447-47c3-812a-6aa44bb5de04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.284499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff265-7447-47c3-812a-6aa44bb5de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.284768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff265-7447-47c3-812a-6aa44bb5de04 admin admin] PATH_INFO: `/v3/projects/ab5eb3e7a6e14b12bb6fd98cfc21d099/users/8c68f9d4382441a2a0468475333f836a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.305635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff265-7447-47c3-812a-6aa44bb5de04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5eb3e7a6e14b12bb6fd98cfc21d099, user_id=8c68f9d4382441a2a0468475333f836a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.307958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff265-7447-47c3-812a-6aa44bb5de04 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.338688 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2658/5299] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:21 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:21.347206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.359025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a52d2-6f96-407b-a0ef-bff3ccf7b178 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.364508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.365112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.365447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.365706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.366398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.367987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.381681 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2659/5300] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:21.382941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.392865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb3a5f-7f67-47bf-859a-7212e480aca8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.399745 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2642/5301] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:21 2022] PUT /identity/v3/projects/ab5eb3e7a6e14b12bb6fd98cfc21d099/users/8c68f9d4382441a2a0468475333f836a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:21.404722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.405011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.405285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.437128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] MFA Rules not processed for user `8c68f9d4382441a2a0468475333f836a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:21.438491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:21.463166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.463837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.464237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.464523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] PATH_INFO: `/v3/projects/16607e1baca44b7a8096c867fc115f57/users/6ab2bdd44ffc43269d3f1993734963b5/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.504226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16607e1baca44b7a8096c867fc115f57, user_id=6ab2bdd44ffc43269d3f1993734963b5, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.507700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.534272 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2643/5302] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:21.546419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.547829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:21.584632 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2660/5303] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:21 2022] PUT /identity/v3/projects/16607e1baca44b7a8096c867fc115f57/users/6ab2bdd44ffc43269d3f1993734963b5/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:21.585565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.618380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded05c-7c37-44c7-ba91-3cc747df494a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.673686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845999-14dc-4f69-bfa4-16ba04ca0d48 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.683729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.685205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.685486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.685761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.686467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.688269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.690174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.691069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.691417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.691691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.703561 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2661/5304] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:21.708004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.722560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b63b98-3787-403c-a3e7-a4110c89a951 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.728355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11d526-890c-4ea5-81bb-ca451e8aa1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.728988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d526-890c-4ea5-81bb-ca451e8aa1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.729265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d526-890c-4ea5-81bb-ca451e8aa1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.729533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d526-890c-4ea5-81bb-ca451e8aa1fc admin admin] PATH_INFO: `/v3/projects/16607e1baca44b7a8096c867fc115f57/users/6ab2bdd44ffc43269d3f1993734963b5/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.732584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11d526-890c-4ea5-81bb-ca451e8aa1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=16607e1baca44b7a8096c867fc115f57, user_id=6ab2bdd44ffc43269d3f1993734963b5, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.735989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11d526-890c-4ea5-81bb-ca451e8aa1fc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.749085 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2662/5305] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:21 2022] PUT /identity/v3/projects/16607e1baca44b7a8096c867fc115f57/users/6ab2bdd44ffc43269d3f1993734963b5/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:21.759748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c4c7-0bc5-42b7-8fd7-9356017f664d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.760033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c4c7-0bc5-42b7-8fd7-9356017f664d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.760357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c4c7-0bc5-42b7-8fd7-9356017f664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.769593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.771834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.784008 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2644/5306] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:21.797034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9b54c4c7-0bc5-42b7-8fd7-9356017f664d None None] MFA Rules not processed for user `6ab2bdd44ffc43269d3f1993734963b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:21.798371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9b54c4c7-0bc5-42b7-8fd7-9356017f664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:21.900934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.901098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2663/5307] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:21.905539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c4c7-0bc5-42b7-8fd7-9356017f664d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.911923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc9d6f-cb3a-4c11-9b16-0ee39af7ffec service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.917205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c4c7-0bc5-42b7-8fd7-9356017f664d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.923105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab2bdd44ffc43269d3f1993734963b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16607e1baca44b7a8096c867fc115f57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.924077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.924290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.924710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.925372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:21.929692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.929692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:21.951952 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2664/5308] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:21.953240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:21.967116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42eb8e-1930-4ce1-9025-81169558c6c2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:21.973788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab2bdd44ffc43269d3f1993734963b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16607e1baca44b7a8096c867fc115f57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:21.974552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:21.974928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:21.975352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:21.976074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:21.978173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:22.015693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:22.016403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:22.016688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:22.016963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] PATH_INFO: `/v3/users/8c68f9d4382441a2a0468475333f836a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:22.018300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c68f9d4382441a2a0468475333f836a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:22.022466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:22.126259 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2665/5309] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:21 2022] POST /identity/v3/projects => generated 350 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:22.130320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:22.195617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362e46d-e3f6-462c-906f-cb4403115a7b tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:22.202318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab2bdd44ffc43269d3f1993734963b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16607e1baca44b7a8096c867fc115f57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:22.202968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:22.203238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:22.203693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:22.204211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:22.204520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:22.206214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:22.209373 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:22.217842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c68f9d4382441a2a0468475333f836a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:22.223172 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2666/5310] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:36:22.230135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c68f9d4382441a2a0468475333f836a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:22.235071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c68f9d4382441a2a0468475333f836a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:22.235198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:22.235321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:22.294312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450403-a424-4a3c-97ae-ed78f9c0fab2 tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:22.297994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af29df-bb3d-46eb-ba39-a9ce9573aa1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:22.298877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af29df-bb3d-46eb-ba39-a9ce9573aa1b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:22.299147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af29df-bb3d-46eb-ba39-a9ce9573aa1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:22.299417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af29df-bb3d-46eb-ba39-a9ce9573aa1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:22.308500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af29df-bb3d-46eb-ba39-a9ce9573aa1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:22.310824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af29df-bb3d-46eb-ba39-a9ce9573aa1b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:22.311712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c68f9d4382441a2a0468475333f836a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:22.312862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c68f9d4382441a2a0468475333f836a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:22.320619 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2667/5311] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:22.344621 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2645/5312] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:21 2022] DELETE /identity/v3/users/8c68f9d4382441a2a0468475333f836a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:22.349367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:22.350215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:22.350531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:22.365003 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:22.373567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:22.374838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:22.455042 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2668/5313] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:22.474000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:22.475427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:22.540116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490fd44-2f2d-4f7c-8df3-15eb0375d745 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:22.544592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773c4bf-4ca2-454b-8315-0a70bf4c05b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:22.545475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c4bf-4ca2-454b-8315-0a70bf4c05b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:22.546023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c4bf-4ca2-454b-8315-0a70bf4c05b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:22.546495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773c4bf-4ca2-454b-8315-0a70bf4c05b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:22.557012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c4bf-4ca2-454b-8315-0a70bf4c05b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:22.558901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773c4bf-4ca2-454b-8315-0a70bf4c05b2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:22.581571 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2646/5314] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:23.152146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:23.153927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:23.173098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a643c-0aff-4f0e-b721-6d125e826515 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:23.178844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:23.179732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:23.180229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:23.180698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] PATH_INFO: `/v3/projects/ab5eb3e7a6e14b12bb6fd98cfc21d099` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:23.182334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5eb3e7a6e14b12bb6fd98cfc21d099)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:23.184456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:23.335772 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:23.337332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5eb3e7a6e14b12bb6fd98cfc21d099', 'request_id': 'req-5ad8308c-9764-4237-860e-458e74dd2307'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:23.351788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5eb3e7a6e14b12bb6fd98cfc21d099', 'request_id': 'req-5ad8308c-9764-4237-860e-458e74dd2307'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:23.415904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5eb3e7a6e14b12bb6fd98cfc21d099', 'request_id': 'req-5ad8308c-9764-4237-860e-458e74dd2307'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:23.427858 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:23.434949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] The token cache is being invalidate because project ab5eb3e7a6e14b12bb6fd98cfc21d099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:23.434949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:23.434949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5ad8308c-9764-4237-860e-458e74dd2307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:23.434949 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2669/5315] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:23 2022] DELETE /identity/v3/projects/ab5eb3e7a6e14b12bb6fd98cfc21d099 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:23.439725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4b08d-575e-4513-b561-0720095c1501 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:23.440333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4b08d-575e-4513-b561-0720095c1501 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:23.440898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4b08d-575e-4513-b561-0720095c1501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:23.465069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-56b4b08d-575e-4513-b561-0720095c1501 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:23.466819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56b4b08d-575e-4513-b561-0720095c1501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:23.565172 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2647/5316] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:23.573534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f3ad-7721-49ae-b6c3-9e806e4449a6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:23.573925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f3ad-7721-49ae-b6c3-9e806e4449a6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:23.576384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7f3ad-7721-49ae-b6c3-9e806e4449a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:23.598970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-05f7f3ad-7721-49ae-b6c3-9e806e4449a6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:23.600393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05f7f3ad-7721-49ae-b6c3-9e806e4449a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:23.618020 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2670/5317] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:23.620121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4b08d-575e-4513-b561-0720095c1501 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:23.632436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4b08d-575e-4513-b561-0720095c1501 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:23.640794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:23.641665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:23.642010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:23.645144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:23.645144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:23.645144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:23.645665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:23.664154 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2648/5318] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:23.665731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7f3ad-7721-49ae-b6c3-9e806e4449a6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:23.676816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7f3ad-7721-49ae-b6c3-9e806e4449a6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:23.682285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:23.686142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:23.686142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:23.686142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:23.686142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:23.686586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:23.783995 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2671/5319] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:23 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:23.788312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:23.804448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba2132-de45-4bd2-a0fa-96a67eee6113 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:23.886752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:23.887686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:23.888022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:23.888356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:23.889110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:23.891303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:23.906690 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:23.957371 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2649/5320] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:23 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:23.958425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:23.970090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff13f0a-f412-4d67-bc75-02c50971544b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:23.975689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:23.976638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:23.976971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:23.977253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:23.977918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:23.979780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:24.000341 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2672/5321] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:24.002185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:24.012984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed509c8-afd5-457a-8386-b271ccae415b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:24.017838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a8a5-0e3e-48ce-9d1d-291608124fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:24.018482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a8a5-0e3e-48ce-9d1d-291608124fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:24.018758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a8a5-0e3e-48ce-9d1d-291608124fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:24.019027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a8a5-0e3e-48ce-9d1d-291608124fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:24.019705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a8a5-0e3e-48ce-9d1d-291608124fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:24.021297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a8a5-0e3e-48ce-9d1d-291608124fdd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:24.048273 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2650/5322] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:24.049487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:24.065129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1000544-5a05-4faa-ae95-f263f83d0c8f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:24.079010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:24.079717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:24.080013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:24.080253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] PATH_INFO: `/v3/projects/3fc87ab1a6364e31914c15bdd29bfb67/users/b88fb09e73454f6ca52ca99832fb48c4/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:24.091447 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:24.113193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc87ab1a6364e31914c15bdd29bfb67, user_id=b88fb09e73454f6ca52ca99832fb48c4, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:24.116258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:24.184135 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2673/5323] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:24 2022] PUT /identity/v3/projects/3fc87ab1a6364e31914c15bdd29bfb67/users/b88fb09e73454f6ca52ca99832fb48c4/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:24.186799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a6af-77b0-47e7-a815-37a535972f0b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:24.187050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a6af-77b0-47e7-a815-37a535972f0b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:24.187326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a6af-77b0-47e7-a815-37a535972f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:24.228437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3838a6af-77b0-47e7-a815-37a535972f0b None None] MFA Rules not processed for user `b88fb09e73454f6ca52ca99832fb48c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:24.238323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3838a6af-77b0-47e7-a815-37a535972f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:24.325131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2651/5324] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:24.329516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:24.435198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f64fcc-1958-48cb-9081-53977aa62028 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:24.438023 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:24.443401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:24.446749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:24.446749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:24.446749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:24.446749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:24.448033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:24.468242 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:24.556346 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2674/5325] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:24 2022] POST /identity/v3/projects => generated 397 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:24.560740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838a6af-77b0-47e7-a815-37a535972f0b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:24.572547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838a6af-77b0-47e7-a815-37a535972f0b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:24.644220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:24.645109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:24.646078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:24.647632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:24.648884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:24.652196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:24.754224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2652/5326] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:24 2022] POST /identity/v3/users => generated 305 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:24.758150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:24.769512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68506fe-1a85-45ec-b0df-61db59be37ee admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:24.774161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:24.774774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:24.775056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:24.775326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:24.776000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:24.777594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:24.789270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2675/5327] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:24.794150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:24.806660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45a67-ccb2-41c6-91c5-2cd03653c3df admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:24.812752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:24.813529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:24.814319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:24.815044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] PATH_INFO: `/v3/projects/5c56098064424395b49c58aaeb2baa9a/users/fa6d1874b5674ceaa6dd875e85bc4179/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:24.817963 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:24.839266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56098064424395b49c58aaeb2baa9a, user_id=fa6d1874b5674ceaa6dd875e85bc4179, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:24.842630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:24.860915 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:24.940802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2653/5328] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:24 2022] PUT /identity/v3/projects/5c56098064424395b49c58aaeb2baa9a/users/fa6d1874b5674ceaa6dd875e85bc4179/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:24.941655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:24.952427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb835e0-17ca-4357-9707-e540eaae5c0f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:25.009167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42224b75-275e-4ebc-9f69-1e38d1c913cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:25.010343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224b75-275e-4ebc-9f69-1e38d1c913cb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:25.010636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224b75-275e-4ebc-9f69-1e38d1c913cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:25.011444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224b75-275e-4ebc-9f69-1e38d1c913cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:25.012174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42224b75-275e-4ebc-9f69-1e38d1c913cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:25.014638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42224b75-275e-4ebc-9f69-1e38d1c913cb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:25.025165 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2676/5329] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:25.029157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:25.040547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc76c-03e1-461c-b0a9-19ac3ee3f603 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:25.045509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:25.046314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:25.046672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:25.047022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] PATH_INFO: `/v3/projects/5c56098064424395b49c58aaeb2baa9a/users/fa6d1874b5674ceaa6dd875e85bc4179/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:25.049619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56098064424395b49c58aaeb2baa9a, user_id=fa6d1874b5674ceaa6dd875e85bc4179, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:25.052445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:25.066276 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:25.073205 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2654/5330] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:25 2022] PUT /identity/v3/projects/5c56098064424395b49c58aaeb2baa9a/users/fa6d1874b5674ceaa6dd875e85bc4179/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:25.083439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:25.083734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:25.083981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:25.108410 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:25.135903 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:25.152779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] MFA Rules not processed for user `fa6d1874b5674ceaa6dd875e85bc4179`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:25.155698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:25.246613 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2677/5331] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:25.262133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:25.266132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:25.345765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654c538-0370-4583-b549-3980dd0d4037 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:25.349762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:25.352068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:25.353581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:25.353746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:25.354041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:25.354318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:25.421481 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:25.466237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:25.468328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:25.483728 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2655/5332] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:25.490516 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:25.499860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631396-8d2c-4a0d-88c5-aaa2e0c6ed62 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:25.505059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab2bdd44ffc43269d3f1993734963b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16607e1baca44b7a8096c867fc115f57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:25.505738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:25.506328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:25.506601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] PATH_INFO: `/v3/projects/3633380986994568a46e02704426595a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:25.508703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3633380986994568a46e02704426595a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:25.510675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:25.662276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3633380986994568a46e02704426595a', 'request_id': 'req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:25.668973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3633380986994568a46e02704426595a', 'request_id': 'req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:25.758190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3633380986994568a46e02704426595a', 'request_id': 'req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:25.771959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] The token cache is being invalidate because project 3633380986994568a46e02704426595a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:25.772229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:25.772893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d16812fc-e75f-49fe-8cee-b3f086cdb8ce tempest-QuotasNegativeTest-892186191 tempest-QuotasNegativeTest-892186191-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:25.775059 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2678/5333] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:25 2022] DELETE /identity/v3/projects/3633380986994568a46e02704426595a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:25.780427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:25.783223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:25.864609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc0a4-c72a-4fab-b6e9-1d5425418618 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:25.920122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:25.920690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:25.920968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:25.921241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] PATH_INFO: `/v3/users/30b21338da8c42d7a6c739feb9610f87` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:25.922412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b21338da8c42d7a6c739feb9610f87)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:25.924658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:26.104661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b21338da8c42d7a6c739feb9610f87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:26.112585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b21338da8c42d7a6c739feb9610f87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:26.113277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b21338da8c42d7a6c739feb9610f87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:26.186891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b21338da8c42d7a6c739feb9610f87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:26.187711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b21338da8c42d7a6c739feb9610f87'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:26.232482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2656/5334] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:25 2022] DELETE /identity/v3/users/30b21338da8c42d7a6c739feb9610f87 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:26.236796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:26.237180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:26.237463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:26.265082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:26.267920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:26.268066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:26.269119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:26.350945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2679/5335] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:26.362756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:26.365019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:26.392297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc042cf-88ba-4d81-9bfa-6f33ad16ad08 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:26.401139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:26.401869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:26.402193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:26.402474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:26.404748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:26.431084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6f8d8-43a4-4fa1-b5fa-ec9ef480b1d9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:26.439463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:26.439463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:26.439463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:26.439463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:26.446369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:26.447802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:26.458140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2680/5336] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:26.472832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:26.472832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:26.483656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2657/5337] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:26.532330 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:26.730321 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:27.028273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:27.029848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:27.050455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff56271-2034-4221-9c2b-2f78593e56eb service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:27.056584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:27.057456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:27.057889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:27.058300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] PATH_INFO: `/v3/projects/32c75fe81e2d4894aa78e91dc323c262` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:27.060349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c75fe81e2d4894aa78e91dc323c262)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:27.063014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:27.211832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c75fe81e2d4894aa78e91dc323c262', 'request_id': 'req-ed7e7fff-c448-4594-86c2-903a0b258041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.218549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c75fe81e2d4894aa78e91dc323c262', 'request_id': 'req-ed7e7fff-c448-4594-86c2-903a0b258041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.312771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c75fe81e2d4894aa78e91dc323c262', 'request_id': 'req-ed7e7fff-c448-4594-86c2-903a0b258041'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.324972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] The token cache is being invalidate because project 32c75fe81e2d4894aa78e91dc323c262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:27.325254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.325885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.327444 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2681/5338] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:27 2022] DELETE /identity/v3/projects/32c75fe81e2d4894aa78e91dc323c262 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:27.331551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:27.345097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abfdfc-b09b-48e3-93d5-8ae6e72e3043 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:27.456716 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:27.458118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:27.458788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:27.459504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:27.466143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] PATH_INFO: `/v3/users/6ab2bdd44ffc43269d3f1993734963b5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:27.466143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab2bdd44ffc43269d3f1993734963b5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:27.474747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:27.703395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab2bdd44ffc43269d3f1993734963b5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.716575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab2bdd44ffc43269d3f1993734963b5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.716575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab2bdd44ffc43269d3f1993734963b5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.764818 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:27.860880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab2bdd44ffc43269d3f1993734963b5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.861763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab2bdd44ffc43269d3f1993734963b5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:27.879512 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2658/5339] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:27 2022] DELETE /identity/v3/users/6ab2bdd44ffc43269d3f1993734963b5 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:28.565687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:28.567478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:28.586157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e7fff-c448-4594-86c2-903a0b258041 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:28.668145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:28.668839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:28.669119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:28.669550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] PATH_INFO: `/v3/projects/16607e1baca44b7a8096c867fc115f57` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:28.671201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=16607e1baca44b7a8096c867fc115f57)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:28.673843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:28.754668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:28.756829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:28.801166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16607e1baca44b7a8096c867fc115f57', 'request_id': 'req-46f87522-95d1-4685-ba44-8faef2db37fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:28.808202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16607e1baca44b7a8096c867fc115f57', 'request_id': 'req-46f87522-95d1-4685-ba44-8faef2db37fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:28.813425 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:28.845145 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:28.873005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16607e1baca44b7a8096c867fc115f57', 'request_id': 'req-46f87522-95d1-4685-ba44-8faef2db37fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:28.879081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb7b9a-ae97-46cb-a193-10c1240dd201 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:28.892058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] The token cache is being invalidate because project 16607e1baca44b7a8096c867fc115f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:28.892366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:28.894640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f87522-95d1-4685-ba44-8faef2db37fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:28.896229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2682/5340] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:28 2022] DELETE /identity/v3/projects/16607e1baca44b7a8096c867fc115f57 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:28.909459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e424e-6fe8-41c7-8090-5d461576a2a2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:28.910420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e424e-6fe8-41c7-8090-5d461576a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:28.911430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e424e-6fe8-41c7-8090-5d461576a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:28.939781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-af5e424e-6fe8-41c7-8090-5d461576a2a2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:28.942527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-af5e424e-6fe8-41c7-8090-5d461576a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:28.966669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:28.967322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:28.967803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:28.968095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:28.969845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:29.051718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2683/5341] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:29.053256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c50ec-8cb9-4959-984e-e7923e66960e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.053494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c50ec-8cb9-4959-984e-e7923e66960e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.054015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c50ec-8cb9-4959-984e-e7923e66960e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.054892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:29.056593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:29.073644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2659/5342] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:29.093326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-536c50ec-8cb9-4959-984e-e7923e66960e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:29.094593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-536c50ec-8cb9-4959-984e-e7923e66960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:29.113110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2684/5343] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:29.114362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:29.127238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6737e6-75d8-443a-be27-54275c890fee service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:29.132642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:29.133419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.133790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.134387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.134921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:29.135355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:29.137029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:29.150624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2660/5344] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:29.154964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c50ec-8cb9-4959-984e-e7923e66960e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:29.165097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c50ec-8cb9-4959-984e-e7923e66960e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:29.182710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:29.183760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.184747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.185026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.185751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:29.187724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:29.302577 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2685/5345] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:29 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:29.307629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:29.323278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d0cd5-bd83-4abf-9d0d-28b74284a67a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:29.447264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:29.447961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.448244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.449742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.449742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:29.451961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:29.538470 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2661/5346] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:29 2022] POST /identity/v3/users => generated 282 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:29.539816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:29.551788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412708-8222-4db5-a311-eea13eec4302 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:29.557022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:29.557657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.557936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.558768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.558899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:29.561059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:29.572121 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2686/5347] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:29.576421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:29.588233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de4ba0-a95c-4473-ac49-07a98b34b70f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:29.593895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c011-4893-446f-b362-ad7e204a2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:29.597351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c011-4893-446f-b362-ad7e204a2272 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.597351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c011-4893-446f-b362-ad7e204a2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.597351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c011-4893-446f-b362-ad7e204a2272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.597351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c011-4893-446f-b362-ad7e204a2272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:29.598740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c011-4893-446f-b362-ad7e204a2272 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:29.611967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2662/5348] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:29.616229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:29.619028 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:29.631369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99dd46-f87c-4e6a-88af-46596d896fa4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:29.643740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:29.649441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.649441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.649441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] PATH_INFO: `/v3/projects/575c8490868443efb3689568f19759ed/users/3aa100d92f6a4c718528c678729776e6/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.664246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575c8490868443efb3689568f19759ed, user_id=3aa100d92f6a4c718528c678729776e6, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:29.668219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:29.770831 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2687/5349] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:29 2022] PUT /identity/v3/projects/575c8490868443efb3689568f19759ed/users/3aa100d92f6a4c718528c678729776e6/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:29.775768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82d7b-905c-4362-a5b7-6159cb31890b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:29.776283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82d7b-905c-4362-a5b7-6159cb31890b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:29.776483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82d7b-905c-4362-a5b7-6159cb31890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:29.830906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8de82d7b-905c-4362-a5b7-6159cb31890b None None] MFA Rules not processed for user `3aa100d92f6a4c718528c678729776e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:29.832531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8de82d7b-905c-4362-a5b7-6159cb31890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:29.943925 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2663/5350] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:29.948571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:30.026081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aebf4-73d2-4d06-bed0-0dfd7b77ea87 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:30.031250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:30.032019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:30.032367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:30.032701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:30.033416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:30.036526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:30.048177 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:30.169082 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2688/5351] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:29 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:30.172673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de82d7b-905c-4362-a5b7-6159cb31890b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:30.196136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de82d7b-905c-4362-a5b7-6159cb31890b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:30.249635 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:30.309875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:30.310769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:30.312616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:30.312967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:30.313847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:30.316092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:30.429237 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2664/5352] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:30 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:30.433518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:30.459022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0a5a7-0120-4197-a613-79bf81366231 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:30.464703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:30.466394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:30.466839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:30.467517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:30.468135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:30.472775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:30.496560 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2689/5353] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:30.500895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:30.517769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae35b6-3eb1-42a9-a123-884f57854bc4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:30.524303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:30.529007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:30.529510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:30.529785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] PATH_INFO: `/v3/projects/b992ac1d79cc47b797f85276284a1bb0/users/4e0c334eed974f8f855cb6cb7599c49e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:30.542017 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:30.560125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b992ac1d79cc47b797f85276284a1bb0, user_id=4e0c334eed974f8f855cb6cb7599c49e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:30.562975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:30.663472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2665/5354] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:30 2022] PUT /identity/v3/projects/b992ac1d79cc47b797f85276284a1bb0/users/4e0c334eed974f8f855cb6cb7599c49e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:30.667823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:30.684934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6380fbd-fcef-4394-b619-a9487d2ba75f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:30.786419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5bf45-5b82-4af7-aa12-d88a5c028446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:30.787563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5bf45-5b82-4af7-aa12-d88a5c028446 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:30.787915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5bf45-5b82-4af7-aa12-d88a5c028446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:30.788192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5bf45-5b82-4af7-aa12-d88a5c028446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:30.788893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5bf45-5b82-4af7-aa12-d88a5c028446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:30.791260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5bf45-5b82-4af7-aa12-d88a5c028446 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:30.806818 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2690/5355] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:30.808341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:30.820310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc7b0-d6de-47a5-9f7e-4b5def13c9e6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:30.826655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:30.827458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:30.827835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:30.832041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] PATH_INFO: `/v3/projects/b992ac1d79cc47b797f85276284a1bb0/users/4e0c334eed974f8f855cb6cb7599c49e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:30.832041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b992ac1d79cc47b797f85276284a1bb0, user_id=4e0c334eed974f8f855cb6cb7599c49e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:30.834208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:30.853128 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2666/5356] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:30 2022] PUT /identity/v3/projects/b992ac1d79cc47b797f85276284a1bb0/users/4e0c334eed974f8f855cb6cb7599c49e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:30.870947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:30.871487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:30.871972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:30.906000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] MFA Rules not processed for user `4e0c334eed974f8f855cb6cb7599c49e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:30.907629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:31.011301 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2691/5357] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:31.031492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:31.033234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:31.100652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9293d-9f0e-4b89-8338-992602277e7a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:31.104519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:31.105170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:31.105452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:31.105724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:31.117260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:31.118988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:31.128641 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2667/5358] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:31.177734 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:32.038496 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:32.329871 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:32.747172 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:33.312714 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:33.506400 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:34.356083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:34.359009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:34.372188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc76cd1-15cd-44c1-9dee-a863bc119224 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:34.375875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5b8f-7e24-44c1-8f60-7f30ea667966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:34.376730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5b8f-7e24-44c1-8f60-7f30ea667966 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:34.377030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5b8f-7e24-44c1-8f60-7f30ea667966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:34.377284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5b8f-7e24-44c1-8f60-7f30ea667966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:34.399285 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:34.438283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5b8f-7e24-44c1-8f60-7f30ea667966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:34.448083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5b8f-7e24-44c1-8f60-7f30ea667966 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:34.448905 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2692/5359] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:34.770103 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:35.314945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:35.316763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:35.393158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63051-ccb0-48a3-9046-fddefdfc5325 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:35.399592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:35.400350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:35.400691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:35.401029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] PATH_INFO: `/v3/users/b88fb09e73454f6ca52ca99832fb48c4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:35.402418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88fb09e73454f6ca52ca99832fb48c4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:35.406350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:35.446972 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:35.605686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88fb09e73454f6ca52ca99832fb48c4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:35.613017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88fb09e73454f6ca52ca99832fb48c4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:35.613686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88fb09e73454f6ca52ca99832fb48c4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:35.711889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88fb09e73454f6ca52ca99832fb48c4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:35.712521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88fb09e73454f6ca52ca99832fb48c4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:35.731551 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2668/5360] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:35 2022] DELETE /identity/v3/users/b88fb09e73454f6ca52ca99832fb48c4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:35.736192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:35.736697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:35.736818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:35.755985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:35.757200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:35.775839 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:35.822250 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2693/5361] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:35.831177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:35.832860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:35.893499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f2d5-7e24-4ac1-9dc1-5a20aba2b3f5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:35.897113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf2ac-b413-4b58-bdb1-a72707b9f85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:35.897789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf2ac-b413-4b58-bdb1-a72707b9f85e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:35.898038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf2ac-b413-4b58-bdb1-a72707b9f85e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:35.898305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf2ac-b413-4b58-bdb1-a72707b9f85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:35.908286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf2ac-b413-4b58-bdb1-a72707b9f85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:35.909709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf2ac-b413-4b58-bdb1-a72707b9f85e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:35.919701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2669/5362] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:35.945535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:35.947000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:35.960075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d8fc-2ee2-43be-8d07-a89aee5f357b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:35.965864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:35.966625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:35.970106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:35.970106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] PATH_INFO: `/v3/users/3aa100d92f6a4c718528c678729776e6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:35.970106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa100d92f6a4c718528c678729776e6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:35.970460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:36.108931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa100d92f6a4c718528c678729776e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.116341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa100d92f6a4c718528c678729776e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.117088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa100d92f6a4c718528c678729776e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.214243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa100d92f6a4c718528c678729776e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.215538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa100d92f6a4c718528c678729776e6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.237704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2694/5363] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:35 2022] DELETE /identity/v3/users/3aa100d92f6a4c718528c678729776e6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:36.242344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:36.242631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:36.242903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:36.264571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:36.265860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:36.320829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:36.326712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:36.339995 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2670/5364] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:36.347984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:36.349672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:36.406481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c78e31-0a3e-4904-b171-e52abb510348 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:36.411339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:36.412015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:36.412294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:36.412566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] PATH_INFO: `/v3/projects/3fc87ab1a6364e31914c15bdd29bfb67` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:36.413754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc87ab1a6364e31914c15bdd29bfb67)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:36.415787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:36.421431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0226-b98c-4432-b301-52146acb97a5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:36.428041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:36.428698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:36.428974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:36.429264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:36.439990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:36.441527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:36.452284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2671/5365] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:36.470832 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:36.532949 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:36.540412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc87ab1a6364e31914c15bdd29bfb67', 'request_id': 'req-3886b283-58da-4dd9-90f9-cb3fae986d8b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.546407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc87ab1a6364e31914c15bdd29bfb67', 'request_id': 'req-3886b283-58da-4dd9-90f9-cb3fae986d8b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.638170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc87ab1a6364e31914c15bdd29bfb67', 'request_id': 'req-3886b283-58da-4dd9-90f9-cb3fae986d8b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.652080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] The token cache is being invalidate because project 3fc87ab1a6364e31914c15bdd29bfb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:36.652517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.653414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.655352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2695/5366] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:36 2022] DELETE /identity/v3/projects/3fc87ab1a6364e31914c15bdd29bfb67 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:36.659670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:36.671785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7595e-a57b-4b73-910f-799e60321c41 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:36.735613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:36.736525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:36.736525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:36.736794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] PATH_INFO: `/v3/users/fa6d1874b5674ceaa6dd875e85bc4179` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:36.737921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6d1874b5674ceaa6dd875e85bc4179)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:36.740077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:36.902650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6d1874b5674ceaa6dd875e85bc4179'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.909917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6d1874b5674ceaa6dd875e85bc4179'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.910699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6d1874b5674ceaa6dd875e85bc4179'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.917457 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:36.974641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6d1874b5674ceaa6dd875e85bc4179'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.975353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6d1874b5674ceaa6dd875e85bc4179'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:36.994681 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2672/5367] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:36 2022] DELETE /identity/v3/users/fa6d1874b5674ceaa6dd875e85bc4179 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:37.160486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:37.161861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:37.176322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886b283-58da-4dd9-90f9-cb3fae986d8b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:37.238823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:37.239572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:37.239729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:37.240183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] PATH_INFO: `/v3/projects/575c8490868443efb3689568f19759ed` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:37.241638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575c8490868443efb3689568f19759ed)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:37.243707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:37.257526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:37.259276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:37.278976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f027b54-9b2e-4739-975b-20a3b722a7aa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:37.284224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:37.285041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:37.285393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:37.285734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] PATH_INFO: `/v3/projects/5c56098064424395b49c58aaeb2baa9a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:37.287019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c56098064424395b49c58aaeb2baa9a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:37.289350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:37.365540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575c8490868443efb3689568f19759ed', 'request_id': 'req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.371388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575c8490868443efb3689568f19759ed', 'request_id': 'req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.423591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c56098064424395b49c58aaeb2baa9a', 'request_id': 'req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.429424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c56098064424395b49c58aaeb2baa9a', 'request_id': 'req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.523808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575c8490868443efb3689568f19759ed', 'request_id': 'req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.538630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] The token cache is being invalidate because project 575c8490868443efb3689568f19759ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:37.538921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.539594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.541397 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2696/5368] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:37 2022] DELETE /identity/v3/projects/575c8490868443efb3689568f19759ed => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:37.545547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:37.546944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:37.612462 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:37.616434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8041-600f-4e30-a2bc-7da8e3cbf727 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:37.626386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c56098064424395b49c58aaeb2baa9a', 'request_id': 'req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.639650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] The token cache is being invalidate because project 5c56098064424395b49c58aaeb2baa9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:37.640046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.645886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5beb595e-cfde-40d4-a1f8-ccd6db8d664c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.645886 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2673/5369] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:37 2022] DELETE /identity/v3/projects/5c56098064424395b49c58aaeb2baa9a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:37.647663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f77f5-76bd-41a2-946f-e02fdef19db3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:37.648107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f77f5-76bd-41a2-946f-e02fdef19db3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:37.648454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f77f5-76bd-41a2-946f-e02fdef19db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:37.693699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:37.694237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cb6f77f5-76bd-41a2-946f-e02fdef19db3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:37.694646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:37.695069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:37.695414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] PATH_INFO: `/v3/users/4e0c334eed974f8f855cb6cb7599c49e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:37.695707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cb6f77f5-76bd-41a2-946f-e02fdef19db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:37.696764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0c334eed974f8f855cb6cb7599c49e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:37.700187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:37.706137 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:37.708365 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2674/5370] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:37.716738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676aba6-32ce-4ea4-beb0-b91ed4152f7c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:37.717023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676aba6-32ce-4ea4-beb0-b91ed4152f7c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:37.717294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676aba6-32ce-4ea4-beb0-b91ed4152f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:37.747718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8676aba6-32ce-4ea4-beb0-b91ed4152f7c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:37.749062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8676aba6-32ce-4ea4-beb0-b91ed4152f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:37.762582 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2675/5371] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:37.764746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676aba6-32ce-4ea4-beb0-b91ed4152f7c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:37.775045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676aba6-32ce-4ea4-beb0-b91ed4152f7c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:37.780597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:37.781204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:37.781478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:37.781744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:37.782523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:37.782822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:37.785163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:37.798041 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2676/5372] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:37.803427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:37.816017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5152-179b-4e0e-a189-288fd32d9483 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:37.821474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:37.822232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:37.822514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:37.822793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:37.823405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:37.825374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:37.870260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0c334eed974f8f855cb6cb7599c49e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.877570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0c334eed974f8f855cb6cb7599c49e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.878311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0c334eed974f8f855cb6cb7599c49e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.952961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0c334eed974f8f855cb6cb7599c49e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.954522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0c334eed974f8f855cb6cb7599c49e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:37.968932 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2677/5373] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:37 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:37.970884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:37.973336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:37.987956 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2697/5374] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:37 2022] DELETE /identity/v3/users/4e0c334eed974f8f855cb6cb7599c49e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:38.083940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030adc6-4706-4478-a606-c3c3e2512c37 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:38.169475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:38.169845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.170160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.170541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.171187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:38.173101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:38.291840 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2678/5375] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:37 2022] POST /identity/v3/users => generated 296 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:38.292051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:38.317482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59c898-973f-41a4-a4a3-856cbef26016 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:38.332645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:38.333346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.333612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.333874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.334732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:38.336338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:38.353320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:38.356075 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2698/5376] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:38.365525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16429d6d-743f-49f5-afae-5d932746208b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:38.370896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:38.371613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.371966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.372477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.373611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:38.375616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:38.386531 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2679/5377] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:38.391403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:38.401910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5956d-197b-40ec-8e1c-cd229baaf1d2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:38.407017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d636b6-5a0b-45e3-918c-90c9c4518124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:38.407692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d636b6-5a0b-45e3-918c-90c9c4518124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.408020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d636b6-5a0b-45e3-918c-90c9c4518124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.408295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d636b6-5a0b-45e3-918c-90c9c4518124 admin admin] PATH_INFO: `/v3/projects/93ba32cf625149bdb43c20b0ee4fda35/users/77f1d85807c84e0698f1950b3b52ec40/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.424492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d636b6-5a0b-45e3-918c-90c9c4518124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ba32cf625149bdb43c20b0ee4fda35, user_id=77f1d85807c84e0698f1950b3b52ec40, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:38.427215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d636b6-5a0b-45e3-918c-90c9c4518124 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:38.525207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:38.527893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:38.541855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7065e4-ef12-49b4-a182-e339c8055d29 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:38.549789 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2699/5378] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:38 2022] PUT /identity/v3/projects/93ba32cf625149bdb43c20b0ee4fda35/users/77f1d85807c84e0698f1950b3b52ec40/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:38.560830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.561256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.562118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.590545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] MFA Rules not processed for user `77f1d85807c84e0698f1950b3b52ec40`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:38.591973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:38.610129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:38.610964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.611256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.611528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] PATH_INFO: `/v3/projects/b992ac1d79cc47b797f85276284a1bb0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.612675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b992ac1d79cc47b797f85276284a1bb0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:38.615402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:38.643343 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:38.674853 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2700/5379] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:38.686373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:38.688289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:38.743721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b992ac1d79cc47b797f85276284a1bb0', 'request_id': 'req-36f713eb-2947-49aa-a95d-cd276fabdad4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:38.754653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b992ac1d79cc47b797f85276284a1bb0', 'request_id': 'req-36f713eb-2947-49aa-a95d-cd276fabdad4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:38.769806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304f4c0-080f-411b-8cf8-718f47bcc83e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:38.804139 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:38.837079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:38.837859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.839364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.839808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.852888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b992ac1d79cc47b797f85276284a1bb0', 'request_id': 'req-36f713eb-2947-49aa-a95d-cd276fabdad4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:38.869927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] The token cache is being invalidate because project b992ac1d79cc47b797f85276284a1bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:38.870423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:38.871880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-36f713eb-2947-49aa-a95d-cd276fabdad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:38.873960 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2680/5380] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:38 2022] DELETE /identity/v3/projects/b992ac1d79cc47b797f85276284a1bb0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:38.879899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1957a-1b6d-4658-82c0-99b65bf4f831 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:38.880217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1957a-1b6d-4658-82c0-99b65bf4f831 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:38.880454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1957a-1b6d-4658-82c0-99b65bf4f831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:38.909929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2ad1957a-1b6d-4658-82c0-99b65bf4f831 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:38.911287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ad1957a-1b6d-4658-82c0-99b65bf4f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:38.944525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:38.945383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:38.955871 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2701/5381] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:38.985415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.002567 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2681/5382] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:39.009212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8869-11fc-47c1-a12c-6d4181405a49 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.020551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8869-11fc-47c1-a12c-6d4181405a49 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.021460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8869-11fc-47c1-a12c-6d4181405a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.045219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d3ae8869-11fc-47c1-a12c-6d4181405a49 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:39.046689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d3ae8869-11fc-47c1-a12c-6d4181405a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:39.061803 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2682/5383] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:39.065779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae8869-11fc-47c1-a12c-6d4181405a49 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.073937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae8869-11fc-47c1-a12c-6d4181405a49 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.079365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.080216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.080849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.081219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.082002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:39.082437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.084426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.089133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2e18b-4919-47b3-9016-4c27b0e58b53 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.095533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.098454 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2683/5384] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:39.099034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.099522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.099969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] PATH_INFO: `/v3/users/77f1d85807c84e0698f1950b3b52ec40` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.101650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f1d85807c84e0698f1950b3b52ec40)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.103501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.104749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.116551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e43f7-5f70-4b94-97a0-8779d5a4e43f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.123284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.123914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.125103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.125103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.126327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.128486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.311066 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2684/5385] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:39 2022] POST /identity/v3/projects => generated 393 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:39.314589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.376654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f1d85807c84e0698f1950b3b52ec40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:39.386174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f1d85807c84e0698f1950b3b52ec40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:39.390883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f1d85807c84e0698f1950b3b52ec40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:39.400240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf6350-aa26-4bad-8240-e6b158c7bdc7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.407112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.407800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.408265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.409134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.410311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.413284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.495024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f1d85807c84e0698f1950b3b52ec40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:39.496220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f1d8b1e3-5bb7-4222-a1b4-995cb32a8d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f1d85807c84e0698f1950b3b52ec40'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:39.508573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2685/5386] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:39 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:39.514225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.516327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:39.525703 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2702/5387] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:38 2022] DELETE /identity/v3/users/77f1d85807c84e0698f1950b3b52ec40 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:39.531043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.531403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.531645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc8b0-a5ef-4acf-85af-83225e0b2829 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.531828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.556530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:39.556530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:39.589007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.590591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.590864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.591130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.591762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.593423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.604748 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2686/5388] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:36:39.608770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.616607 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2703/5389] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:39.622305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4237a5-e4c9-4c28-a174-8c7217a107c6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.631259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.631714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.631995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.632958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.633387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.635040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.640117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.643070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:39.648160 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2687/5390] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:39.651996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:39.663171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee087ed6-0aae-4a1c-a22f-52f76382536d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.669774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.670599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.673546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.673546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] PATH_INFO: `/v3/projects/d5f5436359814ad89cc722ab95a01965/users/aba75cb271ad4a898b73f62d3cff25b9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.703495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f5436359814ad89cc722ab95a01965, user_id=aba75cb271ad4a898b73f62d3cff25b9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.706310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.721016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063099a-fff8-4353-bfc9-35136531b0f2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:39.724919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764254bd-6566-4a26-a4b1-deffc111b45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:39.725616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764254bd-6566-4a26-a4b1-deffc111b45e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.725908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764254bd-6566-4a26-a4b1-deffc111b45e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.726390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764254bd-6566-4a26-a4b1-deffc111b45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.737513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764254bd-6566-4a26-a4b1-deffc111b45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:39.738548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764254bd-6566-4a26-a4b1-deffc111b45e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:39.749098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2704/5391] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:39.828384 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2688/5392] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:39 2022] PUT /identity/v3/projects/d5f5436359814ad89cc722ab95a01965/users/aba75cb271ad4a898b73f62d3cff25b9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:39.839287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29c10-5d00-4f50-a350-97a07eea51c9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:39.840324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29c10-5d00-4f50-a350-97a07eea51c9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:39.840874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29c10-5d00-4f50-a350-97a07eea51c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:39.870916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7fe29c10-5d00-4f50-a350-97a07eea51c9 None None] MFA Rules not processed for user `aba75cb271ad4a898b73f62d3cff25b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:39.872386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7fe29c10-5d00-4f50-a350-97a07eea51c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:39.968171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2705/5393] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:39.974405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:40.056327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8328d-17f6-4b51-8019-4a0d653aa84d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:40.063659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba314e-e42f-4024-a820-a44f2f17b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:40.065325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba314e-e42f-4024-a820-a44f2f17b749 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.065683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba314e-e42f-4024-a820-a44f2f17b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.066023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba314e-e42f-4024-a820-a44f2f17b749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.067086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba314e-e42f-4024-a820-a44f2f17b749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:40.071246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba314e-e42f-4024-a820-a44f2f17b749 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:40.123968 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:40.200949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2689/5394] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:39 2022] POST /identity/v3/projects => generated 393 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:40.204914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29c10-5d00-4f50-a350-97a07eea51c9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:40.216893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29c10-5d00-4f50-a350-97a07eea51c9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:40.312648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa3dd-9fcb-4893-8e45-278116cd75ad None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.313832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa3dd-9fcb-4893-8e45-278116cd75ad None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.314046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa3dd-9fcb-4893-8e45-278116cd75ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.319284 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:40.334317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:40.335742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.336024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.336307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.336997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:40.338997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:40.352408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dd3aa3dd-9fcb-4893-8e45-278116cd75ad None None] MFA Rules not processed for user `634bed7898c24baca6ba00392d49eea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:40.353639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd3aa3dd-9fcb-4893-8e45-278116cd75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:40.416170 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2690/5395] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:40.435609 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2706/5396] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:40 2022] POST /identity/v3/users => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:40.441395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa3dd-9fcb-4893-8e45-278116cd75ad None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:40.460235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa3dd-9fcb-4893-8e45-278116cd75ad None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:40.467542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:40.468704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.469392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.469853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.470734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:40.473228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:40.494711 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2691/5397] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:40.499330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:40.515493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464223b8-0dfb-4d25-9a5e-74afb448bd95 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:40.521734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:40.522744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.523200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.523642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] PATH_INFO: `/v3/projects/ee5b8a7fa26d4100a38253aaa575cc15/users/c38a348847094047983d411d78c186a6/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.541701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5b8a7fa26d4100a38253aaa575cc15, user_id=c38a348847094047983d411d78c186a6, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:40.545513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:40.618516 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2707/5398] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:40 2022] PUT /identity/v3/projects/ee5b8a7fa26d4100a38253aaa575cc15/users/c38a348847094047983d411d78c186a6/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:40.622981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:40.634891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e8e4f-b1a9-4879-a7b4-34a8b1a093d0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:40.706538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7063ec-548e-430b-a11b-e5017612421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:40.710477 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:40.710927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7063ec-548e-430b-a11b-e5017612421d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.710927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7063ec-548e-430b-a11b-e5017612421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.710927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7063ec-548e-430b-a11b-e5017612421d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.710927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7063ec-548e-430b-a11b-e5017612421d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:40.710927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7063ec-548e-430b-a11b-e5017612421d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:40.726083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2692/5399] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:40.727884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:40.741074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bccb7-3e9d-4fcc-8044-9e92cc8b8b0e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:40.746601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:40.747653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.747942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.748224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] PATH_INFO: `/v3/projects/ee5b8a7fa26d4100a38253aaa575cc15/users/c38a348847094047983d411d78c186a6/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.750544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5b8a7fa26d4100a38253aaa575cc15, user_id=c38a348847094047983d411d78c186a6, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:40.753193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:40.768662 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2708/5400] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:40 2022] PUT /identity/v3/projects/ee5b8a7fa26d4100a38253aaa575cc15/users/c38a348847094047983d411d78c186a6/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:40.783536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36d151-b209-4e39-8e0e-cd8e84dc49fc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:40.785937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36d151-b209-4e39-8e0e-cd8e84dc49fc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:40.785937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36d151-b209-4e39-8e0e-cd8e84dc49fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:40.826272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dd36d151-b209-4e39-8e0e-cd8e84dc49fc None None] MFA Rules not processed for user `c38a348847094047983d411d78c186a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:40.827848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd36d151-b209-4e39-8e0e-cd8e84dc49fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:40.927026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:40.929967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:40.952354 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2693/5401] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:40.977704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36d151-b209-4e39-8e0e-cd8e84dc49fc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:41.040038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ee97-547f-4b43-8422-f27b12197282 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:41.048882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:41.049629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.049866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.050115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] PATH_INFO: `/v3/projects/93ba32cf625149bdb43c20b0ee4fda35` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.051878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ba32cf625149bdb43c20b0ee4fda35)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:41.055251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:41.079027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36d151-b209-4e39-8e0e-cd8e84dc49fc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:41.087582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd40868-4118-4059-b502-9098c60f20d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:41.091500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40868-4118-4059-b502-9098c60f20d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.091650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40868-4118-4059-b502-9098c60f20d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.091804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd40868-4118-4059-b502-9098c60f20d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.108080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd40868-4118-4059-b502-9098c60f20d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:41.109672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd40868-4118-4059-b502-9098c60f20d6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:41.120986 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2694/5402] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:41.221029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ba32cf625149bdb43c20b0ee4fda35', 'request_id': 'req-b3353b66-b5c6-48e5-8f58-2a21a3456c08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:41.226700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ba32cf625149bdb43c20b0ee4fda35', 'request_id': 'req-b3353b66-b5c6-48e5-8f58-2a21a3456c08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:41.312431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ba32cf625149bdb43c20b0ee4fda35', 'request_id': 'req-b3353b66-b5c6-48e5-8f58-2a21a3456c08'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:41.326333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] The token cache is being invalidate because project 93ba32cf625149bdb43c20b0ee4fda35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:41.326968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:41.327805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3353b66-b5c6-48e5-8f58-2a21a3456c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:41.329612 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2709/5403] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:40 2022] DELETE /identity/v3/projects/93ba32cf625149bdb43c20b0ee4fda35 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:41.334642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d02e3-4f1f-4d86-86fe-cef333078647 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.335149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d02e3-4f1f-4d86-86fe-cef333078647 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.335489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d02e3-4f1f-4d86-86fe-cef333078647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.361010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a72d02e3-4f1f-4d86-86fe-cef333078647 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:41.362353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a72d02e3-4f1f-4d86-86fe-cef333078647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:41.449931 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2695/5404] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:41.458207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747157-db1e-4a2c-b1a4-9ca663708b07 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.461171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747157-db1e-4a2c-b1a4-9ca663708b07 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.461171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747157-db1e-4a2c-b1a4-9ca663708b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.486847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-db747157-db1e-4a2c-b1a4-9ca663708b07 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:41.488073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-db747157-db1e-4a2c-b1a4-9ca663708b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:41.499118 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2710/5405] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:41.503557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d02e3-4f1f-4d86-86fe-cef333078647 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:41.515008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d02e3-4f1f-4d86-86fe-cef333078647 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:41.520475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:41.521086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.521422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.522767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.525078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:41.525387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:41.527036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:41.546889 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2696/5406] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:41.548604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db747157-db1e-4a2c-b1a4-9ca663708b07 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:41.570643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db747157-db1e-4a2c-b1a4-9ca663708b07 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:41.577081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:41.577572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.578099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.578809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.579438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:41.581671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:41.592376 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:41.686528 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2711/5407] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:41 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:41.690643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:41.701146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8690770-9043-4648-b378-fb4f20a0f506 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:41.768366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:41.779328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.779328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.779328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.779328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:41.779328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:41.917964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2697/5408] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:41 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:41.918264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:41.929627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2023cc6-7d4a-4c8b-bb29-1eef7959430e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:41.935908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:41.936726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.937007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.937274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.937924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:41.939648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:41.957809 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2712/5409] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:41.959690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:41.974458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fbd9d-7d2c-4145-be72-8505e17706d2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:41.981588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3eec2-1432-4605-a4f8-7ce4d19addeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:41.982306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3eec2-1432-4605-a4f8-7ce4d19addeb admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:41.982584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3eec2-1432-4605-a4f8-7ce4d19addeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:41.982989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3eec2-1432-4605-a4f8-7ce4d19addeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:41.983896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3eec2-1432-4605-a4f8-7ce4d19addeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:41.986090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3eec2-1432-4605-a4f8-7ce4d19addeb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:42.005718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:42.005922 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2698/5410] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:42.017835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd353c3-7685-4286-87ec-5ee6de8a1534 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:42.023263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:42.024024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:42.025218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:42.025585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] PATH_INFO: `/v3/projects/418fb46525a24beaa90af2f14438caed/users/569113489b0a452fb33025e77538d953/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:42.048014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418fb46525a24beaa90af2f14438caed, user_id=569113489b0a452fb33025e77538d953, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:42.052757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:42.171769 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2713/5411] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:42 2022] PUT /identity/v3/projects/418fb46525a24beaa90af2f14438caed/users/569113489b0a452fb33025e77538d953/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:42.183983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:42.184525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:42.184525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:42.234404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] MFA Rules not processed for user `569113489b0a452fb33025e77538d953`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:42.236031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:42.353677 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2699/5412] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:42.364771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:42.367903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:42.446542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b036-51d3-40e6-83cf-b695bd8d8b22 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:42.450714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1aef5-78fc-45b7-a969-012923f18ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:42.451429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1aef5-78fc-45b7-a969-012923f18ede service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:42.451799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1aef5-78fc-45b7-a969-012923f18ede service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:42.452241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1aef5-78fc-45b7-a969-012923f18ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:42.461611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1aef5-78fc-45b7-a969-012923f18ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:42.463217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1aef5-78fc-45b7-a969-012923f18ede service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:42.476646 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2714/5413] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:42.632836 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:43.536254 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:44.467244 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:44.969829 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:45.622124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:45.623618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:45.780595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258c57c-5ce1-43b7-acbf-603f1e82168c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:45.787722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:45.788685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:45.789070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:45.789445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] PATH_INFO: `/v3/users/aba75cb271ad4a898b73f62d3cff25b9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:45.790991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba75cb271ad4a898b73f62d3cff25b9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:45.793422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:46.110097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba75cb271ad4a898b73f62d3cff25b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:46.132203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba75cb271ad4a898b73f62d3cff25b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:46.133762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba75cb271ad4a898b73f62d3cff25b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:46.239842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba75cb271ad4a898b73f62d3cff25b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:46.240680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba75cb271ad4a898b73f62d3cff25b9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:46.290516 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2700/5414] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:45 2022] DELETE /identity/v3/users/aba75cb271ad4a898b73f62d3cff25b9 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:46.291235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:46.291235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:46.291235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:46.364076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:46.379505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:46.415313 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:46.571564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2715/5415] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:46.642911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:46.644657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:46.706867 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:46.788155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fee3f-9e8d-460f-9e77-96dca816aa3f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:46.796590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:46.797576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:46.798406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:46.798886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:46.821833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:46.824450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:46.848721 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2701/5416] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:48.113653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:48.115907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:48.134115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9844d-2c32-45bf-b2dc-a0c9a4b85898 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:48.174582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:48.175622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:48.176129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:48.176861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] PATH_INFO: `/v3/projects/d5f5436359814ad89cc722ab95a01965` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:48.178698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f5436359814ad89cc722ab95a01965)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:48.186135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:48.401338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f5436359814ad89cc722ab95a01965', 'request_id': 'req-e1e779e8-0b17-4d88-936e-4e4abb41a605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:48.424501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f5436359814ad89cc722ab95a01965', 'request_id': 'req-e1e779e8-0b17-4d88-936e-4e4abb41a605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:48.523582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f5436359814ad89cc722ab95a01965', 'request_id': 'req-e1e779e8-0b17-4d88-936e-4e4abb41a605'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:48.537314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:48.540959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:48.563902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] The token cache is being invalidate because project d5f5436359814ad89cc722ab95a01965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:48.564558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:48.575021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:48.577181 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2716/5417] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:48 2022] DELETE /identity/v3/projects/d5f5436359814ad89cc722ab95a01965 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:48.586157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:48.587839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:48.730683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e779e8-0b17-4d88-936e-4e4abb41a605 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:48.740147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67b4b0-43a9-45b8-9055-ec72152efaa9 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:48.741449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:48.743613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:48.744439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:48.746286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] PATH_INFO: `/v3/users/c38a348847094047983d411d78c186a6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:48.748912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38a348847094047983d411d78c186a6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:48.751156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:48.880895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:48.881937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:48.884506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:48.885047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:48.889690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:48.935347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:48.937260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:48.976547 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2702/5418] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:49.010337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38a348847094047983d411d78c186a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:49.015437 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:49.053295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38a348847094047983d411d78c186a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:49.054440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38a348847094047983d411d78c186a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:49.143381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38a348847094047983d411d78c186a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:49.144196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-54b7a6da-e072-4510-8ded-fa971df5ae6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38a348847094047983d411d78c186a6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:49.172262 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2717/5419] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:48 2022] DELETE /identity/v3/users/c38a348847094047983d411d78c186a6 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:50.638719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:50.656039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29832-4f07-46dd-92fe-9c894586844f service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:50.756026 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:50.763382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:50.764287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:50.764863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:50.765308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] PATH_INFO: `/v3/projects/ee5b8a7fa26d4100a38253aaa575cc15` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:50.766651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5b8a7fa26d4100a38253aaa575cc15)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:50.769341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:50.889020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5b8a7fa26d4100a38253aaa575cc15', 'request_id': 'req-66725cad-3ee7-468f-8cf4-ec776ccf6c98'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:50.896503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5b8a7fa26d4100a38253aaa575cc15', 'request_id': 'req-66725cad-3ee7-468f-8cf4-ec776ccf6c98'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:50.974627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5b8a7fa26d4100a38253aaa575cc15', 'request_id': 'req-66725cad-3ee7-468f-8cf4-ec776ccf6c98'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:50.987855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] The token cache is being invalidate because project ee5b8a7fa26d4100a38253aaa575cc15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:50.988162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:50.988850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-66725cad-3ee7-468f-8cf4-ec776ccf6c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:50.993652 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2703/5420] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:50 2022] DELETE /identity/v3/projects/ee5b8a7fa26d4100a38253aaa575cc15 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:50.996761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304eeb-ac17-4202-baf9-e9007c1af50e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:50.997248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304eeb-ac17-4202-baf9-e9007c1af50e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:50.997400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304eeb-ac17-4202-baf9-e9007c1af50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.018949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-db304eeb-ac17-4202-baf9-e9007c1af50e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:51.020725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-db304eeb-ac17-4202-baf9-e9007c1af50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:51.093858 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2718/5421] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:51.101621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f821a40-285b-491f-a20b-1feb2e3fcbd1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.102025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f821a40-285b-491f-a20b-1feb2e3fcbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.102423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f821a40-285b-491f-a20b-1feb2e3fcbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.133215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2f821a40-285b-491f-a20b-1feb2e3fcbd1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:51.134772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f821a40-285b-491f-a20b-1feb2e3fcbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:51.144338 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2704/5422] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:51.148275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304eeb-ac17-4202-baf9-e9007c1af50e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:51.159305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304eeb-ac17-4202-baf9-e9007c1af50e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:51.174949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:51.176330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.176939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.177500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.178657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:51.179213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:51.181071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:51.197106 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2719/5423] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:51.202138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f821a40-285b-491f-a20b-1feb2e3fcbd1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:51.213220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f821a40-285b-491f-a20b-1feb2e3fcbd1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:51.223807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:51.224495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.224781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.225057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.226347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:51.232104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:51.387750 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2705/5424] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:51 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:51.391135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:51.411332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411fc26-0d6d-4a7b-9c31-1d83a5a7ce51 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:51.493329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:51.494273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.494615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.494950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.496221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:51.500405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:51.624255 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2720/5425] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:51 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:51.628510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:51.652972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c00c-f1a8-4e27-aae8-e3b7d1e0aabf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:51.659595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:51.660547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.661063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.661557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.662493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:51.664581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:51.680410 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2706/5426] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:51.687324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:51.697744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055886-b9a9-4f4a-99c9-953509b4b99c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:51.704876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a53d0-f857-43c8-8f46-2f4fea417c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:51.706842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a53d0-f857-43c8-8f46-2f4fea417c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.707118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a53d0-f857-43c8-8f46-2f4fea417c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.707391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a53d0-f857-43c8-8f46-2f4fea417c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.708627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a53d0-f857-43c8-8f46-2f4fea417c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:51.711668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a53d0-f857-43c8-8f46-2f4fea417c7d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:51.732669 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2721/5427] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:51.733249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:51.752404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd97a3-27fc-4e7c-9842-8300f0289354 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:51.758968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:51.759977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.760718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.761337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] PATH_INFO: `/v3/projects/1831d38654a14d21ab7888f4b80f55d8/users/e8605390b30c4b65b7fa322cdc13f949/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.803326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1831d38654a14d21ab7888f4b80f55d8, user_id=e8605390b30c4b65b7fa322cdc13f949, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:51.806373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:51.895607 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2707/5428] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:51 2022] PUT /identity/v3/projects/1831d38654a14d21ab7888f4b80f55d8/users/e8605390b30c4b65b7fa322cdc13f949/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:51.908907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456f51-8e8d-4fe7-b823-6c7282b266dc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:51.909295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456f51-8e8d-4fe7-b823-6c7282b266dc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:51.909635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456f51-8e8d-4fe7-b823-6c7282b266dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:51.982219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f8456f51-8e8d-4fe7-b823-6c7282b266dc None None] MFA Rules not processed for user `e8605390b30c4b65b7fa322cdc13f949`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:51.983710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f8456f51-8e8d-4fe7-b823-6c7282b266dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:52.010886 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:52.073461 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2722/5429] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:52.079252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:52.271652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35f45-e242-457f-bdd9-52cbf50e4158 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:52.283725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:52.288543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:52.288543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:52.288543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:52.288543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:52.288543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:52.415146 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2708/5430] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:52 2022] POST /identity/v3/projects => generated 385 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:52.419732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456f51-8e8d-4fe7-b823-6c7282b266dc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:52.435076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456f51-8e8d-4fe7-b823-6c7282b266dc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:52.498075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:52.498967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:52.499254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:52.499656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:52.500328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:52.502330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:52.584866 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2723/5431] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:52 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:36:52.587494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:52.602625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f06cb-dfd9-4dd0-8fe2-1f72b46c57bf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:52.608363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:52.608988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:52.609660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:52.610006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:52.610643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:52.616524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:52.616524 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:52.631878 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2709/5432] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:52.632868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:52.648030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30fca-73e8-44bd-8ff8-0f38f0819ca3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:52.653339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:52.654181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:52.655396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:52.656777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] PATH_INFO: `/v3/projects/8dee53d000934b5297775436a82eb5a1/users/0519cd2673f5495ba0a7f2361e370cb4/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:52.678512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dee53d000934b5297775436a82eb5a1, user_id=0519cd2673f5495ba0a7f2361e370cb4, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:52.681666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:52.779407 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2724/5433] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:52 2022] PUT /identity/v3/projects/8dee53d000934b5297775436a82eb5a1/users/0519cd2673f5495ba0a7f2361e370cb4/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:52.783612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:52.801172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c46a1-29ed-45c1-905f-8a9e318d5abf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:52.905358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:52.905358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:53.008964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:53.010391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:53.010941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:53.011406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:53.012152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:53.014707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:53.081069 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2710/5434] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:53.082771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:53.098411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea2dc3-dc76-4e59-8a93-9f877f381af0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:53.112778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b82c-9ba5-48f4-812b-5891985c3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:53.114400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b82c-9ba5-48f4-812b-5891985c3ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:53.117935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b82c-9ba5-48f4-812b-5891985c3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:53.118278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b82c-9ba5-48f4-812b-5891985c3ce5 admin admin] PATH_INFO: `/v3/projects/8dee53d000934b5297775436a82eb5a1/users/0519cd2673f5495ba0a7f2361e370cb4/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:53.122286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12b82c-9ba5-48f4-812b-5891985c3ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dee53d000934b5297775436a82eb5a1, user_id=0519cd2673f5495ba0a7f2361e370cb4, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:53.130730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12b82c-9ba5-48f4-812b-5891985c3ce5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:53.152656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042b478-d8a5-44d9-a403-787f530bee6e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:53.156488 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2711/5435] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:53 2022] PUT /identity/v3/projects/8dee53d000934b5297775436a82eb5a1/users/0519cd2673f5495ba0a7f2361e370cb4/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:53.170703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:53.170703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:53.170703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:53.216184 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:53.258959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] MFA Rules not processed for user `0519cd2673f5495ba0a7f2361e370cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:53.262004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:53.269927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:53.270607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:53.270887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:53.271165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] PATH_INFO: `/v3/users/803c776e416a49e3aa689f37bd24740a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:53.274806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803c776e416a49e3aa689f37bd24740a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:53.276886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:53.430316 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2712/5436] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:53.451475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:53.454618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:53.506018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803c776e416a49e3aa689f37bd24740a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:53.517080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803c776e416a49e3aa689f37bd24740a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:53.527073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803c776e416a49e3aa689f37bd24740a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:53.598707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdd672-2f72-48cf-975c-91a5944e00eb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:53.603689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddbbe5-d931-47af-b8eb-8ed00dabed77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:53.605290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbbe5-d931-47af-b8eb-8ed00dabed77 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:53.605644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbbe5-d931-47af-b8eb-8ed00dabed77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:53.606011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddbbe5-d931-47af-b8eb-8ed00dabed77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:53.620630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803c776e416a49e3aa689f37bd24740a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:53.620877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddbbe5-d931-47af-b8eb-8ed00dabed77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:53.621644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803c776e416a49e3aa689f37bd24740a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:53.622774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddbbe5-d931-47af-b8eb-8ed00dabed77 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:53.642994 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2713/5437] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:36:53.660782 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2725/5438] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:52 2022] DELETE /identity/v3/users/803c776e416a49e3aa689f37bd24740a => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:36:53.665945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:53.666297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:53.666632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:53.710513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:53.712339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:53.820036 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2714/5439] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:53.852977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:53.854512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:53.961937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43cb6d-a1fa-43d7-90f2-8463ed192556 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:53.968265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:53.968744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:53.968744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:53.969122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:53.987664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:53.990393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:54.011769 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2726/5440] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:54.457765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:54.460339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:54.630217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf2bcf-2f97-47af-8d3e-320165b82820 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:54.636589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df0d6f-b971-4faa-926e-99aea2b5a9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:54.637374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df0d6f-b971-4faa-926e-99aea2b5a9a2 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:54.637662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df0d6f-b971-4faa-926e-99aea2b5a9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:54.637929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df0d6f-b971-4faa-926e-99aea2b5a9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:54.648314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c6df0d6f-b971-4faa-926e-99aea2b5a9a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:54.664733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df0d6f-b971-4faa-926e-99aea2b5a9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:54.666555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df0d6f-b971-4faa-926e-99aea2b5a9a2 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:54.693158 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2715/5441] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:54.900395 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:55.150071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:55.152817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:55.166526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b73fb-8b2b-48aa-a5fa-5290285f323a service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:55.172913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:55.174140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:55.174611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:55.174916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] PATH_INFO: `/v3/projects/b9976c39e9d94256be3fba141c1ebd97` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:55.176301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9976c39e9d94256be3fba141c1ebd97)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:55.178852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:55.319784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9976c39e9d94256be3fba141c1ebd97', 'request_id': 'req-6811085c-ea63-4175-a4d2-014aa90b54d0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:55.321462 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:55.330548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9976c39e9d94256be3fba141c1ebd97', 'request_id': 'req-6811085c-ea63-4175-a4d2-014aa90b54d0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:55.408303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9976c39e9d94256be3fba141c1ebd97', 'request_id': 'req-6811085c-ea63-4175-a4d2-014aa90b54d0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:55.421095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] The token cache is being invalidate because project b9976c39e9d94256be3fba141c1ebd97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:55.422164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:55.422832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6811085c-ea63-4175-a4d2-014aa90b54d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:55.428754 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2727/5442] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:55 2022] DELETE /identity/v3/projects/b9976c39e9d94256be3fba141c1ebd97 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:55.430678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c97f0-b879-4857-8ace-13f5888139a7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:55.431000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c97f0-b879-4857-8ace-13f5888139a7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:55.437028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c97f0-b879-4857-8ace-13f5888139a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:55.457331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c63c97f0-b879-4857-8ace-13f5888139a7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:55.458961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c63c97f0-b879-4857-8ace-13f5888139a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:55.553429 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2716/5443] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:55.561492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd320d-68fd-49b3-a7d7-861899905520 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:55.561785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd320d-68fd-49b3-a7d7-861899905520 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:55.566315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd320d-68fd-49b3-a7d7-861899905520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:55.595937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1dbd320d-68fd-49b3-a7d7-861899905520 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:55.597238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1dbd320d-68fd-49b3-a7d7-861899905520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:55.609461 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2728/5444] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:55.618061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c97f0-b879-4857-8ace-13f5888139a7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:55.624984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c97f0-b879-4857-8ace-13f5888139a7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:55.629645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:55.630282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:55.630565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:55.630835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:55.631481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:55.631781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:55.633372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:55.645251 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2717/5445] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:55.649697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd320d-68fd-49b3-a7d7-861899905520 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:55.659691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd320d-68fd-49b3-a7d7-861899905520 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:55.665121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:55.667320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:55.667320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:55.667320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:55.667776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:55.669737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:55.791488 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2729/5446] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:55 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:55.791638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:55.805380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c550-a820-4e5d-82d6-dbd11999f118 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:55.826942 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:55.905289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:55.905993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:55.906985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:55.906985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:55.907218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:55.909009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.007127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2718/5447] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:55 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:56.008096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.027537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231f5d-5692-4d13-96e4-512535648f93 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.037389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.039662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.039998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.040378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.041283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.043674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.064031 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2730/5448] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:56.065775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.082115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac4f68-be9a-402f-9a8f-caf45b6c789a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.093026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8a8b0-0867-484b-b99a-43ac672b27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.093026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a8b0-0867-484b-b99a-43ac672b27d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.093026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a8b0-0867-484b-b99a-43ac672b27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.093026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a8b0-0867-484b-b99a-43ac672b27d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.093410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8a8b0-0867-484b-b99a-43ac672b27d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.093410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8a8b0-0867-484b-b99a-43ac672b27d8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.130164 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2719/5449] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:56.137282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.152871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495f6e-a2db-40b1-9ebb-abfe1338a4b1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.160082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.160899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.161187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.161838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] PATH_INFO: `/v3/projects/45346836c7a34f269b42e6796262cc0b/users/2e5a65b87242437d86b126ebfe5f26ec/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.193150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45346836c7a34f269b42e6796262cc0b, user_id=2e5a65b87242437d86b126ebfe5f26ec, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.197712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.310757 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2731/5450] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:56 2022] PUT /identity/v3/projects/45346836c7a34f269b42e6796262cc0b/users/2e5a65b87242437d86b126ebfe5f26ec/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:56.313179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d7e69-d5fa-4d8c-8b64-6d456d2a4109 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.316553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d7e69-d5fa-4d8c-8b64-6d456d2a4109 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.316553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d7e69-d5fa-4d8c-8b64-6d456d2a4109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.372336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4e6d7e69-d5fa-4d8c-8b64-6d456d2a4109 None None] MFA Rules not processed for user `2e5a65b87242437d86b126ebfe5f26ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:56.373697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4e6d7e69-d5fa-4d8c-8b64-6d456d2a4109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:56.461701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2720/5451] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:56.475407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.478229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:56.590270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648560a-a1dc-4014-affd-cd89fd6c51e2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.598328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.598954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.599238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.599664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.609039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.611309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.623704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2732/5452] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:56.637178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31d7a-54aa-4dcc-a9e8-096d6fac4ddf None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.637470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31d7a-54aa-4dcc-a9e8-096d6fac4ddf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.637747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31d7a-54aa-4dcc-a9e8-096d6fac4ddf None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.639158 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2721/5453] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:36:56.644155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:36:56.657904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.666786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448709-e185-445a-a75a-4ab218724e2a service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.672131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5a65b87242437d86b126ebfe5f26ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45346836c7a34f269b42e6796262cc0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.672788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.673318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.673590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] PATH_INFO: `/v3/projects/45346836c7a34f269b42e6796262cc0b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.674742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorizing `identity:get_project(project_id=45346836c7a34f269b42e6796262cc0b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.681726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.681726 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2733/5454] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/projects/45346836c7a34f269b42e6796262cc0b => generated 365 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:56.715074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463c72-0498-4cf9-94e8-2d03f578e124 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.715360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463c72-0498-4cf9-94e8-2d03f578e124 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.715636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463c72-0498-4cf9-94e8-2d03f578e124 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.717015 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2722/5455] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:36:56.721916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:36:56.724325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:56.743605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.751982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a52b-37fd-4905-923f-bc4af5ba4728 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.756536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5a65b87242437d86b126ebfe5f26ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45346836c7a34f269b42e6796262cc0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.757270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.757553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.757870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] PATH_INFO: `/v3/projects/45346836c7a34f269b42e6796262cc0b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.761936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorizing `identity:get_project(project_id=45346836c7a34f269b42e6796262cc0b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.761936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.763182 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2734/5456] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/projects/45346836c7a34f269b42e6796262cc0b => generated 365 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:56.803798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05a48-0549-47d6-9297-fe726cac2e42 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.804211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05a48-0549-47d6-9297-fe726cac2e42 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.807971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05a48-0549-47d6-9297-fe726cac2e42 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.807971 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2723/5457] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:36:56.811818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:36:56.831540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.843212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dfe59-c1c3-41c8-89fe-bd042a969c27 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.848192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5a65b87242437d86b126ebfe5f26ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45346836c7a34f269b42e6796262cc0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.848832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.849108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.849442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] PATH_INFO: `/v3/projects/45346836c7a34f269b42e6796262cc0b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.850590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorizing `identity:get_project(project_id=45346836c7a34f269b42e6796262cc0b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.852390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.854104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2735/5458] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/projects/45346836c7a34f269b42e6796262cc0b => generated 365 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:56.894543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5d21-6b05-444c-bbfd-0d0846a1724a None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.895017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5d21-6b05-444c-bbfd-0d0846a1724a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.895281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5d21-6b05-444c-bbfd-0d0846a1724a None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.896790 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2724/5459] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:36:56.903104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:36:56.921147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:56.932115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02e44d-852d-488c-beb0-dc659dc95597 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:56.935610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5a65b87242437d86b126ebfe5f26ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45346836c7a34f269b42e6796262cc0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:56.937032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.937032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.937032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] PATH_INFO: `/v3/projects/45346836c7a34f269b42e6796262cc0b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.938162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorizing `identity:get_project(project_id=45346836c7a34f269b42e6796262cc0b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:56.940101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:56.942033 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2736/5460] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/projects/45346836c7a34f269b42e6796262cc0b => generated 365 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:56.982116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb9dd-ac72-4f11-88d0-2edf31a6a017 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:56.982663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb9dd-ac72-4f11-88d0-2edf31a6a017 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:56.982663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb9dd-ac72-4f11-88d0-2edf31a6a017 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:56.984655 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2725/5461] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 01:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:36:56.989138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 01:36:57.004424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:57.015191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155afdc7-fd35-4f37-9644-ff9650c5a3d4 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:57.019941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0f83f-aec1-4b2c-8263-fb9c13f65166 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5a65b87242437d86b126ebfe5f26ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45346836c7a34f269b42e6796262cc0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:57.020579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0f83f-aec1-4b2c-8263-fb9c13f65166 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:57.020857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0f83f-aec1-4b2c-8263-fb9c13f65166 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:57.021191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0f83f-aec1-4b2c-8263-fb9c13f65166 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] PATH_INFO: `/v3/projects/45346836c7a34f269b42e6796262cc0b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:57.022384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0f83f-aec1-4b2c-8263-fb9c13f65166 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorizing `identity:get_project(project_id=45346836c7a34f269b42e6796262cc0b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:57.024196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0f83f-aec1-4b2c-8263-fb9c13f65166 tempest-QuotasTestJSON-1043960788 tempest-QuotasTestJSON-1043960788-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:57.026075 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2737/5462] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 01:36:56 2022] GET /identity/v3/projects/45346836c7a34f269b42e6796262cc0b => generated 365 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:36:57.059785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb9dd-ac72-4f11-88d0-2edf31a6a017 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:57.146947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb9dd-ac72-4f11-88d0-2edf31a6a017 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:57.154749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:57.155531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:57.156327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:57.156327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] PATH_INFO: `/v3/users/2e5a65b87242437d86b126ebfe5f26ec` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:57.158362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5a65b87242437d86b126ebfe5f26ec)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:57.160903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:57.722006 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:57.722006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5a65b87242437d86b126ebfe5f26ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:57.722006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5a65b87242437d86b126ebfe5f26ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:57.722006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5a65b87242437d86b126ebfe5f26ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:57.722006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5a65b87242437d86b126ebfe5f26ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:57.725233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5a65b87242437d86b126ebfe5f26ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:57.725233 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2726/5463] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:57 2022] DELETE /identity/v3/users/2e5a65b87242437d86b126ebfe5f26ec => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:57.727502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:57.727502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:57.727502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:57.727502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:57.727502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:57.732710 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:57.800464 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2738/5464] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:36:57.834430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:57.836395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:57.905798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d80d7-9535-4b00-9a41-234c0f49a248 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:57.909515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:57.910728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:57.911453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:57.911733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:57.923859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:57.925329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:57.936562 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2727/5465] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:58.362382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:58.363953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:58.379013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf295234-5ec0-4805-83f0-99c5fae4fcce None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:58.393044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:58.393698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:58.394407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:58.394407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] PATH_INFO: `/v3/users/e8605390b30c4b65b7fa322cdc13f949` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:58.399263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8605390b30c4b65b7fa322cdc13f949)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:58.402691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:58.625334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8605390b30c4b65b7fa322cdc13f949'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:58.635936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8605390b30c4b65b7fa322cdc13f949'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:58.636696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8605390b30c4b65b7fa322cdc13f949'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:58.741601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8605390b30c4b65b7fa322cdc13f949'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:58.743602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7b2eb15-69ae-4490-a40a-24065ad58480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8605390b30c4b65b7fa322cdc13f949'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:58.753350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:58.755170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:58.769376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8811f-952d-489c-b64a-9c0aabfab7ff service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:58.784483 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2739/5466] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:36:58 2022] DELETE /identity/v3/users/e8605390b30c4b65b7fa322cdc13f949 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:58.786027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:58.786356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:58.786700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:58.788684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:58.789541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:58.790437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:58.790889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] PATH_INFO: `/v3/projects/45346836c7a34f269b42e6796262cc0b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:58.801610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45346836c7a34f269b42e6796262cc0b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:58.801610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:58.821103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:58.822544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:58.892463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2740/5467] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:58.900313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:58.902013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:58.963384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45346836c7a34f269b42e6796262cc0b', 'request_id': 'req-e19841ab-034b-44f2-b680-5e66622e2b7f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:58.973489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45346836c7a34f269b42e6796262cc0b', 'request_id': 'req-e19841ab-034b-44f2-b680-5e66622e2b7f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:58.988175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7b617-0f31-40b2-8abf-d63880f0ef07 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:59.042367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:59.046618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.046618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.046618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.071643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45346836c7a34f269b42e6796262cc0b', 'request_id': 'req-e19841ab-034b-44f2-b680-5e66622e2b7f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:59.071992 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:59.092645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] The token cache is being invalidate because project 45346836c7a34f269b42e6796262cc0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:36:59.092929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:59.093608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e19841ab-034b-44f2-b680-5e66622e2b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:36:59.095477 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2728/5468] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:36:58 2022] DELETE /identity/v3/projects/45346836c7a34f269b42e6796262cc0b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:36:59.101869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e2e6-a3b3-4ca3-bb1f-acb5cb61fa9c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.102178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e2e6-a3b3-4ca3-bb1f-acb5cb61fa9c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.102452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e2e6-a3b3-4ca3-bb1f-acb5cb61fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.129604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dfd8e2e6-a3b3-4ca3-bb1f-acb5cb61fa9c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:59.131781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dfd8e2e6-a3b3-4ca3-bb1f-acb5cb61fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:59.141027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:59.142730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:59.146463 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2729/5469] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:59.154431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc8cf-bf17-4fe8-b968-2604238c77a0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.159533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc8cf-bf17-4fe8-b968-2604238c77a0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.159533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc8cf-bf17-4fe8-b968-2604238c77a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.167611 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2741/5470] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:36:59.206061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-04cfc8cf-bf17-4fe8-b968-2604238c77a0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:36:59.207336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-04cfc8cf-bf17-4fe8-b968-2604238c77a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:59.217596 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2730/5471] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:36:59.222097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:59.223792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:36:59.239344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c2854-95a8-4fa5-b1c8-45da96637296 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:59.245754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:59.270238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.270948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.271444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.274025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:36:59.276713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:59.278756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:59.302537 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2742/5472] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:36:59.308029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfc8cf-bf17-4fe8-b968-2604238c77a0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:59.334627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfc8cf-bf17-4fe8-b968-2604238c77a0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:59.354850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:59.355721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.356119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.356514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.357340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:59.360652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:59.454610 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:36:59.463615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2731/5473] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:36:59 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:59.468463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:59.485923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6bfaa-53a8-40b5-a147-f4cf8f293836 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:59.639317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:59.640089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.640463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.640857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.641915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:59.644189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:59.771860 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2743/5474] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:36:59 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:36:59.776667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:59.793488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e88e-5e70-4de3-b7d0-90d03e1b9e4c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:59.806534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:59.807173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.807480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.807746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.808395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:59.810682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:59.827583 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2732/5475] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:59.831920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:59.844987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154664-c357-4bd3-ad4d-c295a2080302 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:59.859209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:59.860130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.860566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.861018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.861853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:59.863722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:36:59.893945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2744/5476] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:36:59.894869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:36:59.907692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd31c7-0f4c-4c54-829b-cdc9fee24dc5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:36:59.915357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6222de-0bd8-420f-b5c8-646514f84e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:36:59.917057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6222de-0bd8-420f-b5c8-646514f84e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:36:59.917632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6222de-0bd8-420f-b5c8-646514f84e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:36:59.918669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6222de-0bd8-420f-b5c8-646514f84e59 admin admin] PATH_INFO: `/v3/projects/68dabe2cafd046fea4cb35076787f899/users/cedcdb82756b4512b9cd7db2649e8435/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:36:59.940351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6222de-0bd8-420f-b5c8-646514f84e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dabe2cafd046fea4cb35076787f899, user_id=cedcdb82756b4512b9cd7db2649e8435, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:36:59.944726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6222de-0bd8-420f-b5c8-646514f84e59 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:00.025207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2733/5477] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:36:59 2022] PUT /identity/v3/projects/68dabe2cafd046fea4cb35076787f899/users/cedcdb82756b4512b9cd7db2649e8435/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:00.029968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:00.031769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:00.035751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:00.036047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:00.038238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:00.059926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2f511-0e93-4db3-a92d-754af7a10219 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:00.117656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] MFA Rules not processed for user `cedcdb82756b4512b9cd7db2649e8435`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:00.118904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:00.180129 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:00.199593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:00.199593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:00.199593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:00.199593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] PATH_INFO: `/v3/projects/1831d38654a14d21ab7888f4b80f55d8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:00.201085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1831d38654a14d21ab7888f4b80f55d8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:00.203408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:00.253780 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2734/5478] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:00.296804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:00.298760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:00.371770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1831d38654a14d21ab7888f4b80f55d8', 'request_id': 'req-d368e00f-104a-43c3-a267-ea299c48536d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:00.379680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1831d38654a14d21ab7888f4b80f55d8', 'request_id': 'req-d368e00f-104a-43c3-a267-ea299c48536d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:00.428552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24803bf8-5d92-48bd-a9db-61f301b855a2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:00.465800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1831d38654a14d21ab7888f4b80f55d8', 'request_id': 'req-d368e00f-104a-43c3-a267-ea299c48536d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:00.488641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] The token cache is being invalidate because project 1831d38654a14d21ab7888f4b80f55d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:00.488951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:00.489768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:00.493506 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2745/5479] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:00 2022] DELETE /identity/v3/projects/1831d38654a14d21ab7888f4b80f55d8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:00.497845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:00.505085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:00.563240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:00.563917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:00.564199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:00.564476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:00.566437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:00.596240 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:00.640726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e00f-104a-43c3-a267-ea299c48536d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:00.655082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:00.656374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:00.656374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:00.656825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] PATH_INFO: `/v3/users/0519cd2673f5495ba0a7f2361e370cb4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:00.659343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0519cd2673f5495ba0a7f2361e370cb4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:00.661161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:00.703481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:00.705100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:00.724629 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2735/5480] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:00.989289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0519cd2673f5495ba0a7f2361e370cb4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:01.012401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0519cd2673f5495ba0a7f2361e370cb4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:01.014043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0519cd2673f5495ba0a7f2361e370cb4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:01.054600 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:01.117193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0519cd2673f5495ba0a7f2361e370cb4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:01.118154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4552bfc-8cd6-488d-9049-dde299a10ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0519cd2673f5495ba0a7f2361e370cb4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:01.153275 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2746/5481] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:00 2022] DELETE /identity/v3/users/0519cd2673f5495ba0a7f2361e370cb4 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:01.718488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:01.731520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2f566-4c97-4b6c-bde4-44de666788da service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:01.841066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:01.842895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:01.843402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:01.844242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] PATH_INFO: `/v3/projects/8dee53d000934b5297775436a82eb5a1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:01.847786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dee53d000934b5297775436a82eb5a1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:01.853017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:02.010015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dee53d000934b5297775436a82eb5a1', 'request_id': 'req-83478952-f555-4a01-ac5d-23dc635d0672'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:02.018002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dee53d000934b5297775436a82eb5a1', 'request_id': 'req-83478952-f555-4a01-ac5d-23dc635d0672'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:02.117466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dee53d000934b5297775436a82eb5a1', 'request_id': 'req-83478952-f555-4a01-ac5d-23dc635d0672'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:02.154131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] The token cache is being invalidate because project 8dee53d000934b5297775436a82eb5a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:02.154880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:02.155147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-83478952-f555-4a01-ac5d-23dc635d0672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:02.156925 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2736/5482] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:01 2022] DELETE /identity/v3/projects/8dee53d000934b5297775436a82eb5a1 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:02.162954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0027920-8f96-418a-a6e5-23fb7827a71c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:02.163862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0027920-8f96-418a-a6e5-23fb7827a71c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:02.164322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0027920-8f96-418a-a6e5-23fb7827a71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:02.203070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d0027920-8f96-418a-a6e5-23fb7827a71c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:02.205391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d0027920-8f96-418a-a6e5-23fb7827a71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:02.294471 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2747/5483] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:02.301454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117d30-e075-4b76-ab79-4676c9fbe135 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:02.301744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117d30-e075-4b76-ab79-4676c9fbe135 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:02.302073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117d30-e075-4b76-ab79-4676c9fbe135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:02.344904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1e117d30-e075-4b76-ab79-4676c9fbe135 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:02.345783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1e117d30-e075-4b76-ab79-4676c9fbe135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:02.374899 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2737/5484] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:02.387150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0027920-8f96-418a-a6e5-23fb7827a71c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:02.426101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0027920-8f96-418a-a6e5-23fb7827a71c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:02.450074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:02.451842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:02.454096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:02.456228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:02.457126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:02.457704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:02.459863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:02.484890 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2748/5485] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:02.486620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117d30-e075-4b76-ab79-4676c9fbe135 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:02.498058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117d30-e075-4b76-ab79-4676c9fbe135 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:02.503792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:02.504381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:02.504662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:02.504937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:02.505707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:02.507680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:02.530728 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:02.657235 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2738/5486] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:02 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:02.662063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:02.677990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026bbfb-dd3d-4dba-9dac-01d3928dfade admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:02.856484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:02.857386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:02.858076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:02.858690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:02.859469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:02.861517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:02.968658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:02.969223 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2749/5487] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:02 2022] POST /identity/v3/users => generated 286 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:02.985009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783b9e-5325-4ee2-bd99-e0470eae9187 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:02.989870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:02.990529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:02.990809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:02.991247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:02.991725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:02.993341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:03.030131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2739/5488] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:37:03.034368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:03.052296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc42377-b8e7-487b-9091-05cd9bbc916c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:03.064669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567b91-5351-4c73-9a11-d25a56d1d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:03.071071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567b91-5351-4c73-9a11-d25a56d1d0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:03.071071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567b91-5351-4c73-9a11-d25a56d1d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:03.071071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567b91-5351-4c73-9a11-d25a56d1d0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:03.071071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567b91-5351-4c73-9a11-d25a56d1d0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:03.071071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567b91-5351-4c73-9a11-d25a56d1d0b7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:03.094082 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2750/5489] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:03.102717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:03.123157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7c5e1-60a0-46a5-a34c-55b0596a7ee6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:03.141322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:03.147437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:03.152897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:03.153435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] PATH_INFO: `/v3/projects/b5200107493d419ba8a8c9529851168c/users/a7e81f8fac9048f881008ddc908c1c8c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:03.199413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5200107493d419ba8a8c9529851168c, user_id=a7e81f8fac9048f881008ddc908c1c8c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:03.199413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:03.313350 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2740/5490] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:03 2022] PUT /identity/v3/projects/b5200107493d419ba8a8c9529851168c/users/a7e81f8fac9048f881008ddc908c1c8c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:03.319305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:03.321965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:03.322967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:03.363110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] MFA Rules not processed for user `a7e81f8fac9048f881008ddc908c1c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:03.364993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:03.370946 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:03.486209 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2751/5491] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:03.497779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:03.499995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:03.575912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157eb48-fb7b-4459-8498-ffe66a77bf90 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:03.581017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fbf79-e420-4b06-bad6-b584688b0772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:03.582502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbf79-e420-4b06-bad6-b584688b0772 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:03.582502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbf79-e420-4b06-bad6-b584688b0772 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:03.582732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbf79-e420-4b06-bad6-b584688b0772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:03.594566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fbf79-e420-4b06-bad6-b584688b0772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:03.596219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fbf79-e420-4b06-bad6-b584688b0772 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:03.613469 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2741/5492] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:12.168136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:12.171132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:12.401038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd2d4f-a3f4-48af-9bf7-011979bef304 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:12.435763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:12.437665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:12.440472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:12.440939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] PATH_INFO: `/v3/users/569113489b0a452fb33025e77538d953` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:12.442880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569113489b0a452fb33025e77538d953)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:12.446740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:12.696130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569113489b0a452fb33025e77538d953'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:12.714178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569113489b0a452fb33025e77538d953'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:12.716257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569113489b0a452fb33025e77538d953'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:12.871916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569113489b0a452fb33025e77538d953'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:12.873254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569113489b0a452fb33025e77538d953'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:12.919048 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2752/5493] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:12 2022] DELETE /identity/v3/users/569113489b0a452fb33025e77538d953 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:12.923711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:12.924678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:12.925100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:12.975931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:12.977582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:13.095447 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2742/5494] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:13.106045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:13.112760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:13.186790 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:13.250174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774099-01ca-48a9-860d-b1961e98f259 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:13.272398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:13.272894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:13.273174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:13.273444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:13.291586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:13.294178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:13.315667 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2753/5495] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:13.750582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:13.753066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:13.799370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c83e52-721f-42c6-9ab5-2f0e1be74285 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:13.820358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:13.821043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:13.821329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:13.821598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] PATH_INFO: `/v3/projects/418fb46525a24beaa90af2f14438caed` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:13.823513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=418fb46525a24beaa90af2f14438caed)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:13.827647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:13.978111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:13.994609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cb100-fabf-4bd2-9a76-d57af233720c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:14.021424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571721c-4f85-46c1-9741-00e63709a092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:14.021520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571721c-4f85-46c1-9741-00e63709a092 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:14.021811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571721c-4f85-46c1-9741-00e63709a092 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:14.022083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571721c-4f85-46c1-9741-00e63709a092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:14.029794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d571721c-4f85-46c1-9741-00e63709a092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:14.046400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571721c-4f85-46c1-9741-00e63709a092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:14.049332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571721c-4f85-46c1-9741-00e63709a092 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:14.054713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418fb46525a24beaa90af2f14438caed', 'request_id': 'req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:14.061154 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:14.086247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418fb46525a24beaa90af2f14438caed', 'request_id': 'req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:14.134413 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2754/5496] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:14.157168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418fb46525a24beaa90af2f14438caed', 'request_id': 'req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:14.175463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] The token cache is being invalidate because project 418fb46525a24beaa90af2f14438caed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:14.176140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:14.179018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b36a52c4-ffa2-4d19-99aa-a8d09826afaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:14.181558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2743/5497] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:13 2022] DELETE /identity/v3/projects/418fb46525a24beaa90af2f14438caed => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:14.191200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5285-7d76-48f7-a13b-6a3356b93051 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:14.191200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5285-7d76-48f7-a13b-6a3356b93051 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:14.191200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada5285-7d76-48f7-a13b-6a3356b93051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:14.217663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2ada5285-7d76-48f7-a13b-6a3356b93051 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:14.219343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2ada5285-7d76-48f7-a13b-6a3356b93051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:14.422653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992f2b-5a68-46df-a4c1-357a44ee81f3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:14.423271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992f2b-5a68-46df-a4c1-357a44ee81f3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:14.423473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992f2b-5a68-46df-a4c1-357a44ee81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:14.437741 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2755/5498] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:14.496754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-01992f2b-5a68-46df-a4c1-357a44ee81f3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:14.499721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-01992f2b-5a68-46df-a4c1-357a44ee81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:14.513398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5285-7d76-48f7-a13b-6a3356b93051 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:14.520188 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2744/5499] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:14.528246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada5285-7d76-48f7-a13b-6a3356b93051 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:14.541634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:14.544533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:14.545182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:14.545568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:14.546467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:14.547291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:14.549932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:14.566107 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2756/5500] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:14.570887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992f2b-5a68-46df-a4c1-357a44ee81f3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:14.582344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992f2b-5a68-46df-a4c1-357a44ee81f3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:14.595389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:14.596499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:14.596947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:14.597509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:14.598342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:14.604088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:14.754084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:14.762121 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2745/5501] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:14 2022] POST /identity/v3/projects => generated 393 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:14.767559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d42b5-e974-43c3-b920-a40fa633ce22 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:14.869142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:14.870804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:14.871243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:14.871684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:14.873595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:14.876872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:15.000361 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2757/5502] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:14 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:15.004407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:15.041339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3108ac-3ca4-44e1-877a-40a73ec30489 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:15.059568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:15.063526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:15.064007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:15.064946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:15.066966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:15.072801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:15.108521 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2746/5503] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:37:15.112385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:15.137780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eea11-ed55-409a-857b-715d215eca41 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:15.144254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc64b9-3497-4107-bcc5-10fb4998a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:15.145238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc64b9-3497-4107-bcc5-10fb4998a1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:15.145665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc64b9-3497-4107-bcc5-10fb4998a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:15.148311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc64b9-3497-4107-bcc5-10fb4998a1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:15.149330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc64b9-3497-4107-bcc5-10fb4998a1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:15.151329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc64b9-3497-4107-bcc5-10fb4998a1f6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:15.185679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2758/5504] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:15.189434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:15.215942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6b9d-a59d-4f32-9eab-2547451be9dd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:15.235904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:15.237056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:15.237475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:15.237885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] PATH_INFO: `/v3/projects/f3115fe184e94bbe9f88c092a41378c2/users/df5a3d1698d04454bb3c5f0b83561026/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:15.278641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3115fe184e94bbe9f88c092a41378c2, user_id=df5a3d1698d04454bb3c5f0b83561026, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:15.283123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:15.385475 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2747/5505] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:15 2022] PUT /identity/v3/projects/f3115fe184e94bbe9f88c092a41378c2/users/df5a3d1698d04454bb3c5f0b83561026/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:15.395853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:15.396411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:15.397165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:15.460586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] MFA Rules not processed for user `df5a3d1698d04454bb3c5f0b83561026`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:15.463806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:15.488937 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:15.629246 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2759/5506] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:15.671786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:15.675701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:15.793280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d563-6851-4fef-8a66-99c23ab67a69 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:15.798012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452454fc-e3fc-454e-9f24-5e5de2011d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:15.798791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452454fc-e3fc-454e-9f24-5e5de2011d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:15.799179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452454fc-e3fc-454e-9f24-5e5de2011d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:15.799556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452454fc-e3fc-454e-9f24-5e5de2011d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:15.813920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452454fc-e3fc-454e-9f24-5e5de2011d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:15.815872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452454fc-e3fc-454e-9f24-5e5de2011d4d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:15.827797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2748/5507] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:16.787626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:16.789060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:16.872815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bca824-a0d0-4fe9-9a1d-2447060735f4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:16.878951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:16.880318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:16.880735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:16.881171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] PATH_INFO: `/v3/users/cedcdb82756b4512b9cd7db2649e8435` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:16.882908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedcdb82756b4512b9cd7db2649e8435)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:16.885683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:17.129541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedcdb82756b4512b9cd7db2649e8435'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:17.139965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedcdb82756b4512b9cd7db2649e8435'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:17.142110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedcdb82756b4512b9cd7db2649e8435'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:17.230582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedcdb82756b4512b9cd7db2649e8435'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:17.231752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedcdb82756b4512b9cd7db2649e8435'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:17.284926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2760/5508] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:16 2022] DELETE /identity/v3/users/cedcdb82756b4512b9cd7db2649e8435 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:17.288818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:17.289279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:17.289390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:17.348339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:17.349705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:17.463303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2749/5509] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:17.595434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:17.597083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:17.674479 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:17.732491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e72f1-dbab-47d2-9cf3-7fb589fe3cdf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:17.739537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d52ac-d68a-40fb-8281-d13a3a9b06dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:17.740195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d52ac-d68a-40fb-8281-d13a3a9b06dc service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:17.740535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d52ac-d68a-40fb-8281-d13a3a9b06dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:17.740808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d52ac-d68a-40fb-8281-d13a3a9b06dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:17.768974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d52ac-d68a-40fb-8281-d13a3a9b06dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:17.771320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d52ac-d68a-40fb-8281-d13a3a9b06dc service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:17.796094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2761/5510] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:19.123934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:19.128252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:19.156759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b935-2720-4677-9682-d6d9500bdb76 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:19.165824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:19.168128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:19.168546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:19.168925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] PATH_INFO: `/v3/projects/68dabe2cafd046fea4cb35076787f899` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:19.175594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=68dabe2cafd046fea4cb35076787f899)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:19.178426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:19.205418 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:19.333585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68dabe2cafd046fea4cb35076787f899', 'request_id': 'req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:19.350384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68dabe2cafd046fea4cb35076787f899', 'request_id': 'req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:19.431976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68dabe2cafd046fea4cb35076787f899', 'request_id': 'req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:19.451887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] The token cache is being invalidate because project 68dabe2cafd046fea4cb35076787f899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:19.452180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:19.453954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63d8b79d-7eca-43d2-ab8e-7a5337af33ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:19.459031 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2750/5511] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:19 2022] DELETE /identity/v3/projects/68dabe2cafd046fea4cb35076787f899 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:19.460874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b83fdd-d7bd-4475-bb31-de3a6f1d0f7c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:19.461313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b83fdd-d7bd-4475-bb31-de3a6f1d0f7c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:19.461599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b83fdd-d7bd-4475-bb31-de3a6f1d0f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:19.506467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-62b83fdd-d7bd-4475-bb31-de3a6f1d0f7c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:19.507917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-62b83fdd-d7bd-4475-bb31-de3a6f1d0f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:19.678129 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2762/5512] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:19.685952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2f78-df87-41d6-9cd7-afa094f834cb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:19.686456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2f78-df87-41d6-9cd7-afa094f834cb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:19.687054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e2f78-df87-41d6-9cd7-afa094f834cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:19.727970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cc1e2f78-df87-41d6-9cd7-afa094f834cb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:19.729734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc1e2f78-df87-41d6-9cd7-afa094f834cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:19.742481 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2751/5513] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:19.746402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b83fdd-d7bd-4475-bb31-de3a6f1d0f7c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:19.758470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b83fdd-d7bd-4475-bb31-de3a6f1d0f7c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:19.767884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:19.768594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:19.768943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:19.769418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:19.770379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:19.770698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:19.772748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:19.787134 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2763/5514] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:37:19.792335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e2f78-df87-41d6-9cd7-afa094f834cb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:19.803444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e2f78-df87-41d6-9cd7-afa094f834cb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:19.808721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:19.809354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:19.809667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:19.809942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:19.810625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:19.812593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:19.944690 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2752/5515] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:19 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:19.947733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:19.959455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605a81-3736-4432-b938-c8f42f1f6bf4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:20.043332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:20.044401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:20.044907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:20.045438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:20.046714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:20.049257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:20.198935 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2764/5516] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:19 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:20.202698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:20.217129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018e50c-274a-404d-b5af-a5b09c20b939 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:20.232921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:20.233933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:20.234388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:20.234939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:20.235701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:20.237655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:20.279660 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2753/5517] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:20.283939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:20.299299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb6a1c-fbd6-4683-b22e-86ab26c5c7d8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:20.307168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f1e91-27ea-4e4d-a996-125da1a13132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:20.308051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f1e91-27ea-4e4d-a996-125da1a13132 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:20.308450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f1e91-27ea-4e4d-a996-125da1a13132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:20.308914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f1e91-27ea-4e4d-a996-125da1a13132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:20.309668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f1e91-27ea-4e4d-a996-125da1a13132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:20.311759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f1e91-27ea-4e4d-a996-125da1a13132 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:20.339041 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2765/5518] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:20.340306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:20.358439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dc882-1904-459a-b96b-a034537bff19 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:20.369742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:20.370668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:20.371051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:20.371431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] PATH_INFO: `/v3/projects/119bc884ff7b4b7caf5953a617d04235/users/be2d06653b3e44cf8f34b1583d242d8a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:20.393892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] RBAC: Authorizing `identity:create_grant(project_id=119bc884ff7b4b7caf5953a617d04235, user_id=be2d06653b3e44cf8f34b1583d242d8a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:20.397407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:20.540275 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2754/5519] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:20 2022] PUT /identity/v3/projects/119bc884ff7b4b7caf5953a617d04235/users/be2d06653b3e44cf8f34b1583d242d8a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:20.553033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8c4e-2eb3-418e-9d7f-db8de5853888 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:20.553839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8c4e-2eb3-418e-9d7f-db8de5853888 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:20.554336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8c4e-2eb3-418e-9d7f-db8de5853888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:20.624060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d48d8c4e-2eb3-418e-9d7f-db8de5853888 None None] MFA Rules not processed for user `be2d06653b3e44cf8f34b1583d242d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:20.624060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d48d8c4e-2eb3-418e-9d7f-db8de5853888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:20.745198 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:20.877106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:20.892860 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2766/5520] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:20.991934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90344a-05f4-43bf-b7df-f02370fb984e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:20.999722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:21.000827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:21.001377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:21.002001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:21.003013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:21.005513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:21.122719 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2755/5521] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:20 2022] POST /identity/v3/projects => generated 391 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:21.126550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d8c4e-2eb3-418e-9d7f-db8de5853888 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:21.148234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d8c4e-2eb3-418e-9d7f-db8de5853888 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:21.293849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:21.294516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:21.294797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:21.295071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:21.295717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:21.301592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:21.404731 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2767/5522] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:21 2022] POST /identity/v3/users => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:21.408488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:21.426598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec942-e01c-4b38-b0bb-6a3f7d61d5ad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:21.447550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:21.448199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:21.448483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:21.448754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:21.449417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:21.451094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:21.514313 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2756/5523] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:21.518286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:21.531831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c032275-3493-4660-aeaa-27403fcf5a4f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:21.537773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:21.538408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:21.538686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:21.538997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] PATH_INFO: `/v3/projects/73cc214c862a4439a29fa0a2b955f43e/users/133e102ca70940e4abbdf0384adc2fec/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:21.583135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73cc214c862a4439a29fa0a2b955f43e, user_id=133e102ca70940e4abbdf0384adc2fec, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:21.585836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:21.687550 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2768/5524] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:21 2022] PUT /identity/v3/projects/73cc214c862a4439a29fa0a2b955f43e/users/133e102ca70940e4abbdf0384adc2fec/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:21.689618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:21.709942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8f6d2-10ab-4324-8314-6d4823dc373a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:21.726736 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:21.868165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0bc6-b936-44e5-8a73-a035fa0c06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:21.869726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0bc6-b936-44e5-8a73-a035fa0c06e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:21.870036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0bc6-b936-44e5-8a73-a035fa0c06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:21.870316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0bc6-b936-44e5-8a73-a035fa0c06e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:21.870987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0bc6-b936-44e5-8a73-a035fa0c06e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:21.872639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0bc6-b936-44e5-8a73-a035fa0c06e5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:21.899284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2757/5525] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:21.904817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:21.919004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6eed3e-86c7-43bd-acab-f5b76895be7d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:21.938115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:21.939073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:21.939501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:21.942646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] PATH_INFO: `/v3/projects/73cc214c862a4439a29fa0a2b955f43e/users/133e102ca70940e4abbdf0384adc2fec/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:21.942646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73cc214c862a4439a29fa0a2b955f43e, user_id=133e102ca70940e4abbdf0384adc2fec, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:21.945187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:21.972970 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2769/5526] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:21 2022] PUT /identity/v3/projects/73cc214c862a4439a29fa0a2b955f43e/users/133e102ca70940e4abbdf0384adc2fec/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:21.983364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49b3b-bfd6-4d7b-8f76-6ad3a1765833 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:21.983907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49b3b-bfd6-4d7b-8f76-6ad3a1765833 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:21.984380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c49b3b-bfd6-4d7b-8f76-6ad3a1765833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:22.045899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-98c49b3b-bfd6-4d7b-8f76-6ad3a1765833 None None] MFA Rules not processed for user `133e102ca70940e4abbdf0384adc2fec`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:22.048253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98c49b3b-bfd6-4d7b-8f76-6ad3a1765833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:22.228347 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2758/5527] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:22.229516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:22.251298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d129-f4a9-43b7-bb25-a484a4f12105 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:22.266657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:22.267303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:22.267584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:22.267855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:22.268649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:22.270279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:22.377409 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2770/5528] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:37:22 2022] POST /identity/v3/domains => generated 277 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:22.381989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49b3b-bfd6-4d7b-8f76-6ad3a1765833 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:22.404287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c49b3b-bfd6-4d7b-8f76-6ad3a1765833 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:22.572659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:22.573615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:22.578145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:22.578145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:22.578145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=869b5e95c2304caca2e6efdbcd4252ba)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:22.578145 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:22.578145 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:37:22.578145 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:37:22.579370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:22.752186 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2759/5529] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:37:22 2022] PUT /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config => generated 138 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:22.756416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:22.780693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467f34-c21e-4ebe-95a3-bc51784d3e3b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:22.802885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:22.803596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:22.803996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:22.804276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:22.807710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=869b5e95c2304caca2e6efdbcd4252ba, group=identity)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:22.808776 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:22.808776 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:37:22.808776 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:37:22.809742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:22.838222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2771/5530] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:37:22 2022] GET /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/identity => generated 45 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:22.842694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:22.855543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa6a9-872a-4988-8269-969be32c1b35 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:22.871303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:22.872000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:22.872283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:22.872558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/identity/driver` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:22.877545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=869b5e95c2304caca2e6efdbcd4252ba, group=identity, option=driver)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:22.878801 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:22.878801 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:37:22.878801 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:37:22.879738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:22.881901 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:22.893649 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2760/5531] 10.222.0.42 () {58 vars in 1296 bytes} [Sun Oct 23 01:37:22 2022] GET /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/identity/driver => generated 31 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:22.897835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:22.913859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796175b0-adeb-4257-982d-5b61eca4480a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:22.926741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:22.927605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:22.927889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:22.928167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/ldap` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:22.932271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=869b5e95c2304caca2e6efdbcd4252ba, group=ldap)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:22.934029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:22.961788 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2772/5532] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:37:22 2022] GET /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/ldap => generated 106 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:22.967077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:22.986466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873e15-54ca-4bb8-9993-ed7db248778a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:22.998755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:23.000403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:23.001563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:23.002467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/ldap/url` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:23.005836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=869b5e95c2304caca2e6efdbcd4252ba, group=ldap, option=url)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:23.006474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:23.015763 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2761/5533] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:37:22 2022] GET /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/ldap/url => generated 46 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 23 01:37:23.019433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:23.044482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73763-c659-4f78-b2bb-131d81e304f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:23.052163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:23.053512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:23.054814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:23.057691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/ldap/user_tree_dn` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:23.082120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=869b5e95c2304caca2e6efdbcd4252ba, group=ldap, option=user_tree_dn)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:23.091773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:23.114387 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2773/5534] 10.222.0.42 () {58 vars in 1302 bytes} [Sun Oct 23 01:37:23 2022] GET /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config/ldap/user_tree_dn => generated 63 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:23.119303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:23.131023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719f03c-e7a1-47c7-91bc-c5c208a946f6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:23.137151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:23.138166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:23.138594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:23.139013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:23.139794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=869b5e95c2304caca2e6efdbcd4252ba)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:23.141049 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:23.141049 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:37:23.141049 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:37:23.142282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:23.232842 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2762/5535] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:23 2022] DELETE /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba/config => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:23.241043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:23.252000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844dfa-4571-4958-aaa3-c668a235335c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:23.286316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:23.289656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:23.290783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:23.292476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:23.296344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=869b5e95c2304caca2e6efdbcd4252ba)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:23.302370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:23.338998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:23.340192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:23.455433 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:23.470624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:23.472178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:23.475348 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2774/5536] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:37:23 2022] PATCH /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba => generated 278 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:23.479345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:23.483160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:23.506390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9fad-bc9a-4e53-ab32-78adf6f3db9d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:23.678477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:23.679868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:23.681793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:23.682280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:23.699146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=869b5e95c2304caca2e6efdbcd4252ba)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:23.701484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:23.793406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:23.804497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:23.965295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba', 'request_id': 'req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:23.979002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba', 'request_id': 'req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:24.087728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba', 'request_id': 'req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:24.127455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] The token cache is being invalidate because project 869b5e95c2304caca2e6efdbcd4252ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:24.127755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:24.134451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:24.183903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba', 'request_id': 'req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:24.185669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba', 'request_id': 'req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:24.199238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '869b5e95c2304caca2e6efdbcd4252ba', 'request_id': 'req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:24.249640 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2763/5537] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:37:23 2022] DELETE /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:24.254677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:24.273049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2713d-831f-484d-9489-f2d3c0b2c29f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:24.527404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:24.528117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:24.528898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:24.529178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:24.531095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:24.532910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:24.637844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:24.638899 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2775/5538] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:37:24 2022] POST /identity/v3/domains => generated 276 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:24.639352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:24.668540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a50f-bfe0-4466-95f9-058d4c3b74d8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:24.695887 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:24.797903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:24.800668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:24.801066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:24.801822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:24.803719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:24.808448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:24.811379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:24.815545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:24.939053 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2764/5539] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:37:24 2022] PUT /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config => generated 138 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:37:24.942819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:24.955398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaccac-720f-434b-8265-3a9aaa7dcbfe tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:24.963253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a57e7-73cd-4ce1-b2b3-c654da455ad6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:24.968572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:24.969544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:24.969966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:24.970428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] PATH_INFO: `/v3/users/634bed7898c24baca6ba00392d49eea1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:24.971734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] RBAC: Authorizing `identity:delete_user(user_id=634bed7898c24baca6ba00392d49eea1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:24.972776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:24.973678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:24.974101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:24.974616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:24.975459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:24.978020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:24.988801 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:24.988801 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:37:24.988801 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:37:24.990662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:25.133625 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2765/5540] 10.222.0.42 () {60 vars in 1271 bytes} [Sun Oct 23 01:37:24 2022] PATCH /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config => generated 142 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:37:25.138029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:25.170372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a352d1a-cd9d-440d-a51c-986119aea7c5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:25.177756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:25.178845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:25.179520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:25.180134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:25.184629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:25.188499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:25.197803 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2766/5541] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:25 2022] GET /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config => generated 142 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:25.199202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:25.205661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634bed7898c24baca6ba00392d49eea1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.211719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8681fe4-582b-41b7-a532-42c8c7ede135 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:25.220301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:25.220301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:25.220301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:25.220941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:25.221765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:25.223922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:25.236285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634bed7898c24baca6ba00392d49eea1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.237021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634bed7898c24baca6ba00392d49eea1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.305256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634bed7898c24baca6ba00392d49eea1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.306579 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2767/5542] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:25 2022] DELETE /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:25.309695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634bed7898c24baca6ba00392d49eea1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.310498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:25.314426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:25.347397 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2776/5543] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:24 2022] DELETE /identity/v3/users/634bed7898c24baca6ba00392d49eea1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:25.354659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f60a-0c90-4258-b5ab-44e83748ca58 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:25.520448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:25.521116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:25.523003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:25.523187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:25.527053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:25.532055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Could not find any options in domain configuration for domain a1a3b64ee4334bd490924749b136eb0f.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a1a3b64ee4334bd490924749b136eb0f. Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:37:25.551580 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a1a3b64ee4334bd490924749b136eb0f. Oct 23 01:37:25.552523 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:37:25.553034 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2768/5544] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:25 2022] GET /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config => generated 151 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:37:25.557452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:25.574803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a96f9-0234-445d-98a5-3ca6c412174a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:25.579744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:25.580399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:25.580676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:25.580942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:25.582296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:25.584366 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:25.584366 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:37:25.584366 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:37:25.585345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:25.592005 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:25.598218 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2777/5545] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:25 2022] DELETE /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f/config => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:25.598884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:25.619046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d82d-ec08-4ce0-828b-8319e3f9843a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:25.628858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:25.629462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:25.629747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:25.630038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:25.635516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:25.636819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:25.695146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.696501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.777070 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:25.792976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.802667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:25.810407 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2769/5546] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:37:25 2022] PATCH /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f => generated 277 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:25.821493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:25.821493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:25.853186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a931f7-8d75-4642-98f0-2a7113787cd2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:25.991691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:25.992911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:25.992911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:25.994327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:26.023607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a1a3b64ee4334bd490924749b136eb0f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:26.026508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:26.053903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.058374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.238948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f', 'request_id': 'req-d2f48168-8ce6-48c2-9463-c70402b5b71e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.254823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f', 'request_id': 'req-d2f48168-8ce6-48c2-9463-c70402b5b71e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.292150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:26.292959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:26.367137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f', 'request_id': 'req-d2f48168-8ce6-48c2-9463-c70402b5b71e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.394666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] The token cache is being invalidate because project a1a3b64ee4334bd490924749b136eb0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:26.397561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.401031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.430377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f', 'request_id': 'req-d2f48168-8ce6-48c2-9463-c70402b5b71e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.431784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f', 'request_id': 'req-d2f48168-8ce6-48c2-9463-c70402b5b71e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.447310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a1a3b64ee4334bd490924749b136eb0f', 'request_id': 'req-d2f48168-8ce6-48c2-9463-c70402b5b71e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.450060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b382ed-c275-45cc-9535-e77c4ee981f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:26.475868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2778/5547] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:37:25 2022] DELETE /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:26.475868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:26.478359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:26.599609 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:26.615429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:26.616116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:26.616900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:26.616900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] PATH_INFO: `/v3/projects/842dcab8b48c43d7963a538d914b0b22` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:26.619908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=842dcab8b48c43d7963a538d914b0b22)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:26.621850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:26.652294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f48168-8ce6-48c2-9463-c70402b5b71e tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:26.667589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:26.668316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:26.668842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:26.680430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:26.680430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:26.680430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:26.770532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842dcab8b48c43d7963a538d914b0b22', 'request_id': 'req-47b99ec4-e2cc-451c-8702-c74b032ea7ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.785126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842dcab8b48c43d7963a538d914b0b22', 'request_id': 'req-47b99ec4-e2cc-451c-8702-c74b032ea7ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.807850 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2779/5548] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:37:26 2022] POST /identity/v3/domains => generated 275 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:26.809166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:26.915869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842dcab8b48c43d7963a538d914b0b22', 'request_id': 'req-47b99ec4-e2cc-451c-8702-c74b032ea7ec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.938888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] The token cache is being invalidate because project 842dcab8b48c43d7963a538d914b0b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:26.938888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.939267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47b99ec4-e2cc-451c-8702-c74b032ea7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:26.943120 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2770/5549] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:26 2022] DELETE /identity/v3/projects/842dcab8b48c43d7963a538d914b0b22 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:26.950807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7533f-97ad-4154-bc3d-218978cf9144 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:26.954951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7533f-97ad-4154-bc3d-218978cf9144 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:26.955235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7533f-97ad-4154-bc3d-218978cf9144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:26.986292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f875e2-3057-4c3f-8f10-9adf454f4206 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:27.030169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-30a7533f-97ad-4154-bc3d-218978cf9144 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:27.031651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-30a7533f-97ad-4154-bc3d-218978cf9144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:27.041630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:27.043412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.043853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.044975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.049900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:27.051596 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:27.051596 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:37:27.051596 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:37:27.054672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:27.116314 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:27.186875 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2771/5550] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:27.196048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40988d8-fd1a-40bd-a3e3-f57eb974b28a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.197147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40988d8-fd1a-40bd-a3e3-f57eb974b28a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.197730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40988d8-fd1a-40bd-a3e3-f57eb974b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.233440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2780/5551] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:37:26 2022] PUT /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config => generated 138 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:27.234617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:27.240338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:27.289738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07692a8-7302-455e-b09e-b50b96d60a20 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:27.310391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:27.312558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.312823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.313263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.313898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e40988d8-fd1a-40bd-a3e3-f57eb974b28a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:27.315650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710, group=identity)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:27.316748 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:27.316748 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:37:27.316748 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:37:27.318068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e40988d8-fd1a-40bd-a3e3-f57eb974b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:27.319894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:27.378648 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2772/5552] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:27.379984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40988d8-fd1a-40bd-a3e3-f57eb974b28a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:27.407684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40988d8-fd1a-40bd-a3e3-f57eb974b28a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:27.413308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:27.414183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.414665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.415163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.416021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:27.416428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:27.418263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:27.452754 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2773/5553] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:27.455291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:27.479464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c5f8d-6669-4953-9046-e5c0b5245445 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:27.496967 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2781/5554] 10.222.0.42 () {60 vars in 1297 bytes} [Sun Oct 23 01:37:27 2022] PATCH /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity => generated 176 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:27.497599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:27.498864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.498864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.498864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.500648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:27.501281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:27.507131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:27.517740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebf6da-9d95-4d5f-bcb6-eb250d2d0060 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:27.534495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:27.535204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.535488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.535765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity/driver` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.536457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710, group=identity, option=driver)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:27.538234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:27.633668 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2774/5555] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:27 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:27.638128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:27.730219 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2782/5556] 10.222.0.42 () {60 vars in 1318 bytes} [Sun Oct 23 01:37:27 2022] PATCH /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity/driver => generated 176 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:27.731313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:27.755946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ca0e-66f0-4d55-b3e4-6f18ef92aa0b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:27.866308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39869c07-387b-4fc9-8746-be0c1e2489ed admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:27.887460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:27.893220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.894404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.894788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.897204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:27.906948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:27.923677 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:27.971117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:27.972014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:27.972493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:27.972905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity/driver` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:27.973725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710, group=identity, option=driver)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:27.975548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.067856 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2775/5557] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:27 2022] POST /identity/v3/users => generated 289 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:28.068910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.089116 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2783/5558] 10.222.0.42 () {58 vars in 1299 bytes} [Sun Oct 23 01:37:27 2022] DELETE /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity/driver => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:28.093612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.107565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db67eb5-b19f-4b57-8230-1366887be625 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.112807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa87d-746b-4771-aa01-1aea23dfa2f4 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.127709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.129071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.132440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.133401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.135158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.136098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.137068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.145903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.145903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity/driver` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.145903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710, group=identity, option=driver)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.146996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.152685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.185961 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2776/5559] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:28.187373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Could not find option driver in group identity in domain configuration for domain f704dc1dfc3f4c16820ff0e941603710.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain f704dc1dfc3f4c16820ff0e941603710. Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:37:28.188245 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain f704dc1dfc3f4c16820ff0e941603710. Oct 23 01:37:28.189165 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:37:28.190971 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2784/5560] 10.222.0.42 () {58 vars in 1296 bytes} [Sun Oct 23 01:37:28 2022] GET /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity/driver => generated 171 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:37:28.195526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.229672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ec8f7-5c4a-493b-afc2-52db8a39072c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.240420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ec324-9c21-4bfb-9884-3da02a1dcc2d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.247307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.248489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.250785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.253465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.254815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.263111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.264422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.267512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.267941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.268784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.270116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710, group=identity)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.278800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.313530 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2777/5561] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:28.318644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.335627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f30495-cfe7-4e73-8810-2ea0c3854690 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.342570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.344029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.344496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.344880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] PATH_INFO: `/v3/projects/a2532e029d7c483bbcf901c75023e59f/users/2ceec980f06b45a989a5cd6cbca9d5d1/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.365944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2532e029d7c483bbcf901c75023e59f, user_id=2ceec980f06b45a989a5cd6cbca9d5d1, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.369017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.402822 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2785/5562] 10.222.0.42 () {58 vars in 1278 bytes} [Sun Oct 23 01:37:28 2022] DELETE /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:28.407124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.424398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab50f6-8d19-4a53-992c-ec29e5e1635b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.437448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b735914-955c-46a6-b762-ff419200a4eb tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.439406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735914-955c-46a6-b762-ff419200a4eb tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.439812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735914-955c-46a6-b762-ff419200a4eb tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.440206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735914-955c-46a6-b762-ff419200a4eb tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.442149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b735914-955c-46a6-b762-ff419200a4eb tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710, group=identity)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.445822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b735914-955c-46a6-b762-ff419200a4eb tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.478202 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2778/5563] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:28 2022] PUT /identity/v3/projects/a2532e029d7c483bbcf901c75023e59f/users/2ceec980f06b45a989a5cd6cbca9d5d1/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-0b735914-955c-46a6-b762-ff419200a4eb tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Could not find group identity in domain configuration for domain f704dc1dfc3f4c16820ff0e941603710.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain f704dc1dfc3f4c16820ff0e941603710. Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:37:28.479129 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain f704dc1dfc3f4c16820ff0e941603710. Oct 23 01:37:28.479867 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:37:28.480665 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2786/5564] 10.222.0.42 () {58 vars in 1275 bytes} [Sun Oct 23 01:37:28 2022] GET /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config/identity => generated 154 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:37:28.484702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.491769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.491769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.491769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.534220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:28.536571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:28.592347 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:28.662362 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2787/5565] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:28.679778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71173ffc-5632-4b45-96e2-3bb7ea12ab6c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.683752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.685598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:28.690062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.692155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.692155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.692155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.692155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f704dc1dfc3f4c16820ff0e941603710)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.693130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.762043 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2779/5566] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:28 2022] DELETE /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710/config => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:28.766434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:28.782141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beecc7-51cc-4aca-ac2d-2412c8514fc9 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.789781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.791343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.791755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.792626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.794869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f704dc1dfc3f4c16820ff0e941603710)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.799462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.837311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0a3a5-866e-4795-8e23-3f591aa643d8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:28.848043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:28.848942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:28.849401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:28.849817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:28.867304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:28.869288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:28.881213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2788/5567] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:29.052546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.053504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.236709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.237923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.246367 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2780/5568] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:37:28 2022] PATCH /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710 => generated 276 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:37:29.250229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:29.265675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b8f70-de39-4be2-b1ee-de2fc03cce12 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:29.355113 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:29.403258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:29.403911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:29.404361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:29.404773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:29.429678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f704dc1dfc3f4c16820ff0e941603710)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:29.434680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:29.523285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.535981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.706448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710', 'request_id': 'req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.714491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710', 'request_id': 'req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.847032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710', 'request_id': 'req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.867869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] The token cache is being invalidate because project f704dc1dfc3f4c16820ff0e941603710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:29.868327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.872157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.895364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710', 'request_id': 'req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.896488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710', 'request_id': 'req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.901380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f704dc1dfc3f4c16820ff0e941603710', 'request_id': 'req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:29.915464 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2789/5569] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:37:29 2022] DELETE /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:29.917906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:29.919411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:29.946678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3342d1-79d8-44b9-93b6-1c8670f8d9ac tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.097616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.098780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.099133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.099487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.100145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.107546 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:30.107546 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:37:30.107546 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:37:30.109169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.116199 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2781/5570] 10.222.0.42 () {58 vars in 1173 bytes} [Sun Oct 23 01:37:29 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:30.122358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.123908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:30.152548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d37e-18fe-4aee-ab23-a8c5e75831dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.182164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.187544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.187844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.188130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.188768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.192621 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:30.192621 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:37:30.192621 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:37:30.196748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.206692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.206877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2790/5571] 10.222.0.42 () {58 vars in 1200 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.222632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2810be5-f373-4ae7-ad57-6c931dab2231 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.235583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.236941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.237702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.237702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.238258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.255982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.263509 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2782/5572] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.264746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.284250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda8fa2-5f11-4d37-89ce-e18ac7ff02aa tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.303213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.304011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.304375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.304732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.305603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.308337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.310024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2791/5573] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.314780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.329328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941d00d-04da-4764-9f2b-ebc61098263b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.346565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.347279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.347558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.347833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.354328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.357437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.364321 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2783/5574] 10.222.0.42 () {58 vars in 1188 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:37:30.367137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.381767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c8161-6030-4dee-a070-48c9d64d5b3d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.460787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.460787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.460787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.463395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.463395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.463395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.463395 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2792/5575] 10.222.0.42 () {58 vars in 1200 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.477401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.504169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f570f-4efb-4867-ae14-44d5debe3f6a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.514284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.515560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.515846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.516116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.516806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.518538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.520215 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2784/5576] 10.222.0.42 () {58 vars in 1203 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.541269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.580584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7f599-f8a3-4b8f-b6de-32cf1826bd7f tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.592928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.594148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.594574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.594921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.596548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.599001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.601192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2793/5577] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.605697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.621751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebb104-dcfc-4178-849c-232fa2c8ad5b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.635504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.647260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.647550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.648658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.650103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.654521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.656678 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2785/5578] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.661298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.676633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90726191-f5bb-491b-ba33-b6ab981cc800 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.689198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.691905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.694707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.694707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.695308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.702835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.710129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.723062 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2794/5579] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 23 01:37:30.728820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ec9d0-4354-4791-8ae2-32b7ee592894 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.745401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.746143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.746605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.747044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.747670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.749253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.758409 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2786/5580] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.760622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.794526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2efe55-f669-4581-a8cb-9e7baf282855 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.801618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.802338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.802620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.802897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.803550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.806791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.814108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.825175 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2795/5581] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.827708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5cdb-eb4f-4fb1-8cfd-bf88469235a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.833536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.834604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.835095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.835452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.837619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.838969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.844884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.853619 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2787/5582] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.859067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ee49b-9720-4062-bec0-f5a2446ca731 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.864941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.865954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.866420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.866921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.869343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.872358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.877832 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2796/5583] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.878834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.897479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8ff78-8d82-4018-964e-3e46cbde96dc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.905482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.910787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.910787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.910787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.910787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.911105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.918295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.927042 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2788/5584] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.933566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc7e1d-a517-420e-bb8f-2c691bd10e85 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.940474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.941360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.942888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.943278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.945106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:30.947605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:30.954165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:30.969495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2797/5585] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:30.973829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb777d-857d-458a-9086-2651649af12a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:30.985412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:30.990060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:30.990768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:30.993354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:30.995541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.001988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.010894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.020089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2789/5586] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:37:30 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.027155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd9955-5c37-40d8-ae84-4040a4ddd350 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.034039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.034669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.035790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.035974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.036742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.042654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.054359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.061904 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2798/5587] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.063641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa03643-720f-4c9a-b7eb-0740e2604598 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.071546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.072801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.073248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.073684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.074662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.076836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.081118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2790/5588] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.085760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.099793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e1957-0049-48c4-92dc-af6420e6d7f1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.113764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.114454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.114738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.115014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.115674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.117361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.128025 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2799/5589] 10.222.0.42 () {58 vars in 1269 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.129272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.145557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2503a6-1a86-4f9e-8986-01d54aa37ecc tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.159150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.159853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.160123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.160400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.161008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.162666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.163894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2791/5590] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.168104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.186500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8c4c3-d521-44df-9c5f-30fae8ab667b tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.195699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.196855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.197148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.197427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.198407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.199975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.204554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2800/5591] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.215193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.243465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205635-ff1a-4cd5-ab8f-63d6890036a2 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.251367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.252412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.255067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.258618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.261253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.265488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.270872 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2792/5592] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.274906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.292199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f217e5-18b1-49cc-9660-8abbd4b6ed2a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.294968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.295636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.295918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.296196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.296894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.298714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.310619 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2801/5593] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.312141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.329719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f71d-5f93-45f9-baef-61fdba4d0243 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.344841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.345526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.345810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.346114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.346793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.353333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.358376 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2793/5594] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.359637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.376196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de247b4-2f4b-40b5-8aa1-d8f9548ff710 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.402799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.403817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.403817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.404095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.414494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.416537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.421573 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2802/5595] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.423092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.436577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fd44c-d46e-4243-9c51-b309cf3f369d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.449209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.449954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.450263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.450594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.451204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.453059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.456134 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2794/5596] 10.222.0.42 () {58 vars in 1290 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.461546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.476370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2f39-bceb-4eba-bf5c-7d4f0ecd1bd6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.490754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.491306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.491585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.492036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.492849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.494717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.502120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2803/5597] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.502820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.520476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64486c99-83d8-4365-90ba-b44255fc91b5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.536998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.537679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.537962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.538278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.538884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.540690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.544723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2795/5598] 10.222.0.42 () {58 vars in 1266 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 23 01:37:31.549217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.566931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723fbf9-380d-4927-8cbb-7142fff380f3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.580446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.589854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.589854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.589854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.589854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.591554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.591554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2804/5599] 10.222.0.42 () {58 vars in 1308 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.592064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.604894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24338146-75b1-451f-9a61-b63dc41ac8da tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.620958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.620958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.620958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.621456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.621456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.622216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.628994 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2796/5600] 10.222.0.42 () {58 vars in 1290 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.630866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.645562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dfe5e-008c-462a-a096-f93d9d00412d tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.658843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.659659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.660012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.660359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.661379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.663297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.667716 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2805/5601] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.669090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.683043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f46c-97b2-4be2-bb50-f4f3ad0b466c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.688974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.690200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.690693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.691591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.693174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.695206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.703196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.703789 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2797/5602] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 23 01:37:31.715946 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:31.722384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023df7-a87b-4ede-babc-d0825d3e5c17 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.731722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.733209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.734474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.734988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.736020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.738381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.744426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.758280 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2806/5603] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 23 01:37:31.761330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16726a43-44e8-44a4-b1be-35c56d14a759 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.769813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.770800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.771366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.771953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.772924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.777451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.782208 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2798/5604] 10.222.0.42 () {58 vars in 1245 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.783794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.799053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4627de-fded-42e5-9df8-324d56443077 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.817813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.818800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.819256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.819683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.820504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.824360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.831011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.847973 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2807/5605] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.851033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8ff46-41af-4147-806c-3ed034e78b82 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.862618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.864751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.865220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.866338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.867096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.872867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.878534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.893751 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2799/5606] 10.222.0.42 () {58 vars in 1254 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.898741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e776a-20d4-4835-93d6-50d5e2077ad5 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.912529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.913225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.913515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.917635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.918557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.920309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.925935 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2808/5607] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 23 01:37:31.927347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.945703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc16997-eca1-4e70-90a1-ee5fa8a31fa3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:31.962554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:31.963908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:31.964547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:31.965675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:31.966971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:31.973746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:31.975414 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2800/5608] 10.222.0.42 () {58 vars in 1251 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:31.979683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:31.997198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bbef3-e856-465f-9999-ac6c5ce1ac78 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.009820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.010770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.011224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.011650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.014556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.016573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.025850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.039981 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2809/5609] 10.222.0.42 () {58 vars in 1257 bytes} [Sun Oct 23 01:37:31 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.041094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed6ef3-925d-4946-af73-4b9fd081fb97 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.053490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.054674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.056174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.057047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.058100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.059947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.065745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.075517 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2801/5610] 10.222.0.42 () {58 vars in 1293 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.083488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44275e4c-14e1-424f-9746-614965ca56cf tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.087713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.090628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.091100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.091599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.092459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.094943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.101365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.108227 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:32.113565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2810/5611] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.116997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99963e-10af-4874-8f05-6e426fedf347 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.123806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.124815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.125283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.126181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.127277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.129576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.136738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.145812 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2802/5612] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.150712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644b11-181b-432f-b7ce-28d7342ce442 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.157514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.159066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.159526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.160888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.162350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.164174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.170966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.186312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2811/5613] 10.222.0.42 () {58 vars in 1212 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 23 01:37:32.186509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a359bf8-eced-4cb7-bb9e-7a5f11a7fe5c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.197445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.202183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.202183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.202183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.205217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.207231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.210756 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2803/5614] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.215426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.231348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d88f-a4c1-4e0b-bc9b-00d4c269940a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.240559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.244623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.245377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.245659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.248334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.251365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.252893 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2812/5615] 10.222.0.42 () {58 vars in 1215 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.256884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.268934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1fe2-8462-463f-895c-93f3bafbec21 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.286012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.286697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.287052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.287239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.287844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.290979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.292669 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2804/5616] 10.222.0.42 () {58 vars in 1218 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.298945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.329516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2514-9221-4347-83f7-cb1d6439606a tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.343166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.343962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.344126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.344405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.345006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.346852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.355521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.368484 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2813/5617] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.371957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19694f-f109-40a2-82bb-44346862729c tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.385418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.385418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.386494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.386990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.388651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.390992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.400351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.404055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2805/5618] 10.222.0.42 () {58 vars in 1239 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.405015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.431778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea82b5c-760c-4789-9604-cad1e36b39c6 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.432900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:32.456298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ce545-67a4-4bc7-9f70-3c5eff1b1332 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.456975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce545-67a4-4bc7-9f70-3c5eff1b1332 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.457259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce545-67a4-4bc7-9f70-3c5eff1b1332 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.462349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce545-67a4-4bc7-9f70-3c5eff1b1332 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.471455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ce545-67a4-4bc7-9f70-3c5eff1b1332 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.471455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ce545-67a4-4bc7-9f70-3c5eff1b1332 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.481598 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2814/5619] 10.222.0.42 () {58 vars in 1260 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.486087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719abe70-d3e8-4f25-a903-6f0b40c00a9e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.488490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719abe70-d3e8-4f25-a903-6f0b40c00a9e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.490500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719abe70-d3e8-4f25-a903-6f0b40c00a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.596179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-719abe70-d3e8-4f25-a903-6f0b40c00a9e None None] MFA Rules not processed for user `bb03047092f64e2abbf78e9db1a06e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:32.599177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-719abe70-d3e8-4f25-a903-6f0b40c00a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:32.664058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3a590-940c-4466-b4e5-5eea83d5d6f0 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.679698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.680712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.681082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.681445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] PATH_INFO: `/v3/users/a7e81f8fac9048f881008ddc908c1c8c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.684899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e81f8fac9048f881008ddc908c1c8c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.687053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.770597 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2815/5620] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:32.771792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719abe70-d3e8-4f25-a903-6f0b40c00a9e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.789083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719abe70-d3e8-4f25-a903-6f0b40c00a9e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.796762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.802797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.802797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.802797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.802797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.803166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.803166 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2816/5621] 10.222.0.42 () {58 vars in 1263 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.807808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.818917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510ec63-e051-4af4-b72c-7a56ff553546 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.824748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.826879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.827511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.827880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.832260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.833998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.835331 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2817/5622] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.845726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.873529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506999aa-2979-4737-ac91-76dd3ff27ab8 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.889824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.890866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.891471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.891471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.892307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.898743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.901766 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2818/5623] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.923771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.943015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c519-6e00-45d5-ac47-e73db7612f62 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.949235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.950406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.951080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.951508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.952253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:32.954141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:32.957109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e81f8fac9048f881008ddc908c1c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:32.961518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2819/5624] 10.222.0.42 () {58 vars in 1278 bytes} [Sun Oct 23 01:37:32 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 23 01:37:32.962963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:32.968335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e81f8fac9048f881008ddc908c1c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:32.969571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e81f8fac9048f881008ddc908c1c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:32.969905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:32.988659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77da9c-242a-4380-9157-4c4821819c55 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:32.995017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:32.996092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:32.996092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:32.996356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] PATH_INFO: `/v3/users/df5a3d1698d04454bb3c5f0b83561026` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:32.998174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5a3d1698d04454bb3c5f0b83561026)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:33.000283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:33.054506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e81f8fac9048f881008ddc908c1c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:33.056019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e81f8fac9048f881008ddc908c1c8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:33.116195 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2806/5625] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:32 2022] DELETE /identity/v3/users/a7e81f8fac9048f881008ddc908c1c8c => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:33.117525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:33.119752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:33.203805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5a3d1698d04454bb3c5f0b83561026'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:33.222289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5a3d1698d04454bb3c5f0b83561026'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:33.225470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5a3d1698d04454bb3c5f0b83561026'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:33.304650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5a3d1698d04454bb3c5f0b83561026'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:33.305574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9da0dc1d-bdfe-43a4-86b8-0114aeecd9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5a3d1698d04454bb3c5f0b83561026'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:33.322270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c23fc2-6ab6-45b5-9a72-fe860d74cbbd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:33.333508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01258add-2099-43a4-ab05-fc073eabe1a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:33.334827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01258add-2099-43a4-ab05-fc073eabe1a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.335327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01258add-2099-43a4-ab05-fc073eabe1a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.336219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01258add-2099-43a4-ab05-fc073eabe1a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/f704dc1dfc3f4c16820ff0e941603710` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.341624 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2820/5626] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:32 2022] DELETE /identity/v3/users/df5a3d1698d04454bb3c5f0b83561026 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:33.346531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.348415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.354679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.364912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01258add-2099-43a4-ab05-fc073eabe1a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-01258add-2099-43a4-ab05-fc073eabe1a1 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Could not find domain: f704dc1dfc3f4c16820ff0e941603710.: keystone.exception.DomainNotFound: Could not find domain: f704dc1dfc3f4c16820ff0e941603710. Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f704dc1dfc3f4c16820ff0e941603710. Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:37:33.373436 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:37:33.374624 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:37:33.375602 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f704dc1dfc3f4c16820ff0e941603710. Oct 23 01:37:33.376544 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:37:33.376544 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2807/5627] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:37:33 2022] PATCH /identity/v3/domains/f704dc1dfc3f4c16820ff0e941603710 => generated 112 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:37:33.384172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.384533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.384877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.395589 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:33.396597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:33.398016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:33.413442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:33.416306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:33.444385 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:33.534309 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2821/5628] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:33.541965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:33.543673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:33.572753 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2808/5629] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:33.574021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:33.579679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:33.677765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0248ad-bca8-47b4-b436-e785f981add8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:33.682555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba458f-bbcb-44cb-9633-29053a8af04a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:33.694300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:33.694979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.695263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.695876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:33.695995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/a1a3b64ee4334bd490924749b136eb0f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.696199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.696481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.696827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.710537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Could not find domain: a1a3b64ee4334bd490924749b136eb0f.: keystone.exception.DomainNotFound: Could not find domain: a1a3b64ee4334bd490924749b136eb0f. Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a1a3b64ee4334bd490924749b136eb0f. Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:37:33.718097 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:37:33.719219 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:37:33.720254 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a1a3b64ee4334bd490924749b136eb0f. Oct 23 01:37:33.721337 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:37:33.722777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:33.723182 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2822/5630] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:37:33 2022] PATCH /identity/v3/domains/a1a3b64ee4334bd490924749b136eb0f => generated 112 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:37:33.724238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:33.728165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:33.769033 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2809/5631] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:33.770455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:33.775764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de11f-cdf0-49f9-be7e-406174421564 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:33.784940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:33.785571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.785848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.786174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.803234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a1172-82bd-4f8d-9707-38b47a595668 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:33.807149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133e102ca70940e4abbdf0384adc2fec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73cc214c862a4439a29fa0a2b955f43e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:33.808352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.808814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.809237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] PATH_INFO: `/v3/domains/869b5e95c2304caca2e6efdbcd4252ba` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.811544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:33.813030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:33.818648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Could not find domain: 869b5e95c2304caca2e6efdbcd4252ba.: keystone.exception.DomainNotFound: Could not find domain: 869b5e95c2304caca2e6efdbcd4252ba. Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 869b5e95c2304caca2e6efdbcd4252ba. Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:37:33.830863 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:37:33.837072 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:37:33.838374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 869b5e95c2304caca2e6efdbcd4252ba. Oct 23 01:37:33.839465 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:37:33.839546 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2823/5632] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:33.839631 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2810/5633] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:37:33 2022] PATCH /identity/v3/domains/869b5e95c2304caca2e6efdbcd4252ba => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:37:33.839721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:33.840353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:33.863770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d151-b805-4a0a-ad1c-085420daed5e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:33.879200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:33.879866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:33.880148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:33.880424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] PATH_INFO: `/v3/users/be2d06653b3e44cf8f34b1583d242d8a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:33.882175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2d06653b3e44cf8f34b1583d242d8a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:33.884244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:34.149696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2d06653b3e44cf8f34b1583d242d8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.163688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2d06653b3e44cf8f34b1583d242d8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.164368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2d06653b3e44cf8f34b1583d242d8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.264233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2d06653b3e44cf8f34b1583d242d8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.264882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bc1e5895-c068-43c2-b5f5-801e3fae5ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2d06653b3e44cf8f34b1583d242d8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.275976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:34.280044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:34.300290 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2824/5634] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:33 2022] DELETE /identity/v3/users/be2d06653b3e44cf8f34b1583d242d8a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:34.301869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:34.302193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:34.302550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:34.308348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641f8bc-3855-4685-88ec-9534cbff0bf3 tempest-DomainConfigurationTestJSON-1451461781 tempest-DomainConfigurationTestJSON-1451461781-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:34.347956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:34.349530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:34.399840 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:34.420035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:34.420035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:34.420035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:34.420035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] PATH_INFO: `/v3/projects/b5200107493d419ba8a8c9529851168c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:34.420998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5200107493d419ba8a8c9529851168c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:34.423342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:34.480985 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2825/5635] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:37:34.509473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:34.510974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:34.590665 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:34.601416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305312e2-6560-43cd-a0f4-d306f933aea1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:34.603106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5200107493d419ba8a8c9529851168c', 'request_id': 'req-1976873f-c090-4da5-9dac-99c16d47c1da'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.616040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5200107493d419ba8a8c9529851168c', 'request_id': 'req-1976873f-c090-4da5-9dac-99c16d47c1da'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.672773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:34.673820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:34.674268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:34.674655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:34.688250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5200107493d419ba8a8c9529851168c', 'request_id': 'req-1976873f-c090-4da5-9dac-99c16d47c1da'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.707198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] The token cache is being invalidate because project b5200107493d419ba8a8c9529851168c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:34.708664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.712168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1976873f-c090-4da5-9dac-99c16d47c1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:34.717575 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2811/5636] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:34 2022] DELETE /identity/v3/projects/b5200107493d419ba8a8c9529851168c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:34.721627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c649297-6135-4a6f-9a44-abc6d1079119 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:34.722258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c649297-6135-4a6f-9a44-abc6d1079119 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:34.722823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c649297-6135-4a6f-9a44-abc6d1079119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:34.760587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6c649297-6135-4a6f-9a44-abc6d1079119 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:34.761858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6c649297-6135-4a6f-9a44-abc6d1079119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:34.794799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:34.798080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:34.814332 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2826/5637] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:34.815871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:34.817842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:34.844218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b4e8a-b209-4d96-a23a-dcf0b7ad2a9c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:34.857864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:34.858879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:34.860115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:34.861966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] PATH_INFO: `/v3/projects/f3115fe184e94bbe9f88c092a41378c2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:34.863691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3115fe184e94bbe9f88c092a41378c2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:34.871677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:34.880700 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2812/5638] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:34.889244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104dbb6-ef6e-4e3e-bc83-e26d4d0d73c2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:34.889989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104dbb6-ef6e-4e3e-bc83-e26d4d0d73c2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:34.890443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104dbb6-ef6e-4e3e-bc83-e26d4d0d73c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:34.935880 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:34.940639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5104dbb6-ef6e-4e3e-bc83-e26d4d0d73c2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:34.948596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5104dbb6-ef6e-4e3e-bc83-e26d4d0d73c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:34.977132 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2813/5639] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:37:34.980410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104dbb6-ef6e-4e3e-bc83-e26d4d0d73c2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.005882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104dbb6-ef6e-4e3e-bc83-e26d4d0d73c2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.027873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3115fe184e94bbe9f88c092a41378c2', 'request_id': 'req-fa350510-b876-4073-bfd5-7a91706720d4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:35.039014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3115fe184e94bbe9f88c092a41378c2', 'request_id': 'req-fa350510-b876-4073-bfd5-7a91706720d4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:35.133053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3115fe184e94bbe9f88c092a41378c2', 'request_id': 'req-fa350510-b876-4073-bfd5-7a91706720d4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:35.161876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] The token cache is being invalidate because project f3115fe184e94bbe9f88c092a41378c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:35.162231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:35.163632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa350510-b876-4073-bfd5-7a91706720d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:35.168353 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2827/5640] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:34 2022] DELETE /identity/v3/projects/f3115fe184e94bbe9f88c092a41378c2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:35.175082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1684-da22-4adf-8943-85c15bf56897 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.176698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1684-da22-4adf-8943-85c15bf56897 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.176982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1684-da22-4adf-8943-85c15bf56897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.183363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.183825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.187722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.187722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.187722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:35.187722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.189422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.221880 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2814/5641] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:35.223230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.225192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:35.226512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a32d1684-da22-4adf-8943-85c15bf56897 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:35.228381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a32d1684-da22-4adf-8943-85c15bf56897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:35.260308 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2828/5642] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:35.261681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfb2b-e3e8-4e38-97e9-16df48bb0236 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.262002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfb2b-e3e8-4e38-97e9-16df48bb0236 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.264625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3531b5-a292-43b4-bd70-5a6b4bff2142 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.265698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfb2b-e3e8-4e38-97e9-16df48bb0236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.276132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.276284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.277142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.277423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.279340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.282831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.314663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-06ccfb2b-e3e8-4e38-97e9-16df48bb0236 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:35.315901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-06ccfb2b-e3e8-4e38-97e9-16df48bb0236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:35.333216 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2829/5643] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:35.338682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfb2b-e3e8-4e38-97e9-16df48bb0236 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.349525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfb2b-e3e8-4e38-97e9-16df48bb0236 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.357104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.358564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.358855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.359145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.360045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:35.360418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.362399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.394806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2830/5644] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:35.401188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.419387 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2815/5645] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:35 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:35.423825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.425049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f4149-4935-40e2-93e4-f8082cb6f083 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.477236 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:35.528214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37547fc-65ad-4a04-861a-7e2bfe6ade7c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.547133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.548706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.549007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.549282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.549930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.556889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.592382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.593673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.600042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.600042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.600042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.600042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.685564 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2816/5646] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:35 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:35.689392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.721664 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2831/5647] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:35 2022] POST /identity/v3/projects => generated 365 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:35.722798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.729741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1aea-a166-405c-b26b-48167f074906 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.855995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.856620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.856913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.857256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.858060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.859678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.865772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91a6ff-c142-49f8-8816-feb5b82a4013 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.870370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2817/5648] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:35.874553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.891066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7e6b-22eb-43f1-a411-a4ccdeb4d9a5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.895427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.896063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.896342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.896613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.897435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.898148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.899546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.900012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.900463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.901294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.901544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.904194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:35.931554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2818/5649] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:35.935756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:35.948709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47542f4-98a2-4356-97ec-9cf2b87cc381 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:35.954882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:35.955866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:35.956406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:35.956864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] PATH_INFO: `/v3/projects/f7652377101e4875b60523c182e6198f/users/c1bd8ccea80d422e8d65f3097d978aa1/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:35.975480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7652377101e4875b60523c182e6198f, user_id=c1bd8ccea80d422e8d65f3097d978aa1, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:35.979320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:36.029030 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:36.036490 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2832/5650] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:35 2022] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:37:36.037624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:36.041523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:36.063357 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2819/5651] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:35 2022] PUT /identity/v3/projects/f7652377101e4875b60523c182e6198f/users/c1bd8ccea80d422e8d65f3097d978aa1/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:36.063357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:36.076532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcf3f-355f-4686-a20c-6d6ea2eb9021 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:36.160566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597963c3-635c-41b0-9489-67712645e5f6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:36.166700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569570-6a93-4aea-8230-e914f21f3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:36.168054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569570-6a93-4aea-8230-e914f21f3fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:36.168363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569570-6a93-4aea-8230-e914f21f3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:36.168828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569570-6a93-4aea-8230-e914f21f3fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:36.169601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569570-6a93-4aea-8230-e914f21f3fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:36.186372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569570-6a93-4aea-8230-e914f21f3fa4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:36.210272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:36.210605 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2820/5652] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:36.210605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facaac8-5729-4a35-ba2c-da43c39aa3ee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:36.210605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facaac8-5729-4a35-ba2c-da43c39aa3ee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:36.210605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facaac8-5729-4a35-ba2c-da43c39aa3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:36.211028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:36.211028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:36.211930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] PATH_INFO: `/v3/projects/119bc884ff7b4b7caf5953a617d04235` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:36.213539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119bc884ff7b4b7caf5953a617d04235)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:36.216519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:36.263830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5facaac8-5729-4a35-ba2c-da43c39aa3ee None None] MFA Rules not processed for user `c1bd8ccea80d422e8d65f3097d978aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:36.265659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5facaac8-5729-4a35-ba2c-da43c39aa3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:36.281306 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:36.379248 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2821/5653] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:36.380182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facaac8-5729-4a35-ba2c-da43c39aa3ee None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:36.395231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facaac8-5729-4a35-ba2c-da43c39aa3ee None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:36.415726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119bc884ff7b4b7caf5953a617d04235', 'request_id': 'req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:36.431313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119bc884ff7b4b7caf5953a617d04235', 'request_id': 'req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:36.505296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119bc884ff7b4b7caf5953a617d04235', 'request_id': 'req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:36.541352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:36.542107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:36.542479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:36.542818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:36.543532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:36.545394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:36.547975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] The token cache is being invalidate because project 119bc884ff7b4b7caf5953a617d04235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:36.550045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:36.551030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:36.552919 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2833/5654] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:36 2022] DELETE /identity/v3/projects/119bc884ff7b4b7caf5953a617d04235 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:36.553758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:36.557283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:36.576644 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2822/5655] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:36.580449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:36.583861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee33fd-45ac-4d43-937a-e1fbc58dc081 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:36.586718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:36.631196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:36.634966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:36.639647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:36.639647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:36.639908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:36.650627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:36.654464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2341-8084-4eba-b04c-94412d165d29 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:36.674515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:36.675333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:36.681065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:36.681065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] PATH_INFO: `/v3/users/133e102ca70940e4abbdf0384adc2fec` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:36.681831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] RBAC: Authorizing `identity:delete_user(user_id=133e102ca70940e4abbdf0384adc2fec)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:36.684004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:36.871671 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2834/5656] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:36 2022] POST /identity/v3/projects => generated 365 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:36.872789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:36.875830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:36.984894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133e102ca70940e4abbdf0384adc2fec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:37.002322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133e102ca70940e4abbdf0384adc2fec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:37.004387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133e102ca70940e4abbdf0384adc2fec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:37.020660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd7fb3-7bf6-49b2-b8c3-6d6a9a0dbb68 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:37.025871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:37.026784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:37.027406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:37.027785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] PATH_INFO: `/v3/projects/c62f5a29a0e54ba2a7e3c147eb79a33a/users/63c5322096e8477196746c01f5371367/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:37.047428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62f5a29a0e54ba2a7e3c147eb79a33a, user_id=63c5322096e8477196746c01f5371367, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:37.050545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:37.121781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133e102ca70940e4abbdf0384adc2fec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:37.122615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133e102ca70940e4abbdf0384adc2fec'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:37.152881 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2823/5657] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:36 2022] DELETE /identity/v3/users/133e102ca70940e4abbdf0384adc2fec => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:37.153939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:37.157717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:37.182834 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2835/5658] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:36 2022] PUT /identity/v3/projects/c62f5a29a0e54ba2a7e3c147eb79a33a/users/63c5322096e8477196746c01f5371367/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:37.183846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:37.186813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:37.271885 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:37.332597 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:37.363834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52693743-e8e9-4cea-9056-7c65e6ad920b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:37.409164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2ae3-1a96-44b6-9442-23a5462b4a0b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:37.430181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:37.430889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:37.431232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:37.431588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:37.432290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:37.434343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:37.467278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7385014-3101-4967-a82e-002b449edac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:37.468074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7385014-3101-4967-a82e-002b449edac6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:37.469360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7385014-3101-4967-a82e-002b449edac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:37.469663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7385014-3101-4967-a82e-002b449edac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:37.480149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c7385014-3101-4967-a82e-002b449edac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:37.510758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7385014-3101-4967-a82e-002b449edac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:37.515537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7385014-3101-4967-a82e-002b449edac6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:37.549332 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2824/5659] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:37.566501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de90d-0b27-4181-8588-6a472c7785c9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:37.567946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de90d-0b27-4181-8588-6a472c7785c9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:37.569786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de90d-0b27-4181-8588-6a472c7785c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:37.604790 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2836/5660] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:37 2022] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:37.609339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:37.630992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a15c3c-6e7c-433b-b2c1-9c78d3b3c475 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:37.649698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:37.650468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:37.650871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:37.651375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:37.652558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:37.655394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:37.692062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-151de90d-0b27-4181-8588-6a472c7785c9 None None] MFA Rules not processed for user `63c5322096e8477196746c01f5371367`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:37.693313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-151de90d-0b27-4181-8588-6a472c7785c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:37.710007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2837/5661] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:37.713359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:37.732992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358a14-cf71-4c8b-b313-ae5491ceaea7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:37.741657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808226f-1172-4f95-b346-23073909655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:37.743232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808226f-1172-4f95-b346-23073909655d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:37.743753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808226f-1172-4f95-b346-23073909655d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:37.744229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808226f-1172-4f95-b346-23073909655d admin admin] PATH_INFO: `/v3/projects/61440d99ce5d4ed6b0bb8b48c7af8ca3/users/47688139aad544bd8fc954763d8e1632/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:37.833936 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2825/5662] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:37.912725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de90d-0b27-4181-8588-6a472c7785c9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:37.943430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de90d-0b27-4181-8588-6a472c7785c9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:37.967273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:37.967927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:37.968208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:37.968478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:37.986376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:37.987831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:38.019096 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2826/5663] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:38.206931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808226f-1172-4f95-b346-23073909655d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61440d99ce5d4ed6b0bb8b48c7af8ca3, user_id=47688139aad544bd8fc954763d8e1632, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:38.215470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808226f-1172-4f95-b346-23073909655d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:38.323843 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2838/5664] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:37 2022] PUT /identity/v3/projects/61440d99ce5d4ed6b0bb8b48c7af8ca3/users/47688139aad544bd8fc954763d8e1632/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:38.328501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:38.358791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268d78b-f1f0-4557-88fd-332b8a7d8dfb service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:38.521036 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:38.543294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:38.543930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:38.544210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:38.544485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:38.545137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:38.552870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:38.573949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808226f-1172-4f95-b346-23073909655d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:38.578038 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2827/5665] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:38.592945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808226f-1172-4f95-b346-23073909655d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:38.595969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:38.598151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:38.613952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b89834-4810-4b9d-a0ef-697a40facb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:38.614893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b89834-4810-4b9d-a0ef-697a40facb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:38.615240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b89834-4810-4b9d-a0ef-697a40facb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:38.615746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b89834-4810-4b9d-a0ef-697a40facb63 admin admin] PATH_INFO: `/v3/projects/61440d99ce5d4ed6b0bb8b48c7af8ca3/users/47688139aad544bd8fc954763d8e1632/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:38.623610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa503081-f387-4f3f-be65-8bb9cbf7cedd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:38.628229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b89834-4810-4b9d-a0ef-697a40facb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61440d99ce5d4ed6b0bb8b48c7af8ca3, user_id=47688139aad544bd8fc954763d8e1632, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:38.635950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b89834-4810-4b9d-a0ef-697a40facb63 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:38.638830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:38.639558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:38.639837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:38.640116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] PATH_INFO: `/v3/projects/73cc214c862a4439a29fa0a2b955f43e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:38.641923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73cc214c862a4439a29fa0a2b955f43e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:38.647551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:38.683454 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2839/5666] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:38 2022] PUT /identity/v3/projects/61440d99ce5d4ed6b0bb8b48c7af8ca3/users/47688139aad544bd8fc954763d8e1632/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:38.693762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:38.694264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:38.694704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:38.734735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] MFA Rules not processed for user `47688139aad544bd8fc954763d8e1632`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:38.736198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:38.908039 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2840/5667] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:37:38.924145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:38.927669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:38.935157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73cc214c862a4439a29fa0a2b955f43e', 'request_id': 'req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:38.966922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73cc214c862a4439a29fa0a2b955f43e', 'request_id': 'req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:39.008259 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:39.052661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73cc214c862a4439a29fa0a2b955f43e', 'request_id': 'req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:39.074772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] The token cache is being invalidate because project 73cc214c862a4439a29fa0a2b955f43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:39.075252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:39.077884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b3607c6b-f9c0-4d7d-b016-93a70a45bd18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:39.085562 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2828/5668] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:38 2022] DELETE /identity/v3/projects/73cc214c862a4439a29fa0a2b955f43e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:39.087885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1c1d-16a1-43b2-a30d-9de2b50d1d39 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.088082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1c1d-16a1-43b2-a30d-9de2b50d1d39 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.088448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1c1d-16a1-43b2-a30d-9de2b50d1d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.111794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d537d7b-f02d-448b-b999-17efe39ef008 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:39.114584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-48fe1c1d-16a1-43b2-a30d-9de2b50d1d39 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:39.116365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-48fe1c1d-16a1-43b2-a30d-9de2b50d1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:39.232539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:39.233074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.233349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.233622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.236809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:39.260379 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2829/5669] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:39.268393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac094fc-ef02-4aef-86d3-afacd20c66bf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.268679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac094fc-ef02-4aef-86d3-afacd20c66bf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.268955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac094fc-ef02-4aef-86d3-afacd20c66bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.309305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2ac094fc-ef02-4aef-86d3-afacd20c66bf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:39.310629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ac094fc-ef02-4aef-86d3-afacd20c66bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:39.334482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2830/5670] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:39.336735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac094fc-ef02-4aef-86d3-afacd20c66bf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:39.348891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:39.351441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:39.359560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac094fc-ef02-4aef-86d3-afacd20c66bf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:39.375938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:39.376700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.376981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.377253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.378081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:39.378386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:39.382728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:39.394072 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2841/5671] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:39.413093 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2831/5672] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:39.418055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:39.434899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc177d-7e46-4be7-af30-6e4ea878b805 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:39.440615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:39.441664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.442183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.442782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.443622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:39.446627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:39.555644 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2842/5673] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:39 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:39.558770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:39.572016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dcaf2-d57d-4d3e-8aeb-a8eeb4ae2e5f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:39.640082 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:39.653132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:39.655080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.655722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.656293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.657954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:39.669952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:39.682972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:39.685151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:39.793017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2832/5674] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:39 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:39.796636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:39.802595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d834ab4-3b3d-4006-b266-7b11eb475149 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:39.811249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ddde8-c53a-471f-b10a-83dacb496805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:39.813310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ddde8-c53a-471f-b10a-83dacb496805 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.813786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ddde8-c53a-471f-b10a-83dacb496805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.814403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ddde8-c53a-471f-b10a-83dacb496805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.819936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-678ddde8-c53a-471f-b10a-83dacb496805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:39.821301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa0a4-f679-4bbc-b30e-b645befd1d06 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:39.840622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:39.843905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.846449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.847584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.848304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:39.863930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:39.868643 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:39.890948 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2833/5675] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:39.894905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:39.915868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236d6b9-0508-479a-b055-ed08782d1405 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:39.928173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:39.928804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:39.929076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:39.929344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:39.934223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:39.939829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:39.961626 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2834/5676] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:37:39.966763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:39.970145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ddde8-c53a-471f-b10a-83dacb496805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:39.971828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ddde8-c53a-471f-b10a-83dacb496805 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:39.990520 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2843/5677] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:39.993956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0b34-5cb0-4166-8b52-e0ae2d7c635e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:40.011194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:40.012191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:40.012474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:40.012747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] PATH_INFO: `/v3/projects/e73e5d907d864280ace38d9290065c08/users/c634c90960114bacafa1d7eb3c8f16c3/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:40.054509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73e5d907d864280ace38d9290065c08, user_id=c634c90960114bacafa1d7eb3c8f16c3, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:40.057786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:40.122298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985ed7-aa8a-419b-8737-fd85b602cac5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:40.122586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985ed7-aa8a-419b-8737-fd85b602cac5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:40.123017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985ed7-aa8a-419b-8737-fd85b602cac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:40.129654 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2835/5678] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:39 2022] PUT /identity/v3/projects/e73e5d907d864280ace38d9290065c08/users/c634c90960114bacafa1d7eb3c8f16c3/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:40.188543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-70985ed7-aa8a-419b-8737-fd85b602cac5 None None] MFA Rules not processed for user `c634c90960114bacafa1d7eb3c8f16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:40.189748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-70985ed7-aa8a-419b-8737-fd85b602cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:40.359967 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2844/5679] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:37:40.364597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:40.453770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdc19a-90bb-43fa-8b2b-58c5e5998d63 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:40.459262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:40.460521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:40.461024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:40.461505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:40.462451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:40.465788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:40.577539 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2836/5680] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:40 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:40.578207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985ed7-aa8a-419b-8737-fd85b602cac5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:40.605850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985ed7-aa8a-419b-8737-fd85b602cac5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:40.694929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:40.695634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:40.695912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:40.696223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:40.697037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:40.701878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:40.801693 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2845/5681] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:40 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:40.806217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:40.819667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6fd9d-b518-40f7-b307-8a3c7c7bd713 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:40.828141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:40.829360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:40.829677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:40.829965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:40.835605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:40.835605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:40.866078 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2837/5682] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:40.867732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:40.881488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1ead-a4fb-4553-8084-6c61ee540ff3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:40.894588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:40.895592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:40.895998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:40.896286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] PATH_INFO: `/v3/projects/1f365b7bfb304c729db9d5348fed0371/users/8b1be6c8b1764fabab7ff13f6bb6ecf1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:40.935219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f365b7bfb304c729db9d5348fed0371, user_id=8b1be6c8b1764fabab7ff13f6bb6ecf1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:40.938546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:41.053495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2846/5683] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:40 2022] PUT /identity/v3/projects/1f365b7bfb304c729db9d5348fed0371/users/8b1be6c8b1764fabab7ff13f6bb6ecf1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:41.059638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:41.075510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fad72-2946-40f1-b1f7-8c70c597a923 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:41.185259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc7ef-1ca3-4f6a-9746-e959cdcae30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:41.185897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc7ef-1ca3-4f6a-9746-e959cdcae30e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:41.186254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc7ef-1ca3-4f6a-9746-e959cdcae30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:41.186556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc7ef-1ca3-4f6a-9746-e959cdcae30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:41.187371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc7ef-1ca3-4f6a-9746-e959cdcae30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:41.188987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc7ef-1ca3-4f6a-9746-e959cdcae30e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:41.202057 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2838/5684] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:41.206175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:41.219713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91aa7-9db5-4885-8f30-c69a258205a5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:41.227162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:41.228576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:41.229233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:41.229729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] PATH_INFO: `/v3/projects/1f365b7bfb304c729db9d5348fed0371/users/8b1be6c8b1764fabab7ff13f6bb6ecf1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:41.232116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f365b7bfb304c729db9d5348fed0371, user_id=8b1be6c8b1764fabab7ff13f6bb6ecf1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:41.235550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:41.242934 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:41.249893 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2847/5685] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:41 2022] PUT /identity/v3/projects/1f365b7bfb304c729db9d5348fed0371/users/8b1be6c8b1764fabab7ff13f6bb6ecf1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:41.261178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f77c93-811f-4ba2-bf94-46003636fd35 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:41.261458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f77c93-811f-4ba2-bf94-46003636fd35 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:41.261728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f77c93-811f-4ba2-bf94-46003636fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:41.279028 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:41.299120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d5f77c93-811f-4ba2-bf94-46003636fd35 None None] MFA Rules not processed for user `8b1be6c8b1764fabab7ff13f6bb6ecf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:41.300480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d5f77c93-811f-4ba2-bf94-46003636fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:41.415802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2839/5686] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:41.418232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:41.432297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73af9-7c85-4398-bec3-bc2ec12db994 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:41.439640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:41.440459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:41.440922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:41.441385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:41.442315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:41.444062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:41.541220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2848/5687] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:37:41 2022] POST /identity/v3/domains => generated 274 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:41.543803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f77c93-811f-4ba2-bf94-46003636fd35 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:41.556539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f77c93-811f-4ba2-bf94-46003636fd35 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:41.682671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:41.684145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:41.684649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:41.685568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:41.686484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:41.688977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:41.840505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2840/5688] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:41 2022] POST /identity/v3/projects => generated 403 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:37:41.844892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:41.863276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee346bb-5dc7-481b-9f4c-98ae18946d4e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:42.022953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:42.024034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:42.025313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:42.025817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:42.027163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:42.030297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:42.118445 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2849/5689] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:37:41 2022] POST /identity/v3/groups => generated 301 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:37:42.123150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:42.137355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8bd42-5ff1-47b7-86d3-53aef381ddb5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:42.152119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:42.154410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:42.156310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:42.157649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:42.158527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:42.166773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:42.347685 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2841/5690] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:42 2022] POST /identity/v3/users => generated 445 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:42.348648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:42.361222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81daf63-1100-48da-8ee4-5e502b4377b6 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:42.390247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:42.390879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:42.391158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:42.391441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:42.392121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:42.399737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:42.533751 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2850/5691] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:37:42 2022] POST /identity/v3/roles => generated 240 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:37:42.538171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:42.552264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57ddfd-1ada-49fb-96b9-2b8a3480ce93 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:42.576199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:42.576942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:42.577218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:42.577503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/cc05bde3e200426f8c53d16a108fdd5c/inherited_to_projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:42.606598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, group_id=2df27a1bd18a4bde9ccfe627c356b3cd, role_id=cc05bde3e200426f8c53d16a108fdd5c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:42.614886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:42.733116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2842/5692] 10.222.0.42 () {60 vars in 1585 bytes} [Sun Oct 23 01:37:42 2022] PUT /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/cc05bde3e200426f8c53d16a108fdd5c/inherited_to_projects => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:42.737117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:42.750680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749deab9-1c12-42ad-bdb0-007f541420f1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:42.900854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:42.901567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:42.901855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:42.902168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/cc05bde3e200426f8c53d16a108fdd5c/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:42.908246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, group_id=2df27a1bd18a4bde9ccfe627c356b3cd, role_id=cc05bde3e200426f8c53d16a108fdd5c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:42.909313 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:37:42.909313 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:37:42.909313 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:37:42.917731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:42.949468 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2851/5693] 10.222.0.42 () {58 vars in 1567 bytes} [Sun Oct 23 01:37:42 2022] HEAD /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/cc05bde3e200426f8c53d16a108fdd5c/inherited_to_projects => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:42.953694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:42.976663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c5cd-4826-4615-bae7-685f38fd3bc3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:43.001928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:43.002713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:43.002995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:43.003271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/cc05bde3e200426f8c53d16a108fdd5c/inherited_to_projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:43.011636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, group_id=2df27a1bd18a4bde9ccfe627c356b3cd, role_id=cc05bde3e200426f8c53d16a108fdd5c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:43.022979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:43.035910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role cc05bde3e200426f8c53d16a108fdd5c was removed from group 2df27a1bd18a4bde9ccfe627c356b3cd on project f210c158dda44c18b901e5b5d8d5015a. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:43.036566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:43.037486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:43.126493 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2843/5694] 10.222.0.42 () {58 vars in 1569 bytes} [Sun Oct 23 01:37:42 2022] DELETE /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/cc05bde3e200426f8c53d16a108fdd5c/inherited_to_projects => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:43.129845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:43.131773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:43.168180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491fef5-a3ed-4d9a-b583-9d97f20311c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:43.315966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:43.317207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:43.317643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:43.318310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles/cc05bde3e200426f8c53d16a108fdd5c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:43.320924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cc05bde3e200426f8c53d16a108fdd5c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:43.322799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:43.341050 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:43.491681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role cc05bde3e200426f8c53d16a108fdd5c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:43.493211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:43.506889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:43.518980 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2852/5695] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:43 2022] DELETE /identity/v3/roles/cc05bde3e200426f8c53d16a108fdd5c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:43.524585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:43.548517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb6e76-1290-43b5-ad01-d49f1767039e tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:43.598922 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:43.759798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:43.762231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:43.762773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:43.763281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:43.766356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:43.771383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:43.889372 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2844/5696] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:37:43 2022] POST /identity/v3/roles => generated 240 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:43.893296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:43.895360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:43.926211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee793a38-6a51-4e44-acb4-3a81d9b09a65 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:43.953769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:43.955007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:43.955169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:43.955457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/203c7c28120d4599a3abc00561b7a872/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:44.000304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=203c7c28120d4599a3abc00561b7a872)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:44.002945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:44.092677 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2853/5697] 10.222.0.42 () {60 vars in 1582 bytes} [Sun Oct 23 01:37:43 2022] PUT /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/203c7c28120d4599a3abc00561b7a872/inherited_to_projects => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:44.092856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:44.125434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e92183-f24c-4de7-a5a9-d8c5ae7fab77 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:44.278126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:44.279025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:44.279284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:44.279556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/203c7c28120d4599a3abc00561b7a872/inherited_to_projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:44.283062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=203c7c28120d4599a3abc00561b7a872)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:44.299941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:44.307632 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2845/5698] 10.222.0.42 () {58 vars in 1564 bytes} [Sun Oct 23 01:37:44 2022] HEAD /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/203c7c28120d4599a3abc00561b7a872/inherited_to_projects => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:44.312207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:44.330552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298111-68ba-48fb-8080-7f56593f9a64 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:44.347215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:44.348307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:44.348755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:44.349362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/203c7c28120d4599a3abc00561b7a872/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:44.354852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=203c7c28120d4599a3abc00561b7a872)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:44.358485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:44.373031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role 203c7c28120d4599a3abc00561b7a872 was removed from user 9bdb83b4d2394522942c6edaa0d9a64e on project f210c158dda44c18b901e5b5d8d5015a. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:44.375309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:44.380230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:44.426635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:44.428424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:44.459241 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2854/5699] 10.222.0.42 () {58 vars in 1566 bytes} [Sun Oct 23 01:37:44 2022] DELETE /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/203c7c28120d4599a3abc00561b7a872/inherited_to_projects => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:44.464423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:44.465904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:44.592962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa455182-e54a-465a-b00a-207b35d0f804 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:44.653477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159ddc2-1713-4958-bee2-05950481229d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:44.670629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:44.671285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:44.671565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:44.671836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles/203c7c28120d4599a3abc00561b7a872` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:44.673573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_role(role_id=203c7c28120d4599a3abc00561b7a872)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:44.675293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:44.746963 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:44.750727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:44.751371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:44.751646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:44.751912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] PATH_INFO: `/v3/users/c1bd8ccea80d422e8d65f3097d978aa1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:44.753716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bd8ccea80d422e8d65f3097d978aa1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:44.755681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:44.859617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role 203c7c28120d4599a3abc00561b7a872 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:44.861929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:44.861929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:44.862549 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2855/5700] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:44 2022] DELETE /identity/v3/roles/203c7c28120d4599a3abc00561b7a872 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:44.875104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:44.876591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:44.983350 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:45.007514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66f77-88c9-42b6-a4e6-84520f988fa5 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:45.018031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:45.018675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:45.018955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:45.027492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:45.028627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:45.032099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:45.052056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bd8ccea80d422e8d65f3097d978aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:45.069262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bd8ccea80d422e8d65f3097d978aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:45.070327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bd8ccea80d422e8d65f3097d978aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:45.151467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bd8ccea80d422e8d65f3097d978aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:45.153747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4c7f77d7-b0ff-4bab-aa7f-ad5924b83da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bd8ccea80d422e8d65f3097d978aa1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:45.164800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2856/5701] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:37:44 2022] POST /identity/v3/roles => generated 240 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:45.167891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:45.182810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:45.209968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfccaf-6c9b-45dd-99a4-93ca530c1244 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:45.214290 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2846/5702] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:44 2022] DELETE /identity/v3/users/c1bd8ccea80d422e8d65f3097d978aa1 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:45.218670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10595e4a-0f32-49dc-921f-5d1c64039a1d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:45.219207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10595e4a-0f32-49dc-921f-5d1c64039a1d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:45.219880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10595e4a-0f32-49dc-921f-5d1c64039a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:45.279072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-10595e4a-0f32-49dc-921f-5d1c64039a1d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:45.282032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-10595e4a-0f32-49dc-921f-5d1c64039a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:45.363389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:45.364413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:45.364912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:45.365485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/c59a464ada924efd8e7a2419d0068ab3/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:45.375597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, group_id=2df27a1bd18a4bde9ccfe627c356b3cd, role_id=c59a464ada924efd8e7a2419d0068ab3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:45.378608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:45.403470 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2847/5703] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:45.463898 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2857/5704] 10.222.0.42 () {60 vars in 1582 bytes} [Sun Oct 23 01:37:45 2022] PUT /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/c59a464ada924efd8e7a2419d0068ab3/inherited_to_projects => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:45.468256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10595e4a-0f32-49dc-921f-5d1c64039a1d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:45.488413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10595e4a-0f32-49dc-921f-5d1c64039a1d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:45.507914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:45.510167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:45.635339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ae3a-4b69-4aaf-85e2-288a3de92870 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:45.648929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:45.649835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:45.650325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:45.650777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:45.677215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:45.678170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:45.678463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:45.679592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/inherited_to_projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:45.685368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, group_id=2df27a1bd18a4bde9ccfe627c356b3cd)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:45.690789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:45.730846 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2848/5705] 10.222.0.42 () {58 vars in 1464 bytes} [Sun Oct 23 01:37:45 2022] GET /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/inherited_to_projects => generated 448 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:45.738044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:45.760402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:45.760664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61583a75-cafa-49e9-88f8-30084e8a091b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:45.762253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:45.774073 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2858/5706] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:45.774936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:45.775672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:45.775965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:45.776330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/c59a464ada924efd8e7a2419d0068ab3/inherited_to_projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:45.789534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, group_id=2df27a1bd18a4bde9ccfe627c356b3cd, role_id=c59a464ada924efd8e7a2419d0068ab3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:45.792431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:45.799291 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:45.812526 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2849/5707] 10.222.0.42 () {58 vars in 1564 bytes} [Sun Oct 23 01:37:45 2022] HEAD /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/c59a464ada924efd8e7a2419d0068ab3/inherited_to_projects => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:45.818156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:45.835330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e041-cee4-46d5-9840-655ab5171ad1 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:45.846278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:45.847493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:45.847841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:45.848420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/c59a464ada924efd8e7a2419d0068ab3/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:45.853603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, group_id=2df27a1bd18a4bde9ccfe627c356b3cd, role_id=c59a464ada924efd8e7a2419d0068ab3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:45.856928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:45.897933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role c59a464ada924efd8e7a2419d0068ab3 was removed from group 2df27a1bd18a4bde9ccfe627c356b3cd on domain e75c7b3b50354293adb30a6ecc0c8ffd. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:45.899600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:45.901001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:46.002544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2859/5708] 10.222.0.42 () {58 vars in 1566 bytes} [Sun Oct 23 01:37:45 2022] DELETE /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/groups/2df27a1bd18a4bde9ccfe627c356b3cd/roles/c59a464ada924efd8e7a2419d0068ab3/inherited_to_projects => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:46.006308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:46.008174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:46.036762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e38dd-0224-4ed2-a2d6-04c4c5743a43 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:46.151884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:46.152734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:46.153032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:46.153291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles/c59a464ada924efd8e7a2419d0068ab3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:46.154776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c59a464ada924efd8e7a2419d0068ab3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:46.156824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:46.281097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role c59a464ada924efd8e7a2419d0068ab3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:46.281398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:46.282338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:46.288243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2850/5709] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:46 2022] DELETE /identity/v3/roles/c59a464ada924efd8e7a2419d0068ab3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:46.295304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:46.310445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634335ec-fdea-4068-9816-3e1cf2e3e328 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:46.332092 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:46.444918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:46.446122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:46.446409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:46.447300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:46.447980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:46.449618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:46.560095 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2860/5710] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:37:46 2022] POST /identity/v3/roles => generated 239 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:46.561173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:46.563877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:46.603582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93786e-9daf-4f89-abce-ea0190bd2be0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:46.612814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee05cf-753a-45aa-b646-d99fd6bc60c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:46.623079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee05cf-753a-45aa-b646-d99fd6bc60c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:46.624040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee05cf-753a-45aa-b646-d99fd6bc60c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:46.630647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee05cf-753a-45aa-b646-d99fd6bc60c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/dbc268dd0bb04e3992a5b5c8aa92db1c/inherited_to_projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:46.641121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee05cf-753a-45aa-b646-d99fd6bc60c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=dbc268dd0bb04e3992a5b5c8aa92db1c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:46.645411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee05cf-753a-45aa-b646-d99fd6bc60c8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:46.757606 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2851/5711] 10.222.0.42 () {60 vars in 1579 bytes} [Sun Oct 23 01:37:46 2022] PUT /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/dbc268dd0bb04e3992a5b5c8aa92db1c/inherited_to_projects => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:46.761482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:46.774918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301a52-976b-4ce4-b6d8-8112662f83af tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:46.829873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:46.830018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:46.830479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:46.892680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] MFA Rules not processed for user `2ceec980f06b45a989a5cd6cbca9d5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:46.894056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:46.916296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:46.917186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:46.917720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:46.918199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:46.930865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, user_id=9bdb83b4d2394522942c6edaa0d9a64e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:46.933594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:46.975808 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2861/5712] 10.222.0.42 () {58 vars in 1461 bytes} [Sun Oct 23 01:37:46 2022] GET /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/inherited_to_projects => generated 446 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:46.977403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.004580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574286a-b7d2-46af-9150-0563f8db1469 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.022731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.023755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.024190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.024619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/dbc268dd0bb04e3992a5b5c8aa92db1c/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.030845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=dbc268dd0bb04e3992a5b5c8aa92db1c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.033914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.048508 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2862/5713] 10.222.0.42 () {58 vars in 1561 bytes} [Sun Oct 23 01:37:46 2022] HEAD /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/dbc268dd0bb04e3992a5b5c8aa92db1c/inherited_to_projects => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:47.052626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.077303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2852/5714] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:47.078319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.081670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:47.089467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faac31-fdc8-435d-bf77-d6eeaa91f84d tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.100077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.101070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.102087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.102579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/dbc268dd0bb04e3992a5b5c8aa92db1c/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.110761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=dbc268dd0bb04e3992a5b5c8aa92db1c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.114201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.130139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role dbc268dd0bb04e3992a5b5c8aa92db1c was removed from user 9bdb83b4d2394522942c6edaa0d9a64e on domain e75c7b3b50354293adb30a6ecc0c8ffd. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:47.131319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:47.132815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:47.214728 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:47.230744 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2863/5715] 10.222.0.42 () {58 vars in 1563 bytes} [Sun Oct 23 01:37:47 2022] DELETE /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/dbc268dd0bb04e3992a5b5c8aa92db1c/inherited_to_projects => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:47.235120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.238128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:47.250955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ab5c-2243-45cf-9706-19e7894ebee8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.352292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ee1eb-9b3a-43d2-8603-03db4a791311 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.375227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.375875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.376152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.379350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.381408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.386227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.386967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.388434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.388920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.389406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles/dbc268dd0bb04e3992a5b5c8aa92db1c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.391550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dbc268dd0bb04e3992a5b5c8aa92db1c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.393578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.546514 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2853/5716] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:47 2022] POST /identity/v3/projects => generated 377 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:47.551582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.556626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role dbc268dd0bb04e3992a5b5c8aa92db1c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:47.557274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:47.560185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:47.562354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:47.565826 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2864/5717] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:47 2022] DELETE /identity/v3/roles/dbc268dd0bb04e3992a5b5c8aa92db1c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:47.575801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.577560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:47.686587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81981-f0b7-4a6b-bb5c-af5b40d6d000 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.740311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffaba8-349c-48d4-b45e-2f1a1ae623b7 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.749052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.749748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.750057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.750332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.751068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.754110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.766568 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:47.774784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.775417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.775692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.775958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.776834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.779295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.823398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2865/5718] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:37:47 2022] POST /identity/v3/roles => generated 240 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:47.823647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.825123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:47.844222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4bd92-1734-4504-86de-e9decc69c73c tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.850395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.851532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.852205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.852641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] PATH_INFO: `/v3/projects/f7652377101e4875b60523c182e6198f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.857965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7652377101e4875b60523c182e6198f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.860072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.878756 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2854/5719] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:47 2022] POST /identity/v3/users => generated 295 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:47.883986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:47.908710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed861660-1a18-49d4-9d47-1e59e2665739 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:47.914475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:47.915624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:47.915809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:47.916184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:47.916767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:47.918826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:47.982340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7652377101e4875b60523c182e6198f', 'request_id': 'req-0147d79e-ed37-4072-b96f-800c540797a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:47.988917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7652377101e4875b60523c182e6198f', 'request_id': 'req-0147d79e-ed37-4072-b96f-800c540797a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.049752 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2855/5720] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:47 2022] POST /identity/v3/projects => generated 409 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:48.051357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:48.053912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:48.094244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7652377101e4875b60523c182e6198f', 'request_id': 'req-0147d79e-ed37-4072-b96f-800c540797a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.114530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] The token cache is being invalidate because project f7652377101e4875b60523c182e6198f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:48.114882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.116310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.119098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2866/5721] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:47 2022] DELETE /identity/v3/projects/f7652377101e4875b60523c182e6198f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:48.120911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:48.123330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:48.193714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040294-6e22-4ac2-88c8-5503afea96b0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:48.205541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:48.205541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:48.205541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:48.205541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:48.205892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:48.207591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:48.227606 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2856/5722] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:48 2022] GET /identity/v3/roles => generated 1651 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:48.228472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:48.238179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:48.246091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147d79e-ed37-4072-b96f-800c540797a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:48.263161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcb794-5a74-4350-8358-cfc870de0e03 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:48.284750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:48.286120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:48.286430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:48.286705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] PATH_INFO: `/v3/users/47688139aad544bd8fc954763d8e1632` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:48.288475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=47688139aad544bd8fc954763d8e1632)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:48.291399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:48.348447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:48.349319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:48.350174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:48.350472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/00482167c07d4ec2939332317c9f8283/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:48.353726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=00482167c07d4ec2939332317c9f8283)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:48.357413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:48.465689 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2867/5723] 10.222.0.42 () {60 vars in 1579 bytes} [Sun Oct 23 01:37:48 2022] PUT /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/00482167c07d4ec2939332317c9f8283/inherited_to_projects => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:48.471391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:48.475263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:48.575500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b8b8a-154a-4549-ad45-a8cc2ddc25f2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:48.583428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:48.584255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:48.584636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:48.585154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] PATH_INFO: `/v3/projects/d631681159a54c1e8b5cae82d8068600/users/767b7a49f41948f5833a91fe521c92f9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:48.608976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d631681159a54c1e8b5cae82d8068600, user_id=767b7a49f41948f5833a91fe521c92f9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:48.613272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:48.617294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47688139aad544bd8fc954763d8e1632'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.640683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47688139aad544bd8fc954763d8e1632'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.645641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47688139aad544bd8fc954763d8e1632'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.726404 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2868/5724] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:48 2022] PUT /identity/v3/projects/d631681159a54c1e8b5cae82d8068600/users/767b7a49f41948f5833a91fe521c92f9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:48.726404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:48.733731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47688139aad544bd8fc954763d8e1632'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.734688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47688139aad544bd8fc954763d8e1632'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:48.775209 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2857/5725] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:48 2022] DELETE /identity/v3/users/47688139aad544bd8fc954763d8e1632 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:48.778126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:48.783259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:48.875016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83fc3-17fb-45ba-8898-924c7e39a2a7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:48.887953 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:48.956038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f38c4-2cb4-45c5-a538-33cb0adc92ba admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:48.978770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:48.979899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:48.981232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:48.982575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:48.988634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:48.988634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:49.025136 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2858/5726] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:48 2022] GET /identity/v3/roles => generated 1651 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:49.028021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:49.040097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:49.041536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:49.042018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:49.043509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:49.044580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Adding query filter params (scope.project.id=f210c158dda44c18b901e5b5d8d5015a, user.id=9bdb83b4d2394522942c6edaa0d9a64e) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:49.046801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:49.051423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:49.058146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9031ad-16f7-433b-8781-c4bd89702c84 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:49.076896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:49.077849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:49.080984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:49.080984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] PATH_INFO: `/v3/projects/d631681159a54c1e8b5cae82d8068600/users/767b7a49f41948f5833a91fe521c92f9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:49.082377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d631681159a54c1e8b5cae82d8068600, user_id=767b7a49f41948f5833a91fe521c92f9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:49.087323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:49.100112 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2859/5727] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:49 2022] PUT /identity/v3/projects/d631681159a54c1e8b5cae82d8068600/users/767b7a49f41948f5833a91fe521c92f9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:49.138663 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:49.207395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:49.209846 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2869/5728] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:37:48 2022] GET /identity/v3/role_assignments?scope.project.id=f210c158dda44c18b901e5b5d8d5015a&user.id=9bdb83b4d2394522942c6edaa0d9a64e&effective => generated 648 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:49.210104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:49.353733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733e8c-0729-425f-bab7-cc0d8058c330 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:49.360305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:49.361440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:49.362174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:49.362655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:49.363755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Adding query filter params (scope.project.id=578e67d3daae42fd8745d4747f6fd2a4, user.id=9bdb83b4d2394522942c6edaa0d9a64e) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:49.364271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:49.369321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:49.466186 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2860/5729] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:37:49 2022] GET /identity/v3/role_assignments?scope.project.id=578e67d3daae42fd8745d4747f6fd2a4&user.id=9bdb83b4d2394522942c6edaa0d9a64e&effective => generated 648 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:37:49.470716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:49.488848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7583-28dc-4aac-9bd0-39c0dda45d8b tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:49.495063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:49.495761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:49.496052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:49.496356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/00482167c07d4ec2939332317c9f8283/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:49.498712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=00482167c07d4ec2939332317c9f8283)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:49.501538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:49.503892 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:49.511071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role 00482167c07d4ec2939332317c9f8283 was removed from user 9bdb83b4d2394522942c6edaa0d9a64e on domain e75c7b3b50354293adb30a6ecc0c8ffd. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:49.511071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:49.511650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:49.600008 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2870/5730] 10.222.0.42 () {58 vars in 1563 bytes} [Sun Oct 23 01:37:49 2022] DELETE /identity/v3/OS-INHERIT/domains/e75c7b3b50354293adb30a6ecc0c8ffd/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/00482167c07d4ec2939332317c9f8283/inherited_to_projects => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:49.604794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:49.606759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:49.627786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf99f5-047f-4b47-aa7e-8b0e25d17d62 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:49.814612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:49.815492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:49.816654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:49.817158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:49.818245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Adding query filter params (scope.project.id=f210c158dda44c18b901e5b5d8d5015a, user.id=9bdb83b4d2394522942c6edaa0d9a64e) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:49.818764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:49.821447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:49.924699 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2861/5731] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:37:49 2022] GET /identity/v3/role_assignments?scope.project.id=f210c158dda44c18b901e5b5d8d5015a&user.id=9bdb83b4d2394522942c6edaa0d9a64e&effective => generated 228 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:49.928602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:49.946052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a542e-4510-4e02-a63b-e9c2abafae9f tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:49.963403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:49.964204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:49.964648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:49.965095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:49.966041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Adding query filter params (scope.project.id=578e67d3daae42fd8745d4747f6fd2a4, user.id=9bdb83b4d2394522942c6edaa0d9a64e) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:49.966501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:49.969464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:50.101778 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2871/5732] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:37:49 2022] GET /identity/v3/role_assignments?scope.project.id=578e67d3daae42fd8745d4747f6fd2a4&user.id=9bdb83b4d2394522942c6edaa0d9a64e&effective => generated 228 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:50.106103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:50.120487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd5e6-cc3d-41be-b456-c85359d269f3 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:50.125725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:50.126441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:50.126897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:50.127174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/projects/578e67d3daae42fd8745d4747f6fd2a4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:50.129143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_project(project_id=578e67d3daae42fd8745d4747f6fd2a4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:50.131490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:50.231714 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:50.249330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:50.252955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:50.282423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578e67d3daae42fd8745d4747f6fd2a4', 'request_id': 'req-ee3ba34f-4a54-4847-a2af-7c917143be53'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.292293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578e67d3daae42fd8745d4747f6fd2a4', 'request_id': 'req-ee3ba34f-4a54-4847-a2af-7c917143be53'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.377613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578e67d3daae42fd8745d4747f6fd2a4', 'request_id': 'req-ee3ba34f-4a54-4847-a2af-7c917143be53'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.404388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] The token cache is being invalidate because project 578e67d3daae42fd8745d4747f6fd2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:50.408393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.410574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.413295 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2862/5733] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:50 2022] DELETE /identity/v3/projects/578e67d3daae42fd8745d4747f6fd2a4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:50.417509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:50.419484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:50.434679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9212b-8ace-41c5-ab1b-5a6764c68257 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:50.592088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba34f-4a54-4847-a2af-7c917143be53 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:50.598239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:50.600846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:50.602136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:50.602724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:50.602843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:50.603039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:50.603204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles/00482167c07d4ec2939332317c9f8283` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:50.609048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] PATH_INFO: `/v3/projects/61440d99ce5d4ed6b0bb8b48c7af8ca3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:50.609048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] RBAC: Authorizing `identity:delete_project(project_id=61440d99ce5d4ed6b0bb8b48c7af8ca3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:50.609640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_role(role_id=00482167c07d4ec2939332317c9f8283)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:50.609731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:50.609906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:50.681817 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:50.721172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role 00482167c07d4ec2939332317c9f8283 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:50.721638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.723197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.727017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2863/5734] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:50 2022] DELETE /identity/v3/roles/00482167c07d4ec2939332317c9f8283 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:50.732586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:50.734727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:50.842591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61440d99ce5d4ed6b0bb8b48c7af8ca3', 'request_id': 'req-7355d4a1-21cb-4318-87e3-3f746247878c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.858346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61440d99ce5d4ed6b0bb8b48c7af8ca3', 'request_id': 'req-7355d4a1-21cb-4318-87e3-3f746247878c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.954942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61440d99ce5d4ed6b0bb8b48c7af8ca3', 'request_id': 'req-7355d4a1-21cb-4318-87e3-3f746247878c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.965390 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:50.977493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] The token cache is being invalidate because project 61440d99ce5d4ed6b0bb8b48c7af8ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:50.980747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.983644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76aa55-b464-4f93-9c31-555d217a5da0 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:50.985557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:50.990958 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2872/5735] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:50 2022] DELETE /identity/v3/projects/61440d99ce5d4ed6b0bb8b48c7af8ca3 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:50.992640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:50.996570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:51.116688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0d951-16a3-4ea5-ad3e-820bb1b62281 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:51.118525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0d951-16a3-4ea5-ad3e-820bb1b62281 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.119162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0d951-16a3-4ea5-ad3e-820bb1b62281 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.119541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0d951-16a3-4ea5-ad3e-820bb1b62281 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.120326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0d951-16a3-4ea5-ad3e-820bb1b62281 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:51.122221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0d951-16a3-4ea5-ad3e-820bb1b62281 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:51.170452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d4a1-21cb-4318-87e3-3f746247878c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:51.179219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:51.180610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.181145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.181673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.198921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:51.222096 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2864/5736] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:37:50 2022] POST /identity/v3/roles => generated 239 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:51.223622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.224742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.226731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.250427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:51.253876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:51.298677 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2873/5737] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:51.298677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:51.298900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:51.300593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:51.303055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:51.333572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d34676-0c3f-44ac-bf02-a4c25d8c66b0 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:51.358041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95442dd3-d2f3-4cde-be98-429cac15b2e8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:51.358041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95442dd3-d2f3-4cde-be98-429cac15b2e8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.358041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95442dd3-d2f3-4cde-be98-429cac15b2e8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.358765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95442dd3-d2f3-4cde-be98-429cac15b2e8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.358765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95442dd3-d2f3-4cde-be98-429cac15b2e8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:51.358765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95442dd3-d2f3-4cde-be98-429cac15b2e8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:51.437309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2865/5738] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:51.438228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:51.439605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:51.465615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbd80d-7c99-4a78-b956-201713074855 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:51.473480 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2874/5739] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:51 2022] POST /identity/v3/projects => generated 409 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:51.473480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0692d-fc7b-47fb-943b-1a04793278f8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.473480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0692d-fc7b-47fb-943b-1a04793278f8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.473480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0692d-fc7b-47fb-943b-1a04793278f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.512937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ebb0692d-fc7b-47fb-943b-1a04793278f8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:51.513753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ebb0692d-fc7b-47fb-943b-1a04793278f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:51.539733 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:51.591381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:51.591928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.592256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.592712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] PATH_INFO: `/v3/users/0c65e7ab0b544d9ebdac8bc2129d051a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.595386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c65e7ab0b544d9ebdac8bc2129d051a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:51.602540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:51.629478 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2875/5740] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:51.630464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0692d-fc7b-47fb-943b-1a04793278f8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:51.704363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0692d-fc7b-47fb-943b-1a04793278f8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:51.709318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:51.710151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.710540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.710897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/192b7b32dd8b40079387697ecba49677/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.713328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=192b7b32dd8b40079387697ecba49677)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:51.716157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:51.815884 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2876/5741] 10.222.0.42 () {60 vars in 1582 bytes} [Sun Oct 23 01:37:51 2022] PUT /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/192b7b32dd8b40079387697ecba49677/inherited_to_projects => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:51.815884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:51.831591 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:51.857571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c65e7ab0b544d9ebdac8bc2129d051a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:51.868938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c65e7ab0b544d9ebdac8bc2129d051a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:51.869775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c65e7ab0b544d9ebdac8bc2129d051a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:51.891433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128961f-98e3-4587-8a85-df19085ae7d1 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:51.898301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:51.899044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:51.899423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:51.899805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:51.900626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:51.901046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:51.903278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:51.920842 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2877/5742] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:51.920842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:51.943278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c65e7ab0b544d9ebdac8bc2129d051a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:51.947298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c65e7ab0b544d9ebdac8bc2129d051a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:51.985786 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2866/5743] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:51 2022] DELETE /identity/v3/users/0c65e7ab0b544d9ebdac8bc2129d051a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:51.986833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:52.005918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:52.025003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59ea26-e26c-4f26-ac14-18884b04aeb0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:52.132840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:52.134139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:52.134499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:52.134693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:52.135717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Adding query filter params (scope.project.id=b0d67b7309d04c8889bed9c6bb6c614d, user.id=9bdb83b4d2394522942c6edaa0d9a64e) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:52.136033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:52.137803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449d5bf-7e42-4305-a646-6ec17611a7ff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:52.138128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:52.144693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:52.145486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:52.145871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:52.146432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:52.147383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:52.150239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:52.230739 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2878/5744] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:37:51 2022] GET /identity/v3/role_assignments?scope.project.id=b0d67b7309d04c8889bed9c6bb6c614d&user.id=9bdb83b4d2394522942c6edaa0d9a64e&effective => generated 649 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:52.233792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:52.238811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:52.272286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c745b7d-7141-423b-9259-c23a70cb9f66 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:52.279223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:52.279926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:52.280200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:52.280549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/192b7b32dd8b40079387697ecba49677/inherited_to_projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:52.283659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f210c158dda44c18b901e5b5d8d5015a, user_id=9bdb83b4d2394522942c6edaa0d9a64e, role_id=192b7b32dd8b40079387697ecba49677)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:52.286840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:52.298534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role 192b7b32dd8b40079387697ecba49677 was removed from user 9bdb83b4d2394522942c6edaa0d9a64e on project f210c158dda44c18b901e5b5d8d5015a. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:52.298907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:52.305510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:52.311488 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2867/5745] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:51 2022] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:52.312480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:52.314797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:52.437309 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2879/5746] 10.222.0.42 () {58 vars in 1566 bytes} [Sun Oct 23 01:37:52 2022] DELETE /identity/v3/OS-INHERIT/projects/f210c158dda44c18b901e5b5d8d5015a/users/9bdb83b4d2394522942c6edaa0d9a64e/roles/192b7b32dd8b40079387697ecba49677/inherited_to_projects => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:52.446313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:52.449291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:52.453056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7f9a-5736-4361-a997-0b51fb130aaa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:52.604179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:52.607138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:52.609204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:52.609715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:52.611989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:52.617639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931507-c12a-448a-876f-136ed600f784 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:52.617886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:52.638828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:52.639722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:52.640177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:52.640631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] PATH_INFO: `/v3/projects/6edb27d1224244809ecbb55ac953c645` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:52.642108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edb27d1224244809ecbb55ac953c645)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:52.644650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:52.752011 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2868/5747] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:52 2022] POST /identity/v3/users => generated 287 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:52.753352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:52.763288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:52.820175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edb27d1224244809ecbb55ac953c645', 'request_id': 'req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:52.831072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edb27d1224244809ecbb55ac953c645', 'request_id': 'req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:52.901721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ca2e-fd80-41a8-b246-2bea06781153 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:52.923899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edb27d1224244809ecbb55ac953c645', 'request_id': 'req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:52.956402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] The token cache is being invalidate because project 6edb27d1224244809ecbb55ac953c645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:52.957051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:52.960514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:52.968740 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2880/5748] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:52 2022] DELETE /identity/v3/projects/6edb27d1224244809ecbb55ac953c645 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:52.968740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:52.973098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.023757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db055d3d-95ad-4773-b235-0aef1778b193 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.024753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055d3d-95ad-4773-b235-0aef1778b193 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.025204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055d3d-95ad-4773-b235-0aef1778b193 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.025780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055d3d-95ad-4773-b235-0aef1778b193 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.026774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db055d3d-95ad-4773-b235-0aef1778b193 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Adding query filter params (scope.project.id=b0d67b7309d04c8889bed9c6bb6c614d, user.id=9bdb83b4d2394522942c6edaa0d9a64e) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:53.027748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db055d3d-95ad-4773-b235-0aef1778b193 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.030323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db055d3d-95ad-4773-b235-0aef1778b193 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.115677 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:53.119687 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2869/5749] 10.222.0.42 () {58 vars in 1356 bytes} [Sun Oct 23 01:37:52 2022] GET /identity/v3/role_assignments?scope.project.id=b0d67b7309d04c8889bed9c6bb6c614d&user.id=9bdb83b4d2394522942c6edaa0d9a64e&effective => generated 228 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:53.120775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.121056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.121521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.143457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9a55-3bff-4b03-8e8f-35223fcd8e7d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:53.150383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.151527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.151527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.151856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.153827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.156263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.158879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:53.160020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.170604 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2870/5750] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:53.171503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:53.173029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.180533 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2881/5751] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:52 2022] GET /identity/v3/roles => generated 1650 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:53.180533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:53.191150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ed4e1-5423-4806-923c-61b6ebb3b441 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:53.195940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92891bf4-fde7-447e-993c-83ef69c13ff3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:53.196744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b3478-83f5-4d9f-a9dc-6888207914cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.197573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3478-83f5-4d9f-a9dc-6888207914cf admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.197967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3478-83f5-4d9f-a9dc-6888207914cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.198475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3478-83f5-4d9f-a9dc-6888207914cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.199374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b3478-83f5-4d9f-a9dc-6888207914cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.201097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b3478-83f5-4d9f-a9dc-6888207914cf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.201483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.202260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.202633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.203003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/projects/b0d67b7309d04c8889bed9c6bb6c614d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.204243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b0d67b7309d04c8889bed9c6bb6c614d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.206714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.221041 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2882/5752] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:53 2022] GET /identity/v3/roles => generated 1650 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:53.222515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2e1c-2ca1-4401-a721-6e608dc9174f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.222804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2e1c-2ca1-4401-a721-6e608dc9174f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.223077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2e1c-2ca1-4401-a721-6e608dc9174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.272719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1d9a2e1c-2ca1-4401-a721-6e608dc9174f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:53.284021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1d9a2e1c-2ca1-4401-a721-6e608dc9174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.302277 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2883/5753] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:53.303550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2e1c-2ca1-4401-a721-6e608dc9174f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:53.321470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2e1c-2ca1-4401-a721-6e608dc9174f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:53.327340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.328206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.329565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.329565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] PATH_INFO: `/v3/projects/112627260b9e4c61b435408a05290ef4/users/a9a8ec415bf24197b4a810a01275b0bc/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.349273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d67b7309d04c8889bed9c6bb6c614d', 'request_id': 'req-fc0caf31-38e0-4212-bd0a-9a6acbc22946'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:53.355979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d67b7309d04c8889bed9c6bb6c614d', 'request_id': 'req-fc0caf31-38e0-4212-bd0a-9a6acbc22946'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:53.367481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112627260b9e4c61b435408a05290ef4, user_id=a9a8ec415bf24197b4a810a01275b0bc, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.371119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.431263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d67b7309d04c8889bed9c6bb6c614d', 'request_id': 'req-fc0caf31-38e0-4212-bd0a-9a6acbc22946'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:53.451722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] The token cache is being invalidate because project b0d67b7309d04c8889bed9c6bb6c614d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:53.452402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:53.453670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:53.462697 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2871/5754] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:53 2022] DELETE /identity/v3/projects/b0d67b7309d04c8889bed9c6bb6c614d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:53.462697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:53.462697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.498674 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2884/5755] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:53 2022] PUT /identity/v3/projects/112627260b9e4c61b435408a05290ef4/users/a9a8ec415bf24197b4a810a01275b0bc/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:53.499569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:53.501449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.582772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0caf31-38e0-4212-bd0a-9a6acbc22946 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:53.626170 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:53.635651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b57c8f-8ea0-4528-b352-d0eb8abd13f7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:53.641357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.641571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.641901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.642206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/roles/192b7b32dd8b40079387697ecba49677` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.644450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_role(role_id=192b7b32dd8b40079387697ecba49677)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.647313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.683817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ec0ee-9f0f-43ed-932f-f9dc5a29448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.684371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ec0ee-9f0f-43ed-932f-f9dc5a29448b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.684650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ec0ee-9f0f-43ed-932f-f9dc5a29448b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.685035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ec0ee-9f0f-43ed-932f-f9dc5a29448b admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.685576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ec0ee-9f0f-43ed-932f-f9dc5a29448b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:53.685880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ec0ee-9f0f-43ed-932f-f9dc5a29448b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.687794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ec0ee-9f0f-43ed-932f-f9dc5a29448b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.701250 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2872/5756] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:53.705682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.705999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.706279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.744206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] MFA Rules not processed for user `a9a8ec415bf24197b4a810a01275b0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:53.746311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.786741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invalidating the token cache because role 192b7b32dd8b40079387697ecba49677 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:53.787671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:53.792726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:53.797154 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2885/5757] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:53 2022] DELETE /identity/v3/roles/192b7b32dd8b40079387697ecba49677 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:53.799327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:53.804679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.949338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d1135-ff77-46e5-a35e-c2bd8ebb23d8 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:53.956652 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2873/5758] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:53.957790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:53.964161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:53.975606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:53.976951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:53.977228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:53.977501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:53.982088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:53.984251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:53.997232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d19986-6a1f-4816-b99a-aff45456c6af None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:54.073201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:54.074240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:54.074676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:54.075105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/users/9bdb83b4d2394522942c6edaa0d9a64e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:54.076557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9bdb83b4d2394522942c6edaa0d9a64e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:54.078891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:54.102318 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2886/5759] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:53 2022] POST /identity/v3/projects => generated 375 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:54.103572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:54.108825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:54.244168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6ad6-ac01-4489-83ad-5ee1822372e9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:54.250432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:54.251564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:54.252026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:54.252449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:54.256786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdb83b4d2394522942c6edaa0d9a64e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:54.266593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdb83b4d2394522942c6edaa0d9a64e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:54.267530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdb83b4d2394522942c6edaa0d9a64e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:54.339649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdb83b4d2394522942c6edaa0d9a64e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:54.341265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdb83b4d2394522942c6edaa0d9a64e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:54.344309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:54.347074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:54.378503 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2887/5761] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:54.378634 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2874/5761] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:53 2022] DELETE /identity/v3/users/9bdb83b4d2394522942c6edaa0d9a64e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:54.378634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:54.380104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:54.381703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:54.519990 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:54.545294 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:54.587959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69a7e5-399a-40cf-9b09-6ef7804a3eb2 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:54.593853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:54.594737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:54.595098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:54.595571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:54.596413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:54.599361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:54.605635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fb1b0-c918-46ac-9562-e3488c44f9da service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:54.687720 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2875/5762] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:37:54 2022] POST /identity/v3/users => generated 288 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:37:54.693607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:54.721220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de3c3-ab9c-4e93-8e01-33fdfdc0e6bb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:54.746236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:54.748533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:54.748533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:54.748533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:54.750178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:54.753154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:54.779127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:54.780071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:54.782376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:54.783052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/groups/2df27a1bd18a4bde9ccfe627c356b3cd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:54.786346 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2876/5763] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:37:54.789035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2df27a1bd18a4bde9ccfe627c356b3cd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:54.789470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:54.790809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:54.830593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762923-3a75-400c-878f-c1a260eda5c0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:54.846968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:54.847604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:54.847887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:54.848158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:54.848808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:54.853115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:54.889503 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2877/5764] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:37:54.891224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:54.913023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15660a0-c4c8-4c33-b312-c20fece87639 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:54.924671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d4496-c375-4fbf-b2d1-d97f19b2fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:54.928593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4496-c375-4fbf-b2d1-d97f19b2fc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:54.928593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4496-c375-4fbf-b2d1-d97f19b2fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:54.928593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4496-c375-4fbf-b2d1-d97f19b2fc55 admin admin] PATH_INFO: `/v3/projects/99f75a43268a4f51a730755ec5ee380b/users/95e71874d1f642eea36ca4dcfbe59be2/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:54.942608 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2888/5765] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:37:54 2022] DELETE /identity/v3/groups/2df27a1bd18a4bde9ccfe627c356b3cd => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:54.948583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:54.950551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:54.965141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d4496-c375-4fbf-b2d1-d97f19b2fc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f75a43268a4f51a730755ec5ee380b, user_id=95e71874d1f642eea36ca4dcfbe59be2, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:54.968288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d4496-c375-4fbf-b2d1-d97f19b2fc55 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:55.077146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea2f58-8e04-48f2-b349-6772e25b15be tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:55.086457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:55.087180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:55.087467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:55.087738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/projects/f210c158dda44c18b901e5b5d8d5015a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:55.089208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f210c158dda44c18b901e5b5d8d5015a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:55.091303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:55.126781 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2878/5766] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:37:54 2022] PUT /identity/v3/projects/99f75a43268a4f51a730755ec5ee380b/users/95e71874d1f642eea36ca4dcfbe59be2/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:55.128285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:55.128570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:55.128843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:55.167842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] MFA Rules not processed for user `95e71874d1f642eea36ca4dcfbe59be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:55.169635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:55.213916 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:55.284350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f210c158dda44c18b901e5b5d8d5015a', 'request_id': 'req-46f2b75e-4820-48e8-98ec-3b2b83b0a549'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.293401 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2879/5767] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:55.301537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:55.303577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:55.303793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f210c158dda44c18b901e5b5d8d5015a', 'request_id': 'req-46f2b75e-4820-48e8-98ec-3b2b83b0a549'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.377654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f210c158dda44c18b901e5b5d8d5015a', 'request_id': 'req-46f2b75e-4820-48e8-98ec-3b2b83b0a549'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.396914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] The token cache is being invalidate because project f210c158dda44c18b901e5b5d8d5015a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:55.396914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.397797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.400778 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2889/5768] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:54 2022] DELETE /identity/v3/projects/f210c158dda44c18b901e5b5d8d5015a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:55.405271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:55.410164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:55.512441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2bf11-dd97-4810-9b05-9b92a6b8fdcd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:55.592533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2b75e-4820-48e8-98ec-3b2b83b0a549 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:55.627178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:55.627966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:55.628250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:55.628525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/domains/e75c7b3b50354293adb30a6ecc0c8ffd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:55.629811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:55.631924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:55.677131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:55.678395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:55.679479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:55.681413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:55.689864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:55.698957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.699881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.828880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.831021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:55.832467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:55.837808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:55.842122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2890/5769] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:37:55 2022] PATCH /identity/v3/domains/e75c7b3b50354293adb30a6ecc0c8ffd => generated 275 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:55.844649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:55.847890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:55.892098 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2880/5770] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:55.973313 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:55.986911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe947-869d-404d-a3bd-124390874917 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:55.999837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b1be6c8b1764fabab7ff13f6bb6ecf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f365b7bfb304c729db9d5348fed0371', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:56.000512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:56.000803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:56.001594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] PATH_INFO: `/v3/domains/e75c7b3b50354293adb30a6ecc0c8ffd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:56.019992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e75c7b3b50354293adb30a6ecc0c8ffd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:56.022215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:56.060348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.066596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.240156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd', 'request_id': 'req-f9bb4577-d913-469b-ab1b-58d621238fa9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.258412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd', 'request_id': 'req-f9bb4577-d913-469b-ab1b-58d621238fa9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.266121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:56.267687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:56.372032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd', 'request_id': 'req-f9bb4577-d913-469b-ab1b-58d621238fa9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.393939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] The token cache is being invalidate because project e75c7b3b50354293adb30a6ecc0c8ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:56.397599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.399121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.399256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f388b7b-53c8-479c-b951-573a206f0d2e service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:56.417324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd', 'request_id': 'req-f9bb4577-d913-469b-ab1b-58d621238fa9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.420008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd', 'request_id': 'req-f9bb4577-d913-469b-ab1b-58d621238fa9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.431921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e75c7b3b50354293adb30a6ecc0c8ffd', 'request_id': 'req-f9bb4577-d913-469b-ab1b-58d621238fa9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.441035 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2891/5771] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:37:55 2022] DELETE /identity/v3/domains/e75c7b3b50354293adb30a6ecc0c8ffd => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:56.447136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:56.449260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:56.558545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:56.562825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:56.563293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:56.563719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] PATH_INFO: `/v3/users/95e71874d1f642eea36ca4dcfbe59be2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:56.565208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e71874d1f642eea36ca4dcfbe59be2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:56.571947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:56.607999 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:56.668347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb4577-d913-469b-ab1b-58d621238fa9 tempest-InheritsV3TestJSON-1789355306 tempest-InheritsV3TestJSON-1789355306-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:56.678037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:56.700787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:56.701310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:56.701557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] PATH_INFO: `/v3/users/c634c90960114bacafa1d7eb3c8f16c3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:56.702997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c634c90960114bacafa1d7eb3c8f16c3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:56.704928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:56.721041 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:56.874499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e71874d1f642eea36ca4dcfbe59be2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.891055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e71874d1f642eea36ca4dcfbe59be2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.891811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e71874d1f642eea36ca4dcfbe59be2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.916950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c634c90960114bacafa1d7eb3c8f16c3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.928156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c634c90960114bacafa1d7eb3c8f16c3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.928984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c634c90960114bacafa1d7eb3c8f16c3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.948871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e71874d1f642eea36ca4dcfbe59be2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.949626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-96240a6c-d431-498d-83c0-28fc83245ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e71874d1f642eea36ca4dcfbe59be2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:56.980877 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2881/5772] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:56 2022] DELETE /identity/v3/users/95e71874d1f642eea36ca4dcfbe59be2 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:56.984765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:56.985094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:56.985369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:57.025299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:57.027040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:57.029161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c634c90960114bacafa1d7eb3c8f16c3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:57.029807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-69bd14b3-278b-49b7-a4b7-9938febae95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c634c90960114bacafa1d7eb3c8f16c3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:57.069816 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2892/5773] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:56 2022] DELETE /identity/v3/users/c634c90960114bacafa1d7eb3c8f16c3 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:37:57.072104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2a30-7d09-4dae-8a59-14cc60cb8d51 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:57.075496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2a30-7d09-4dae-8a59-14cc60cb8d51 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:57.076504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2a30-7d09-4dae-8a59-14cc60cb8d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:57.142080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9daa2a30-7d09-4dae-8a59-14cc60cb8d51 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:57.143403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9daa2a30-7d09-4dae-8a59-14cc60cb8d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:57.187010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2882/5774] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:37:57.188269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:57.196567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:57.314636 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2893/5775] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:57.331462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2a30-7d09-4dae-8a59-14cc60cb8d51 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:57.357833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63e7d-1593-4bfc-adc9-5306abb824f0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:57.437255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:57.438533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:57.438533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:57.438533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:57.459102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:57.465552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:57.474052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2a30-7d09-4dae-8a59-14cc60cb8d51 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:57.484294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:57.484931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:57.485210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:57.485736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:57.497587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2883/5776] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:37:57.515449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:57.518002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:57.542131 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2894/5777] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:37:57.995641 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:58.035602 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:58.498536 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:58.968304 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:59.140380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:59.146441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:59.148072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:59.148199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:59.166906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e9ef9-19be-4a03-84e5-3136dda1a8ad service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:59.171650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eff11-9261-4bf8-93ee-58a7e7963dfb service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:59.174700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:59.188182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:59.188952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:59.189427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] PATH_INFO: `/v3/projects/99f75a43268a4f51a730755ec5ee380b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:59.192148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f75a43268a4f51a730755ec5ee380b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:59.195380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:59.199400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:59.200056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:59.200335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:59.200608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] PATH_INFO: `/v3/projects/e73e5d907d864280ace38d9290065c08` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:59.202961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73e5d907d864280ace38d9290065c08)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:59.204899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:59.357198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73e5d907d864280ace38d9290065c08', 'request_id': 'req-5cde586b-65c4-4f2e-b234-78ac35343e34'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.368067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73e5d907d864280ace38d9290065c08', 'request_id': 'req-5cde586b-65c4-4f2e-b234-78ac35343e34'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.442699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f75a43268a4f51a730755ec5ee380b', 'request_id': 'req-49877766-6916-4797-99ed-864e81588b2c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.451980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73e5d907d864280ace38d9290065c08', 'request_id': 'req-5cde586b-65c4-4f2e-b234-78ac35343e34'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.465031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f75a43268a4f51a730755ec5ee380b', 'request_id': 'req-49877766-6916-4797-99ed-864e81588b2c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.470231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] The token cache is being invalidate because project e73e5d907d864280ace38d9290065c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:59.470775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.471604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.473592 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2895/5778] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:59 2022] DELETE /identity/v3/projects/e73e5d907d864280ace38d9290065c08 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:59.477577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:59.483072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:59.544576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f75a43268a4f51a730755ec5ee380b', 'request_id': 'req-49877766-6916-4797-99ed-864e81588b2c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.576893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] The token cache is being invalidate because project 99f75a43268a4f51a730755ec5ee380b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:37:59.577735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.580845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-49877766-6916-4797-99ed-864e81588b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:37:59.584102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2884/5779] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:37:59 2022] DELETE /identity/v3/projects/99f75a43268a4f51a730755ec5ee380b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:37:59.590251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311ee7-edff-48f1-aef5-3a604bbaf34c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:59.590529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311ee7-edff-48f1-aef5-3a604bbaf34c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:59.590803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311ee7-edff-48f1-aef5-3a604bbaf34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:59.614489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-35311ee7-edff-48f1-aef5-3a604bbaf34c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:59.615614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-35311ee7-edff-48f1-aef5-3a604bbaf34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:59.630427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde586b-65c4-4f2e-b234-78ac35343e34 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:59.720583 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:59.820841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:59.824045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:59.827319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:59.827820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] PATH_INFO: `/v3/users/8b1be6c8b1764fabab7ff13f6bb6ecf1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:59.829859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1be6c8b1764fabab7ff13f6bb6ecf1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:59.838458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:59.845870 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2885/5780] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:59.856220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed075-043c-4656-a766-f2e6b220a48f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:59.856606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed075-043c-4656-a766-f2e6b220a48f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:59.856990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed075-043c-4656-a766-f2e6b220a48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:59.876925 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:37:59.909398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a6fed075-043c-4656-a766-f2e6b220a48f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:37:59.910972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a6fed075-043c-4656-a766-f2e6b220a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:37:59.928513 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2886/5781] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:37:59.935257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed075-043c-4656-a766-f2e6b220a48f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:59.947473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed075-043c-4656-a766-f2e6b220a48f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:37:59.953279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:37:59.953907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:37:59.954286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:37:59.954569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:37:59.955294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:37:59.955606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:37:59.957905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:37:59.982658 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2887/5782] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:37:59.984311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:37:59.996281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82c98-6b60-4cbb-a788-bd8100c09a8c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:00.002510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:00.003500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:00.003969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:00.004451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:00.005299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:00.009182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:00.080418 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:00.097167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1be6c8b1764fabab7ff13f6bb6ecf1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:00.114786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1be6c8b1764fabab7ff13f6bb6ecf1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:00.117281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1be6c8b1764fabab7ff13f6bb6ecf1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:00.138819 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2888/5783] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:37:59 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:00.139822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:00.206315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1be6c8b1764fabab7ff13f6bb6ecf1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:00.207104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1be6c8b1764fabab7ff13f6bb6ecf1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:00.230317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfb8ca-e1e7-4f57-ab8f-cfdaac7b6d5a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:00.237018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:00.237785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:00.238199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:00.238693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:00.240622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:00.242163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:00.244760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2896/5784] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:37:59 2022] DELETE /identity/v3/users/8b1be6c8b1764fabab7ff13f6bb6ecf1 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:00.363996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:00.366083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:00.369565 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2889/5785] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:00 2022] POST /identity/v3/users => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:00.514709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a35714-39d8-4892-a6f6-ee12de6f8789 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:00.523275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:00.524352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:00.524814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:00.525251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:00.526616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:00.529160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:00.550100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:00.558109 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2897/5786] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:38:00.563927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159c880-7d4e-413e-9124-35ba9afb92bf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:00.571853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c48762-6294-49de-b310-7e7c60e13696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:00.573294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48762-6294-49de-b310-7e7c60e13696 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:00.573830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48762-6294-49de-b310-7e7c60e13696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:00.575194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48762-6294-49de-b310-7e7c60e13696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:00.576235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48762-6294-49de-b310-7e7c60e13696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:00.578167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48762-6294-49de-b310-7e7c60e13696 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:00.599009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:00.610721 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2890/5787] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:00.612829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3c196-a2ab-4bc2-aecf-5ea2481bb968 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:00.630611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:00.631556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:00.632390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:00.632668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] PATH_INFO: `/v3/projects/862ab019e925460f806c605b092b07f1/users/6909300e9f1e46a3b4d1671062fafa44/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:00.658236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=862ab019e925460f806c605b092b07f1, user_id=6909300e9f1e46a3b4d1671062fafa44, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:00.666126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:00.768597 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2898/5788] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:00 2022] PUT /identity/v3/projects/862ab019e925460f806c605b092b07f1/users/6909300e9f1e46a3b4d1671062fafa44/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:00.788825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918a2b-23e0-425f-a656-8d4c1728dd0c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:00.789041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918a2b-23e0-425f-a656-8d4c1728dd0c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:00.789392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918a2b-23e0-425f-a656-8d4c1728dd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:00.872433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1a918a2b-23e0-425f-a656-8d4c1728dd0c None None] MFA Rules not processed for user `6909300e9f1e46a3b4d1671062fafa44`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:00.883529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a918a2b-23e0-425f-a656-8d4c1728dd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:01.092633 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2891/5789] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:01.105874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:01.249930 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:01.307304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489fecf-d74c-4678-beec-5817ea73a7bd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:01.325129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:01.330398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:01.331473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:01.331838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:01.332531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:01.337039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:01.400610 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:01.510872 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2899/5790] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:01 2022] POST /identity/v3/projects => generated 399 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:01.514888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918a2b-23e0-425f-a656-8d4c1728dd0c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:01.529700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918a2b-23e0-425f-a656-8d4c1728dd0c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:01.642119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:01.643268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:01.643569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:01.643940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:01.644617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:01.646977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:01.810520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2892/5791] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:01 2022] POST /identity/v3/users => generated 306 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:38:01.811432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:01.826976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775a39-56e9-4d0a-ad78-71075e5edfd0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:01.840272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:01.840915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:01.841197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:01.841473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:01.842164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:01.843795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:01.864442 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2900/5792] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:01.870397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:01.883512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d734a3-289c-4bd1-beb2-d4def6663946 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:01.888713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:01.890205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:01.890717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:01.891310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] PATH_INFO: `/v3/projects/30a5eeb643b440ecb00f7afaf370612d/users/d5c92d62327b4d3fabca282f4cd70d9f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:01.917546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a5eeb643b440ecb00f7afaf370612d, user_id=d5c92d62327b4d3fabca282f4cd70d9f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:01.917546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:02.033706 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2893/5793] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:01 2022] PUT /identity/v3/projects/30a5eeb643b440ecb00f7afaf370612d/users/d5c92d62327b4d3fabca282f4cd70d9f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:02.037944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:02.082947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae3cb-c696-4835-8a21-9339a851853a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:02.274524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371b061-20d1-4dff-b52a-f0c634da028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:02.275409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371b061-20d1-4dff-b52a-f0c634da028c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:02.275864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371b061-20d1-4dff-b52a-f0c634da028c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:02.276613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371b061-20d1-4dff-b52a-f0c634da028c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:02.277849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371b061-20d1-4dff-b52a-f0c634da028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:02.279970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371b061-20d1-4dff-b52a-f0c634da028c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:02.313059 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2901/5794] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:02.316665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:02.330832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b37fb-7440-4691-80e2-a33a12dedba7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:02.338198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:02.339221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:02.339749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:02.340025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] PATH_INFO: `/v3/projects/30a5eeb643b440ecb00f7afaf370612d/users/d5c92d62327b4d3fabca282f4cd70d9f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:02.342474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a5eeb643b440ecb00f7afaf370612d, user_id=d5c92d62327b4d3fabca282f4cd70d9f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:02.345507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:02.360631 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2894/5795] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:02 2022] PUT /identity/v3/projects/30a5eeb643b440ecb00f7afaf370612d/users/d5c92d62327b4d3fabca282f4cd70d9f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:02.374859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc0402-aae4-4f43-8f2b-024b2df86420 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:02.379068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc0402-aae4-4f43-8f2b-024b2df86420 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:02.383308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc0402-aae4-4f43-8f2b-024b2df86420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:02.429720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f0fc0402-aae4-4f43-8f2b-024b2df86420 None None] MFA Rules not processed for user `d5c92d62327b4d3fabca282f4cd70d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:02.430881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f0fc0402-aae4-4f43-8f2b-024b2df86420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:02.508482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:02.510292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:02.596463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2902/5796] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:02.602338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc0402-aae4-4f43-8f2b-024b2df86420 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:02.625025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc0402-aae4-4f43-8f2b-024b2df86420 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:02.634479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820686a-385e-4257-bbce-42d2b1c0965c tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5c92d62327b4d3fabca282f4cd70d9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a5eeb643b440ecb00f7afaf370612d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:02.639970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820686a-385e-4257-bbce-42d2b1c0965c tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:02.639970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820686a-385e-4257-bbce-42d2b1c0965c tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:02.639970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820686a-385e-4257-bbce-42d2b1c0965c tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:02.639970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820686a-385e-4257-bbce-42d2b1c0965c tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:02.640428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820686a-385e-4257-bbce-42d2b1c0965c tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:02.655845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755e06-5f1b-4381-9441-2684ed5d6fee admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:02.663487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:02.663487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:02.663487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:02.663487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] PATH_INFO: `/v3/projects/1f365b7bfb304c729db9d5348fed0371` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:02.665424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f365b7bfb304c729db9d5348fed0371)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:02.667752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:02.753380 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2903/5797] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:38:02 2022] POST /identity/v3/roles => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:02.754766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3861-eea6-45f6-be88-26d48ceeb2b4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:02.755051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3861-eea6-45f6-be88-26d48ceeb2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:02.755313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3861-eea6-45f6-be88-26d48ceeb2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:02.808500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f365b7bfb304c729db9d5348fed0371', 'request_id': 'req-e41d5a56-acca-4943-9e96-f7eee3194358'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:02.808981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9d9f3861-eea6-45f6-be88-26d48ceeb2b4 None None] MFA Rules not processed for user `767b7a49f41948f5833a91fe521c92f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:02.810419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d9f3861-eea6-45f6-be88-26d48ceeb2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:02.816242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f365b7bfb304c729db9d5348fed0371', 'request_id': 'req-e41d5a56-acca-4943-9e96-f7eee3194358'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:02.887602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f365b7bfb304c729db9d5348fed0371', 'request_id': 'req-e41d5a56-acca-4943-9e96-f7eee3194358'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:02.904877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] The token cache is being invalidate because project 1f365b7bfb304c729db9d5348fed0371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:02.905400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:02.906688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e41d5a56-acca-4943-9e96-f7eee3194358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:02.909227 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2904/5798] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:02.910228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3861-eea6-45f6-be88-26d48ceeb2b4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:02.910730 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2895/5799] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:02 2022] DELETE /identity/v3/projects/1f365b7bfb304c729db9d5348fed0371 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:02.916695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:02.917086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:02.917637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:02.953066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:02.956532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:03.047454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3861-eea6-45f6-be88-26d48ceeb2b4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:03.052554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2947f-9995-4d4d-9a07-a676bf0f6f05 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5c92d62327b4d3fabca282f4cd70d9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a5eeb643b440ecb00f7afaf370612d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:03.053279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2947f-9995-4d4d-9a07-a676bf0f6f05 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.054261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2947f-9995-4d4d-9a07-a676bf0f6f05 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.054603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2947f-9995-4d4d-9a07-a676bf0f6f05 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] PATH_INFO: `/v3/projects/862ab019e925460f806c605b092b07f1/users/6909300e9f1e46a3b4d1671062fafa44/roles/90a434f1d8954f1c9edcd53cfdfbcb9d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.064698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2947f-9995-4d4d-9a07-a676bf0f6f05 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: Authorizing `identity:create_grant(project_id=862ab019e925460f806c605b092b07f1, user_id=6909300e9f1e46a3b4d1671062fafa44, role_id=90a434f1d8954f1c9edcd53cfdfbcb9d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:03.068011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2947f-9995-4d4d-9a07-a676bf0f6f05 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:03.084532 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2896/5800] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:03.086263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:03.087850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:03.155302 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2905/5801] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:02 2022] PUT /identity/v3/projects/862ab019e925460f806c605b092b07f1/users/6909300e9f1e46a3b4d1671062fafa44/roles/90a434f1d8954f1c9edcd53cfdfbcb9d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:03.156913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54d4c-8470-4027-bec8-4029112f0e8c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.157371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54d4c-8470-4027-bec8-4029112f0e8c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.157818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54d4c-8470-4027-bec8-4029112f0e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.196484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd844ab5-9c45-4d8f-a7fe-de2cfbc4e872 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:03.201199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-48a54d4c-8470-4027-bec8-4029112f0e8c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:03.202452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-48a54d4c-8470-4027-bec8-4029112f0e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:03.299855 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:03.312060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:03.312705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.313036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.313275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.315809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:03.331855 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2906/5802] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:03.337414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f670-cddb-4b6a-958b-ddac919ac53e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.337414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f670-cddb-4b6a-958b-ddac919ac53e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.337414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509f670-cddb-4b6a-958b-ddac919ac53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.362399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9509f670-cddb-4b6a-958b-ddac919ac53e None None] MFA Rules not processed for user `bb03047092f64e2abbf78e9db1a06e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:03.364809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9509f670-cddb-4b6a-958b-ddac919ac53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:03.383122 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:03.439030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:03.440233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:03.451179 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2897/5803] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:03.452415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:03.453325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:03.483640 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2907/5804] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:03.495521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509f670-cddb-4b6a-958b-ddac919ac53e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:03.528518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509f670-cddb-4b6a-958b-ddac919ac53e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:03.541883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:03.552616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.552616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.552616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.552616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:03.552616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:03.552616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:03.576974 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2908/5805] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:03.581182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:03.602229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d7194-d2a3-4b99-84d6-db24eef7efc0 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:03.605711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee8baa-2af8-43c0-943c-aeb50d363502 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:03.606251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466283a-7fed-4208-a444-73067455bf6e tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6909300e9f1e46a3b4d1671062fafa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862ab019e925460f806c605b092b07f1', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1487663166', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:03.607351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466283a-7fed-4208-a444-73067455bf6e tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.608208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466283a-7fed-4208-a444-73067455bf6e tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.608790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466283a-7fed-4208-a444-73067455bf6e tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] PATH_INFO: `/v3/users/6909300e9f1e46a3b4d1671062fafa44/application_credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.610322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466283a-7fed-4208-a444-73067455bf6e tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] RBAC: Authorizing `identity:create_application_credential(user_id=6909300e9f1e46a3b4d1671062fafa44)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:03.611996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466283a-7fed-4208-a444-73067455bf6e tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:03.635884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:03.636718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.637171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.637593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.638397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:03.640985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:03.823780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2909/5806] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:03 2022] POST /identity/v3/projects => generated 369 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:03.835559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:03.985871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9393b6-8c34-4d77-81f2-222d5cc4e669 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:03.993146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:03.993779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:03.994344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:03.994624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:03.995828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:03.997203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:04.018772 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2898/5807] 10.222.0.42 () {60 vars in 1315 bytes} [Sun Oct 23 01:38:03 2022] POST /identity/v3/users/6909300e9f1e46a3b4d1671062fafa44/application_credentials => generated 656 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:04.020797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256327-0099-45c5-bf4e-50904d8fafe0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.021156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256327-0099-45c5-bf4e-50904d8fafe0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.021434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256327-0099-45c5-bf4e-50904d8fafe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.054756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-da256327-0099-45c5-bf4e-50904d8fafe0 None None] MFA Rules not processed for user `6909300e9f1e46a3b4d1671062fafa44`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:04.056267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-da256327-0099-45c5-bf4e-50904d8fafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:04.109859 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2910/5808] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:03 2022] POST /identity/v3/users => generated 285 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:04.110835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.123548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26656ee3-06f4-4eab-83d8-de43c32db0d2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.146388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.147355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.147706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.148101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.149386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:04.151107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:04.176304 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2911/5809] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:04 2022] GET /identity/v3/roles => generated 1651 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:04.180827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.243568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25def-e380-44ab-a308-7a1ae5eff167 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.258299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.259869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.260253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.265703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.266727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:04.268582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:04.296159 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2899/5810] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 23 01:38:04.297521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da256327-0099-45c5-bf4e-50904d8fafe0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.307905 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2912/5811] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:04 2022] GET /identity/v3/roles => generated 1651 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:38:04.309262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.333358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f732a-1263-41e8-b555-8dee43edb5b9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.348996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1a8e-96a5-4b91-8875-a3aaf98fe5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.349263 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:04.349966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1a8e-96a5-4b91-8875-a3aaf98fe5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.358492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1a8e-96a5-4b91-8875-a3aaf98fe5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.358492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1a8e-96a5-4b91-8875-a3aaf98fe5d1 admin admin] PATH_INFO: `/v3/projects/6346ae469a6f415893ed3c6f8d8922dc/users/1f1f465fd98843ed8fef1e758a18b82f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.373313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da256327-0099-45c5-bf4e-50904d8fafe0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.379882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6909300e9f1e46a3b4d1671062fafa44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862ab019e925460f806c605b092b07f1', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1487663166', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.380764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.381052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.382242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] PATH_INFO: `/v3/users/6909300e9f1e46a3b4d1671062fafa44/application_credentials/8195c9dee5214912b6451404de2e556c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.383135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6909300e9f1e46a3b4d1671062fafa44, application_credential_id=8195c9dee5214912b6451404de2e556c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:04.385224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:04.422078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1a8e-96a5-4b91-8875-a3aaf98fe5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6346ae469a6f415893ed3c6f8d8922dc, user_id=1f1f465fd98843ed8fef1e758a18b82f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:04.422078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1a8e-96a5-4b91-8875-a3aaf98fe5d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:04.507716 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2900/5812] 10.222.0.42 () {58 vars in 1395 bytes} [Sun Oct 23 01:38:04 2022] DELETE /identity/v3/users/6909300e9f1e46a3b4d1671062fafa44/application_credentials/8195c9dee5214912b6451404de2e556c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:04.511524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.516815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:04.542834 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2913/5813] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:04 2022] PUT /identity/v3/projects/6346ae469a6f415893ed3c6f8d8922dc/users/1f1f465fd98843ed8fef1e758a18b82f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:04.546182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840525c-5d11-4eac-92bb-b7454a5f1861 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.546468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840525c-5d11-4eac-92bb-b7454a5f1861 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.546740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840525c-5d11-4eac-92bb-b7454a5f1861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.601888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c840525c-5d11-4eac-92bb-b7454a5f1861 None None] MFA Rules not processed for user `1f1f465fd98843ed8fef1e758a18b82f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:04.604201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c840525c-5d11-4eac-92bb-b7454a5f1861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:04.729254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bc4c3-6a1c-4ff6-971b-07664e02652d tempest-ApplicationCredentialsV3AdminTest-605910093 tempest-ApplicationCredentialsV3AdminTest-605910093-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.819698 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:04.827172 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2914/5814] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:04.832035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840525c-5d11-4eac-92bb-b7454a5f1861 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.864684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840525c-5d11-4eac-92bb-b7454a5f1861 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.880231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1570-892a-453d-a877-af9124e9d6db tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1f465fd98843ed8fef1e758a18b82f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6346ae469a6f415893ed3c6f8d8922dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.880975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1570-892a-453d-a877-af9124e9d6db tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.882281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1570-892a-453d-a877-af9124e9d6db tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.884195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1570-892a-453d-a877-af9124e9d6db tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] PATH_INFO: `/v3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.899014 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2915/5815] 10.222.0.42 () {58 vars in 1104 bytes} [Sun Oct 23 01:38:04 2022] GET /identity/v3 => generated 255 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:04.901666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1570-892a-453d-a877-af9124e9d6db tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.909132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5c92d62327b4d3fabca282f4cd70d9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a5eeb643b440ecb00f7afaf370612d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.910084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.921372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.921372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] PATH_INFO: `/v3/roles/90a434f1d8954f1c9edcd53cfdfbcb9d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.921372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: Authorizing `identity:delete_role(role_id=90a434f1d8954f1c9edcd53cfdfbcb9d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:04.921372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:04.924339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1570-892a-453d-a877-af9124e9d6db tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.935983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c79d4-2635-412b-830a-cf754734c089 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1f465fd98843ed8fef1e758a18b82f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6346ae469a6f415893ed3c6f8d8922dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.937713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c79d4-2635-412b-830a-cf754734c089 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.939125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c79d4-2635-412b-830a-cf754734c089 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.939429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c79d4-2635-412b-830a-cf754734c089 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] PATH_INFO: `/v3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:04.948613 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2916/5816] 10.222.0.42 () {58 vars in 1104 bytes} [Sun Oct 23 01:38:04 2022] GET /identity/v3 => generated 255 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:04.950103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c79d4-2635-412b-830a-cf754734c089 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:04.964657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c79d4-2635-412b-830a-cf754734c089 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:04.994906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0b1ba-ef05-4a98-98f9-36b7f3bd95f6 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1f465fd98843ed8fef1e758a18b82f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6346ae469a6f415893ed3c6f8d8922dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:04.995671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b1ba-ef05-4a98-98f9-36b7f3bd95f6 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:04.995671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b1ba-ef05-4a98-98f9-36b7f3bd95f6 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:04.996154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b1ba-ef05-4a98-98f9-36b7f3bd95f6 tempest-TestApiDiscovery-1840493183 tempest-TestApiDiscovery-1840493183-project] PATH_INFO: `/v3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:05.003114 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2917/5817] 10.222.0.42 () {58 vars in 1104 bytes} [Sun Oct 23 01:38:04 2022] GET /identity/v3 => generated 255 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:05.004642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ffcf-3107-42e7-8479-d319a9372847 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:05.005008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ffcf-3107-42e7-8479-d319a9372847 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:05.005336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ffcf-3107-42e7-8479-d319a9372847 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:05.013252 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2918/5818] 10.222.0.42 () {56 vars in 895 bytes} [Sun Oct 23 01:38:05 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:38:05.015403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d96f-4b71-47a8-802d-46e15709f2f6 None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:05.015669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d96f-4b71-47a8-802d-46e15709f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:05.015948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d96f-4b71-47a8-802d-46e15709f2f6 None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:05.023221 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2919/5819] 10.222.0.42 () {56 vars in 895 bytes} [Sun Oct 23 01:38:05 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:38:05.023580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3d96f-4b71-47a8-802d-46e15709f2f6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:05.184301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] Invalidating the token cache because role 90a434f1d8954f1c9edcd53cfdfbcb9d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:05.185057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.186128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.192739 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2901/5820] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:04 2022] DELETE /identity/v3/roles/90a434f1d8954f1c9edcd53cfdfbcb9d => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:05.193035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:05.198828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:05.218286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3d96f-4b71-47a8-802d-46e15709f2f6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:05.420473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd425f-fd95-4653-a0df-7f4a7684f8f3 tempest-ApplicationCredentialsV3AdminTest-39627703 tempest-ApplicationCredentialsV3AdminTest-39627703-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:05.430633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:05.431578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:05.432449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:05.432944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] PATH_INFO: `/v3/users/1f1f465fd98843ed8fef1e758a18b82f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:05.434425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1f465fd98843ed8fef1e758a18b82f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:05.436822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:05.450419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:05.451106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:05.451390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:05.451667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] PATH_INFO: `/v3/users/6909300e9f1e46a3b4d1671062fafa44` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:05.456263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6909300e9f1e46a3b4d1671062fafa44)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:05.462399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:05.733570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6909300e9f1e46a3b4d1671062fafa44'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.750157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6909300e9f1e46a3b4d1671062fafa44'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.752339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6909300e9f1e46a3b4d1671062fafa44'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.836576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1f465fd98843ed8fef1e758a18b82f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.858709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6909300e9f1e46a3b4d1671062fafa44'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.868215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4907c63f-f699-43f6-b7c0-e51452ef058f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6909300e9f1e46a3b4d1671062fafa44'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.888581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1f465fd98843ed8fef1e758a18b82f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.890687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1f465fd98843ed8fef1e758a18b82f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:05.926239 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2902/5821] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:05 2022] DELETE /identity/v3/users/6909300e9f1e46a3b4d1671062fafa44 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:05.928677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:05.930239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:05.931392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:06.000787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1f465fd98843ed8fef1e758a18b82f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:06.001904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa258ef5-3ad6-440e-9480-d844e8f826d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1f465fd98843ed8fef1e758a18b82f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:06.003442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:06.004837 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:06.006967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:06.075437 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2920/5822] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:05 2022] DELETE /identity/v3/users/1f1f465fd98843ed8fef1e758a18b82f => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:06.083715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f5207-21fc-467b-a647-bcd40cf2a225 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:06.086147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f5207-21fc-467b-a647-bcd40cf2a225 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:06.089692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f5207-21fc-467b-a647-bcd40cf2a225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:06.180204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-927f5207-21fc-467b-a647-bcd40cf2a225 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:06.189274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-927f5207-21fc-467b-a647-bcd40cf2a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:06.271050 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:06.280470 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2903/5823] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:06.289335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:06.293819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:06.465386 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2921/5824] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:06.589680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b32f4-cbf9-4f81-ae29-8127652460e1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:06.610492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f5207-21fc-467b-a647-bcd40cf2a225 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:06.624578 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:06.725015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:06.726208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:06.726493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:06.726757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:06.739863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:06.742148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:06.754344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2904/5825] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:06.778285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f5207-21fc-467b-a647-bcd40cf2a225 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:06.789744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:06.790413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:06.790710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:06.790964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:06.829662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:06.831395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:06.864928 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2922/5826] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:07.046778 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:07.765950 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:07.860962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:07.865200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:07.895460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba054-0988-4bc0-b107-f78de322ed12 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:07.915008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:07.916051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:07.916551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:07.917033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] PATH_INFO: `/v3/projects/862ab019e925460f806c605b092b07f1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:07.918464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=862ab019e925460f806c605b092b07f1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:07.920736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:08.054696 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:08.122639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862ab019e925460f806c605b092b07f1', 'request_id': 'req-8e78c400-8435-491f-974c-87591cfbcdd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.144913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862ab019e925460f806c605b092b07f1', 'request_id': 'req-8e78c400-8435-491f-974c-87591cfbcdd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.246509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862ab019e925460f806c605b092b07f1', 'request_id': 'req-8e78c400-8435-491f-974c-87591cfbcdd9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.283883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] The token cache is being invalidate because project 862ab019e925460f806c605b092b07f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:08.284175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.285159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.297518 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2905/5827] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:07 2022] DELETE /identity/v3/projects/862ab019e925460f806c605b092b07f1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:08.298257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:08.320072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3ef65-58db-457d-9001-ca3f27493983 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:08.409026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:08.410943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:08.445200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:08.446464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:08.446962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:08.447858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] PATH_INFO: `/v3/users/d5c92d62327b4d3fabca282f4cd70d9f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:08.450359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c92d62327b4d3fabca282f4cd70d9f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:08.452873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:08.578367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78c400-8435-491f-974c-87591cfbcdd9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:08.583639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:08.584316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:08.585171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:08.586101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] PATH_INFO: `/v3/projects/6346ae469a6f415893ed3c6f8d8922dc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:08.587015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6346ae469a6f415893ed3c6f8d8922dc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:08.589209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:08.709888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c92d62327b4d3fabca282f4cd70d9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.720202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c92d62327b4d3fabca282f4cd70d9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.721303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c92d62327b4d3fabca282f4cd70d9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.727740 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:08.766247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6346ae469a6f415893ed3c6f8d8922dc', 'request_id': 'req-91227bd9-82f5-4728-8b93-eb1abe0ca26e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.790757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6346ae469a6f415893ed3c6f8d8922dc', 'request_id': 'req-91227bd9-82f5-4728-8b93-eb1abe0ca26e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.887463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c92d62327b4d3fabca282f4cd70d9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.890231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1bfe78e2-7441-4afe-9917-97c827e820f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c92d62327b4d3fabca282f4cd70d9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:08.932554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2923/5828] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:08 2022] DELETE /identity/v3/users/d5c92d62327b4d3fabca282f4cd70d9f => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:08.994037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6346ae469a6f415893ed3c6f8d8922dc', 'request_id': 'req-91227bd9-82f5-4728-8b93-eb1abe0ca26e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:09.017464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] The token cache is being invalidate because project 6346ae469a6f415893ed3c6f8d8922dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:09.019496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:09.020867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-91227bd9-82f5-4728-8b93-eb1abe0ca26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:09.034240 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2906/5829] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:08 2022] DELETE /identity/v3/projects/6346ae469a6f415893ed3c6f8d8922dc => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:09.035747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78925de2-5756-4d96-8f68-dc9819d308df None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:09.036194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78925de2-5756-4d96-8f68-dc9819d308df None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:09.036465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78925de2-5756-4d96-8f68-dc9819d308df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:09.084297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-78925de2-5756-4d96-8f68-dc9819d308df None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:09.087040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78925de2-5756-4d96-8f68-dc9819d308df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:09.092853 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:09.258561 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2924/5830] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:09.266384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceeb75-655b-47f0-bf88-d5d6d1f8b6bc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:09.266689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceeb75-655b-47f0-bf88-d5d6d1f8b6bc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:09.267318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceeb75-655b-47f0-bf88-d5d6d1f8b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:09.350916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-64ceeb75-655b-47f0-bf88-d5d6d1f8b6bc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:09.355350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-64ceeb75-655b-47f0-bf88-d5d6d1f8b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:09.389527 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2907/5831] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:09.394060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78925de2-5756-4d96-8f68-dc9819d308df None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:09.410720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78925de2-5756-4d96-8f68-dc9819d308df None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:09.436507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:09.442573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:09.447477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:09.448855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:09.449823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:09.451415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:09.453273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:09.479927 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2925/5832] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:09.483622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ceeb75-655b-47f0-bf88-d5d6d1f8b6bc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:09.501236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ceeb75-655b-47f0-bf88-d5d6d1f8b6bc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:09.527531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:09.528175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:09.528457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:09.536843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:09.537680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:09.550745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:09.734246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2908/5833] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:09 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:38:09.736988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:09.764024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d6026-267d-4ad0-ad93-f1229b28f946 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:09.922802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:09.925773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:09.927059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:09.929641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:09.934420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:09.943533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:10.064464 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:10.073241 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2926/5834] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:09 2022] POST /identity/v3/users => generated 287 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:10.077103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:10.091148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8e3c7-cac9-4bbb-af50-399efec1777b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:10.119187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:10.120130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:10.120415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:10.120689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:10.121346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:10.123039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:10.139246 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2909/5835] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:10.140558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:10.166150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1495e-7e49-4e3b-bf5f-17a92b32e0c8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:10.190019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:10.205622 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:10.207744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:10.208271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:10.208563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:10.212576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:10.219848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:10.257350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2927/5836] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:10.259786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:10.273008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71461322-446b-4f16-b88f-7d41e2be7682 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:10.285227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32c55a-8489-4fc2-bc6d-3fa2ec6c6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:10.287436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c55a-8489-4fc2-bc6d-3fa2ec6c6292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:10.288794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c55a-8489-4fc2-bc6d-3fa2ec6c6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:10.289245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c55a-8489-4fc2-bc6d-3fa2ec6c6292 admin admin] PATH_INFO: `/v3/projects/c68a6d83d061413e88776ba98e0f3e7d/users/d10ebb778d0747d2a4389da7325a6d8c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:10.341100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32c55a-8489-4fc2-bc6d-3fa2ec6c6292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68a6d83d061413e88776ba98e0f3e7d, user_id=d10ebb778d0747d2a4389da7325a6d8c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:10.345758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32c55a-8489-4fc2-bc6d-3fa2ec6c6292 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:10.495122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:10.497138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:10.498218 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2910/5837] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:10 2022] PUT /identity/v3/projects/c68a6d83d061413e88776ba98e0f3e7d/users/d10ebb778d0747d2a4389da7325a6d8c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:10.513548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0718491-484d-48bd-ac3d-a32e9dc2fb5e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:10.514125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0718491-484d-48bd-ac3d-a32e9dc2fb5e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:10.514598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0718491-484d-48bd-ac3d-a32e9dc2fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:10.519965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb61e3-cc15-46bd-96a8-1b347d981258 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:10.585483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c0718491-484d-48bd-ac3d-a32e9dc2fb5e None None] MFA Rules not processed for user `d10ebb778d0747d2a4389da7325a6d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:10.587423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c0718491-484d-48bd-ac3d-a32e9dc2fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:10.666301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:10.668342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:10.668841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:10.669324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] PATH_INFO: `/v3/projects/30a5eeb643b440ecb00f7afaf370612d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:10.671015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a5eeb643b440ecb00f7afaf370612d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:10.673448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:10.799241 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2911/5838] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:10.805079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0718491-484d-48bd-ac3d-a32e9dc2fb5e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:10.851595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0718491-484d-48bd-ac3d-a32e9dc2fb5e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:10.871163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd10ebb778d0747d2a4389da7325a6d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c68a6d83d061413e88776ba98e0f3e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:10.877708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:10.878611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:10.886537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:10.886537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:10.886537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:10.895384 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2912/5839] 10.222.0.42 () {58 vars in 1143 bytes} [Sun Oct 23 01:38:10 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:10.900779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:10.900943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a5eeb643b440ecb00f7afaf370612d', 'request_id': 'req-683ba72b-de5d-4556-b972-8b046f45efd2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:10.913524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a5eeb643b440ecb00f7afaf370612d', 'request_id': 'req-683ba72b-de5d-4556-b972-8b046f45efd2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:10.936525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba29f-ba1d-41da-9108-9cc208eb3d02 tempest-IdentityCatalogTest-336682512 tempest-IdentityCatalogTest-336682512-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:10.989483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a5eeb643b440ecb00f7afaf370612d', 'request_id': 'req-683ba72b-de5d-4556-b972-8b046f45efd2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.020879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] The token cache is being invalidate because project 30a5eeb643b440ecb00f7afaf370612d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:11.021446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.024180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-683ba72b-de5d-4556-b972-8b046f45efd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.029632 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2928/5840] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:10 2022] DELETE /identity/v3/projects/30a5eeb643b440ecb00f7afaf370612d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:11.038853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d0007-f018-4dc1-8d86-547ad4da36b5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:11.039147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d0007-f018-4dc1-8d86-547ad4da36b5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:11.039423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d0007-f018-4dc1-8d86-547ad4da36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:11.104452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:11.106029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:11.106862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:11.107448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] PATH_INFO: `/v3/users/d10ebb778d0747d2a4389da7325a6d8c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:11.108946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10ebb778d0747d2a4389da7325a6d8c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:11.115068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:11.119406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4c7d0007-f018-4dc1-8d86-547ad4da36b5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:11.120704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c7d0007-f018-4dc1-8d86-547ad4da36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:11.155948 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2929/5841] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:11.164132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999819de-99c0-4b00-b1df-b753c39a6ace None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:11.164507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999819de-99c0-4b00-b1df-b753c39a6ace None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:11.164905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999819de-99c0-4b00-b1df-b753c39a6ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:11.221790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-999819de-99c0-4b00-b1df-b753c39a6ace None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:11.223750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-999819de-99c0-4b00-b1df-b753c39a6ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:11.245160 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2930/5842] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:38:11.256258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999819de-99c0-4b00-b1df-b753c39a6ace None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:11.293686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999819de-99c0-4b00-b1df-b753c39a6ace None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:11.317000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:11.317885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:11.319937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:11.320234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:11.324057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:11.324841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:11.327907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:11.351753 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2931/5843] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:11.386872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:11.408424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78794f4d-2031-44cb-98fc-c20daefdb41c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:11.425187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:11.426088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:11.426334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:11.426605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:11.427395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:11.435228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:11.478922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10ebb778d0747d2a4389da7325a6d8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.538695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10ebb778d0747d2a4389da7325a6d8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.540090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10ebb778d0747d2a4389da7325a6d8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.865103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10ebb778d0747d2a4389da7325a6d8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.865818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d11bd1bf-d429-4e02-8816-0f4821cf77f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10ebb778d0747d2a4389da7325a6d8c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:11.883466 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2932/5844] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:11 2022] POST /identity/v3/projects => generated 375 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:11.887816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:11.892873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:11.921229 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2913/5845] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:10 2022] DELETE /identity/v3/users/d10ebb778d0747d2a4389da7325a6d8c => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:11.926587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:11.927135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:11.927575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:11.962427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:11.964124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:12.024341 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:12.064207 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:12.069008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da97e-fd71-4009-86a8-1fda4033df70 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:12.096566 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2914/5846] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:12.122410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:12.124069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:12.183109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:12.183109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:12.183764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:12.183764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:12.184190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:12.188403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:12.245232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa0d83-f537-475e-8352-763d0a7ea9b0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:12.257714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:12.260322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:12.260322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:12.260322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:12.286922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:12.290157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:12.321752 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2933/5847] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:11 2022] POST /identity/v3/users => generated 288 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:12.326403 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2915/5848] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:38:12.327568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:12.358017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56603e9-a530-46a0-82a3-c6415195425a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:12.372936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:12.374728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:12.375010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:12.375281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:12.375966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:12.378723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:12.408975 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2916/5849] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:12.415933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:12.435405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5942c2b-5646-4b4d-86da-356dfca384b3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:12.464185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa5df0-acae-434a-967f-693675857c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:12.465274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa5df0-acae-434a-967f-693675857c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:12.465560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa5df0-acae-434a-967f-693675857c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:12.465830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa5df0-acae-434a-967f-693675857c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:12.467660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa5df0-acae-434a-967f-693675857c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:12.471490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa5df0-acae-434a-967f-693675857c48 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:12.496936 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2934/5850] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:12.500545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:12.516194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8d6f8-c829-4291-9e11-cb7185e63cef admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:12.528349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:12.528968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:12.529251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:12.529547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] PATH_INFO: `/v3/projects/7f524ba71a8844648af562dda76e9084/users/8a9803b0b28c4e7a9ca3b00ab06c5883/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:12.564066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f524ba71a8844648af562dda76e9084, user_id=8a9803b0b28c4e7a9ca3b00ab06c5883, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:12.566780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:12.666033 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2917/5851] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:12 2022] PUT /identity/v3/projects/7f524ba71a8844648af562dda76e9084/users/8a9803b0b28c4e7a9ca3b00ab06c5883/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:12.676775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031847-c93c-4189-8845-37cab7635481 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:12.677071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031847-c93c-4189-8845-37cab7635481 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:12.677331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031847-c93c-4189-8845-37cab7635481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:12.710656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:12.713698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:12.741717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aa031847-c93c-4189-8845-37cab7635481 None None] MFA Rules not processed for user `8a9803b0b28c4e7a9ca3b00ab06c5883`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:12.744641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa031847-c93c-4189-8845-37cab7635481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:12.892963 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2935/5852] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:12.894217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa031847-c93c-4189-8845-37cab7635481 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:12.907663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e846c-d369-4052-a181-8c2b7eebc429 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:12.920675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:12.925994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:12.926469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:12.926970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:12.930320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:12.949080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:12.951368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:12.988967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2918/5853] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:13.023803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa031847-c93c-4189-8845-37cab7635481 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:13.029102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:13.030232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:13.030738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:13.031239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:13.033364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:13.037764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:13.163872 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2936/5854] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:12 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:13.168044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:13.208292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0d631-8082-45b6-9d39-928308a9c93f service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:13.353838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:13.355803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:13.442626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:13.444622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:13.444911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:13.445188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:13.450841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:13.456475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:13.503437 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:13.564871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267be165-2a58-475b-b033-16e86c3de9f3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:13.577923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:13.578536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:13.578820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:13.581290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] PATH_INFO: `/v3/projects/c68a6d83d061413e88776ba98e0f3e7d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:13.582969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68a6d83d061413e88776ba98e0f3e7d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:13.599104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:13.604564 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2919/5855] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:13 2022] POST /identity/v3/users => generated 294 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:13.605636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:13.630482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c4bb-c1ba-4427-8869-1b44563f3e89 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:13.641482 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:13.647882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:13.653600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:13.653600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:13.653600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:13.653600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:13.656413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:13.717020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2920/5856] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:13.726677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:13.739877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91b70-fd65-4ade-8100-ed1f26597fe1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:13.746067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:13.747335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:13.747812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:13.748160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] PATH_INFO: `/v3/projects/7b04ddcd83ca4040a1c42c13fe03cd70/users/23e2e20e2a244dc29770fc78b3434560/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:13.814580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b04ddcd83ca4040a1c42c13fe03cd70, user_id=23e2e20e2a244dc29770fc78b3434560, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:13.819191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:13.846983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68a6d83d061413e88776ba98e0f3e7d', 'request_id': 'req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:13.864466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68a6d83d061413e88776ba98e0f3e7d', 'request_id': 'req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:13.894896 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2921/5857] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:13 2022] PUT /identity/v3/projects/7b04ddcd83ca4040a1c42c13fe03cd70/users/23e2e20e2a244dc29770fc78b3434560/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:13.901015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.000445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68a6d83d061413e88776ba98e0f3e7d', 'request_id': 'req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:14.048090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] The token cache is being invalidate because project c68a6d83d061413e88776ba98e0f3e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:14.048090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:14.048090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7ec1bf1a-f29a-4ec5-a124-1e35952e1ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:14.048090 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2937/5858] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:13 2022] DELETE /identity/v3/projects/c68a6d83d061413e88776ba98e0f3e7d => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:14.048090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b0c0-68f6-4a54-ab0b-64341e083dba None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.048789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b0c0-68f6-4a54-ab0b-64341e083dba None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.048789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b0c0-68f6-4a54-ab0b-64341e083dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.099313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-75a8b0c0-68f6-4a54-ab0b-64341e083dba None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:14.103933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-75a8b0c0-68f6-4a54-ab0b-64341e083dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:14.114597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf205a3-872a-4c5c-ab35-9384e5333ed8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.124442 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2938/5859] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:14.127506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.128908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.129375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.129842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.130755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.132506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ba8bf-e077-40ac-adae-9db64f603c53 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.132797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ba8bf-e077-40ac-adae-9db64f603c53 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.133077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ba8bf-e077-40ac-adae-9db64f603c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.133216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.144844 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2922/5860] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:14.149208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.157684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:14.181927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733f3a-c0a7-4b42-9590-ac2f6df58d68 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.190806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-666ba8bf-e077-40ac-adae-9db64f603c53 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:14.193224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-666ba8bf-e077-40ac-adae-9db64f603c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:14.194008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d58575-e125-4a9a-8087-247ec8c51bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.200428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d58575-e125-4a9a-8087-247ec8c51bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.200428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d58575-e125-4a9a-8087-247ec8c51bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.200428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d58575-e125-4a9a-8087-247ec8c51bb3 admin admin] PATH_INFO: `/v3/projects/7b04ddcd83ca4040a1c42c13fe03cd70/users/23e2e20e2a244dc29770fc78b3434560/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.200428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d58575-e125-4a9a-8087-247ec8c51bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b04ddcd83ca4040a1c42c13fe03cd70, user_id=23e2e20e2a244dc29770fc78b3434560, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.208665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d58575-e125-4a9a-8087-247ec8c51bb3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.209928 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2939/5861] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:14.211347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ba8bf-e077-40ac-adae-9db64f603c53 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.229556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ba8bf-e077-40ac-adae-9db64f603c53 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.260007 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2923/5862] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:14 2022] PUT /identity/v3/projects/7b04ddcd83ca4040a1c42c13fe03cd70/users/23e2e20e2a244dc29770fc78b3434560/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:14.266670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f4f3d-139d-4d55-b21d-b71e8cb6106f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.266968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f4f3d-139d-4d55-b21d-b71e8cb6106f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.267253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f4f3d-139d-4d55-b21d-b71e8cb6106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.327147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-df9f4f3d-139d-4d55-b21d-b71e8cb6106f None None] MFA Rules not processed for user `23e2e20e2a244dc29770fc78b3434560`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:14.329734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-df9f4f3d-139d-4d55-b21d-b71e8cb6106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:14.380616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.381819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.382113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.383224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.383915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:14.384215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.389702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.414850 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:14.429222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2940/5863] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:14.439350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.456228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9860416-99c6-40a5-8471-0c2beeb1fb54 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.462137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.466810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.466810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.466810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.466810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.466810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.486136 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:14.512743 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2924/5864] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:14.520698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f4f3d-139d-4d55-b21d-b71e8cb6106f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.545332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f4f3d-139d-4d55-b21d-b71e8cb6106f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.554134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.554732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.555083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.555432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.556167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.558255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.579707 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2941/5865] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:14.587563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.712121 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2925/5866] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:14 2022] POST /identity/v3/projects => generated 350 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:14.715480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.725435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eba0c-81cc-45ef-826d-2362abee6116 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.814692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.825175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.825693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.826183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.827837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.830830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.895955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867106cc-c93d-4ba0-8fff-d39b6675a09e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.903173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.904182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.904634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.905096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.905944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.909303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.931664 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:14.940591 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2942/5867] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:14 2022] POST /identity/v3/users => generated 300 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:14.945515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:14.956384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761205-7688-4f0d-a4be-6b33b08933e0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:14.965041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:14.965584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:14.969294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:14.969294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:14.969294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:14.969294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:14.980443 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2943/5868] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:14.984194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.000447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77968016-b978-4b64-8ebe-6abf5fec11af admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.009468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.010435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.010988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.012081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] PATH_INFO: `/v3/projects/63bc51997f2e41949035326292837000/users/2c26d759fb644e8a938bdefcd7325119/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.034937 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2926/5869] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:14 2022] POST /identity/v3/projects => generated 351 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:15.040252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.050954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bc51997f2e41949035326292837000, user_id=2c26d759fb644e8a938bdefcd7325119, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.058320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.061791 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:15.155935 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2944/5870] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:14 2022] PUT /identity/v3/projects/63bc51997f2e41949035326292837000/users/2c26d759fb644e8a938bdefcd7325119/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:15.159615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a5e3-dca5-4b27-b48c-7a7e87f2617a tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.165526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.270176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.270979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.271325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.272881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/users/8a9803b0b28c4e7a9ca3b00ab06c5883` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.274211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:get_user(user_id=8a9803b0b28c4e7a9ca3b00ab06c5883)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.281203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.286035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2927/5871] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:38:15 2022] GET /identity/v3/users/8a9803b0b28c4e7a9ca3b00ab06c5883 => generated 288 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:15.289066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.316739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e987b-d31e-4362-a373-258b69047321 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.325919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.327082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.329651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.329651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.329651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.331167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.337314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093c29-132c-4f9f-8af2-8caf7eb88058 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.346807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.347435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.347721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.348089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.348749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.350952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.370507 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2945/5872] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:15.371603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.399779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb027b-c9f4-42d1-97ce-1a5e0d2a7889 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.405329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec388-dd9d-4297-b373-ad98e1f9537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.406181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec388-dd9d-4297-b373-ad98e1f9537b admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.406459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec388-dd9d-4297-b373-ad98e1f9537b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.406752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec388-dd9d-4297-b373-ad98e1f9537b admin admin] PATH_INFO: `/v3/projects/63bc51997f2e41949035326292837000/users/2c26d759fb644e8a938bdefcd7325119/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.413111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ec388-dd9d-4297-b373-ad98e1f9537b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bc51997f2e41949035326292837000, user_id=2c26d759fb644e8a938bdefcd7325119, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.416624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ec388-dd9d-4297-b373-ad98e1f9537b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.430154 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2946/5873] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:15 2022] PUT /identity/v3/projects/63bc51997f2e41949035326292837000/users/2c26d759fb644e8a938bdefcd7325119/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:15.441437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.441690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.442148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.484370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2928/5874] 10.222.0.42 () {60 vars in 1162 bytes} [Sun Oct 23 01:38:15 2022] POST /identity/v3/credentials => generated 427 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:15.490709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.520292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c31de-37b6-415c-aed5-42139d58c34e tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.524495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] MFA Rules not processed for user `2c26d759fb644e8a938bdefcd7325119`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:15.529142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:15.686765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.687838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.688316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.688798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials/3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.692901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.697270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.703471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.718730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.732276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2947/5875] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:15.733838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.735807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:15.773678 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:15.820408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f5697-3fb1-4a48-a5c7-065c0eed030b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.823782 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2929/5876] 10.222.0.42 () {60 vars in 1358 bytes} [Sun Oct 23 01:38:15 2022] PATCH /identity/v3/credentials/3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72 => generated 437 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:15.826342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:15.827100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.827872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.828247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.828614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] PATH_INFO: `/v3/users/ccbaed58156741a08c90099b28cb2af4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.841636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbaed58156741a08c90099b28cb2af4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.843917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:15.857115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eff311-6ccd-45af-b5d3-9e29744635df tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:15.863606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:15.864267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:15.865211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:15.866115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:15.866760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:15.869159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.014491 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2930/5877] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:15 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:16.014491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.070319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbaed58156741a08c90099b28cb2af4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:16.086266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbaed58156741a08c90099b28cb2af4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:16.087838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbaed58156741a08c90099b28cb2af4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:16.098710 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:16.172510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be8553-4cfe-432a-abfe-97d21a1cdc82 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.177403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbaed58156741a08c90099b28cb2af4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:16.179976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbaed58156741a08c90099b28cb2af4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:16.180102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:16.180453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.181265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.181265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials/3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.183727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:16.185638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.206008 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2931/5878] 10.222.0.42 () {58 vars in 1335 bytes} [Sun Oct 23 01:38:16 2022] GET /identity/v3/credentials/3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72 => generated 437 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:16.206008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.214198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:16.224227 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2948/5879] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:15 2022] DELETE /identity/v3/users/ccbaed58156741a08c90099b28cb2af4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:16.225442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.228131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:16.371371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd91bb8-0ac8-4dac-a4db-7c7e3ae6d715 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.377636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27314ef-6a17-42f4-ac6f-d4c8aeb75a89 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:16.379312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27314ef-6a17-42f4-ac6f-d4c8aeb75a89 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.379609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27314ef-6a17-42f4-ac6f-d4c8aeb75a89 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.379880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27314ef-6a17-42f4-ac6f-d4c8aeb75a89 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials/3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.387024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27314ef-6a17-42f4-ac6f-d4c8aeb75a89 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:16.388815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27314ef-6a17-42f4-ac6f-d4c8aeb75a89 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.414372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556627-b205-44a3-b6eb-06d4f6a097fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.508062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:16.509067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.509560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.510178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.511280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:16.513445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.533121 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2949/5880] 10.222.0.42 () {58 vars in 1338 bytes} [Sun Oct 23 01:38:16 2022] DELETE /identity/v3/credentials/3a45060a6067bb3b0b36ad8534f581dbd54b9ef8a369780e1c574e8699cd8d72 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:16.536777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd945863-e453-4ad9-aae3-b92828e66aa2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.537548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd945863-e453-4ad9-aae3-b92828e66aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.537945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd945863-e453-4ad9-aae3-b92828e66aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.576646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fd945863-e453-4ad9-aae3-b92828e66aa2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:16.577894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd945863-e453-4ad9-aae3-b92828e66aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:16.597856 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2950/5881] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:16.598792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd945863-e453-4ad9-aae3-b92828e66aa2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.615981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd945863-e453-4ad9-aae3-b92828e66aa2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.629663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:16.629778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.630102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.630411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.631594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:16.636373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.653744 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2932/5882] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:16 2022] POST /identity/v3/users => generated 293 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:16.658347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.663622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:16.763907 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2951/5883] 10.222.0.42 () {60 vars in 1162 bytes} [Sun Oct 23 01:38:16 2022] POST /identity/v3/credentials => generated 429 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:16.764808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.793762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46825715-f3e2-4de5-85a0-f14342fd0313 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.807942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:16.808578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.808866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.809277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.809877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:16.811527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.830968 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2952/5884] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:16.837847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.862746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28000ea-7959-4486-bf11-b1e03ac18c2f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.868891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041fd54-2c49-440c-8467-05e9b7ccb6dd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.872895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:16.873566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.873884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.874294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.879114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:16.880665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.881558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:16.882978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:16.883448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:16.883903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:16.891361 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:16.914200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:16.915925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:16.957368 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2933/5885] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:16.958409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.973353 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:16.975982 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2953/5886] 10.222.0.42 () {60 vars in 1162 bytes} [Sun Oct 23 01:38:16 2022] POST /identity/v3/credentials => generated 431 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:16.983574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6609-13f3-4973-9175-73d4648ce9be service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:16.983980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:16.999631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:17.000507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.000997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.001483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.002368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.006862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.026778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf02f5-0a7d-452e-842d-ecdd1ef16b43 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:17.034931 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2934/5887] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:17.039545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:17.041140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:17.041773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.042080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.042364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.042981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.044555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.051745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58212c-8e54-44fe-a38b-e9e747276faf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:17.058091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9475-6815-4627-8c5a-fa6d1f54842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:17.059264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9475-6815-4627-8c5a-fa6d1f54842e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.060123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9475-6815-4627-8c5a-fa6d1f54842e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.060578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9475-6815-4627-8c5a-fa6d1f54842e admin admin] PATH_INFO: `/v3/projects/aa462acfc499496d9dfeee76df6521b9/users/ccf974078d2a4b67b5aa114e97ff76a1/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.061787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.064978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.067943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.070241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.072686 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2954/5888] 10.222.0.42 () {58 vars in 1140 bytes} [Sun Oct 23 01:38:16 2022] GET /identity/v3/credentials => generated 945 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:17.086520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:17.105215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9475-6815-4627-8c5a-fa6d1f54842e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa462acfc499496d9dfeee76df6521b9, user_id=ccf974078d2a4b67b5aa114e97ff76a1, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.108293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb5e7-6f5a-4da7-a721-10860e709a65 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:17.115004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9475-6815-4627-8c5a-fa6d1f54842e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.120159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:17.126035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.126035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.126035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials/49813b03a660bef823f828219cd5b01fb9f32087a136a7421654fadef0141243` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.132357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=49813b03a660bef823f828219cd5b01fb9f32087a136a7421654fadef0141243)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.144067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.180513 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2935/5889] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:17 2022] PUT /identity/v3/projects/aa462acfc499496d9dfeee76df6521b9/users/ccf974078d2a4b67b5aa114e97ff76a1/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:17.192042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61821fa-9ff5-4277-af28-aa004aea9c76 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.192608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61821fa-9ff5-4277-af28-aa004aea9c76 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.192892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61821fa-9ff5-4277-af28-aa004aea9c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.201926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2955/5890] 10.222.0.42 () {58 vars in 1338 bytes} [Sun Oct 23 01:38:17 2022] DELETE /identity/v3/credentials/49813b03a660bef823f828219cd5b01fb9f32087a136a7421654fadef0141243 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:17.206051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:17.224167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6df6c4-c7e9-4732-896a-9a4691b2a6fe tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:17.310632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a61821fa-9ff5-4277-af28-aa004aea9c76 None None] MFA Rules not processed for user `ccf974078d2a4b67b5aa114e97ff76a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:17.315928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a61821fa-9ff5-4277-af28-aa004aea9c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:17.365575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:17.368019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.368766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.368766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/credentials/c7cfc9514c779a2eb9aee66a4614e70ee253a7ccc147564379f34f1e48de8120` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.372939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=c7cfc9514c779a2eb9aee66a4614e70ee253a7ccc147564379f34f1e48de8120)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.379349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.464225 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2936/5891] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:17.494387 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2956/5892] 10.222.0.42 () {58 vars in 1338 bytes} [Sun Oct 23 01:38:17 2022] DELETE /identity/v3/credentials/c7cfc9514c779a2eb9aee66a4614e70ee253a7ccc147564379f34f1e48de8120 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:17.499100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61821fa-9ff5-4277-af28-aa004aea9c76 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:17.502007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:17.504122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:17.532230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61821fa-9ff5-4277-af28-aa004aea9c76 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:17.544867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:17.545872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.548915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.550474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/projects/93cbdb4ddfb947b999dfc8b12087d7bb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.555810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=93cbdb4ddfb947b999dfc8b12087d7bb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.560340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.727408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8026-8865-4099-a01a-417254eff561 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:17.732315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:17.733267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:17.733267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:17.733490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:17.735297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:17.815397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cbdb4ddfb947b999dfc8b12087d7bb', 'request_id': 'req-37a42b5a-a616-408d-9b77-043093a53491'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:17.827488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cbdb4ddfb947b999dfc8b12087d7bb', 'request_id': 'req-37a42b5a-a616-408d-9b77-043093a53491'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:17.868870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:17.870760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:17.886054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2957/5893] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:17.887047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:17.888592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:17.914183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cbdb4ddfb947b999dfc8b12087d7bb', 'request_id': 'req-37a42b5a-a616-408d-9b77-043093a53491'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:17.938910 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:17.943655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] The token cache is being invalidate because project 93cbdb4ddfb947b999dfc8b12087d7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:17.945572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:17.947304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:17.953389 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2937/5894] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:17 2022] DELETE /identity/v3/projects/93cbdb4ddfb947b999dfc8b12087d7bb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:17.958012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:17.960955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:18.004389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89007ff-15be-42d6-9698-e8615e7c13c9 service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:18.094659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:18.095706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:18.096155 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:18.096294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:18.096849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] PATH_INFO: `/v3/projects/9869b74cfa7741d9b8a98bc25e9f3cc5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:18.098552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9869b74cfa7741d9b8a98bc25e9f3cc5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:18.102060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:18.136505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42b5a-a616-408d-9b77-043093a53491 tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:18.143265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e2e20e2a244dc29770fc78b3434560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b04ddcd83ca4040a1c42c13fe03cd70', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:18.144019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:18.144403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:18.144792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] PATH_INFO: `/v3/projects/241e12eea8564b62821b57ad86106d77` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:18.147071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=241e12eea8564b62821b57ad86106d77)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:18.149240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:18.309963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9869b74cfa7741d9b8a98bc25e9f3cc5', 'request_id': 'req-de699e3d-b650-4e40-a62e-e21d2defd4b5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.314783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241e12eea8564b62821b57ad86106d77', 'request_id': 'req-2ba1cf23-76e8-4e04-8345-27085f3112cd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.317191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9869b74cfa7741d9b8a98bc25e9f3cc5', 'request_id': 'req-de699e3d-b650-4e40-a62e-e21d2defd4b5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.322019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241e12eea8564b62821b57ad86106d77', 'request_id': 'req-2ba1cf23-76e8-4e04-8345-27085f3112cd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.394432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9869b74cfa7741d9b8a98bc25e9f3cc5', 'request_id': 'req-de699e3d-b650-4e40-a62e-e21d2defd4b5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.410933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] The token cache is being invalidate because project 9869b74cfa7741d9b8a98bc25e9f3cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:18.410933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.410933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.414222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2958/5895] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:17 2022] DELETE /identity/v3/projects/9869b74cfa7741d9b8a98bc25e9f3cc5 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:18.416381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:18.417992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:18.479646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241e12eea8564b62821b57ad86106d77', 'request_id': 'req-2ba1cf23-76e8-4e04-8345-27085f3112cd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.503405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] The token cache is being invalidate because project 241e12eea8564b62821b57ad86106d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:18.503693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.504779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ba1cf23-76e8-4e04-8345-27085f3112cd tempest-CredentialsTestJSON-1010800020 tempest-CredentialsTestJSON-1010800020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.514677 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2938/5896] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:17 2022] DELETE /identity/v3/projects/241e12eea8564b62821b57ad86106d77 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:18.515997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:18.516279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:18.516552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:18.525007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699e3d-b650-4e40-a62e-e21d2defd4b5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:18.558672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:18.559987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:18.619607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:18.620284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:18.620567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:18.620845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] PATH_INFO: `/v3/users/63c5322096e8477196746c01f5371367` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:18.622103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c5322096e8477196746c01f5371367)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:18.624240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:18.637520 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2939/5897] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:18.639093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:18.645137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:18.660758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb2dde-077a-4890-a307-4f649d3afe9d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:18.667973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:18.672652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:18.672652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:18.672652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] PATH_INFO: `/v3/users/2c26d759fb644e8a938bdefcd7325119` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:18.672652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c26d759fb644e8a938bdefcd7325119)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:18.672984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:18.931020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c5322096e8477196746c01f5371367'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.932985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c26d759fb644e8a938bdefcd7325119'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.941665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c26d759fb644e8a938bdefcd7325119'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.947809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c26d759fb644e8a938bdefcd7325119'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.948069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c5322096e8477196746c01f5371367'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:18.948069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c5322096e8477196746c01f5371367'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.063770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c26d759fb644e8a938bdefcd7325119'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.064216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c26d759fb644e8a938bdefcd7325119'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.083275 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2940/5898] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:18 2022] DELETE /identity/v3/users/2c26d759fb644e8a938bdefcd7325119 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:19.084202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.085649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.091473 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:19.119888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c5322096e8477196746c01f5371367'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.120707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-044b21c7-4744-4038-b8c3-ab4dba117314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c5322096e8477196746c01f5371367'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.140286 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2959/5899] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:18 2022] DELETE /identity/v3/users/63c5322096e8477196746c01f5371367 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:19.141671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b6e8-57c0-43d5-8f83-540c84f31f07 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.141956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b6e8-57c0-43d5-8f83-540c84f31f07 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.142289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b6e8-57c0-43d5-8f83-540c84f31f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.159648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec6859-2ace-4a2b-9cb6-77c02741abfe admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:19.162816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b837b6e8-57c0-43d5-8f83-540c84f31f07 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:19.164035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b837b6e8-57c0-43d5-8f83-540c84f31f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.230571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:19.234704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.234704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.234704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] PATH_INFO: `/v3/users/8a9803b0b28c4e7a9ca3b00ab06c5883` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.234704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9803b0b28c4e7a9ca3b00ab06c5883)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:19.235037 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2960/5900] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:19.235216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:19.235324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802a725-f6c6-436e-995f-96b7a5641146 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.235561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802a725-f6c6-436e-995f-96b7a5641146 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.235836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802a725-f6c6-436e-995f-96b7a5641146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.280753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4802a725-f6c6-436e-995f-96b7a5641146 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:19.280753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4802a725-f6c6-436e-995f-96b7a5641146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.287355 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2961/5901] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:19.287541 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:19.287656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be4b1-b0bf-4fa7-ad19-4dae13c4e5ee None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.287656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be4b1-b0bf-4fa7-ad19-4dae13c4e5ee None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.287656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be4b1-b0bf-4fa7-ad19-4dae13c4e5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.309202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d21be4b1-b0bf-4fa7-ad19-4dae13c4e5ee None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:19.310582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d21be4b1-b0bf-4fa7-ad19-4dae13c4e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.325868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2962/5902] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:19.326805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be4b1-b0bf-4fa7-ad19-4dae13c4e5ee None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.336896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be4b1-b0bf-4fa7-ad19-4dae13c4e5ee None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:19.344414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:19.346602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.347049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.347373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.348785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:19.349094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:19.354538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:19.371284 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2963/5903] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:19.376546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.376546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.440974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9803b0b28c4e7a9ca3b00ab06c5883'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.456758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9803b0b28c4e7a9ca3b00ab06c5883'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.457709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9803b0b28c4e7a9ca3b00ab06c5883'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.479418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542a0a0-b1ad-498f-98ff-a12d6fe25995 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:19.483995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:19.484860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.485143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.485420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.498875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:19.499197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:19.512736 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2964/5904] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:19.513713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.515239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.535297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66472974-260c-4626-a719-8fb59d9a6320 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:19.539730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:19.543250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.543250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.543250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.551168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:19.553264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:19.555633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9803b0b28c4e7a9ca3b00ab06c5883'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.556543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31f845fb-0e83-40fb-bde0-d4372167aba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9803b0b28c4e7a9ca3b00ab06c5883'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:19.564674 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2965/5905] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:19.565514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.576636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb63ff2-5f8f-4ef3-bedb-478781019bfa service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:19.587561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:19.593771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.593771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.593771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.593771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:19.593771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:19.599221 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2941/5906] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:19 2022] DELETE /identity/v3/users/8a9803b0b28c4e7a9ca3b00ab06c5883 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:19.602235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.602777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.605177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.611512 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:19.649374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:19.658098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.703750 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:19.728499 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2966/5907] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:19 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:19.733302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.736786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.768576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2942/5908] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:38:19.827131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096880-31ee-4a9c-b8ff-bcfb493c139d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:19.832590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:19.833225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.836153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.836524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.837760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:19.842098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:19.871994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.873286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:19.923753 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2967/5909] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:19 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:19.925067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.953369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8f104-540d-485d-bc42-417c9b06eb11 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:19.969464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:19.969464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:19.969464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:19.969464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:19.969947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:19.970417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:19.991704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2968/5910] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:19.992649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:19.995506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:20.001444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abd8a4-b6db-4291-a741-0d6bb0f51aa6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:20.019022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6573a-118c-40b2-9cb2-87c6dfaaec3b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:20.020112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:20.020911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.021527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.021812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] PATH_INFO: `/v3/projects/c62f5a29a0e54ba2a7e3c147eb79a33a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.023057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62f5a29a0e54ba2a7e3c147eb79a33a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:20.025483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:20.111540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:20.113508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.113787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.116599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.128984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:20.131317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:20.142616 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:20.154480 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2943/5911] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:38:20.160016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:20.160914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62f5a29a0e54ba2a7e3c147eb79a33a', 'request_id': 'req-60510354-22df-4cc9-965f-d1474480bd09'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.168196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62f5a29a0e54ba2a7e3c147eb79a33a', 'request_id': 'req-60510354-22df-4cc9-965f-d1474480bd09'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.183506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef718e-178c-488a-a22a-e8f1cdcace7d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:20.286170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62f5a29a0e54ba2a7e3c147eb79a33a', 'request_id': 'req-60510354-22df-4cc9-965f-d1474480bd09'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.308788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] The token cache is being invalidate because project c62f5a29a0e54ba2a7e3c147eb79a33a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:20.309309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.310017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e941-e4e6-4685-a55e-28a7b20aa478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:20.310661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e941-e4e6-4685-a55e-28a7b20aa478 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.311125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e941-e4e6-4685-a55e-28a7b20aa478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.311411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e941-e4e6-4685-a55e-28a7b20aa478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.312148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e941-e4e6-4685-a55e-28a7b20aa478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:20.315810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e941-e4e6-4685-a55e-28a7b20aa478 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:20.324431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.328116 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2969/5912] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:19 2022] DELETE /identity/v3/projects/c62f5a29a0e54ba2a7e3c147eb79a33a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:20.334020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2944/5913] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:20.335412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:20.336325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.336615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.336909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.353999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:20.385215 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:20.399482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60510354-22df-4cc9-965f-d1474480bd09 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:20.406868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:20.408069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.408446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.408986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] PATH_INFO: `/v3/projects/63bc51997f2e41949035326292837000` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.409921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:20.411196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63bc51997f2e41949035326292837000)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:20.413893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:20.415433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:20.446164 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2945/5914] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:20.446164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:20.446164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:20.473371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a2ee3-7c38-4215-a111-ebb8431e2d8c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:20.485611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c1a96-e853-476b-a5a0-02d9257f202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:20.486477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c1a96-e853-476b-a5a0-02d9257f202e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.486849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c1a96-e853-476b-a5a0-02d9257f202e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.487198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c1a96-e853-476b-a5a0-02d9257f202e admin admin] PATH_INFO: `/v3/projects/484394ebe12c4d9286cc1dddc576a480/users/34f29a8fb3fc4ca28e49066964d77de4/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.559423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c1a96-e853-476b-a5a0-02d9257f202e admin admin] RBAC: Authorizing `identity:create_grant(project_id=484394ebe12c4d9286cc1dddc576a480, user_id=34f29a8fb3fc4ca28e49066964d77de4, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:20.574124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c1a96-e853-476b-a5a0-02d9257f202e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:20.683922 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2946/5915] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:20 2022] PUT /identity/v3/projects/484394ebe12c4d9286cc1dddc576a480/users/34f29a8fb3fc4ca28e49066964d77de4/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:20.686186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.686563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.686812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.702399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63bc51997f2e41949035326292837000', 'request_id': 'req-52698267-ee46-4cba-a44d-bbf66726e22a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.715538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63bc51997f2e41949035326292837000', 'request_id': 'req-52698267-ee46-4cba-a44d-bbf66726e22a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.716199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:20.717516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:20.777038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63bc51997f2e41949035326292837000', 'request_id': 'req-52698267-ee46-4cba-a44d-bbf66726e22a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.806848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] The token cache is being invalidate because project 63bc51997f2e41949035326292837000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:20.807680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.808818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52698267-ee46-4cba-a44d-bbf66726e22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:20.812270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2970/5916] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:20 2022] DELETE /identity/v3/projects/63bc51997f2e41949035326292837000 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:20.816561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136e908-86e8-4637-bcb9-2492d0be919c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.820510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136e908-86e8-4637-bcb9-2492d0be919c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.821338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136e908-86e8-4637-bcb9-2492d0be919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.881180 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2947/5917] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:20.881959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:20.884364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:20.885489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5136e908-86e8-4637-bcb9-2492d0be919c None None] MFA Rules not processed for user `34f29a8fb3fc4ca28e49066964d77de4`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:20.887636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5136e908-86e8-4637-bcb9-2492d0be919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:20.915063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bdccb-f638-40fe-a5ee-9930b45fa566 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:20.930760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:20.931444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:20.933073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:20.933580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] PATH_INFO: `/v3/users/ccf974078d2a4b67b5aa114e97ff76a1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:20.935660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf974078d2a4b67b5aa114e97ff76a1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:20.944985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:21.034904 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2971/5918] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:21.042518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136e908-86e8-4637-bcb9-2492d0be919c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:21.055599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136e908-86e8-4637-bcb9-2492d0be919c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:21.061501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:21.062166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:21.068164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:21.068164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:21.068164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:21.068164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:21.068164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:21.080854 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2972/5919] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:21.081809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:21.090735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:21.105173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101520-db51-4b92-aab4-d46fcb46b14a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:21.111176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:21.111816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:21.112091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:21.112356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] PATH_INFO: `/v3/projects/7f524ba71a8844648af562dda76e9084` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:21.113528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f524ba71a8844648af562dda76e9084)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:21.116049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:21.130634 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:21.162869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf974078d2a4b67b5aa114e97ff76a1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.171814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf974078d2a4b67b5aa114e97ff76a1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.173092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf974078d2a4b67b5aa114e97ff76a1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.223133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f524ba71a8844648af562dda76e9084', 'request_id': 'req-1ff1b680-7dde-4ec0-a130-f817cd52038e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.235167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f524ba71a8844648af562dda76e9084', 'request_id': 'req-1ff1b680-7dde-4ec0-a130-f817cd52038e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.268280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf974078d2a4b67b5aa114e97ff76a1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.270204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf974078d2a4b67b5aa114e97ff76a1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.296781 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2948/5920] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:20 2022] DELETE /identity/v3/users/ccf974078d2a4b67b5aa114e97ff76a1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:21.299696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:21.307128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:21.354635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f524ba71a8844648af562dda76e9084', 'request_id': 'req-1ff1b680-7dde-4ec0-a130-f817cd52038e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.378660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] The token cache is being invalidate because project 7f524ba71a8844648af562dda76e9084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:21.378964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.380092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.386568 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2973/5921] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:21 2022] DELETE /identity/v3/projects/7f524ba71a8844648af562dda76e9084 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:21.387427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:21.390027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:21.452670 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:21.479823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ec22-aba9-4d7f-b4f5-0c64b6f0a543 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:21.495247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:21.506499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:21.507676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:21.508736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:21.509121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b680-7dde-4ec0-a130-f817cd52038e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:21.516452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:21.597365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:21.598087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:21.598364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:21.598638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:21.599968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:21.602024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:21.622882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:21.628539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:21.640437 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2949/5922] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:21.641160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:21.643543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:21.659238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7007c-a267-4a80-ae69-8647ec560440 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:21.667538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:21.668190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:21.668469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:21.669086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] PATH_INFO: `/v3/users/23e2e20e2a244dc29770fc78b3434560` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:21.670682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e2e20e2a244dc29770fc78b3434560)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:21.673585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:21.756080 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2974/5923] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:21 2022] POST /identity/v3/projects => generated 383 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:21.757175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:21.760916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:21.814433 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:21.855586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427524-1f7b-4a87-9d4f-fdc7176b20d7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:21.856526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:21.857180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:21.857460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:21.857730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] PATH_INFO: `/v3/users/34f29a8fb3fc4ca28e49066964d77de4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:21.858932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f29a8fb3fc4ca28e49066964d77de4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:21.860862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:21.966936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e2e20e2a244dc29770fc78b3434560'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.980922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e2e20e2a244dc29770fc78b3434560'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:21.981335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e2e20e2a244dc29770fc78b3434560'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.085471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e2e20e2a244dc29770fc78b3434560'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.086372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e2e20e2a244dc29770fc78b3434560'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.105212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f29a8fb3fc4ca28e49066964d77de4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.109368 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2950/5924] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:21 2022] DELETE /identity/v3/users/23e2e20e2a244dc29770fc78b3434560 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:22.110291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:22.116045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f29a8fb3fc4ca28e49066964d77de4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.117387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f29a8fb3fc4ca28e49066964d77de4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.121715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.194653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f29a8fb3fc4ca28e49066964d77de4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.195910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f29a8fb3fc4ca28e49066964d77de4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.230372 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2975/5925] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:21 2022] DELETE /identity/v3/users/34f29a8fb3fc4ca28e49066964d77de4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:22.232136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:22.234277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.278136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9cf1-4e22-4cd1-b7ad-2d2271be9e07 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:22.306074 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:22.333216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3c44e-36a3-4d7f-a6be-d9e363b60964 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:22.346723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:22.348145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.348328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.349605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] PATH_INFO: `/v3/projects/aa462acfc499496d9dfeee76df6521b9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.353161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa462acfc499496d9dfeee76df6521b9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:22.356822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:22.368328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342296a-6822-4087-801a-db5e9ed33b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:22.368328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342296a-6822-4087-801a-db5e9ed33b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.368328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342296a-6822-4087-801a-db5e9ed33b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.368328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342296a-6822-4087-801a-db5e9ed33b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.368831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342296a-6822-4087-801a-db5e9ed33b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:22.369772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342296a-6822-4087-801a-db5e9ed33b44 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:22.465716 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2951/5926] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:22 2022] POST /identity/v3/users => generated 292 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:22.467279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ebeb8-827e-4735-a02a-123ed74e8688 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.467717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ebeb8-827e-4735-a02a-123ed74e8688 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.468812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ebeb8-827e-4735-a02a-123ed74e8688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.530634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa462acfc499496d9dfeee76df6521b9', 'request_id': 'req-d3552478-ab31-46aa-96b5-15e9c4574951'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.539212 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:22.540605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa462acfc499496d9dfeee76df6521b9', 'request_id': 'req-d3552478-ab31-46aa-96b5-15e9c4574951'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.566928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-922ebeb8-827e-4735-a02a-123ed74e8688 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:22.568816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-922ebeb8-827e-4735-a02a-123ed74e8688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.633473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa462acfc499496d9dfeee76df6521b9', 'request_id': 'req-d3552478-ab31-46aa-96b5-15e9c4574951'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.652029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] The token cache is being invalidate because project aa462acfc499496d9dfeee76df6521b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:22.652425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.653298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:22.655720 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2976/5927] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:22 2022] DELETE /identity/v3/projects/aa462acfc499496d9dfeee76df6521b9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:22.657328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:22.658821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.683470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552478-ab31-46aa-96b5-15e9c4574951 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:22.688010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2952/5928] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:22.689253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:22.689653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6df92-d84e-4b18-8aea-26f4dcb9d36e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.689878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.690097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6df92-d84e-4b18-8aea-26f4dcb9d36e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.690237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.690486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6df92-d84e-4b18-8aea-26f4dcb9d36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.690615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.691360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:22.693550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:22.706042 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2977/5929] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:22.706042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:22.708084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.711947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-58a6df92-d84e-4b18-8aea-26f4dcb9d36e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:22.713178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-58a6df92-d84e-4b18-8aea-26f4dcb9d36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.723136 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2953/5930] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:22.723984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6df92-d84e-4b18-8aea-26f4dcb9d36e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:22.735806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6df92-d84e-4b18-8aea-26f4dcb9d36e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:22.740384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d597e50-83cf-42f8-8cc0-de5b74db5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:22.741082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597e50-83cf-42f8-8cc0-de5b74db5587 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.741387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597e50-83cf-42f8-8cc0-de5b74db5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.741650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597e50-83cf-42f8-8cc0-de5b74db5587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.742339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d597e50-83cf-42f8-8cc0-de5b74db5587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:22.743939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d597e50-83cf-42f8-8cc0-de5b74db5587 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:22.755835 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2954/5931] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:22.759550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.759550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.759550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.782993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:22.784649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.806102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2955/5932] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:22.807508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:22.809221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:22.822660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf905ee1-f3cc-4ff5-8897-98be70b2a863 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:22.825424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7e6-f56d-44b4-96cf-15816e1b8303 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:22.827901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:22.828543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.828822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.829092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] PATH_INFO: `/v3/projects/7b04ddcd83ca4040a1c42c13fe03cd70` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.830270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:22.830488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b04ddcd83ca4040a1c42c13fe03cd70)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:22.831008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.831355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.832652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:22.832769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.846747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:22.848182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:22.861033 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2978/5933] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:22.873624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:22.882606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afae0e-1f01-4a6e-a508-cadc545e43dc service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:22.887497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:22.888162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:22.888633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:22.888923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] PATH_INFO: `/v3/projects/f41f41f65a5b4a43bc9adac90cea571b/users/afd6110a50da478ca84097726d1741ea/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:22.910043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41f41f65a5b4a43bc9adac90cea571b, user_id=afd6110a50da478ca84097726d1741ea, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:22.912858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:22.995206 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2979/5934] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:22 2022] PUT /identity/v3/projects/f41f41f65a5b4a43bc9adac90cea571b/users/afd6110a50da478ca84097726d1741ea/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:22.996704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:23.015241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b04ddcd83ca4040a1c42c13fe03cd70', 'request_id': 'req-d989f545-ebde-433a-9719-63a647e1ae7f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.031310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b04ddcd83ca4040a1c42c13fe03cd70', 'request_id': 'req-d989f545-ebde-433a-9719-63a647e1ae7f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.099770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f03472-e24e-46f6-bd64-b938d3c85436 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:23.120505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b04ddcd83ca4040a1c42c13fe03cd70', 'request_id': 'req-d989f545-ebde-433a-9719-63a647e1ae7f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.155902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] The token cache is being invalidate because project 7b04ddcd83ca4040a1c42c13fe03cd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:23.155902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.155902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d989f545-ebde-433a-9719-63a647e1ae7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.155902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2956/5935] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:22 2022] DELETE /identity/v3/projects/7b04ddcd83ca4040a1c42c13fe03cd70 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:23.155902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3affa7-1db4-4d84-a46d-dabac2002e4a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.156368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3affa7-1db4-4d84-a46d-dabac2002e4a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.156368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3affa7-1db4-4d84-a46d-dabac2002e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.207491 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:23.229516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ee3affa7-1db4-4d84-a46d-dabac2002e4a None None] MFA Rules not processed for user `afd6110a50da478ca84097726d1741ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:23.232375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee3affa7-1db4-4d84-a46d-dabac2002e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:23.237731 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:23.246176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c0da7-cd90-4705-a817-0a1716fd7e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:23.247389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c0da7-cd90-4705-a817-0a1716fd7e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.247910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c0da7-cd90-4705-a817-0a1716fd7e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.248388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c0da7-cd90-4705-a817-0a1716fd7e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.250308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c0da7-cd90-4705-a817-0a1716fd7e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:23.250984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c0da7-cd90-4705-a817-0a1716fd7e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:23.253386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c0da7-cd90-4705-a817-0a1716fd7e5a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:23.278169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2980/5936] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:23.284264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.286106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.286393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.327668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:23.328866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:23.341918 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2981/5937] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:23.343246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:23.344669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:23.357397 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2957/5938] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:23.362957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.363285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.363514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.364478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f855-5822-4911-aa19-f1f25183719f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:23.372329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:23.382236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.382236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.382236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.382236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:23.382236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:23.385152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:23.386373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:23.395714 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2958/5939] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:23.397220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:23.398556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:23.471508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee5d3e-6d90-4099-b2a1-f96bf4d2ac0a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:23.486352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:23.487513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.488173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.488862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.501797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:23.503780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:23.515552 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2982/5940] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:23 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:23.516529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:23.517697 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2959/5941] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:23.519311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:23.525032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:23.543660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078a3b4-ef9f-4df4-94ca-ef8a324e7a7a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:23.643970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc324b-2e68-48b6-b819-065688f32e03 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:23.650218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:23.653082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.653209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:23.653657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.654131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] PATH_INFO: `/v3/projects/484394ebe12c4d9286cc1dddc576a480` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.660263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=484394ebe12c4d9286cc1dddc576a480)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:23.669834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:23.670192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.670192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.670192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.673789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:23.674547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:23.679967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:23.714237 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2983/5942] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:23.715325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:23.737847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199c64f-0424-4272-aa5e-e6762265ba27 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:23.746087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:23.747122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:23.752929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:23.753352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:23.756084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:23.756406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:23.891847 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:23.901676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484394ebe12c4d9286cc1dddc576a480', 'request_id': 'req-edea8b38-fc3d-4096-9464-bb1a79afc6ba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.908810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484394ebe12c4d9286cc1dddc576a480', 'request_id': 'req-edea8b38-fc3d-4096-9464-bb1a79afc6ba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.976621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484394ebe12c4d9286cc1dddc576a480', 'request_id': 'req-edea8b38-fc3d-4096-9464-bb1a79afc6ba'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.984792 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2984/5943] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:23 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:23.985789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:23.988766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:23.994422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] The token cache is being invalidate because project 484394ebe12c4d9286cc1dddc576a480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:23.994731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:23.995763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:24.002017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2960/5944] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:23 2022] DELETE /identity/v3/projects/484394ebe12c4d9286cc1dddc576a480 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:24.002017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.003234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.022422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112ffa5-ff1e-4dfd-8ad9-5946d3da4ea4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.086742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8b38-fc3d-4096-9464-bb1a79afc6ba admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.093293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.094035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.094410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.094753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.095464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.097539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.151482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.152258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.152656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.152953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] PATH_INFO: `/v3/users/a9a8ec415bf24197b4a810a01275b0bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.154504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a8ec415bf24197b4a810a01275b0bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.156737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.187152 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2961/5945] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:23 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:24.187152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.189324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.292820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d067-b95d-4778-a27b-1136d3db6211 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.298642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f56f5-c77f-4c3e-a8fc-d2d2d9088b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.299278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f56f5-c77f-4c3e-a8fc-d2d2d9088b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.299724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f56f5-c77f-4c3e-a8fc-d2d2d9088b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.302796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f56f5-c77f-4c3e-a8fc-d2d2d9088b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.302796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f56f5-c77f-4c3e-a8fc-d2d2d9088b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.303052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f56f5-c77f-4c3e-a8fc-d2d2d9088b2a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.316457 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2962/5946] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:24.316457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dacf7-403e-4ac0-843c-b4a2850ee867 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.316457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dacf7-403e-4ac0-843c-b4a2850ee867 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.316457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dacf7-403e-4ac0-843c-b4a2850ee867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.336523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1f8dacf7-403e-4ac0-843c-b4a2850ee867 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:24.337763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1f8dacf7-403e-4ac0-843c-b4a2850ee867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.345845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2963/5947] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:24.347035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dacf7-403e-4ac0-843c-b4a2850ee867 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.360876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dacf7-403e-4ac0-843c-b4a2850ee867 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.366412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.368656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.368656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.368656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.368656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.370088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.372881 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:24.381231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a8ec415bf24197b4a810a01275b0bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:24.390288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a8ec415bf24197b4a810a01275b0bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:24.391756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a8ec415bf24197b4a810a01275b0bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:24.446065 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2964/5948] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:24 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:24.446065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.457591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295326c5-e639-45c1-8d2e-41aaa0b11bb6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.462334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a8ec415bf24197b4a810a01275b0bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:24.463203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a8ec415bf24197b4a810a01275b0bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:24.464470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe784f-3b4a-418e-9e66-12bfdd987786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.466659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe784f-3b4a-418e-9e66-12bfdd987786 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.466659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe784f-3b4a-418e-9e66-12bfdd987786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.466659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe784f-3b4a-418e-9e66-12bfdd987786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.470176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe784f-3b4a-418e-9e66-12bfdd987786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.471922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe784f-3b4a-418e-9e66-12bfdd987786 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.486324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2965/5949] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:24.487366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.487615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.494793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.508911 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2985/5950] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:23 2022] DELETE /identity/v3/users/a9a8ec415bf24197b4a810a01275b0bc => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:24.510227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.511689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.512935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:24.514392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.528312 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:24.608898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc62a-594e-4e03-b82e-a3c431e33d09 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.609848 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2966/5951] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:24.611092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.612659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.618527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922407c-9927-44b7-b2f5-6dd306413ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.619446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922407c-9927-44b7-b2f5-6dd306413ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.620164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922407c-9927-44b7-b2f5-6dd306413ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.620721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922407c-9927-44b7-b2f5-6dd306413ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.621569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922407c-9927-44b7-b2f5-6dd306413ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.624589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922407c-9927-44b7-b2f5-6dd306413ec7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.626816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9eb6-c116-48b8-a371-a3cb971daf74 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.637383 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2986/5952] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:24.638996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.642656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c79e2c-3206-4754-80f6-f6800677f9e2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.642656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c79e2c-3206-4754-80f6-f6800677f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.642870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.642960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c79e2c-3206-4754-80f6-f6800677f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.643045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.643045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] PATH_INFO: `/v3/projects/4129df7aec53473595ea1b12c47e8ed7/users/609336ab3179468394ba50768e69551a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.673531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4129df7aec53473595ea1b12c47e8ed7, user_id=609336ab3179468394ba50768e69551a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.682776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.699358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-97c79e2c-3206-4754-80f6-f6800677f9e2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:24.701376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-97c79e2c-3206-4754-80f6-f6800677f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.727541 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2987/5953] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:24.728648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c79e2c-3206-4754-80f6-f6800677f9e2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.741770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c79e2c-3206-4754-80f6-f6800677f9e2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.747298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.748010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.755019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.755019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.755019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:24.755019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.755019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.755460 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2967/5954] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:24 2022] PUT /identity/v3/projects/4129df7aec53473595ea1b12c47e8ed7/users/609336ab3179468394ba50768e69551a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:24.755460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.768898 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2988/5955] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:24.769515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:24.772483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.842012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981940db-6182-4da1-bfd8-3b1e399bd339 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.856471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da62c94-80fb-44fa-b0dd-bd75de4db035 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:24.856895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6e964-aae9-4556-b3c4-1415712edf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.860006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6e964-aae9-4556-b3c4-1415712edf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.860497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6e964-aae9-4556-b3c4-1415712edf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.861813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6e964-aae9-4556-b3c4-1415712edf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.863021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6e964-aae9-4556-b3c4-1415712edf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.867055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6e964-aae9-4556-b3c4-1415712edf77 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.899830 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2968/5956] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:24.901439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b84865-dad9-49ef-a4c9-80f60b6e7336 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.902014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b84865-dad9-49ef-a4c9-80f60b6e7336 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.902305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b84865-dad9-49ef-a4c9-80f60b6e7336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.942358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-29b84865-dad9-49ef-a4c9-80f60b6e7336 None None] MFA Rules not processed for user `609336ab3179468394ba50768e69551a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:24.944386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-29b84865-dad9-49ef-a4c9-80f60b6e7336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:24.945711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:24.950335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:24.950335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:24.950335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:24.964627 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:24.975771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:24.976593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:24.988790 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2989/5957] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:24.990325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.000753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9672ef-b2a5-4715-837e-ea16cdceb45f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.007945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.009543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.009543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.009543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.010272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.012466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.043535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2969/5958] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:25.046179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b84865-dad9-49ef-a4c9-80f60b6e7336 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.055995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b84865-dad9-49ef-a4c9-80f60b6e7336 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.061751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.062944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.065012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.065012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] PATH_INFO: `/v3/projects/8938f55c10ed4be9b681c0ee688e12f1/users/ea76135df3144f53a07b5d821f7ead54/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.080186 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:25.084044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8938f55c10ed4be9b681c0ee688e12f1, user_id=ea76135df3144f53a07b5d821f7ead54, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.086940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.098433 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2990/5959] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:24 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:25.098433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.165385 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2970/5960] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:25 2022] PUT /identity/v3/projects/8938f55c10ed4be9b681c0ee688e12f1/users/ea76135df3144f53a07b5d821f7ead54/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:25.166833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.205564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33717c8-3d74-4dba-8bf8-b358013c8da9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.277125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770dff-a998-4823-9f37-18a39ee8ac1d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.282599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.283644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.284169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.284450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.285110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.288102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.302151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f2171-2247-4c44-b047-563d934137de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.302874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f2171-2247-4c44-b047-563d934137de admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.303192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f2171-2247-4c44-b047-563d934137de admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.303459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f2171-2247-4c44-b047-563d934137de admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.304161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f2171-2247-4c44-b047-563d934137de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.306299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f2171-2247-4c44-b047-563d934137de admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.414099 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2991/5961] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:25.416962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9ac65-f8ba-4e67-b836-f9a5c849ce03 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.417248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9ac65-f8ba-4e67-b836-f9a5c849ce03 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.417523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9ac65-f8ba-4e67-b836-f9a5c849ce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.420668 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2971/5962] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:25 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:25.423000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.446558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442a2b-8a07-4295-8486-dabe861e6957 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.452205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1bc9ac65-f8ba-4e67-b836-f9a5c849ce03 None None] MFA Rules not processed for user `ea76135df3144f53a07b5d821f7ead54`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:25.453955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1bc9ac65-f8ba-4e67-b836-f9a5c849ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:25.540530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.541912 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:25.542094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.542371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.542645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.543290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.546019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.556512 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2992/5963] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:25.558887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9ac65-f8ba-4e67-b836-f9a5c849ce03 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.580101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9ac65-f8ba-4e67-b836-f9a5c849ce03 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.586417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.587038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.587316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.587591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.588239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.589887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.602197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2993/5964] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:25.605512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.613425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a9b9-c516-4ecd-92f4-a21359de2ed3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.619113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.619727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.620007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.620278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.620907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.622892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.651130 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2972/5965] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:25 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:25.652345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.664488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2967b-f452-411b-8ad8-260a26d3ffca admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.669300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.669902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.670219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.670873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.673913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.673913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.689393 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2973/5966] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:25.689393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.700328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd1681-bb3b-4ee6-b368-556822acbd85 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.705394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.706374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.706660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.706926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.707564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.710047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.725070 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2994/5967] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:25 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:25.727855 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2974/5968] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:25.728973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.729795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.737714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:25.756332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb9da-3853-42e6-97f5-6589fefe209d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.818941 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:25.819211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c841d-73ec-4e49-9838-34e12ff9f92f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:25.825523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.826460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.827007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.827007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] PATH_INFO: `/v3/projects/abe8371fc27f48158e075210b1eeebab/users/6a8b44ca69b0465abbffb424c302d084/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.832665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:25.834308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:25.836772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:25.836772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] PATH_INFO: `/v3/projects/112627260b9e4c61b435408a05290ef4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:25.836772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112627260b9e4c61b435408a05290ef4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.838222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.852041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe8371fc27f48158e075210b1eeebab, user_id=6a8b44ca69b0465abbffb424c302d084, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:25.857542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:25.945827 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2995/5969] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:25 2022] PUT /identity/v3/projects/abe8371fc27f48158e075210b1eeebab/users/6a8b44ca69b0465abbffb424c302d084/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:25.946934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:25.970128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112627260b9e4c61b435408a05290ef4', 'request_id': 'req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:25.980675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112627260b9e4c61b435408a05290ef4', 'request_id': 'req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:26.028816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05766-75dc-43a5-95d6-5771a072ad18 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.062047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112627260b9e4c61b435408a05290ef4', 'request_id': 'req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:26.075864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] The token cache is being invalidate because project 112627260b9e4c61b435408a05290ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:26.076146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:26.078082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:26.082138 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2975/5970] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:25 2022] DELETE /identity/v3/projects/112627260b9e4c61b435408a05290ef4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:26.087043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.088622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:26.098019 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:26.103194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0b0db-a505-4a8f-a0a5-5c64cde745dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.103846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0b0db-a505-4a8f-a0a5-5c64cde745dd admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.104124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0b0db-a505-4a8f-a0a5-5c64cde745dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.104402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0b0db-a505-4a8f-a0a5-5c64cde745dd admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.105029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0b0db-a505-4a8f-a0a5-5c64cde745dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.107015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0b0db-a505-4a8f-a0a5-5c64cde745dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.175476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd580e9-ff9f-4f7c-9e8f-fbe7446c25a2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.184187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718e464-c4c2-4a3b-b154-fcbe955b7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.185989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e464-c4c2-4a3b-b154-fcbe955b7817 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.186887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e464-c4c2-4a3b-b154-fcbe955b7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.187001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e464-c4c2-4a3b-b154-fcbe955b7817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.188119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718e464-c4c2-4a3b-b154-fcbe955b7817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.190446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718e464-c4c2-4a3b-b154-fcbe955b7817 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.200657 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2996/5971] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:25 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:26.200657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c694e-8919-4930-afef-e8013391d3a0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.200657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c694e-8919-4930-afef-e8013391d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.200657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c694e-8919-4930-afef-e8013391d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.232381 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2976/5972] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:26.232381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.232381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.232381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.245678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9b9c694e-8919-4930-afef-e8013391d3a0 None None] MFA Rules not processed for user `6a8b44ca69b0465abbffb424c302d084`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:26.246640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9b9c694e-8919-4930-afef-e8013391d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:26.259545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:26.261069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:26.274352 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2977/5973] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:26.275659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.277121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:26.291131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ffa47-a25d-424c-a9df-94d279f322c7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.301861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.302664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.303148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.303560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.304208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.308035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.322525 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2978/5974] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:26.326804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.330976 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2997/5975] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:26.332768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fde07-67e5-4c24-984c-670bbcac27a1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.333383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fde07-67e5-4c24-984c-670bbcac27a1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.334581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fde07-67e5-4c24-984c-670bbcac27a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.341446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaea6f-3ea1-4a2b-a98a-7a4a4be473f5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.359666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.360503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.360776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.360886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d55fde07-67e5-4c24-984c-670bbcac27a1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:26.361049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] PATH_INFO: `/v3/projects/9172167513b1499aa4e66a933abeadd1/users/df2ff32ea43948158f9484aca3f5b653/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.364328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d55fde07-67e5-4c24-984c-670bbcac27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:26.381467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9172167513b1499aa4e66a933abeadd1, user_id=df2ff32ea43948158f9484aca3f5b653, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.384620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.388650 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2998/5976] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:26.392295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fde07-67e5-4c24-984c-670bbcac27a1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.402582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fde07-67e5-4c24-984c-670bbcac27a1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.411941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.412095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.412319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.412590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] PATH_INFO: `/v3/projects/93a0418f57e342b88ea7bbfbc1838465/users/490d036707c54ee684a58f842b5734a9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.431217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a0418f57e342b88ea7bbfbc1838465, user_id=490d036707c54ee684a58f842b5734a9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.433998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.480398 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2979/5977] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:26 2022] PUT /identity/v3/projects/9172167513b1499aa4e66a933abeadd1/users/df2ff32ea43948158f9484aca3f5b653/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:26.481810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.483492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:26.508093 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 2999/5978] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:26 2022] PUT /identity/v3/projects/93a0418f57e342b88ea7bbfbc1838465/users/490d036707c54ee684a58f842b5734a9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:26.509666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.587249 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:26.619431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ba26a-275f-4837-a039-f8efbe851b05 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.640668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d1c5a-42f1-401e-b356-d6dcdb1d8453 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.646960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.649345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.650274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.654588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.661273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:26.661273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.661273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.694486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3000/5979] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:26.697453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.721430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2aad7-9627-48f9-95e0-d5b47c6aadc6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.727866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6379d-5593-45c5-a408-a4f716d7826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.728486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6379d-5593-45c5-a408-a4f716d7826c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.728812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6379d-5593-45c5-a408-a4f716d7826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.729137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6379d-5593-45c5-a408-a4f716d7826c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.730072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6379d-5593-45c5-a408-a4f716d7826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.732497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6379d-5593-45c5-a408-a4f716d7826c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.754810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.755512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.768701 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3001/5980] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:26.768701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3202c-5d8c-43e8-a6b1-eca68c6b87ab None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.769134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3202c-5d8c-43e8-a6b1-eca68c6b87ab None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.770353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3202c-5d8c-43e8-a6b1-eca68c6b87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.778398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.779241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.857934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-97a3202c-5d8c-43e8-a6b1-eca68c6b87ab None None] MFA Rules not processed for user `df2ff32ea43948158f9484aca3f5b653`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:26.857934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-97a3202c-5d8c-43e8-a6b1-eca68c6b87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:26.874557 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:26.898530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.901624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.920964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2980/5981] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:26.933742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.947432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47b737-0b7b-4881-ba15-0016fb8c9ac5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:26.959307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d5691-1455-417a-8cae-7531863bb008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:26.959933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5691-1455-417a-8cae-7531863bb008 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:26.960204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5691-1455-417a-8cae-7531863bb008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:26.960476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5691-1455-417a-8cae-7531863bb008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:26.961117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d5691-1455-417a-8cae-7531863bb008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:26.963129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d5691-1455-417a-8cae-7531863bb008 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:26.980716 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3002/5982] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:26.982341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3202c-5d8c-43e8-a6b1-eca68c6b87ab None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:26.996176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3202c-5d8c-43e8-a6b1-eca68c6b87ab None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:27.001314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:27.002425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.002734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.003562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] PATH_INFO: `/v3/projects/93a0418f57e342b88ea7bbfbc1838465/users/490d036707c54ee684a58f842b5734a9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.005846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a0418f57e342b88ea7bbfbc1838465, user_id=490d036707c54ee684a58f842b5734a9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:27.008871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:27.021488 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3003/5983] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:26 2022] PUT /identity/v3/projects/93a0418f57e342b88ea7bbfbc1838465/users/490d036707c54ee684a58f842b5734a9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:27.022578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:27.024159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.098784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482330f-ffa9-4fb9-a7a6-0ea8e27686e2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:27.105649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:27.106487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.106793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.107166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] PATH_INFO: `/v3/users/6a8b44ca69b0465abbffb424c302d084` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.108500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8b44ca69b0465abbffb424c302d084)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:27.110507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:27.125141 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2981/5984] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:26 2022] POST /identity/v3/projects => generated 399 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:27.128700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161560c-b47c-4bdb-b98e-a27187fcd3bf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.129000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161560c-b47c-4bdb-b98e-a27187fcd3bf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.130269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161560c-b47c-4bdb-b98e-a27187fcd3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.185288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7161560c-b47c-4bdb-b98e-a27187fcd3bf None None] MFA Rules not processed for user `490d036707c54ee684a58f842b5734a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:27.186599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7161560c-b47c-4bdb-b98e-a27187fcd3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.265108 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2982/5985] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:27.265929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161560c-b47c-4bdb-b98e-a27187fcd3bf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:27.275463 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:27.332790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161560c-b47c-4bdb-b98e-a27187fcd3bf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:27.338837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:27.339479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.339759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.340033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.340663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:27.342619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:27.370010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8b44ca69b0465abbffb424c302d084'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:27.384417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8b44ca69b0465abbffb424c302d084'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:27.386544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8b44ca69b0465abbffb424c302d084'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:27.485640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8b44ca69b0465abbffb424c302d084'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:27.487925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8b44ca69b0465abbffb424c302d084'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:27.495643 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2983/5986] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:27 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:27.499535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:27.502075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.521505 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3004/5987] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:27 2022] DELETE /identity/v3/users/6a8b44ca69b0465abbffb424c302d084 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:27.522518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:27.530555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.572468 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:27.635622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a019c-a003-4cd6-b98e-4fecce4822a6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:27.653891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180bdc5-483d-49f9-a7d7-6ffbd91a5c23 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:27.664370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:27.670072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.670072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.670072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.670072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:27.670072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:27.725623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190a98-dd2c-4a3e-a0a3-b55b55f0742e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:27.726270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190a98-dd2c-4a3e-a0a3-b55b55f0742e service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.726585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190a98-dd2c-4a3e-a0a3-b55b55f0742e service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.726835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190a98-dd2c-4a3e-a0a3-b55b55f0742e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.728542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c3190a98-dd2c-4a3e-a0a3-b55b55f0742e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.758148 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3005/5988] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:27 2022] POST /identity/v3/services => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:27.758148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:27.762014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.803995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190a98-dd2c-4a3e-a0a3-b55b55f0742e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:27.805444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190a98-dd2c-4a3e-a0a3-b55b55f0742e service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:27.817094 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2984/5989] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:27.819370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c079-98a3-4e87-a901-d811e687dec6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.819659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c079-98a3-4e87-a901-d811e687dec6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.820185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c079-98a3-4e87-a901-d811e687dec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.835225 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:27.844666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5834c079-98a3-4e87-a901-d811e687dec6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:27.846267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5834c079-98a3-4e87-a901-d811e687dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.864001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192be51-c51f-42b3-a99f-a47486646a38 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:27.870184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:27.870942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.871327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.871698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.872449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:27.873540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2985/5990] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:27.875177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:27.875555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.875994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.876433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.888331 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3006/5991] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:27.889194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:27.902958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:27.903998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:27.912298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea813b-7622-463f-9dc1-f7e2148c80da admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:27.917362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:27.917993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:27.918277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:27.918547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:27.919201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:27.920213 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:27.920213 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:38:27.920213 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:38:27.921086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:27.971354 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2986/5992] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3328 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:27.972224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:27.973551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:28.059111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc45c5e-b707-4d3c-962e-1e1456b7a01a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:28.062795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:28.063399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:28.063673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:28.063940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:28.074096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:28.075536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:28.085332 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2987/5993] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:28.085932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:28.095377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eac61-5abc-4319-997b-e2e2801e670d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:28.101024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:28.102030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:28.102030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:28.102212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:28.102846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:28.104647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:28.115836 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2988/5994] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:28.120087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:28.130909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a90ae3-fa7c-4e36-8caf-308c64ba1601 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:28.136308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:28.136971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:28.137245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:28.137571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] PATH_INFO: `/v3/projects/0d872573354747cd8473248d530ed5b5/users/cf39b21f09de4e10acce3b9501eb2af0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:28.152814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d872573354747cd8473248d530ed5b5, user_id=cf39b21f09de4e10acce3b9501eb2af0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:28.155544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: 'False' Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise error Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'False' Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.252390 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:38:28.256361 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'False' Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.257534 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3007/5995] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:38:27 2022] POST /identity/v3/endpoints => generated 283 bytes in 366 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 23 01:38:28.259895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:28.271606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4146f-69d4-4ab5-9212-e154f4d44611 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:28.276774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:28.277512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:28.277746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:28.278108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:28.278895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:28.280598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: 'True' Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise error Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'True' Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.287687 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:38:28.289203 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'True' Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:28.290432 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3008/5996] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:38:28 2022] POST /identity/v3/endpoints => generated 281 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 23 01:38:28.294206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:28.305548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97e73a-9162-460b-9ec8-0aac7da7f3e0 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:28.310081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953abbc-9473-4774-863c-355300c13ad6 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:28.310754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953abbc-9473-4774-863c-355300c13ad6 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:28.311058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953abbc-9473-4774-863c-355300c13ad6 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:28.311348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953abbc-9473-4774-863c-355300c13ad6 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:28.312057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953abbc-9473-4774-863c-355300c13ad6 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:28.313626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953abbc-9473-4774-863c-355300c13ad6 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:28.644683 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-1953abbc-9473-4774-863c-355300c13ad6 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2052011890. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:38:28.644683 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:38:28.644683 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:38:28.651869 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2989/5997] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:28 2022] PUT /identity/v3/projects/0d872573354747cd8473248d530ed5b5/users/cf39b21f09de4e10acce3b9501eb2af0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:28.652846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:28.654742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:28.756804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbee848-8f8a-42bc-89c0-f582d02efe27 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:28.781361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:28.782328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:28.782610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:28.783641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:28.821382 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3009/5998] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:38:28 2022] POST /identity/v3/endpoints => generated 361 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:38:28.823533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8bde-92ac-4c77-b3c0-7c7865096635 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:28.825225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8bde-92ac-4c77-b3c0-7c7865096635 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:28.826139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8bde-92ac-4c77-b3c0-7c7865096635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:28.866927 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:28.876085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7e6e8bde-92ac-4c77-b3c0-7c7865096635 None None] MFA Rules not processed for user `cf39b21f09de4e10acce3b9501eb2af0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:28.877526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e6e8bde-92ac-4c77-b3c0-7c7865096635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:28.883901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:28.885691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:28.907559 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2990/5999] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:38:28.908637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:28.932856 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:29.004624 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3010/6000] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:28 2022] POST /identity/v3/auth/tokens => generated 3592 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:29.006402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8bde-92ac-4c77-b3c0-7c7865096635 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:29.103844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4577ce-5bfa-4151-a469-af22ca7e47d3 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:29.153842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:29.155004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:29.155409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:29.155809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/regions/tempest-region-2052011890` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:29.156512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2052011890)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:29.157850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:29.163746 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2991/6001] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:38:28 2022] GET /identity/v3/regions/tempest-region-2052011890 => generated 180 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:29.163746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:29.165261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:29.192254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8bde-92ac-4c77-b3c0-7c7865096635 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:29.197811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:29.198465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:29.198745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:29.199016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:29.203822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:29.277481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14886276-7041-4b13-9ed8-bee06aef02bf tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:29.282210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:29.282858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:29.285025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:29.285319 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:29.285679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:29.286180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:29.288023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:29.296308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:29.298039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:29.320679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2992/6003] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:29 2022] GET /identity/v3/auth/tokens => generated 3592 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:29.321627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:29.323969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:29.332926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3011/6003] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:29 2022] GET /identity/v3/auth/tokens => generated 3576 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:29.335802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:29.361512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c94dc-8af9-48cc-8074-ec2cd4b60c6d service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:29.369552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:29.371626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:29.371626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:29.372189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints/c8f4b9d5189c46dabebf0a6c0a15645e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:29.386640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=c8f4b9d5189c46dabebf0a6c0a15645e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:29.387781 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:29.387781 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:38:29.387781 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:38:29.388714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: 'False' Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise error Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'False' Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:29.407297 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:38:29.409556 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'False' Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:29.410513 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3012/6004] 10.222.0.42 () {60 vars in 1255 bytes} [Sun Oct 23 01:38:29 2022] PATCH /identity/v3/endpoints/c8f4b9d5189c46dabebf0a6c0a15645e => generated 283 bytes in 75 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 23 01:38:29.416375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:29.458128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76908e-6471-437c-be36-64f66da3c5c3 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:29.466397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:29.466397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:29.466397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:29.466650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints/c8f4b9d5189c46dabebf0a6c0a15645e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:29.478927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c8f4b9d5189c46dabebf0a6c0a15645e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:29.479955 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:29.479955 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:38:29.479955 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:38:29.480982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:29.501100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fe6a4-c6da-4a01-9b37-2c5563a1dd25 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:29.509566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:29.510356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:29.510613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:29.510895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] PATH_INFO: `/v3/projects/abe8371fc27f48158e075210b1eeebab` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:29.513263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe8371fc27f48158e075210b1eeebab)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:29.515367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:29.663957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c8f4b9d5189c46dabebf0a6c0a15645e', 'request_id': 'req-aa75594a-5f8f-408b-b4ed-b859ae573fd9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:29.708631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe8371fc27f48158e075210b1eeebab', 'request_id': 'req-9ed240a5-7eae-4863-a439-d3fdecd3c16c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:29.725816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe8371fc27f48158e075210b1eeebab', 'request_id': 'req-9ed240a5-7eae-4863-a439-d3fdecd3c16c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:29.734332 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3013/6005] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:29 2022] DELETE /identity/v3/endpoints/c8f4b9d5189c46dabebf0a6c0a15645e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:29.743286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:29.837373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75594a-5f8f-408b-b4ed-b859ae573fd9 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:29.857505 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:29.878835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe8371fc27f48158e075210b1eeebab', 'request_id': 'req-9ed240a5-7eae-4863-a439-d3fdecd3c16c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:29.894031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] The token cache is being invalidate because project abe8371fc27f48158e075210b1eeebab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:29.894322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:29.896661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9ed240a5-7eae-4863-a439-d3fdecd3c16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:29.898718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2993/6006] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:29 2022] DELETE /identity/v3/projects/abe8371fc27f48158e075210b1eeebab => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:29.905338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8320d34-c14c-460b-b9d9-22042b3ac8fb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:29.906261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8320d34-c14c-460b-b9d9-22042b3ac8fb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:29.906261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8320d34-c14c-460b-b9d9-22042b3ac8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:29.980430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a8320d34-c14c-460b-b9d9-22042b3ac8fb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:29.983263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a8320d34-c14c-460b-b9d9-22042b3ac8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:30.001074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.001736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.002044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.002325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/regions/tempest-region-2052011890` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.007542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2052011890)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.013787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.129023 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3014/6007] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:38:29 2022] DELETE /identity/v3/regions/tempest-region-2052011890 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:30.133445 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:30.137863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.140512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:30.167666 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2994/6008] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:30.175231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f10a4-56e9-48a2-b17d-c78976f9a64d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.175671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f10a4-56e9-48a2-b17d-c78976f9a64d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.175948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f10a4-56e9-48a2-b17d-c78976f9a64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.261827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617058-e3be-484f-a342-f623ec09a592 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.267701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-513f10a4-56e9-48a2-b17d-c78976f9a64d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:30.269010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.269631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.269964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-513f10a4-56e9-48a2-b17d-c78976f9a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:30.270188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.277509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.278446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.281960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.329993 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2995/6009] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:30.334368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f10a4-56e9-48a2-b17d-c78976f9a64d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.353344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f10a4-56e9-48a2-b17d-c78976f9a64d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.368957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.371079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.372499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.372932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.373936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:30.374429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.376873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.399486 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2100611346. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:38:30.399486 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:38:30.399486 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:38:30.414492 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2996/6010] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:38:30.417064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.435195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612afcd5-a8fd-4503-89ce-627bac1ebe43 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.466417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.472766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.472766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.472766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.472766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.473343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.520472 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3015/6011] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:38:30 2022] POST /identity/v3/endpoints => generated 360 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:30.526471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.573843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9a92-a59c-4dc3-9bd5-66d8724a8c10 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.580428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.581085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.581792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.581792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/regions/tempest-region-2100611346` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.582328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2100611346)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.583487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.586017 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3016/6012] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:38:30 2022] GET /identity/v3/regions/tempest-region-2100611346 => generated 180 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:30.590564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.601139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31a8e-9a24-4cfa-960a-30e2f33f5dc5 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.607234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.607871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.608152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.608500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints/489c267bf4984ed89b3faf58a0ef32b8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.616290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=489c267bf4984ed89b3faf58a0ef32b8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.618156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: On instance['enabled']: Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: 'True' Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise error Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'True' Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:30.626595 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 23 01:38:30.636202 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application On instance['enabled']: Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application 'True' Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:38:30.637554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3017/6013] 10.222.0.42 () {60 vars in 1255 bytes} [Sun Oct 23 01:38:30 2022] PATCH /identity/v3/endpoints/489c267bf4984ed89b3faf58a0ef32b8 => generated 281 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 23 01:38:30.639044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.653429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e2ed-eb40-4540-a7e4-40b81980f165 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.672872 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2997/6014] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:30 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:30.672996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.681138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.686660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.686921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.687201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/endpoints/489c267bf4984ed89b3faf58a0ef32b8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.689491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=489c267bf4984ed89b3faf58a0ef32b8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.691143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.777547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcdb6a-48fe-4820-a2df-be1d40c8fa62 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.796007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.796627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.797166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.797439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.798098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.800388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.805948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '489c267bf4984ed89b3faf58a0ef32b8', 'request_id': 'req-d13de91e-c352-4d45-b878-575ee38e9842'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:30.824835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3018/6015] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:38:30 2022] DELETE /identity/v3/endpoints/489c267bf4984ed89b3faf58a0ef32b8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:30.831944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:30.832526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:30.867543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de91e-c352-4d45-b878-575ee38e9842 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:30.883490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:30.884241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:30.884610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:30.884959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] PATH_INFO: `/v3/users/609336ab3179468394ba50768e69551a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:30.886311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609336ab3179468394ba50768e69551a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:30.888352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:30.948745 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2998/6016] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:30 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:30.949799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:31.142116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609336ab3179468394ba50768e69551a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:31.144900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6219-0e02-42ba-ab1f-a8c3cd5b1997 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:31.147753 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:31.151575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609336ab3179468394ba50768e69551a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:31.152286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609336ab3179468394ba50768e69551a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:31.172261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:31.172985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:31.173205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:31.173480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/regions/tempest-region-2100611346` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:31.174164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2100611346)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:31.176110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:31.184159 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:31.239281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609336ab3179468394ba50768e69551a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:31.241023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609336ab3179468394ba50768e69551a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:31.262348 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2100611346. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:38:31.262348 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:38:31.262348 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:38:31.282399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 2999/6017] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:38:30 2022] DELETE /identity/v3/regions/tempest-region-2100611346 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:31.293495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:31.302790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:31.359351 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3019/6018] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:30 2022] DELETE /identity/v3/users/609336ab3179468394ba50768e69551a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:31.360269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:31.362672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:31.406709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de9943-0cac-4374-9916-28c5ea5b7e18 tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:31.560220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbfcaa-a3bb-45da-83d4-ffbbcc368a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:31.560645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1a16f-5581-4c2d-8d74-a3f987918330 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:31.560911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbfcaa-a3bb-45da-83d4-ffbbcc368a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:31.561195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbfcaa-a3bb-45da-83d4-ffbbcc368a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:31.561468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbfcaa-a3bb-45da-83d4-ffbbcc368a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:31.562721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbfcaa-a3bb-45da-83d4-ffbbcc368a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:31.564565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbfcaa-a3bb-45da-83d4-ffbbcc368a45 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:31.585339 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3000/6019] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:31.591242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755def5-4a5b-4792-a430-f92380d18dce None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:31.591596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755def5-4a5b-4792-a430-f92380d18dce None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:31.591983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755def5-4a5b-4792-a430-f92380d18dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:31.635131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490d036707c54ee684a58f842b5734a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a0418f57e342b88ea7bbfbc1838465', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:31.635805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:31.639307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:31.654695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] PATH_INFO: `/v3/services/4463cc1aff2c430895878645ba3cdd54` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:31.654695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4463cc1aff2c430895878645ba3cdd54)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:31.654695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:31.669830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b755def5-4a5b-4792-a430-f92380d18dce None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:31.675093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b755def5-4a5b-4792-a430-f92380d18dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:31.706728 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3001/6020] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:31.707814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755def5-4a5b-4792-a430-f92380d18dce None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:31.733559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755def5-4a5b-4792-a430-f92380d18dce None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:31.758174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:31.758876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:31.759162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:31.759440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:31.760100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:31.761804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:31.792389 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3002/6021] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:31.794112 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3020/6022] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:31 2022] DELETE /identity/v3/services/4463cc1aff2c430895878645ba3cdd54 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:31.797822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:31.799548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:31.801464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:31.840428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d70ef5-e5e8-4c5b-be0f-b1c011f9a2ec tempest-EndpointsNegativeTestJSON-697475513 tempest-EndpointsNegativeTestJSON-697475513-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:31.846859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d2def-d96d-42a5-80d6-e96b5208171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:31.851637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2def-d96d-42a5-80d6-e96b5208171a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:31.851637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2def-d96d-42a5-80d6-e96b5208171a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:31.851637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2def-d96d-42a5-80d6-e96b5208171a admin admin] PATH_INFO: `/v3/projects/010a6123180d463a9514c7b9e888c638/users/5c81c71bd6b44505a06ad897f3ab3d08/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:31.908126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d2def-d96d-42a5-80d6-e96b5208171a admin admin] RBAC: Authorizing `identity:create_grant(project_id=010a6123180d463a9514c7b9e888c638, user_id=5c81c71bd6b44505a06ad897f3ab3d08, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:31.911006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d2def-d96d-42a5-80d6-e96b5208171a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:31.955343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d389-9bcf-41c2-81be-306c2fa86cc2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:31.974415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:31.975356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:31.976254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:31.976254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:31.989959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:31.991633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:32.017991 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3003/6023] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:32.019110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:32.023515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:32.041114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365159c-5438-453e-8953-a97a01e7d1ec service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:32.064219 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3021/6024] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:31 2022] PUT /identity/v3/projects/010a6123180d463a9514c7b9e888c638/users/5c81c71bd6b44505a06ad897f3ab3d08/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:32.065465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:32.066503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:32.067077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:32.068397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] PATH_INFO: `/v3/users/ea76135df3144f53a07b5d821f7ead54` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:32.070370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea76135df3144f53a07b5d821f7ead54)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:32.072706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:32.076611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbdb0-ef3a-41eb-adff-6f18a10a32a4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:32.077114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbdb0-ef3a-41eb-adff-6f18a10a32a4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:32.077732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbdb0-ef3a-41eb-adff-6f18a10a32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:32.155805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-716cbdb0-ef3a-41eb-adff-6f18a10a32a4 None None] MFA Rules not processed for user `5c81c71bd6b44505a06ad897f3ab3d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:32.157032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-716cbdb0-ef3a-41eb-adff-6f18a10a32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:32.234496 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:32.289624 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:32.298520 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3022/6025] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:38:32.304271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbdb0-ef3a-41eb-adff-6f18a10a32a4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:32.399581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea76135df3144f53a07b5d821f7ead54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:32.443191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea76135df3144f53a07b5d821f7ead54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:32.443962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea76135df3144f53a07b5d821f7ead54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:32.553430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea76135df3144f53a07b5d821f7ead54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:32.554089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a5575629-5d0f-4cfb-a633-83e48c923bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea76135df3144f53a07b5d821f7ead54'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:32.589823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbdb0-ef3a-41eb-adff-6f18a10a32a4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:32.602738 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3004/6026] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:32 2022] DELETE /identity/v3/users/ea76135df3144f53a07b5d821f7ead54 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:32.603586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:32.603586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:32.603586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:32.603586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:32.603950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:32.605822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:32.608613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:32.615045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:32.615045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:32.673097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:32.677706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:32.788131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3005/6027] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:32.795679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:32.797618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:32.807681 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3023/6028] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:32 2022] POST /identity/v3/projects => generated 381 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:38:32.812260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:32.815014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:32.957584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493b758-ea52-4ec8-9f19-7b413115bc42 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.042922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fe309-2bc2-404a-9a11-86a266918d40 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.070932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.071865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.072319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.074710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.076039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.095623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.126716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.127354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.138045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.138045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.143803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.146352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.161784 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3006/6029] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:38:33.167139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:33.169071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:33.181413 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:33.187369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5901853-4e95-42ce-a031-8238f8bc90c2 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.198369 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3024/6030] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:32 2022] POST /identity/v3/users => generated 297 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:33.201772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.202564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.203264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:33.203403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.203764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] PATH_INFO: `/v3/projects/4129df7aec53473595ea1b12c47e8ed7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.210406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4129df7aec53473595ea1b12c47e8ed7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.215021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.240038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb2563-a9ec-4158-9a19-1d8c9923ed7a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.251107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.252389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.255587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.256218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.256759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.258492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.293865 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3025/6031] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:33.304507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:33.335902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51631f-06e1-4723-8966-20194fd2d745 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.345538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.353640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.355069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.355803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] PATH_INFO: `/v3/projects/bd85a6d313b1437b8d3923b019c44550/users/841c1377934f4c25a065935f2ad36d38/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.389287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd85a6d313b1437b8d3923b019c44550, user_id=841c1377934f4c25a065935f2ad36d38, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.390962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.393926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4129df7aec53473595ea1b12c47e8ed7', 'request_id': 'req-f820ec81-fdfd-42a1-b7bd-82c8b944e573'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:33.400958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4129df7aec53473595ea1b12c47e8ed7', 'request_id': 'req-f820ec81-fdfd-42a1-b7bd-82c8b944e573'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:33.475874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4129df7aec53473595ea1b12c47e8ed7', 'request_id': 'req-f820ec81-fdfd-42a1-b7bd-82c8b944e573'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:33.491002 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3026/6032] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:33 2022] PUT /identity/v3/projects/bd85a6d313b1437b8d3923b019c44550/users/841c1377934f4c25a065935f2ad36d38/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:33.494632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:33.523902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] The token cache is being invalidate because project 4129df7aec53473595ea1b12c47e8ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:33.525397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:33.526488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:33.529901 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3007/6033] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:33 2022] DELETE /identity/v3/projects/4129df7aec53473595ea1b12c47e8ed7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:33.534063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:33.535683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:33.603198 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:33.666915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb28e46-4d69-47b7-88d7-f3dd0fac7871 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.672877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.673537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.673791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.674093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.674750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.676508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.703435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820ec81-fdfd-42a1-b7bd-82c8b944e573 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.710178 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3027/6034] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:33.712075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:33.717736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:33.719654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.720399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.720757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.721101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] PATH_INFO: `/v3/users/df2ff32ea43948158f9484aca3f5b653` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.724063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2ff32ea43948158f9484aca3f5b653)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.727038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.736538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fd6df-82cc-4218-be08-81b730201343 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:33.742898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6062112-00b1-485d-b467-383f44886b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:33.743727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062112-00b1-485d-b467-383f44886b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.744458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062112-00b1-485d-b467-383f44886b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.745191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062112-00b1-485d-b467-383f44886b3e admin admin] PATH_INFO: `/v3/projects/bd85a6d313b1437b8d3923b019c44550/users/841c1377934f4c25a065935f2ad36d38/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.747625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6062112-00b1-485d-b467-383f44886b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd85a6d313b1437b8d3923b019c44550, user_id=841c1377934f4c25a065935f2ad36d38, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:33.750890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6062112-00b1-485d-b467-383f44886b3e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:33.771969 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3028/6035] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:33 2022] PUT /identity/v3/projects/bd85a6d313b1437b8d3923b019c44550/users/841c1377934f4c25a065935f2ad36d38/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:33.783766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:33.784160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:33.785292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:33.825786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] MFA Rules not processed for user `841c1377934f4c25a065935f2ad36d38`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:33.828368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:33.985375 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3029/6036] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:33.986349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:33.987877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:34.015044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2ff32ea43948158f9484aca3f5b653'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.041044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2ff32ea43948158f9484aca3f5b653'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.049628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2ff32ea43948158f9484aca3f5b653'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.135848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2ff32ea43948158f9484aca3f5b653'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.136621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2ff32ea43948158f9484aca3f5b653'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.145674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d456e-f02c-43ee-9c7e-03bf05e95897 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:34.163321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:34.174870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:34.176232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:34.178163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] PATH_INFO: `/v3/projects/8938f55c10ed4be9b681c0ee688e12f1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:34.182553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8938f55c10ed4be9b681c0ee688e12f1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:34.187151 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3008/6037] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:33 2022] DELETE /identity/v3/users/df2ff32ea43948158f9484aca3f5b653 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:34.189569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:34.199560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:34.205848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:34.231315 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:34.374948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf021990-d73e-45df-8207-5ddc8c0979fe admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:34.385440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8938f55c10ed4be9b681c0ee688e12f1', 'request_id': 'req-1301e197-0360-48bf-8ba6-91e697d4a8f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.387135 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:34.396104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8938f55c10ed4be9b681c0ee688e12f1', 'request_id': 'req-1301e197-0360-48bf-8ba6-91e697d4a8f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.447666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:34.449203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:34.449666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:34.450149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:34.452198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:34.472300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8938f55c10ed4be9b681c0ee688e12f1', 'request_id': 'req-1301e197-0360-48bf-8ba6-91e697d4a8f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.495944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] The token cache is being invalidate because project 8938f55c10ed4be9b681c0ee688e12f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:34.497054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.498304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:34.501072 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3030/6038] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:33 2022] DELETE /identity/v3/projects/8938f55c10ed4be9b681c0ee688e12f1 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:34.505434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:34.509736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:34.713290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e197-0360-48bf-8ba6-91e697d4a8f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:34.728044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:34.741877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:34.750170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:34.750561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] PATH_INFO: `/v3/users/490d036707c54ee684a58f842b5734a9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:34.757378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490d036707c54ee684a58f842b5734a9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:34.763749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:34.792951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:34.796222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:34.817253 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3009/6039] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:35.112982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:35.113675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:35.133784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab6291-d5c4-4b3f-bd5e-c76371fef949 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:35.143612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:35.143612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:35.143612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:35.143612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] PATH_INFO: `/v3/projects/9172167513b1499aa4e66a933abeadd1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:35.144681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9172167513b1499aa4e66a933abeadd1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:35.145922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:35.245529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490d036707c54ee684a58f842b5734a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.263806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490d036707c54ee684a58f842b5734a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.264606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490d036707c54ee684a58f842b5734a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.384955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9172167513b1499aa4e66a933abeadd1', 'request_id': 'req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.391362 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:35.392740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9172167513b1499aa4e66a933abeadd1', 'request_id': 'req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.428316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490d036707c54ee684a58f842b5734a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.428972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490d036707c54ee684a58f842b5734a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.461022 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3031/6040] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:34 2022] DELETE /identity/v3/users/490d036707c54ee684a58f842b5734a9 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:35.462228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:35.476271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:35.530102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9172167513b1499aa4e66a933abeadd1', 'request_id': 'req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.550392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] The token cache is being invalidate because project 9172167513b1499aa4e66a933abeadd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:35.550702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.552282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7043cd6d-0b03-41bd-9f50-6a6784fa5c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:35.562197 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3010/6041] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:35 2022] DELETE /identity/v3/projects/9172167513b1499aa4e66a933abeadd1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:35.568175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9792a7-e13e-4719-a6ca-c4a9e39db505 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:35.568175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9792a7-e13e-4719-a6ca-c4a9e39db505 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:35.568175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9792a7-e13e-4719-a6ca-c4a9e39db505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:35.576620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852d7ae-5348-4aaf-ab95-cb861669e886 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:35.592007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2430d-5933-45cc-9608-3c49298046bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:35.593815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2430d-5933-45cc-9608-3c49298046bf service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:35.593815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2430d-5933-45cc-9608-3c49298046bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:35.593815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2430d-5933-45cc-9608-3c49298046bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:35.605801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e4b2430d-5933-45cc-9608-3c49298046bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:35.639684 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:35.662565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9d9792a7-e13e-4719-a6ca-c4a9e39db505 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:35.663822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9d9792a7-e13e-4719-a6ca-c4a9e39db505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:35.896174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2430d-5933-45cc-9608-3c49298046bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:35.911661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2430d-5933-45cc-9608-3c49298046bf service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:35.977309 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3032/6042] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:36.006132 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3011/6043] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:36.014167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df7d0-06a0-449e-b3e8-4abf0e923663 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:36.014564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df7d0-06a0-449e-b3e8-4abf0e923663 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:36.014945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df7d0-06a0-449e-b3e8-4abf0e923663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:36.091824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-917df7d0-06a0-449e-b3e8-4abf0e923663 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:36.095275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-917df7d0-06a0-449e-b3e8-4abf0e923663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:36.119685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9792a7-e13e-4719-a6ca-c4a9e39db505 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:36.127145 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3033/6044] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:36.132724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9792a7-e13e-4719-a6ca-c4a9e39db505 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:36.139338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:36.140135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:36.140520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:36.140898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:36.141738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:36.142191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:36.143952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:36.165789 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3012/6045] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:36.170827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df7d0-06a0-449e-b3e8-4abf0e923663 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:36.209442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df7d0-06a0-449e-b3e8-4abf0e923663 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:36.220063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:36.223033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:36.224153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:36.227165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:36.232564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:36.243497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:36.379904 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3034/6046] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:36 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:36.382447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:36.396019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce6ab-2d3b-4b42-b675-10affcb18ade admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:36.539240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:36.541594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:36.566265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:36.568468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:36.568926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:36.571952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:36.572878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:36.575018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:36.675360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc737f18-2770-452c-8d79-8a66bf83331c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:36.705871 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3013/6047] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:36 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:36.706962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:36.707668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:36.709934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:36.712298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:36.713761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:36.717528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] PATH_INFO: `/v3/projects/93a0418f57e342b88ea7bbfbc1838465` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:36.719575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a0418f57e342b88ea7bbfbc1838465)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:36.725239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:36.738575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6e4d-0540-491b-89e9-053c6bbedfaa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:36.755534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:36.760260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:36.760623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:36.761005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] PATH_INFO: `/v3/users/5c81c71bd6b44505a06ad897f3ab3d08` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:36.778903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c81c71bd6b44505a06ad897f3ab3d08)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:36.783237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:36.919660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a0418f57e342b88ea7bbfbc1838465', 'request_id': 'req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:36.926529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a0418f57e342b88ea7bbfbc1838465', 'request_id': 'req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.005493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a0418f57e342b88ea7bbfbc1838465', 'request_id': 'req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.025005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] The token cache is being invalidate because project 93a0418f57e342b88ea7bbfbc1838465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:37.026361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.028470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.031359 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3035/6048] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:36 2022] DELETE /identity/v3/projects/93a0418f57e342b88ea7bbfbc1838465 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:37.038289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:37.038289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:37.038633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c81c71bd6b44505a06ad897f3ab3d08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.070361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c81c71bd6b44505a06ad897f3ab3d08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.074079 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:37.076334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c81c71bd6b44505a06ad897f3ab3d08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.079159 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:37.176805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c81c71bd6b44505a06ad897f3ab3d08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.177680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec294ca-69af-4ab1-b3dc-0a326e60fbc6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:37.177828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c81c71bd6b44505a06ad897f3ab3d08'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:37.185110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a73ab7-d4b9-416f-a7ff-e88366650b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:37.186697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a73ab7-d4b9-416f-a7ff-e88366650b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.186697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a73ab7-d4b9-416f-a7ff-e88366650b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.186697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a73ab7-d4b9-416f-a7ff-e88366650b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.187130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a73ab7-d4b9-416f-a7ff-e88366650b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:37.188745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a73ab7-d4b9-416f-a7ff-e88366650b2b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:37.210320 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3036/6050] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:37.211181 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3014/6050] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:36 2022] DELETE /identity/v3/users/5c81c71bd6b44505a06ad897f3ab3d08 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:37.212099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:37.212248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dfbe-fc63-44fe-b8e0-b8d09d059a79 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.213014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dfbe-fc63-44fe-b8e0-b8d09d059a79 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.213408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dfbe-fc63-44fe-b8e0-b8d09d059a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.213919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:37.245817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-20f7dfbe-fc63-44fe-b8e0-b8d09d059a79 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:37.247600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-20f7dfbe-fc63-44fe-b8e0-b8d09d059a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:37.348505 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3037/6051] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:37.353266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564576-71a4-4e04-a6c2-f6cd5a3a7ce0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:37.358882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c43f-8709-4fb7-ac0f-41216ee8865c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.359238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c43f-8709-4fb7-ac0f-41216ee8865c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.359718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c43f-8709-4fb7-ac0f-41216ee8865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.376583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd7db1-0809-4c3e-b0e5-bf301d615aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:37.376583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7db1-0809-4c3e-b0e5-bf301d615aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.376583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7db1-0809-4c3e-b0e5-bf301d615aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.376583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7db1-0809-4c3e-b0e5-bf301d615aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.377463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd7db1-0809-4c3e-b0e5-bf301d615aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:37.377463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd7db1-0809-4c3e-b0e5-bf301d615aa7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:37.384551 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3015/6052] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:37.386393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.386806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.387454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.388100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2240c43f-8709-4fb7-ac0f-41216ee8865c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:37.389352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2240c43f-8709-4fb7-ac0f-41216ee8865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:37.399838 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3038/6053] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:37.400661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240c43f-8709-4fb7-ac0f-41216ee8865c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:37.414813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240c43f-8709-4fb7-ac0f-41216ee8865c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:37.420753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:37.421541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.422126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.422500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] PATH_INFO: `/v3/projects/843fc65568334476b44d153650a82ca5/users/c651899b4d9d4791b806a37a783be245/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.429334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:37.431260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:37.443473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=843fc65568334476b44d153650a82ca5, user_id=c651899b4d9d4791b806a37a783be245, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:37.446990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:37.454424 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3016/6054] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:37.455340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:37.458651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:37.545125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3039/6055] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:37 2022] PUT /identity/v3/projects/843fc65568334476b44d153650a82ca5/users/c651899b4d9d4791b806a37a783be245/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:37.558887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:37.599705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb52f20-e6ce-4f7a-ba84-e1fcc88701a3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:37.691277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ffb9c-950a-4e80-be8f-e36c70b9a17d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:37.702326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e2ee-e98e-43d4-9555-e8f20cb08c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:37.703777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e2ee-e98e-43d4-9555-e8f20cb08c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.709495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e2ee-e98e-43d4-9555-e8f20cb08c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.709495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e2ee-e98e-43d4-9555-e8f20cb08c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.709495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e2ee-e98e-43d4-9555-e8f20cb08c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:37.709495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e2ee-e98e-43d4-9555-e8f20cb08c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:37.712486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e2ee-e98e-43d4-9555-e8f20cb08c5e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:37.737108 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3040/6056] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:37.739579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.740123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.740589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.753040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:37.755148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.755831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.756552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.834460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:37.834460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:37.834649 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:37.834777 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3017/6057] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:37.834777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:37.860733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e328-6e13-467c-8f6d-474f1b331bb0 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:37.861233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] MFA Rules not processed for user `c651899b4d9d4791b806a37a783be245`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:37.861233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:37.861467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:37.861467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:37.870065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:37.870334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:37.871043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:37.873033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:37.959713 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3041/6058] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:37.974400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:37.976718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:38.093471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fea9c-8fbe-49a5-917a-c0c4b205f04d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:38.106355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:38.106355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:38.106355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:38.106355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:38.120997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:38.123345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:38.141049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3042/6059] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:38:38.173479 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:38.183363 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3018/6060] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:37 2022] POST /identity/v3/projects => generated 369 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:38.187785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:38.205344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb715-99a6-4088-9d6e-d0910ddb5334 service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:38.361488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:38.362319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:38.362818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:38.363174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:38.363998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:38.366516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:38.502200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3043/6061] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:38 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:38.507467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:38.523871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328067a-f9bd-459f-ab05-1c5e5e9ec1e7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:38.539164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:38.539891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:38.540264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:38.540652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:38.541537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:38.552193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:38.570444 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3019/6062] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:38.583416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:38.587831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daec13-58aa-4844-aef3-d8bd61953d46 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:38.612262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb1abb-75ae-40d2-84ab-758354a7aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:38.616305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb1abb-75ae-40d2-84ab-758354a7aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:38.616305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb1abb-75ae-40d2-84ab-758354a7aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:38.616305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb1abb-75ae-40d2-84ab-758354a7aef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:38.616305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb1abb-75ae-40d2-84ab-758354a7aef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:38.616305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb1abb-75ae-40d2-84ab-758354a7aef7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:38.642971 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3044/6063] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:38.647809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:38.663060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43017e6c-a268-49f9-815d-faf5e7c066a1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:38.678880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:38.679929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:38.679929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:38.680190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] PATH_INFO: `/v3/projects/64cd92d2f8a641809ebda76e74a54e29/users/6bb714cede7d4288b749a40cd358d7f7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:38.710595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cd92d2f8a641809ebda76e74a54e29, user_id=6bb714cede7d4288b749a40cd358d7f7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:38.713377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:38.818422 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3020/6064] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:38 2022] PUT /identity/v3/projects/64cd92d2f8a641809ebda76e74a54e29/users/6bb714cede7d4288b749a40cd358d7f7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:38.829332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:38.829624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:38.829906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:38.881419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] MFA Rules not processed for user `6bb714cede7d4288b749a40cd358d7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:38.887166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:38.897609 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:39.059541 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3045/6065] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:39.063659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:39.075714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:39.077536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:39.199724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f6cf3-6ece-4fe1-9abf-17eb515cc21d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:39.207175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:39.208497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb035ca-aea0-4a6f-8904-c30a77f81947 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:39.209453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:39.209936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:39.210402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] PATH_INFO: `/v3/projects/010a6123180d463a9514c7b9e888c638` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:39.212311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=010a6123180d463a9514c7b9e888c638)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:39.213593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:39.214590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:39.214945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:39.215290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:39.216278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:39.217740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:39.221702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:39.384284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3021/6066] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:39 2022] POST /identity/v3/projects => generated 369 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:39.388481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:39.400055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010a6123180d463a9514c7b9e888c638', 'request_id': 'req-9d40b5c3-fc59-4680-9bbf-4dea649c4118'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:39.408658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010a6123180d463a9514c7b9e888c638', 'request_id': 'req-9d40b5c3-fc59-4680-9bbf-4dea649c4118'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:39.543265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a88a5-751f-466a-875e-d69a24399d3a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:39.549161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:39.549905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:39.550374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:39.550662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:39.551853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:39.553805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:39.558965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010a6123180d463a9514c7b9e888c638', 'request_id': 'req-9d40b5c3-fc59-4680-9bbf-4dea649c4118'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:39.578091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] The token cache is being invalidate because project 010a6123180d463a9514c7b9e888c638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:39.578496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:39.579431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:39.581435 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3046/6067] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:39 2022] DELETE /identity/v3/projects/010a6123180d463a9514c7b9e888c638 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:39.586649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:39.588222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:39.654374 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:39.695356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40b5c3-fc59-4680-9bbf-4dea649c4118 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:39.713835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:39.713835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:39.713835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:39.713835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] PATH_INFO: `/v3/users/841c1377934f4c25a065935f2ad36d38` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:39.714519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=841c1377934f4c25a065935f2ad36d38)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:39.714519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:39.750382 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3022/6068] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:39 2022] POST /identity/v3/users => generated 291 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:39.753936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:39.768099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:39.788751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465290a3-b301-44e4-8d66-aa7453f27f03 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:39.795985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:39.797554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:39.798188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:39.798641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] PATH_INFO: `/v3/users/c651899b4d9d4791b806a37a783be245` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:39.799937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c651899b4d9d4791b806a37a783be245)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:39.802666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:40.056021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841c1377934f4c25a065935f2ad36d38'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.066151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841c1377934f4c25a065935f2ad36d38'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.067807 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:40.068049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841c1377934f4c25a065935f2ad36d38'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.088553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c651899b4d9d4791b806a37a783be245'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.096454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c651899b4d9d4791b806a37a783be245'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.097189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c651899b4d9d4791b806a37a783be245'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.222017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841c1377934f4c25a065935f2ad36d38'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.222845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841c1377934f4c25a065935f2ad36d38'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.250357 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3047/6069] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:39 2022] DELETE /identity/v3/users/841c1377934f4c25a065935f2ad36d38 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:40.251712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:40.274666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:40.301958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c651899b4d9d4791b806a37a783be245'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.302624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c651899b4d9d4791b806a37a783be245'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:40.358934 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3023/6070] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:39 2022] DELETE /identity/v3/users/c651899b4d9d4791b806a37a783be245 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:40.360104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:40.376097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:40.446720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e747f6-e8fb-48e9-9b06-9265412ba4ab admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:40.545607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78428-7b83-4b7e-86a6-9903f20aa7d1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:40.552321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:40.553421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:40.553793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:40.554333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] PATH_INFO: `/v3/users/afd6110a50da478ca84097726d1741ea` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:40.556228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd6110a50da478ca84097726d1741ea)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:40.558866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:40.580601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74aaf-8ed3-47ae-9d47-ae5c99054527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:40.581892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74aaf-8ed3-47ae-9d47-ae5c99054527 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:40.583123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74aaf-8ed3-47ae-9d47-ae5c99054527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:40.585304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74aaf-8ed3-47ae-9d47-ae5c99054527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:40.587767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74aaf-8ed3-47ae-9d47-ae5c99054527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:40.589481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74aaf-8ed3-47ae-9d47-ae5c99054527 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:40.592449 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:40.607094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3048/6071] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:40.608696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:40.608995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:40.609277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:40.630856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:40.632094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:40.641697 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3049/6072] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:40.643160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:40.643998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:40.663322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71377-8bfb-447c-8beb-e2b193224125 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:40.674059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:40.682914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:40.682914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:40.682914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] PATH_INFO: `/v3/projects/9199a9deb0fa425e970ca022d0f7bb31/users/bc133f332f7b41bfab5816c900912ebb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:40.697248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9199a9deb0fa425e970ca022d0f7bb31, user_id=bc133f332f7b41bfab5816c900912ebb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:40.699965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:41.027496 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3050/6073] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:40 2022] PUT /identity/v3/projects/9199a9deb0fa425e970ca022d0f7bb31/users/bc133f332f7b41bfab5816c900912ebb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:41.032514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:41.032514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:41.080974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd6110a50da478ca84097726d1741ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.092276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd6110a50da478ca84097726d1741ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.094641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd6110a50da478ca84097726d1741ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.127927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982029ed-a8cb-4b73-bf84-30728bf5b35a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:41.137161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:41.137161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.137161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.137161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.182046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd6110a50da478ca84097726d1741ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.182046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd6110a50da478ca84097726d1741ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.215609 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3024/6074] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:40 2022] DELETE /identity/v3/users/afd6110a50da478ca84097726d1741ea => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:41.220058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:41.222495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:41.248661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:41.250510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:41.261958 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3051/6075] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:41.262987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:41.265023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:41.280262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a342-bbcf-4bf8-b84a-9282e0fb283b service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:41.288266 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:41.346575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b92cd8-603e-416b-83c7-c9f1c084be87 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:41.352401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388d617-3bf5-4c76-8bed-165c4700b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:41.358371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388d617-3bf5-4c76-8bed-165c4700b404 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.358371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388d617-3bf5-4c76-8bed-165c4700b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.358371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388d617-3bf5-4c76-8bed-165c4700b404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.358371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388d617-3bf5-4c76-8bed-165c4700b404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:41.358371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388d617-3bf5-4c76-8bed-165c4700b404 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:41.376462 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3025/6076] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:41.382285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc81229-b98b-4faf-950b-232eb8f5a08a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.384413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc81229-b98b-4faf-950b-232eb8f5a08a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.384413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc81229-b98b-4faf-950b-232eb8f5a08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.404502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:41.405919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.406463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.406913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] PATH_INFO: `/v3/projects/bd85a6d313b1437b8d3923b019c44550` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.410796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd85a6d313b1437b8d3923b019c44550)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:41.415978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:41.426914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2dc81229-b98b-4faf-950b-232eb8f5a08a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:41.428459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2dc81229-b98b-4faf-950b-232eb8f5a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:41.438944 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3026/6077] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:41.452109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc81229-b98b-4faf-950b-232eb8f5a08a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:41.465447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc81229-b98b-4faf-950b-232eb8f5a08a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:41.476173 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:41.479253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:41.481695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.483539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.490036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] PATH_INFO: `/v3/projects/9199a9deb0fa425e970ca022d0f7bb31/users/bc133f332f7b41bfab5816c900912ebb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.490036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9199a9deb0fa425e970ca022d0f7bb31, user_id=bc133f332f7b41bfab5816c900912ebb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:41.495917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:41.514163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3027/6078] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:41 2022] PUT /identity/v3/projects/9199a9deb0fa425e970ca022d0f7bb31/users/bc133f332f7b41bfab5816c900912ebb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:41.515619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:41.517390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:41.646459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd85a6d313b1437b8d3923b019c44550', 'request_id': 'req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.665527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd85a6d313b1437b8d3923b019c44550', 'request_id': 'req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.667500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05e743-fbf7-4f8f-93a5-c37a4056ca34 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:41.741263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd85a6d313b1437b8d3923b019c44550', 'request_id': 'req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.746870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f3969-8da3-497d-8917-38f89bfd0717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:41.770679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f3969-8da3-497d-8917-38f89bfd0717 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.770679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f3969-8da3-497d-8917-38f89bfd0717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.770679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f3969-8da3-497d-8917-38f89bfd0717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.771121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] The token cache is being invalidate because project bd85a6d313b1437b8d3923b019c44550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:41.771121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.771373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9f1e91d3-1074-4f6b-9ea2-c8b545283dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:41.776488 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3052/6079] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:41 2022] DELETE /identity/v3/projects/bd85a6d313b1437b8d3923b019c44550 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:41.778115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d8d6-368d-42c9-88cb-edb9719f30c6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.778402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d8d6-368d-42c9-88cb-edb9719f30c6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.778835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d8d6-368d-42c9-88cb-edb9719f30c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.852723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f409d8d6-368d-42c9-88cb-edb9719f30c6 None None] MFA Rules not processed for user `bc133f332f7b41bfab5816c900912ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:41.858038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f409d8d6-368d-42c9-88cb-edb9719f30c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:41.880364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f3969-8da3-497d-8917-38f89bfd0717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:41.883319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f3969-8da3-497d-8917-38f89bfd0717 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:41.909303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3028/6080] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:41.911333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be79b81-d5a8-4e44-9a7f-1a078dd5bca0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.913713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be79b81-d5a8-4e44-9a7f-1a078dd5bca0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.914127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be79b81-d5a8-4e44-9a7f-1a078dd5bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.947869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6be79b81-d5a8-4e44-9a7f-1a078dd5bca0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:41.949218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6be79b81-d5a8-4e44-9a7f-1a078dd5bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:41.968066 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3029/6081] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:41.981448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:41.981933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:41.982306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:41.986555 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3053/6082] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:41.997283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409d8d6-368d-42c9-88cb-edb9719f30c6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:42.030897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409d8d6-368d-42c9-88cb-edb9719f30c6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:42.047246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:42.047909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:42.048194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:42.048467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:42.049159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:42.052990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:42.075774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:42.077041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:42.106089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3030/6083] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:38:42.106089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:42.107144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:42.125701 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:42.138968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3860-7f89-424a-9538-d09a50ab8327 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:42.145789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:42.147555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:42.148209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:42.148762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] PATH_INFO: `/v3/projects/843fc65568334476b44d153650a82ca5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:42.150316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843fc65568334476b44d153650a82ca5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:42.152973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:42.174500 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3054/6084] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:38:41 2022] POST /identity/v3/domains => generated 276 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:42.175746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:42.311073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ac8d-0ac6-4469-9b7c-89784493c177 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:42.331736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:42.331736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:42.331736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:42.331736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:42.333017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:42.333017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:42.338365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:42.361195 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3055/6085] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:42.363233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:42.384843 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:42.423546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843fc65568334476b44d153650a82ca5', 'request_id': 'req-09e86b2d-b707-49f0-87fb-01704c411d92'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:42.450713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843fc65568334476b44d153650a82ca5', 'request_id': 'req-09e86b2d-b707-49f0-87fb-01704c411d92'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:42.523696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c57a0d-e626-42a2-9fad-ca9f289a83db admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:42.556150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843fc65568334476b44d153650a82ca5', 'request_id': 'req-09e86b2d-b707-49f0-87fb-01704c411d92'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:42.576426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] The token cache is being invalidate because project 843fc65568334476b44d153650a82ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:42.576877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:42.577956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:42.582701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3031/6086] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:42 2022] DELETE /identity/v3/projects/843fc65568334476b44d153650a82ca5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:42.582701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:42.582701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:42.657294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:42.658085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:42.658350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:42.658614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:42.659301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:42.662418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:42.680129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86b2d-b707-49f0-87fb-01704c411d92 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:42.685658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d1f4e-57ff-4be5-a700-e280ce394120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:42.686490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1f4e-57ff-4be5-a700-e280ce394120 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:42.686770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1f4e-57ff-4be5-a700-e280ce394120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:42.687044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1f4e-57ff-4be5-a700-e280ce394120 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:42.687723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d1f4e-57ff-4be5-a700-e280ce394120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:42.690053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d1f4e-57ff-4be5-a700-e280ce394120 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:42.767041 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3056/6087] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:42 2022] POST /identity/v3/groups => generated 280 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:42.768072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:42.775462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:42.795112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf731bd-8005-44ae-8062-4a727d986971 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:42.802896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:42.805892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:42.805892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:42.805892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] PATH_INFO: `/v3/projects/f41f41f65a5b4a43bc9adac90cea571b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:42.805892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41f41f65a5b4a43bc9adac90cea571b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:42.810709 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3032/6088] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:42 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:42.810878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:42.810973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:42.810973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:42.810973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:42.846257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:42.847175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:42.942647 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3033/6089] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:42.943928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:42.945467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:42.967869 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:42.989072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41f41f65a5b4a43bc9adac90cea571b', 'request_id': 'req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:43.002596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41f41f65a5b4a43bc9adac90cea571b', 'request_id': 'req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:43.072218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ff06a-1334-48f6-902f-f7df2f29e674 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.096997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41f41f65a5b4a43bc9adac90cea571b', 'request_id': 'req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:43.117921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] The token cache is being invalidate because project f41f41f65a5b4a43bc9adac90cea571b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:43.118309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:43.119725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:43.124269 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3057/6090] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:42 2022] DELETE /identity/v3/projects/f41f41f65a5b4a43bc9adac90cea571b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:43.125402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.132356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:43.187238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eeb10-ce84-4e65-b4ac-a5c62d2969bd tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.189951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eeb10-ce84-4e65-b4ac-a5c62d2969bd tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.190415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eeb10-ce84-4e65-b4ac-a5c62d2969bd tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.192008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eeb10-ce84-4e65-b4ac-a5c62d2969bd tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.205835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eeb10-ce84-4e65-b4ac-a5c62d2969bd tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:update_group(group_id=e575b8bcd1e046c8b7d87cb61e1989db)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.208874 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-805eeb10-ce84-4e65-b4ac-a5c62d2969bd tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:43.208874 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:38:43.208874 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:38:43.211327 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:43.212907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eeb10-ce84-4e65-b4ac-a5c62d2969bd tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.294636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925906cb-7b33-4b0b-96bc-9eeb1c2b254a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.300409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.301413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.301766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.302124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.309631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.309631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.345234 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3034/6091] 10.222.0.42 () {60 vars in 1247 bytes} [Sun Oct 23 01:38:42 2022] PATCH /identity/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db => generated 291 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:43.347160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86235c-a890-46d9-bb63-b6c014e351c9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.347546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86235c-a890-46d9-bb63-b6c014e351c9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.347980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86235c-a890-46d9-bb63-b6c014e351c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.380342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7b86235c-a890-46d9-bb63-b6c014e351c9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:43.381568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7b86235c-a890-46d9-bb63-b6c014e351c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:43.390049 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3035/6092] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:43.394784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1081ab-d1cd-4c62-993e-95e8512e173e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.395667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1081ab-d1cd-4c62-993e-95e8512e173e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.395879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1081ab-d1cd-4c62-993e-95e8512e173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.401225 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3058/6093] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:43 2022] POST /identity/v3/users => generated 286 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:43.401225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.402658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:43.428195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dc1081ab-d1cd-4c62-993e-95e8512e173e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:43.431319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd455c7-54e5-46fc-ac52-b0ce7d202174 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.432824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc1081ab-d1cd-4c62-993e-95e8512e173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:43.449919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.451014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.451497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.451957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.455288 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3036/6094] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:43.456272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1081ab-d1cd-4c62-993e-95e8512e173e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.461620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:get_group(group_id=e575b8bcd1e046c8b7d87cb61e1989db)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.471203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.476623 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3059/6095] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:43 2022] GET /identity/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db => generated 291 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:43.477023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.492534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a3b0-b270-4596-969f-a1a1e1cbbc8b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.498103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b6ba5-aa8a-4849-8ca4-e7b8c05b9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.498363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1081ab-d1cd-4c62-993e-95e8512e173e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.499098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6ba5-aa8a-4849-8ca4-e7b8c05b9337 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.499570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6ba5-aa8a-4849-8ca4-e7b8c05b9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.500075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6ba5-aa8a-4849-8ca4-e7b8c05b9337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.500997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b6ba5-aa8a-4849-8ca4-e7b8c05b9337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.502781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b6ba5-aa8a-4849-8ca4-e7b8c05b9337 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.503679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.505255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.505692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.506012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.506768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:43.507223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.508958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.521811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3060/6096] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:43.523430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccebbc1-f6cd-4cdc-ad5f-2734bc8f6cb3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.523912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccebbc1-f6cd-4cdc-ad5f-2734bc8f6cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.524309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccebbc1-f6cd-4cdc-ad5f-2734bc8f6cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.529472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3037/6097] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:43.530601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.546518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289321-4f67-46fa-b6fe-770898a2af5e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.553132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.553642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fccebbc1-f6cd-4cdc-ad5f-2734bc8f6cb3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:43.554117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.554621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.555018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.555130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fccebbc1-f6cd-4cdc-ad5f-2734bc8f6cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:43.556516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:update_group(group_id=e575b8bcd1e046c8b7d87cb61e1989db)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.558623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.563895 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3061/6098] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:43.564778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccebbc1-f6cd-4cdc-ad5f-2734bc8f6cb3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.579253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccebbc1-f6cd-4cdc-ad5f-2734bc8f6cb3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.590011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.591195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.591401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.591915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.592568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.594379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.609150 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3062/6099] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:43.609150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.626392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ac61-2608-490c-a789-f60027281b79 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.634061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.634817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.635103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.635431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.639168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.647444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.670566 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3038/6100] 10.222.0.42 () {60 vars in 1246 bytes} [Sun Oct 23 01:38:43 2022] PATCH /identity/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:43.671885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.701339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3407189-b88e-496e-ad42-9c90d691afeb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.711756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.712551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.712941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.713323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.714134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:43.714530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.716536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.740542 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3039/6101] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:43.741711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.756372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf26e6-721b-4559-84f8-99ca8ab1f61d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.763012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.763817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.764198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.764572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] PATH_INFO: `/v3/projects/d53e92891fa74db68db5554878af0adf/users/6e9f6fbfc6484cbfb60167b73e87a768/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.793178 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3063/6102] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:43 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:43.793178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:43.839744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53e92891fa74db68db5554878af0adf, user_id=6e9f6fbfc6484cbfb60167b73e87a768, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.847529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.938141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21e78-ddec-41f3-a504-806a45b67e03 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:43.943553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:43.944370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:43.944748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:43.945125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:43.955247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e575b8bcd1e046c8b7d87cb61e1989db)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:43.958035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:43.966136 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3040/6103] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:43 2022] PUT /identity/v3/projects/d53e92891fa74db68db5554878af0adf/users/6e9f6fbfc6484cbfb60167b73e87a768/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:43.967129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.016676 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:44.066969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8e33a-99fb-43e1-ae08-76dbdc8fee8c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.072971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d128b-d57f-4fae-9d91-0ad8a2ef7c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.073146 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3064/6104] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:38:43 2022] DELETE /identity/v3/groups/e575b8bcd1e046c8b7d87cb61e1989db => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:44.073613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d128b-d57f-4fae-9d91-0ad8a2ef7c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.073881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d128b-d57f-4fae-9d91-0ad8a2ef7c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.074363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d128b-d57f-4fae-9d91-0ad8a2ef7c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.074987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d128b-d57f-4fae-9d91-0ad8a2ef7c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.079447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d128b-d57f-4fae-9d91-0ad8a2ef7c41 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:44.079827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.116424 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:44.164453 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3041/6105] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:43 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:44.164453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76b9d6-c7dc-4446-96eb-6c7bed51b6c9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.164453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76b9d6-c7dc-4446-96eb-6c7bed51b6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.164827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76b9d6-c7dc-4446-96eb-6c7bed51b6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.205080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4b76b9d6-c7dc-4446-96eb-6c7bed51b6c9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:44.206695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8559266-6814-417b-b99a-61bd8dbe4117 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.209522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4b76b9d6-c7dc-4446-96eb-6c7bed51b6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:44.331726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.332964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.334521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.334939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.336048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.340039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:44.345619 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3042/6106] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:44.346603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76b9d6-c7dc-4446-96eb-6c7bed51b6c9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.471472 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3065/6107] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:44 2022] POST /identity/v3/users => generated 293 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:44.471472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.506826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46deb-01d9-4ec3-9b72-f1b4b2d10e9f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.517458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76b9d6-c7dc-4446-96eb-6c7bed51b6c9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.524177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.525599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.526822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.527841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.528603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.529413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.531456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.531897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.532902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:44.533247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.534247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.540835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:44.635968 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3043/6108] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:44 2022] POST /identity/v3/groups => generated 327 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:44.637361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.641656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:44.663205 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3066/6109] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:44 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:44.664043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.672339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:44.673557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdf141-38c9-4dfb-8b10-e1ce4566e92b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.685261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.686041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.686906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.687398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] PATH_INFO: `/v3/users/cf39b21f09de4e10acce3b9501eb2af0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.691422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf39b21f09de4e10acce3b9501eb2af0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.694927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:44.781053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbabeb-af88-4c73-80eb-bfbea77d3e35 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.786073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.786825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.787215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.787611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.805026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.806577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:44.823943 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3067/6110] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:44.838116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.865321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744480c5-730c-4024-849b-7fbddc70d1dd service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.876209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.876899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.877249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.877587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.878599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.881905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:44.898684 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:44.916936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf39b21f09de4e10acce3b9501eb2af0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:44.932458 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3068/6111] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:44.934808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:44.938175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf39b21f09de4e10acce3b9501eb2af0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:44.940403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf39b21f09de4e10acce3b9501eb2af0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:44.978682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8ba13-10c3-4317-8256-5c03afb7a77c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:44.989248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:44.989871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:44.990202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:44.990481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:44.991224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:44.992994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:45.061560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf39b21f09de4e10acce3b9501eb2af0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:45.062314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf39b21f09de4e10acce3b9501eb2af0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:45.105009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3069/6112] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:44 2022] POST /identity/v3/users => generated 323 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:45.107255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:45.113038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:45.119575 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3044/6113] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:44 2022] DELETE /identity/v3/users/cf39b21f09de4e10acce3b9501eb2af0 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:45.120642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:45.122204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:45.133386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beced14b-e405-48c8-8cb9-178842b7141e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:45.139123 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:45.219448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413e2d4-4f9a-44ba-b80f-99d1b093060e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:45.234026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:45.234958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.236725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.237239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:45.239647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:45.244719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:45.277784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65efab7-e8a8-49bb-9df6-e831dbf64aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:45.278711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65efab7-e8a8-49bb-9df6-e831dbf64aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.279258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65efab7-e8a8-49bb-9df6-e831dbf64aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.279848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65efab7-e8a8-49bb-9df6-e831dbf64aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:45.280643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65efab7-e8a8-49bb-9df6-e831dbf64aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:45.282690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65efab7-e8a8-49bb-9df6-e831dbf64aa9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:45.284653 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3045/6114] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:45.286340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:45.288743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:45.305178 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3070/6115] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:45.309767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f127-80f2-4f36-8a89-0ae4171a9697 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.310392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f127-80f2-4f36-8a89-0ae4171a9697 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.312203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f127-80f2-4f36-8a89-0ae4171a9697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:45.362145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7c55f127-80f2-4f36-8a89-0ae4171a9697 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:45.363920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7c55f127-80f2-4f36-8a89-0ae4171a9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:45.380053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294ad9-56ed-4eb8-b753-6ed7d4d31afd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:45.383020 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3071/6116] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:45.386153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55f127-80f2-4f36-8a89-0ae4171a9697 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:45.386264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:45.393366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.393721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.394209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/25b9e62043ec4078b2464aa94be06d2a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:45.406552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55f127-80f2-4f36-8a89-0ae4171a9697 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:45.420263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=25b9e62043ec4078b2464aa94be06d2a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:45.422856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:45.423245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:45.423955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.424480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.424941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] PATH_INFO: `/v3/projects/eaf5f6076384433eb428f65024e99a12/users/c603a3dba9fa4e9db2c0ba7e1247ae72/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:45.463057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf5f6076384433eb428f65024e99a12, user_id=c603a3dba9fa4e9db2c0ba7e1247ae72, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:45.466282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:45.526019 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3046/6117] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:38:45 2022] PUT /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/25b9e62043ec4078b2464aa94be06d2a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:45.527329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:45.554592 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3072/6118] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:45 2022] PUT /identity/v3/projects/eaf5f6076384433eb428f65024e99a12/users/c603a3dba9fa4e9db2c0ba7e1247ae72/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:45.555956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:45.567609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:45.585047 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:45.695348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c89eb-395e-4427-92a0-84d945207247 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:45.749503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66092-6797-4877-8d0f-8e1d9dd26475 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:45.776782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02204364-bfe9-4995-adca-3ece621756da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:45.777442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02204364-bfe9-4995-adca-3ece621756da service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.777726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02204364-bfe9-4995-adca-3ece621756da service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.778033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02204364-bfe9-4995-adca-3ece621756da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:45.864869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:45.865867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.867483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.867959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:45.871869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:45.875440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:45.898370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3047/6119] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:45.899531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:45.918825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02204364-bfe9-4995-adca-3ece621756da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:45.920894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02204364-bfe9-4995-adca-3ece621756da service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:45.949848 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3073/6120] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:45.952975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa21e-1e31-45aa-8237-608c04d238a4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:45.958977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa21e-1e31-45aa-8237-608c04d238a4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:45.958977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fa21e-1e31-45aa-8237-608c04d238a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:46.030251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-880fa21e-1e31-45aa-8237-608c04d238a4 None None] MFA Rules not processed for user `c603a3dba9fa4e9db2c0ba7e1247ae72`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:46.031583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-880fa21e-1e31-45aa-8237-608c04d238a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:46.065402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e3592-2f24-4a1f-92d7-3640e096bc86 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:46.065883 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:46.074733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:46.077739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:46.078601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:46.079264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:46.080759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:46.084339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:46.190860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3048/6121] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:45 2022] POST /identity/v3/users => generated 321 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:46.195383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:46.212285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3074/6122] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:46.212285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa21e-1e31-45aa-8237-608c04d238a4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:46.228165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daee36-f025-4ba1-aa22-7d2656172a15 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:46.237626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:46.239996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:46.240528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:46.240998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] PATH_INFO: `/v3/projects/4a928ecfa41146858674739987189b9d/users/e9ea0ce71ac545c995c3e75cb564674a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:46.244182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fa21e-1e31-45aa-8237-608c04d238a4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:46.251853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044eaec-576d-4ad5-9869-f09ccfcece0d tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:46.255910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044eaec-576d-4ad5-9869-f09ccfcece0d tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:46.256308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044eaec-576d-4ad5-9869-f09ccfcece0d tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:46.257595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044eaec-576d-4ad5-9869-f09ccfcece0d tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/614fcec1a95f498fa8529f8fb5f59f7d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:46.282110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a928ecfa41146858674739987189b9d, user_id=e9ea0ce71ac545c995c3e75cb564674a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:46.289125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:46.295931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044eaec-576d-4ad5-9869-f09ccfcece0d tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=614fcec1a95f498fa8529f8fb5f59f7d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:46.300399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044eaec-576d-4ad5-9869-f09ccfcece0d tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:46.446058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3049/6123] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:46 2022] PUT /identity/v3/projects/4a928ecfa41146858674739987189b9d/users/e9ea0ce71ac545c995c3e75cb564674a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:46.446058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:46.492579 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3075/6124] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:38:46 2022] PUT /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/614fcec1a95f498fa8529f8fb5f59f7d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:46.494044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659118-f8c2-4cd5-9167-c82d1c83e45c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:46.494420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659118-f8c2-4cd5-9167-c82d1c83e45c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:46.494764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659118-f8c2-4cd5-9167-c82d1c83e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:46.506216 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:46.545161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-97659118-f8c2-4cd5-9167-c82d1c83e45c None None] MFA Rules not processed for user `e9ea0ce71ac545c995c3e75cb564674a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:46.547314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-97659118-f8c2-4cd5-9167-c82d1c83e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:46.600093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e778f-d4c0-4983-801a-da5a5b9ece4c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:46.636985 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3076/6125] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:46.638323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659118-f8c2-4cd5-9167-c82d1c83e45c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:46.659175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:46.659798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:46.660078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:46.660929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:46.661074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:46.663264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:46.709834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659118-f8c2-4cd5-9167-c82d1c83e45c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:46.714419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:46.715064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:46.715353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:46.715626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:46.716249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:46.718117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:46.909084 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:46.916391 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3050/6126] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:46 2022] POST /identity/v3/projects => generated 385 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:46.917649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:46.923659 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3077/6127] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:46 2022] POST /identity/v3/users => generated 323 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:46.924609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:46.927094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:46.943629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecc4c9-a1f4-4fa4-956e-50589ea64d89 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.045998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.045998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.045998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.045998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] PATH_INFO: `/v3/projects/0d872573354747cd8473248d530ed5b5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.046394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d872573354747cd8473248d530ed5b5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.046394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.052113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9ea3-52d1-4f49-b8b8-92756368a58d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.085621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.086285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.086561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.087007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.087913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.093822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.220265 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3051/6128] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:46 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:47.220265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:47.269720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d872573354747cd8473248d530ed5b5', 'request_id': 'req-dd4c741f-5747-42dd-9489-602b9ec6e7fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:47.288616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d872573354747cd8473248d530ed5b5', 'request_id': 'req-dd4c741f-5747-42dd-9489-602b9ec6e7fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:47.342373 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:47.358398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d872573354747cd8473248d530ed5b5', 'request_id': 'req-dd4c741f-5747-42dd-9489-602b9ec6e7fa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:47.382809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] The token cache is being invalidate because project 0d872573354747cd8473248d530ed5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:47.383105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:47.383976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:47.386932 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3078/6129] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:46 2022] DELETE /identity/v3/projects/0d872573354747cd8473248d530ed5b5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:47.387520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:47.392324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:47.395612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9274e-12c1-418a-b2b2-5e5d5e2bf210 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.412194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daab3b8-3497-4134-823a-ce0b4514c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.413060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daab3b8-3497-4134-823a-ce0b4514c5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.413497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daab3b8-3497-4134-823a-ce0b4514c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.414195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daab3b8-3497-4134-823a-ce0b4514c5ca admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.415664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daab3b8-3497-4134-823a-ce0b4514c5ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.418074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daab3b8-3497-4134-823a-ce0b4514c5ca admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.470479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c741f-5747-42dd-9489-602b9ec6e7fa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.544886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.545696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.546068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.546943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/c25edbcad9974b6eb92ec813abebb33b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.549223 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3052/6130] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:47 2022] POST /identity/v3/users => generated 299 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:47.552675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a419-7a2e-4ee0-9436-83b697a9afca None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.553030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a419-7a2e-4ee0-9436-83b697a9afca None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.553719 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:47.554571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a419-7a2e-4ee0-9436-83b697a9afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.566056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=c25edbcad9974b6eb92ec813abebb33b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.568962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.605449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-35f6a419-7a2e-4ee0-9436-83b697a9afca None None] MFA Rules not processed for user `6e9f6fbfc6484cbfb60167b73e87a768`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:47.607104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-35f6a419-7a2e-4ee0-9436-83b697a9afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:47.669543 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3079/6131] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:38:47 2022] PUT /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/c25edbcad9974b6eb92ec813abebb33b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:47.673652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:47.676257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:47.731787 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3053/6132] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:47.733432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.733723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.734001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.763916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:47.763916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:47.776355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389a87f-6d0d-4928-ab46-36bfd81b4f6e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.781816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.782619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.783065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.783485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.784344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.787085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.837110 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3054/6133] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:47.839492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:47.840757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:47.853446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7ceb0-852d-40d2-9a54-c4d80f6a46dd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.858261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.858862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.859136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.859434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.860070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.861642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.871796 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3055/6134] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:47.872678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:47.887941 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3080/6135] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:47 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:47.887941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:47.890531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:47.907490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d7e9a-68a0-48f8-8722-771859b0e83f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.913867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.914652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.915792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.916090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.917080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.919129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.922187 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:47.944268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea4e12-4021-47e5-89c1-a9a73eea4fc6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:47.949022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8cd4d-c357-490f-8e76-e6f96e83e82e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:47.949658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8cd4d-c357-490f-8e76-e6f96e83e82e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.949937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8cd4d-c357-490f-8e76-e6f96e83e82e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.950237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8cd4d-c357-490f-8e76-e6f96e83e82e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.952061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8cd4d-c357-490f-8e76-e6f96e83e82e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=4a3a6269e51941fa9c606dff3ad72d87)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:47.953077 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-4ee8cd4d-c357-490f-8e76-e6f96e83e82e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:47.953077 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:38:47.953077 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:38:47.954285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8cd4d-c357-490f-8e76-e6f96e83e82e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:47.973945 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3056/6136] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:38:47 2022] GET /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users => generated 1083 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:47.975068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cecd0-c0b3-47f4-800a-8a17b7357069 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:47.975354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cecd0-c0b3-47f4-800a-8a17b7357069 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:47.975625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cecd0-c0b3-47f4-800a-8a17b7357069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:47.995894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fe1cecd0-c0b3-47f4-800a-8a17b7357069 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:47.997084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe1cecd0-c0b3-47f4-800a-8a17b7357069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:48.005093 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3057/6137] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:48.005835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cecd0-c0b3-47f4-800a-8a17b7357069 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.016717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cecd0-c0b3-47f4-800a-8a17b7357069 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.021777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.022498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.022796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.023075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] PATH_INFO: `/v3/projects/0b3d490e32554248b2696947c567e417/users/c7649aa81c1a4643af3d9d37a31cf387/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.038863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3d490e32554248b2696947c567e417, user_id=c7649aa81c1a4643af3d9d37a31cf387, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.044985 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3081/6138] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:47 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:48.045490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.045587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.109581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc0e7c-ea10-4710-9ba5-b0a0bd33b3b9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.115006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.115605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.115880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.116146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.116778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.118403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.128126 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3082/6139] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:48.129800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.167726 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3058/6140] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:48 2022] PUT /identity/v3/projects/0b3d490e32554248b2696947c567e417/users/c7649aa81c1a4643af3d9d37a31cf387/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:48.167726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.174481 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:48.202863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce522f-3ab1-4fbf-8eae-63e31956890b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.273484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de6e8d-9673-42dd-9985-4840fe9b7a13 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.281591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.282297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.282738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.282925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.283571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:38:48.283876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.286446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.293717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.294500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.297545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.297545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/25b9e62043ec4078b2464aa94be06d2a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.297545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=25b9e62043ec4078b2464aa94be06d2a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.298378 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:48.298378 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:38:48.298378 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:38:48.299615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.302132 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3059/6141] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:48.303297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.316185 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3083/6142] 10.222.0.42 () {58 vars in 1342 bytes} [Sun Oct 23 01:38:48 2022] HEAD /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/25b9e62043ec4078b2464aa94be06d2a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:48.317035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.319138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e723e6b-8cab-477a-a5b3-28e7238278d4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.324223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.324930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.325269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.325544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.326211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.328248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.328738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a165d-86b4-4d6b-a446-9bec4d5488dc tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.334122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.334850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.335127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.335399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] PATH_INFO: `/v3/projects/8820e661d2614998ba770aee64fe54d4/users/d2ca45185aa643968166b849054a262c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.358090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8820e661d2614998ba770aee64fe54d4, user_id=d2ca45185aa643968166b849054a262c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.358090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.401826 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3060/6143] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:48 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:48.401826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.409532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b04fd2-b3cf-4156-a5f3-d7a654aaa471 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.416460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.416587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.416796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.417085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.417731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.419461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.438700 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3084/6144] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:48 2022] PUT /identity/v3/projects/8820e661d2614998ba770aee64fe54d4/users/d2ca45185aa643968166b849054a262c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:48.438700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.439005 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3061/6145] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:48.439005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.449378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6cfcc-03e7-4907-8902-efdc2b00c2ff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.508122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d797d1-dec7-430f-b959-50dc3ae8f7e0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.513010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.513654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.513889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.514214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.514838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.516848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.517239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.518465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.518754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.519032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/25b9e62043ec4078b2464aa94be06d2a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.521477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=25b9e62043ec4078b2464aa94be06d2a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.524569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.655043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '25b9e62043ec4078b2464aa94be06d2a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:48.657114 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:48.665628 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3085/6146] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:38:48 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:48.665628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.678185 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:48.727014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271a2e4-ea7e-4434-8113-b4633828d9bc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.731840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.732448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.732732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.733002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.733909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.735545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.745631 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3086/6147] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:48.746454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.753486 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3062/6148] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:38:48 2022] DELETE /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/25b9e62043ec4078b2464aa94be06d2a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:48.759536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.759656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812307e7-24b7-4bcc-82da-27f4e231c28d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.815247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.815906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.816186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.816977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] PATH_INFO: `/v3/projects/0b3d490e32554248b2696947c567e417/users/c7649aa81c1a4643af3d9d37a31cf387/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.818957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3d490e32554248b2696947c567e417, user_id=c7649aa81c1a4643af3d9d37a31cf387, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.820232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724cafe-4896-4ec8-8f6f-05b51796ee3e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.821796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.824903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.825748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.829734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.829734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.829734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.829734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.833286 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3087/6149] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:48 2022] PUT /identity/v3/projects/0b3d490e32554248b2696947c567e417/users/c7649aa81c1a4643af3d9d37a31cf387/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:48.834251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.839994 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3063/6150] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:48.840645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:48.852091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d97ae-9579-46cf-9f69-ea159891b60d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.899957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095f886-7247-4505-8f74-1f5562cf400a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:48.904651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.905247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.905530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.906115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.907026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.908614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:48.909267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:48.909541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:48.909852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] PATH_INFO: `/v3/projects/3c1bf01c3f9846fd87558dc6cd2ead8b/users/fafd69cbb8644b55a058bfb4e8d12604/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:48.909957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:48.924804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1bf01c3f9846fd87558dc6cd2ead8b, user_id=fafd69cbb8644b55a058bfb4e8d12604, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:48.928291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.018702 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3088/6151] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:48 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:49.018702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.028066 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3064/6152] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:48 2022] PUT /identity/v3/projects/3c1bf01c3f9846fd87558dc6cd2ead8b/users/fafd69cbb8644b55a058bfb4e8d12604/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:49.029138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.055118 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:49.085601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb45ec-9cd6-4392-9315-ab43cd777676 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.094657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e9a6e-06bc-43d9-a938-9db6714e8362 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.100771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9a362-415e-49f2-a078-c8d48aff5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.101852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a362-415e-49f2-a078-c8d48aff5f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.101852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a362-415e-49f2-a078-c8d48aff5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.102154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a362-415e-49f2-a078-c8d48aff5f7f admin admin] PATH_INFO: `/v3/projects/8820e661d2614998ba770aee64fe54d4/users/d2ca45185aa643968166b849054a262c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.104085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9a362-415e-49f2-a078-c8d48aff5f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8820e661d2614998ba770aee64fe54d4, user_id=d2ca45185aa643968166b849054a262c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.106867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9a362-415e-49f2-a078-c8d48aff5f7f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.131083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3065/6153] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:49 2022] PUT /identity/v3/projects/8820e661d2614998ba770aee64fe54d4/users/d2ca45185aa643968166b849054a262c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:49.131083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55f52-2d5f-4109-adf2-5fbb8d30b9e4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.131083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55f52-2d5f-4109-adf2-5fbb8d30b9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.131083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f55f52-2d5f-4109-adf2-5fbb8d30b9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.133538 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:49.152789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.153560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.154396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.154396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/614fcec1a95f498fa8529f8fb5f59f7d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.156164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=614fcec1a95f498fa8529f8fb5f59f7d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.157863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-73f55f52-2d5f-4109-adf2-5fbb8d30b9e4 None None] MFA Rules not processed for user `c7649aa81c1a4643af3d9d37a31cf387`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:49.158254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.159320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-73f55f52-2d5f-4109-adf2-5fbb8d30b9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:49.204822 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3089/6154] 10.222.0.42 () {58 vars in 1342 bytes} [Sun Oct 23 01:38:49 2022] HEAD /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/614fcec1a95f498fa8529f8fb5f59f7d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:49.208569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.221119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190f280-c415-4585-b9eb-490688f2eae7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.237243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3066/6155] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:49.238732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55f52-2d5f-4109-adf2-5fbb8d30b9e4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.301541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd7568-ed9b-4197-b4ce-4632f5e4b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.302295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd7568-ed9b-4197-b4ce-4632f5e4b603 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.302641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd7568-ed9b-4197-b4ce-4632f5e4b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.302983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd7568-ed9b-4197-b4ce-4632f5e4b603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.303638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd7568-ed9b-4197-b4ce-4632f5e4b603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.305514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd7568-ed9b-4197-b4ce-4632f5e4b603 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.319934 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3090/6156] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:49.320121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f55f52-2d5f-4109-adf2-5fbb8d30b9e4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.320234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.320234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.320234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.326054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.327177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.327633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.327907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.330352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.332025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.348396 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3067/6157] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:49.348396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.351869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] MFA Rules not processed for user `d2ca45185aa643968166b849054a262c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:49.353256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:49.414491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5685-1dcf-456f-abee-4f0301c340b4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.418209 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:49.420586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.421257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.421803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.422104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/614fcec1a95f498fa8529f8fb5f59f7d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.423801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=614fcec1a95f498fa8529f8fb5f59f7d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.434919 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3091/6158] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:49.434919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.435305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.437269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:49.515571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af988f8-6958-4a64-8d7a-2f0790be568c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.519405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.520017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.520298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.520570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.522456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:49.540829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '614fcec1a95f498fa8529f8fb5f59f7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:49.599620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.601038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.610575 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3092/6159] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:49.611499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.622250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffdca4-35a9-40dd-aab0-eed9fdd243d2 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.627517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.627956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.628234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.628503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.629242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.632685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.637310 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3068/6160] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:38:49 2022] DELETE /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/614fcec1a95f498fa8529f8fb5f59f7d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:49.638508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.646438 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3093/6161] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:49.647315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.651899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:49.657878 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:49.717519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969901b7-e687-4fd4-9d32-0311a3a67e85 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.720538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcfa68-639d-44b6-b169-e960751dcfec tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.726606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.727276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.727551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.727813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] PATH_INFO: `/v3/projects/3c1bf01c3f9846fd87558dc6cd2ead8b/users/fafd69cbb8644b55a058bfb4e8d12604/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.729721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1bf01c3f9846fd87558dc6cd2ead8b, user_id=fafd69cbb8644b55a058bfb4e8d12604, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.732894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.743316 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3069/6162] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:49 2022] PUT /identity/v3/projects/3c1bf01c3f9846fd87558dc6cd2ead8b/users/fafd69cbb8644b55a058bfb4e8d12604/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:49.747670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.807113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.808349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.808684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.809057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.811849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:49.820913 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:49.889527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3b2ab-324d-45e7-88b3-03fa998c733f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.897334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.898066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.903434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.904125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.904418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.905274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/c25edbcad9974b6eb92ec813abebb33b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.909541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=c25edbcad9974b6eb92ec813abebb33b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.910131 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3094/6163] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:49.911366 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:49.911366 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:38:49.911366 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:38:49.911625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.912580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:49.931208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6fd6-2343-4111-8ed1-27be89244b2c service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.944780 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3070/6164] 10.222.0.42 () {58 vars in 1342 bytes} [Sun Oct 23 01:38:49 2022] HEAD /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/c25edbcad9974b6eb92ec813abebb33b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:49.949253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:49.963427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae64dcb-b196-4af9-aa15-5518c213fd83 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:49.970010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07181b-4fcd-4451-af90-821c1e07d9c6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:49.970897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07181b-4fcd-4451-af90-821c1e07d9c6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:49.971023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07181b-4fcd-4451-af90-821c1e07d9c6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:49.971274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07181b-4fcd-4451-af90-821c1e07d9c6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/c25edbcad9974b6eb92ec813abebb33b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:49.973165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07181b-4fcd-4451-af90-821c1e07d9c6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4a3a6269e51941fa9c606dff3ad72d87, user_id=c25edbcad9974b6eb92ec813abebb33b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:49.975703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07181b-4fcd-4451-af90-821c1e07d9c6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:50.017762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:50.020063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:50.020063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:50.020063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] PATH_INFO: `/v3/projects/a78e75dfc0c844df9d92191c743bc540/users/24a5c439d21241028857e51aef0d10f6/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:50.044499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78e75dfc0c844df9d92191c743bc540, user_id=24a5c439d21241028857e51aef0d10f6, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:50.050012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:50.056353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7a07181b-4fcd-4451-af90-821c1e07d9c6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c25edbcad9974b6eb92ec813abebb33b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:50.140245 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3095/6165] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:38:49 2022] PUT /identity/v3/projects/a78e75dfc0c844df9d92191c743bc540/users/24a5c439d21241028857e51aef0d10f6/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:50.141571 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3071/6166] 10.222.0.42 () {58 vars in 1344 bytes} [Sun Oct 23 01:38:49 2022] DELETE /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users/c25edbcad9974b6eb92ec813abebb33b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:50.142317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:50.143685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:50.144024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:50.144604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:50.221338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:50.223721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:50.236672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b8002-979f-40e3-89dd-bb66837b5541 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:50.294985 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:50.316978 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3072/6167] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:50.326227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:50.327595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:50.330378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:50.331031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:50.331314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:50.331586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:50.334182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=4a3a6269e51941fa9c606dff3ad72d87)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:50.335012 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:50.335012 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:38:50.335012 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:38:50.336200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:50.351080 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3096/6168] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:38:50 2022] GET /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87/users => generated 145 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:50.351997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:50.363746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718f1c9-7933-4fb0-817b-64bcc8022d01 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:50.370797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:50.373083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:50.386814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:50.388225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users/c25edbcad9974b6eb92ec813abebb33b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:50.391429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c25edbcad9974b6eb92ec813abebb33b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:50.399162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:50.423935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5356ec-757d-4022-a392-4a8e3a4c3647 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:50.431161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:50.431161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:50.431161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:50.431161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:50.446067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:50.454511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:50.467423 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3073/6169] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:50.519104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:50.532602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acd49d-9785-47bd-8a2e-b3ef94131143 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:50.538456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:50.539068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:50.539439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:50.539717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:50.570204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25edbcad9974b6eb92ec813abebb33b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:50.578891 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:50.605274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25edbcad9974b6eb92ec813abebb33b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:50.607937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25edbcad9974b6eb92ec813abebb33b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:50.685701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:50.685701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:50.691421 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3074/6170] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:50.722131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25edbcad9974b6eb92ec813abebb33b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:50.724818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25edbcad9974b6eb92ec813abebb33b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:50.774748 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3097/6171] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:50 2022] DELETE /identity/v3/users/c25edbcad9974b6eb92ec813abebb33b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:50.776799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:50.791162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d0388-2c67-4efd-9eb7-29800cd684dd service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:50.905746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:50.906522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:50.906874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:50.907218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users/614fcec1a95f498fa8529f8fb5f59f7d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:50.909289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_user(user_id=614fcec1a95f498fa8529f8fb5f59f7d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:50.911998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:51.093258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614fcec1a95f498fa8529f8fb5f59f7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.110886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614fcec1a95f498fa8529f8fb5f59f7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.118290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614fcec1a95f498fa8529f8fb5f59f7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.198601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614fcec1a95f498fa8529f8fb5f59f7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.199295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-15ba180f-65a2-4673-aee4-e5ab1d45aeb8 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614fcec1a95f498fa8529f8fb5f59f7d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.224458 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3075/6172] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:50 2022] DELETE /identity/v3/users/614fcec1a95f498fa8529f8fb5f59f7d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:51.228573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:51.231293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:51.257382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d52c6-dc4d-47da-aabe-4eccfa058ca4 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:51.327084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:51.328382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:51.328501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:51.328833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users/25b9e62043ec4078b2464aa94be06d2a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:51.330287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_user(user_id=25b9e62043ec4078b2464aa94be06d2a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:51.333200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:51.463751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bdab6-c3fa-4845-8227-8882e1df398a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:51.464282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bdab6-c3fa-4845-8227-8882e1df398a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:51.464480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bdab6-c3fa-4845-8227-8882e1df398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:51.481632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b9e62043ec4078b2464aa94be06d2a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.483755 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:51.493176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b9e62043ec4078b2464aa94be06d2a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.494581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b9e62043ec4078b2464aa94be06d2a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.502484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-351bdab6-c3fa-4845-8227-8882e1df398a None None] MFA Rules not processed for user `fafd69cbb8644b55a058bfb4e8d12604`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:51.503941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-351bdab6-c3fa-4845-8227-8882e1df398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:51.592824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b9e62043ec4078b2464aa94be06d2a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.594264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b9e62043ec4078b2464aa94be06d2a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:51.618144 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3098/6173] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:51 2022] DELETE /identity/v3/users/25b9e62043ec4078b2464aa94be06d2a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:51.622007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:51.623419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:51.669012 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3076/6174] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:51.670556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:51.670847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:51.671174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:51.717721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] MFA Rules not processed for user `6e9f6fbfc6484cbfb60167b73e87a768`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:51.720553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:51.747797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa09e0-b8cb-4252-b3fd-45007b0185ed tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:51.748384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:51.749045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:51.749324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:51.749913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/4a3a6269e51941fa9c606dff3ad72d87` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:51.752196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4a3a6269e51941fa9c606dff3ad72d87)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:51.754554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:51.824996 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3077/6175] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:51.836707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:51.840355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:51.990355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07fe06-8f31-4d2a-ac7d-a4258c6772e4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:52.006644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:52.007429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:52.007821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:52.008209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:52.010225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:52.018853 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3099/6176] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:38:51 2022] DELETE /identity/v3/groups/4a3a6269e51941fa9c606dff3ad72d87 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:52.019847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:52.035582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:52.039484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:52.068173 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3078/6177] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:38:52.170221 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:52.179649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943909a-0c5f-48c4-a495-16db7a5aecc6 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:52.186271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:52.187303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:52.187849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:52.188547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:52.189667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:52.192957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:52.296257 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3100/6178] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:52 2022] POST /identity/v3/groups => generated 326 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:52.298683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:52.310704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1cc16-89d0-421b-a3c1-7d3680e23c06 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:52.315008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:52.315638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:52.315923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:52.316879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:52.317413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:52.319363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:52.484428 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3079/6179] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:52 2022] POST /identity/v3/groups => generated 326 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:38:52.485796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:52.504156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f66dc-a53d-4b10-be54-c9333b67ca08 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:52.515942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:52.517152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:52.517693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:52.518123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:52.519469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:52.521746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:52.612341 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3101/6180] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:52 2022] POST /identity/v3/groups => generated 324 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:52.614403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:52.624872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f71de2-e946-40a5-af77-f557cfe13b24 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:52.637543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:52.638208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:52.638640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:52.638924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:52.639707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:52.640742 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:38:52.640742 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:38:52.640742 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:38:52.641889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:52.652180 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3080/6181] 10.222.0.42 () {58 vars in 1125 bytes} [Sun Oct 23 01:38:52 2022] GET /identity/v3/groups => generated 1486 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:38:52.653439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:52.664111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1064069-1629-444e-a601-85e96c1bda9b tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:52.668882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:52.669511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:52.669796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:52.670113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/e9a9786c22b74f748c677d91d02cad9b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:52.676720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e9a9786c22b74f748c677d91d02cad9b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:52.679828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:52.835520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:52.839155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:52.889285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3102/6182] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:38:52 2022] DELETE /identity/v3/groups/e9a9786c22b74f748c677d91d02cad9b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:52.893345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:53.046361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b3885-529b-47fc-8c99-dae2740e5f6c tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:53.061038 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:53.112086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d8f3b-9edd-465f-99ea-2aa06066c2bb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:53.120914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:53.121566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:53.121854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:53.122167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/f7ba920681714e71aaee4a84fb5db8ea` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:53.135365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f7ba920681714e71aaee4a84fb5db8ea)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:53.137368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:53.171754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:53.172559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:53.172813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:53.174330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:53.181098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:53.226977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:53.228852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:53.245643 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:53.256334 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3081/6183] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:53.304121 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3103/6184] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:38:52 2022] DELETE /identity/v3/groups/f7ba920681714e71aaee4a84fb5db8ea => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:53.306007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:53.327185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4baa06-c845-4d59-bebc-0c02806a29a3 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:53.444280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:53.445156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:53.445540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:53.445968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/b56dfb146854419b8b430e18b6702142` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:53.454662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b56dfb146854419b8b430e18b6702142)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:53.456932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:53.633598 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3082/6185] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:38:53 2022] DELETE /identity/v3/groups/b56dfb146854419b8b430e18b6702142 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:53.643161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:53.658459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603edc6c-0409-4d55-91e2-a8185fe74ccf tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:53.744202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:53.745356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:53.746393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:53.746940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:53.747755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:53.749817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:53.981912 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3104/6186] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:38:53 2022] POST /identity/v3/users => generated 319 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:53.987473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:54.002839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cde78-6d5a-46fb-8acc-1dae464ac1ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:54.019649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:54.020790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:54.020790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:54.020790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:54.021469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:54.029486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:54.120496 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3083/6187] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:53 2022] POST /identity/v3/groups => generated 326 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:54.124646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:54.143918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f2872-aa2c-4a3d-acd6-581b0c54404f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:54.156917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:54.157603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:54.157889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:54.158192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/6b2c272c486a4775a68f6b4dc3d19a6d/users/0c092a82703b4489a183b68756c9d937` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:54.202839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6b2c272c486a4775a68f6b4dc3d19a6d, user_id=0c092a82703b4489a183b68756c9d937)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:54.211401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:54.331636 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3105/6188] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:38:54 2022] PUT /identity/v3/groups/6b2c272c486a4775a68f6b4dc3d19a6d/users/0c092a82703b4489a183b68756c9d937 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:54.338174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:54.353354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3e583-b883-4efe-81bd-91118e64aeb1 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:54.540680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:54.541340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:54.548612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:54.548612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:54.548612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:54.548612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:54.627401 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:54.700236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3084/6189] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:38:54 2022] POST /identity/v3/groups => generated 326 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:38:54.701276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:54.722110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9501f62-5b48-4d40-b5cf-ffda878dd8b7 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:54.729009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:54.730082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:54.730522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:54.731234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/9b490d4add01451aaf6eeeb6a39ec66d/users/0c092a82703b4489a183b68756c9d937` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:54.745859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9b490d4add01451aaf6eeeb6a39ec66d, user_id=0c092a82703b4489a183b68756c9d937)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:54.757271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:54.876126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:54.882870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3106/6190] 10.222.0.42 () {60 vars in 1360 bytes} [Sun Oct 23 01:38:54 2022] PUT /identity/v3/groups/9b490d4add01451aaf6eeeb6a39ec66d/users/0c092a82703b4489a183b68756c9d937 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:54.889538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efca081-3d42-4ae2-bc55-c13b49c76947 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:55.034180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:55.042598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:55.042821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:55.043250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users/0c092a82703b4489a183b68756c9d937/groups` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:55.044994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=0c092a82703b4489a183b68756c9d937)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:55.047824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:55.056077 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:55.084375 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3085/6191] 10.222.0.42 () {58 vars in 1242 bytes} [Sun Oct 23 01:38:54 2022] GET /identity/v3/users/0c092a82703b4489a183b68756c9d937/groups => generated 838 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:38:55.088499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:55.101413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88520b-a96f-4263-818d-bc50b9554499 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:55.108296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:55.109361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:55.109860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:55.110659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/9b490d4add01451aaf6eeeb6a39ec66d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:55.127369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9b490d4add01451aaf6eeeb6a39ec66d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:55.130692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:55.350006 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3107/6192] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:38:55 2022] DELETE /identity/v3/groups/9b490d4add01451aaf6eeeb6a39ec66d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:55.354106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:55.373120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef7699-6514-4a67-9ef4-d515d147e70e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:55.513488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:55.514184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:55.514470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:55.514744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/groups/6b2c272c486a4775a68f6b4dc3d19a6d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:55.516074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6b2c272c486a4775a68f6b4dc3d19a6d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:55.518164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:55.736783 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3086/6193] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:38:55 2022] DELETE /identity/v3/groups/6b2c272c486a4775a68f6b4dc3d19a6d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:55.743865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:55.771976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c888df-62dc-4611-9271-1f5efa8bfffb tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:55.862385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:55.863169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:55.863553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:55.863931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/users/0c092a82703b4489a183b68756c9d937` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:55.866331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0c092a82703b4489a183b68756c9d937)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:55.868799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:56.056669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c092a82703b4489a183b68756c9d937'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.057630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c092a82703b4489a183b68756c9d937'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.058804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c092a82703b4489a183b68756c9d937'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.117606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c092a82703b4489a183b68756c9d937'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.118371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c092a82703b4489a183b68756c9d937'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.302717 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3108/6194] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:55 2022] DELETE /identity/v3/users/0c092a82703b4489a183b68756c9d937 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:56.303315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:56.305312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:56.326334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236afbbc-88ee-4360-98c9-dfe6285dc056 tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:56.441819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:56.442523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:56.446495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:56.446495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/domains/0ac8af7fa47d42dcbfb0f9835a4d9780` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:56.446495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0ac8af7fa47d42dcbfb0f9835a4d9780)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:56.446807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:56.472278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.473314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.490873 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:56.602776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.603411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.605917 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3087/6195] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:38:56 2022] PATCH /identity/v3/domains/0ac8af7fa47d42dcbfb0f9835a4d9780 => generated 277 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:38:56.609937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:56.621836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19aa96-d611-41d8-985c-04bec5a2b3ae tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:56.748180 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:56.770256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc133f332f7b41bfab5816c900912ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9199a9deb0fa425e970ca022d0f7bb31', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:56.770920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:56.771198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:56.771475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] PATH_INFO: `/v3/domains/0ac8af7fa47d42dcbfb0f9835a4d9780` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:56.801083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:56.802797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:56.841560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0ac8af7fa47d42dcbfb0f9835a4d9780)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:56.847405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:56.945749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.954330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:56.973243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75526d-6077-4e93-bc57-25beb480320f tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:56.983005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:56.983855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:56.985100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:56.985620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:56.990056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:57.096942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:57.099735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:57.117476 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3088/6196] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:57.156629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780', 'request_id': 'req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.169952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780', 'request_id': 'req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.263147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780', 'request_id': 'req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.288435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] The token cache is being invalidate because project 0ac8af7fa47d42dcbfb0f9835a4d9780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:38:57.289057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.291271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.310439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780', 'request_id': 'req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.311495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780', 'request_id': 'req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.315484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e tempest-GroupsV3TestJSON-1437617390 tempest-GroupsV3TestJSON-1437617390-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0ac8af7fa47d42dcbfb0f9835a4d9780', 'request_id': 'req-127e06aa-db73-4fb7-b1ba-1c742a9c4a8e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.332368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:57.332547 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3109/6197] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:38:56 2022] DELETE /identity/v3/domains/0ac8af7fa47d42dcbfb0f9835a4d9780 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:38:57.332647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:57.437444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57eaf3-6e3d-45ab-82f3-745a9efa8adb service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:57.525722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:57.526408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:57.526684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:57.526954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] PATH_INFO: `/v3/users/6bb714cede7d4288b749a40cd358d7f7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:57.528115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb714cede7d4288b749a40cd358d7f7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:57.530081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:57.826452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb714cede7d4288b749a40cd358d7f7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.827692 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:57.855550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb714cede7d4288b749a40cd358d7f7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.858696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb714cede7d4288b749a40cd358d7f7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.947358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb714cede7d4288b749a40cd358d7f7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.948362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb714cede7d4288b749a40cd358d7f7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:38:57.985445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3089/6198] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:38:57 2022] DELETE /identity/v3/users/6bb714cede7d4288b749a40cd358d7f7 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:38:57.990640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:57.991642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:57.992111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:58.033041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:38:58.034978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:58.130394 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:58.144721 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3110/6199] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:38:58.188102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:58.189631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:58.304636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfbbe-0d2c-4ddb-9fc4-fb27a6a673ad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:58.314919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:58.317586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:58.317586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:58.317855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:58.339248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:58.340841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:38:58.365964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3090/6200] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:38:59.586779 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:38:59.945901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:38:59.947455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:38:59.970220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ae813-76d7-475a-a4ff-60f4735c5a14 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:38:59.986030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:38:59.986738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:38:59.987003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:38:59.987281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] PATH_INFO: `/v3/projects/64cd92d2f8a641809ebda76e74a54e29` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:38:59.989038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64cd92d2f8a641809ebda76e74a54e29)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:38:59.995795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:00.157822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cd92d2f8a641809ebda76e74a54e29', 'request_id': 'req-b7569779-7503-48f1-9cab-41e0336c868e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:00.174866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cd92d2f8a641809ebda76e74a54e29', 'request_id': 'req-b7569779-7503-48f1-9cab-41e0336c868e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:00.283567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cd92d2f8a641809ebda76e74a54e29', 'request_id': 'req-b7569779-7503-48f1-9cab-41e0336c868e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:00.305413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] The token cache is being invalidate because project 64cd92d2f8a641809ebda76e74a54e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:00.305715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:00.318226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7569779-7503-48f1-9cab-41e0336c868e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:00.319948 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3111/6201] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:38:59 2022] DELETE /identity/v3/projects/64cd92d2f8a641809ebda76e74a54e29 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:00.324089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:00.388148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b8e0-c6f3-45cd-a135-3cfaefffa89a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:00.587688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:00.590085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:00.592433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:00.596748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] PATH_INFO: `/v3/users/bc133f332f7b41bfab5816c900912ebb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:00.599845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc133f332f7b41bfab5816c900912ebb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:00.602320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:01.004558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc133f332f7b41bfab5816c900912ebb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:01.027752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc133f332f7b41bfab5816c900912ebb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:01.028802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc133f332f7b41bfab5816c900912ebb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:01.134843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc133f332f7b41bfab5816c900912ebb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:01.135753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc133f332f7b41bfab5816c900912ebb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:01.195142 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:01.199016 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3091/6202] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:00 2022] DELETE /identity/v3/users/bc133f332f7b41bfab5816c900912ebb => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:03.198379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:03.200165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:03.200692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:03.270958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] MFA Rules not processed for user `24a5c439d21241028857e51aef0d10f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:03.272193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:03.429306 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3112/6203] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:03.430479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:03.436361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:03.437537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:03.437625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:03.466984 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:03.610807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c6213-d4f2-4f71-b391-d26a4334a25c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:03.621360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:03.622383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:03.622859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:03.623326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:03.624195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:03.630562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:03.648446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508d46-2f43-4144-8d26-40ab675da247 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:03.660438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:03.661022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:03.661298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:03.662315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] PATH_INFO: `/v3/projects/9199a9deb0fa425e970ca022d0f7bb31` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:03.666138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9199a9deb0fa425e970ca022d0f7bb31)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:03.670802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:03.769841 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3113/6204] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:03 2022] POST /identity/v3/projects => generated 379 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:03.770979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:03.842991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9199a9deb0fa425e970ca022d0f7bb31', 'request_id': 'req-db0d6b13-ff6c-42ac-8072-7333076c87ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:03.854116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9199a9deb0fa425e970ca022d0f7bb31', 'request_id': 'req-db0d6b13-ff6c-42ac-8072-7333076c87ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:03.899756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcd2f5-28cf-433e-98f1-cde66b73174b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:03.996312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:03.997610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:03.998180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:03.998674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:03.999658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.002939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.020689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9199a9deb0fa425e970ca022d0f7bb31', 'request_id': 'req-db0d6b13-ff6c-42ac-8072-7333076c87ea'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:04.044965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] The token cache is being invalidate because project 9199a9deb0fa425e970ca022d0f7bb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:04.046112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:04.046853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db0d6b13-ff6c-42ac-8072-7333076c87ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:04.054897 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3092/6205] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:03 2022] DELETE /identity/v3/projects/9199a9deb0fa425e970ca022d0f7bb31 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:04.059328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5468-7a42-4550-9f32-3043ee018950 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.059619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5468-7a42-4550-9f32-3043ee018950 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.060087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5468-7a42-4550-9f32-3043ee018950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.146064 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3114/6206] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:03 2022] POST /identity/v3/users => generated 296 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:39:04.147276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.150324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:04.202852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d0fa5468-7a42-4550-9f32-3043ee018950 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:04.204276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d0fa5468-7a42-4550-9f32-3043ee018950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:04.212125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6f5fc-1471-49a4-9d81-b08121619b78 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:04.219304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:04.220390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.220865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.222177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.223031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.225151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.225810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3093/6207] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:04.235031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06c11e-adea-419a-b47d-941c92bdd82b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.235362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06c11e-adea-419a-b47d-941c92bdd82b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.235544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06c11e-adea-419a-b47d-941c92bdd82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.260829 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3115/6208] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:04.266329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.288070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2d06c11e-adea-419a-b47d-941c92bdd82b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:04.292074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d06c11e-adea-419a-b47d-941c92bdd82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:04.308831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7fad7-0bc4-438c-ba8c-437bc0c26673 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:04.317998 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3094/6209] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:04.322569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06c11e-adea-419a-b47d-941c92bdd82b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.328020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:04.329908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.332355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.332840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] PATH_INFO: `/v3/projects/319625a497ba49cb987393afd9bbf54c/users/598618fec823423d94c443aaa6d5b1fa/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.354854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06c11e-adea-419a-b47d-941c92bdd82b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:04.368298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:04.369349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.369636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.369909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.370643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:04.371704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.373360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.401691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=319625a497ba49cb987393afd9bbf54c, user_id=598618fec823423d94c443aaa6d5b1fa, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.404952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.416372 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3095/6210] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:04.420670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.466112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dbc65-d4be-4edc-81b8-2efb1ab62347 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:04.485826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:04.487195 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:04.491154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.491698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.493369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.497928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.499106 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3116/6211] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:04 2022] PUT /identity/v3/projects/319625a497ba49cb987393afd9bbf54c/users/598618fec823423d94c443aaa6d5b1fa/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:04.503381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.510567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.639324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3096/6212] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:04 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:04.648686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.670366 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:04.713322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f0198-1235-44f4-a264-1d66572bd2de admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:04.809467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec244db-ffc6-4b25-a509-e8677431d725 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:04.816019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:04.816678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.816958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.817426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.818184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.820256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.860925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:04.861573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.861855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.862154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.863342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.866493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.893325 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3117/6213] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:04.894290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.914984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d64429-5dd6-41ba-b573-32e910779fea admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:04.937391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:04.938023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:04.938860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:04.938860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] PATH_INFO: `/v3/projects/319625a497ba49cb987393afd9bbf54c/users/598618fec823423d94c443aaa6d5b1fa/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:04.941619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319625a497ba49cb987393afd9bbf54c, user_id=598618fec823423d94c443aaa6d5b1fa, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:04.944921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:04.970887 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3097/6214] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:04 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:04.972222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:04.974169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3118/6215] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:04 2022] PUT /identity/v3/projects/319625a497ba49cb987393afd9bbf54c/users/598618fec823423d94c443aaa6d5b1fa/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:05.013334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21610-6591-4f9c-94a6-0d5cb045bfa0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:05.152382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:05.154076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:05.154359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:05.154637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:05.155303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:05.163559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:05.196430 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3098/6216] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:05.196627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:05.213710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c277-e453-45bb-b620-80ca2d8b10b1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:05.225899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501dde7-0639-47f5-9c9a-60c60a85d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:05.226555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501dde7-0639-47f5-9c9a-60c60a85d597 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:05.226837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501dde7-0639-47f5-9c9a-60c60a85d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:05.227111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501dde7-0639-47f5-9c9a-60c60a85d597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:05.227770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501dde7-0639-47f5-9c9a-60c60a85d597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:05.234725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501dde7-0639-47f5-9c9a-60c60a85d597 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:05.257445 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3119/6217] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:39:05.262365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:05.274372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba516-a01a-4616-a463-8fe3c6a5d5de admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:05.281030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:05.281867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:05.282462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:05.282745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] PATH_INFO: `/v3/projects/4e9e877f56344fe297edf426c4aa51e4/users/5f426f15774c46afaf8dc7a090edd24d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:05.336663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9e877f56344fe297edf426c4aa51e4, user_id=5f426f15774c46afaf8dc7a090edd24d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:05.340772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:05.433430 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3099/6218] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:05 2022] PUT /identity/v3/projects/4e9e877f56344fe297edf426c4aa51e4/users/5f426f15774c46afaf8dc7a090edd24d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:05.435545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e500e8b-442a-4613-b90c-56d9aa0bcd4e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:05.435836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e500e8b-442a-4613-b90c-56d9aa0bcd4e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:05.436141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e500e8b-442a-4613-b90c-56d9aa0bcd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:05.502641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8e500e8b-442a-4613-b90c-56d9aa0bcd4e None None] MFA Rules not processed for user `5f426f15774c46afaf8dc7a090edd24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:05.504520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e500e8b-442a-4613-b90c-56d9aa0bcd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:05.683751 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3120/6219] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:05.688379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:05.703154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5698-728d-499a-9d6f-389e295fa941 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:05.715648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:05.717020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:05.717576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:05.718805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:05.719749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5f426f15774c46afaf8dc7a090edd24d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:05.722417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:05.892799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3100/6220] 10.222.0.42 () {60 vars in 1299 bytes} [Sun Oct 23 01:39:05 2022] POST /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2 => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:39:05.906863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e500e8b-442a-4613-b90c-56d9aa0bcd4e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:05.922091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e500e8b-442a-4613-b90c-56d9aa0bcd4e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:05.938240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:05.938931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:05.939215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:05.941948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/9bed520fde7e48d39818245a410d40b2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:05.947995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5f426f15774c46afaf8dc7a090edd24d, credential_id=9bed520fde7e48d39818245a410d40b2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:05.949463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:05.953421 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:06.056462 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3121/6221] 10.222.0.42 () {58 vars in 1380 bytes} [Sun Oct 23 01:39:05 2022] DELETE /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/9bed520fde7e48d39818245a410d40b2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:06.061954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.074338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98bf10-0ecd-4cf9-8ded-0882c29f1154 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.087558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.088473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.088916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.089374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.090591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5f426f15774c46afaf8dc7a090edd24d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.092319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:06.216841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3101/6222] 10.222.0.42 () {60 vars in 1299 bytes} [Sun Oct 23 01:39:06 2022] POST /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2 => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:06.221098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.238956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc56fd-1e1a-4b3a-b46d-71b8e509928e tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.245886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.246646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.246934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.247413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/e88d5136777946f48ba89829e7566423` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.249550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5f426f15774c46afaf8dc7a090edd24d, credential_id=e88d5136777946f48ba89829e7566423)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.252919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:06.370283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.370737 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3122/6223] 10.222.0.42 () {58 vars in 1380 bytes} [Sun Oct 23 01:39:06 2022] DELETE /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/e88d5136777946f48ba89829e7566423 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:06.385296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.388038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366f478-6a83-43be-9b92-ae4ca0de12b2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.389548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:06.394875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febb2e-d0c1-45f3-a4a7-31a9e5c9c373 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.395609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febb2e-d0c1-45f3-a4a7-31a9e5c9c373 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.395865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febb2e-d0c1-45f3-a4a7-31a9e5c9c373 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.396142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81febb2e-d0c1-45f3-a4a7-31a9e5c9c373 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/e88d5136777946f48ba89829e7566423` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-81febb2e-d0c1-45f3-a4a7-31a9e5c9c373 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Could not find credential: cf8ff1c106965cef67507f1e97294552d8252249780b6cefc17fb6f0a4094b54.: keystone.exception.CredentialNotFound: Could not find credential: cf8ff1c106965cef67507f1e97294552d8252249780b6cefc17fb6f0a4094b54. Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 23 01:39:06.422858 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:39:06.424005 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: cf8ff1c106965cef67507f1e97294552d8252249780b6cefc17fb6f0a4094b54. Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:39:06.425294 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3102/6224] 10.222.0.42 () {58 vars in 1377 bytes} [Sun Oct 23 01:39:06 2022] GET /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/e88d5136777946f48ba89829e7566423 => generated 148 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:39:06.432104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febb2e-d0c1-45f3-a4a7-31a9e5c9c373 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.446350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81febb2e-d0c1-45f3-a4a7-31a9e5c9c373 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.452392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.453594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.453887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.454224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.454916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5f426f15774c46afaf8dc7a090edd24d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.457340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:06.500022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36bf80-84f4-4e91-820f-4d6119d98f5c tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.505215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.505852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.512455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.512455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.512455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:06.522231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.523829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:06.536336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3123/6225] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:39:06.560828 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3103/6226] 10.222.0.42 () {60 vars in 1299 bytes} [Sun Oct 23 01:39:06 2022] POST /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2 => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:06.566141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.584652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee379-85a6-43e8-bbdf-f9cbd4bd06fc service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.602938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.604288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.604288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.604288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.604836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5f426f15774c46afaf8dc7a090edd24d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.607016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:06.719274 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3124/6227] 10.222.0.42 () {60 vars in 1299 bytes} [Sun Oct 23 01:39:06 2022] POST /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2 => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:06.720135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.749650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e943ed-9a5f-4c2b-8cbb-8460293b54f2 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.778473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.779364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.779855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.780427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.781309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=5f426f15774c46afaf8dc7a090edd24d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.783142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:06.808426 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3104/6228] 10.222.0.42 () {58 vars in 1278 bytes} [Sun Oct 23 01:39:06 2022] GET /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2 => generated 865 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:39:06.809617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.827530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965776-9f48-4ac6-be45-d16fd93a8abb tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.836020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.836840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.837131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.837410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/bc88dd71206045d983833eda3583197f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.839472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5f426f15774c46afaf8dc7a090edd24d, credential_id=bc88dd71206045d983833eda3583197f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.840912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:06.904424 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3125/6229] 10.222.0.42 () {58 vars in 1380 bytes} [Sun Oct 23 01:39:06 2022] DELETE /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/bc88dd71206045d983833eda3583197f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:39:06.909712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:06.958023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa4d7-1cf9-49af-9e7b-23b643ffd094 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:06.978709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:06.981676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:06.982087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:06.982372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/ec0be7508dfa470bba976ab23c20b661` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:06.985613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5f426f15774c46afaf8dc7a090edd24d, credential_id=ec0be7508dfa470bba976ab23c20b661)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:06.987120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:07.020332 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:07.113708 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3105/6230] 10.222.0.42 () {58 vars in 1380 bytes} [Sun Oct 23 01:39:06 2022] DELETE /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/ec0be7508dfa470bba976ab23c20b661 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:07.119105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:07.135337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37c671-e0ae-40c6-9d53-9b3324c4bf81 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:07.144746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:07.145783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:07.145783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:07.146100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:07.146955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=5f426f15774c46afaf8dc7a090edd24d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:07.148501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:07.295690 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3126/6231] 10.222.0.42 () {60 vars in 1299 bytes} [Sun Oct 23 01:39:07 2022] POST /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2 => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:07.299770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:07.317729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112cf16-e427-4dcd-91c8-e87253479d58 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:07.336684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:07.337628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:07.338151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:07.338752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/420fb94f680247e3a9c8addb10651570` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:07.340981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=5f426f15774c46afaf8dc7a090edd24d, credential_id=420fb94f680247e3a9c8addb10651570)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:07.342828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:07.349415 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3106/6232] 10.222.0.42 () {58 vars in 1377 bytes} [Sun Oct 23 01:39:07 2022] GET /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/420fb94f680247e3a9c8addb10651570 => generated 367 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:07.353769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:07.373761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3601cc-466a-4eae-9c0c-8ecacd1a42b1 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:07.379677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f24016-c0e6-4e28-bd29-75722f36444f tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f426f15774c46afaf8dc7a090edd24d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9e877f56344fe297edf426c4aa51e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:07.380660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24016-c0e6-4e28-bd29-75722f36444f tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:07.381169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24016-c0e6-4e28-bd29-75722f36444f tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:07.381649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24016-c0e6-4e28-bd29-75722f36444f tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/420fb94f680247e3a9c8addb10651570` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:07.383894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24016-c0e6-4e28-bd29-75722f36444f tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=5f426f15774c46afaf8dc7a090edd24d, credential_id=420fb94f680247e3a9c8addb10651570)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:07.385808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24016-c0e6-4e28-bd29-75722f36444f tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:07.493261 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3127/6233] 10.222.0.42 () {58 vars in 1380 bytes} [Sun Oct 23 01:39:07 2022] DELETE /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d/credentials/OS-EC2/420fb94f680247e3a9c8addb10651570 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:07.500006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:07.637122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df75fc2-d0e8-422b-b497-a2acc6aaf618 tempest-EC2CredentialsTest-1203581058 tempest-EC2CredentialsTest-1203581058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:07.642630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:07.644322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:07.644857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:07.645332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] PATH_INFO: `/v3/users/5f426f15774c46afaf8dc7a090edd24d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:07.646899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f426f15774c46afaf8dc7a090edd24d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:07.649097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:07.887776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f426f15774c46afaf8dc7a090edd24d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:07.922225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f426f15774c46afaf8dc7a090edd24d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:07.925939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f426f15774c46afaf8dc7a090edd24d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:08.043212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f426f15774c46afaf8dc7a090edd24d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:08.043812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f426f15774c46afaf8dc7a090edd24d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:08.094059 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3107/6234] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:07 2022] DELETE /identity/v3/users/5f426f15774c46afaf8dc7a090edd24d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:08.099389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:08.100247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:08.100553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:08.147344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:08.148284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:08.263100 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:08.278717 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3128/6235] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:08.322889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:08.324329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:08.455140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177fc4-23e0-4549-bde9-331bf8a61d60 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:08.463244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a82eb-b95b-4218-bc0b-9dac343c3a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:08.463882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a82eb-b95b-4218-bc0b-9dac343c3a11 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:08.464154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a82eb-b95b-4218-bc0b-9dac343c3a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:08.464425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a82eb-b95b-4218-bc0b-9dac343c3a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:08.487513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a82eb-b95b-4218-bc0b-9dac343c3a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:08.488964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a82eb-b95b-4218-bc0b-9dac343c3a11 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:08.519877 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3108/6236] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:10.713227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:10.714779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:10.772827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0cdd5-2ced-46b8-8ae6-448a0de29c06 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:10.790636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:10.791679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:10.792224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:10.792716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] PATH_INFO: `/v3/projects/4e9e877f56344fe297edf426c4aa51e4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:10.794350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9e877f56344fe297edf426c4aa51e4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:10.803372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:10.992869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9e877f56344fe297edf426c4aa51e4', 'request_id': 'req-6ce0e25d-8456-403b-b05d-f1d6394d4814'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:11.012039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9e877f56344fe297edf426c4aa51e4', 'request_id': 'req-6ce0e25d-8456-403b-b05d-f1d6394d4814'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:11.180483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9e877f56344fe297edf426c4aa51e4', 'request_id': 'req-6ce0e25d-8456-403b-b05d-f1d6394d4814'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:11.200085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] The token cache is being invalidate because project 4e9e877f56344fe297edf426c4aa51e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:11.206204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:11.206204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ce0e25d-8456-403b-b05d-f1d6394d4814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:11.206204 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3129/6237] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:10 2022] DELETE /identity/v3/projects/4e9e877f56344fe297edf426c4aa51e4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:11.210219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886959d-cb37-467a-9d1c-6ee0edd71d5c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:11.211140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886959d-cb37-467a-9d1c-6ee0edd71d5c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:11.211637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886959d-cb37-467a-9d1c-6ee0edd71d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:11.243015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0886959d-cb37-467a-9d1c-6ee0edd71d5c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:11.246331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0886959d-cb37-467a-9d1c-6ee0edd71d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:11.274643 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:11.458626 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3109/6238] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:11.573420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f809-5d8b-4d99-8a87-b29ca0b51f96 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:11.573877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f809-5d8b-4d99-8a87-b29ca0b51f96 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:11.574423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f809-5d8b-4d99-8a87-b29ca0b51f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:11.618115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bf67f809-5d8b-4d99-8a87-b29ca0b51f96 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:11.622956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf67f809-5d8b-4d99-8a87-b29ca0b51f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:11.641649 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3130/6239] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:11.647192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886959d-cb37-467a-9d1c-6ee0edd71d5c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:11.661023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886959d-cb37-467a-9d1c-6ee0edd71d5c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:11.667055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:11.671757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:11.671757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:11.671757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:11.671757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:11.671757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:11.673636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:11.729232 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3110/6240] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:11.731863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f809-5d8b-4d99-8a87-b29ca0b51f96 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:11.742234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f809-5d8b-4d99-8a87-b29ca0b51f96 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:11.772331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:11.773174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:11.773593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:11.773995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:11.774778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:11.776921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:11.943504 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3131/6241] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:11 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:11.947948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:11.964625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e49f31-8f43-4b2b-8896-6797cbc33cc5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:12.152066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:12.154457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:12.154797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:12.155219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:12.155892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:12.157847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:12.298498 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3111/6242] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:11 2022] POST /identity/v3/users => generated 290 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:12.303070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:12.315858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e911c5-17fc-47a0-b6ce-4b848063590f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:12.341069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:12.345056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:12.346345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:12.347514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:12.349092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:12.351734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:12.394515 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3132/6243] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:12.397056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:12.414474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f4c2e-0702-4885-8c51-f0508ea8b053 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:12.427496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d995e-6687-4b33-b706-8636ace9112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:12.429677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d995e-6687-4b33-b706-8636ace9112d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:12.431092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d995e-6687-4b33-b706-8636ace9112d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:12.432178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d995e-6687-4b33-b706-8636ace9112d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:12.434443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d995e-6687-4b33-b706-8636ace9112d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:12.436247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d995e-6687-4b33-b706-8636ace9112d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:12.483147 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3112/6244] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:12.489894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:12.507101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c0141-e0de-403f-b073-dc998052c99c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:12.514236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca324d9-ef23-4bf6-96e9-7962b6e2a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:12.517712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca324d9-ef23-4bf6-96e9-7962b6e2a59b admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:12.517712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca324d9-ef23-4bf6-96e9-7962b6e2a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:12.517712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca324d9-ef23-4bf6-96e9-7962b6e2a59b admin admin] PATH_INFO: `/v3/projects/b53f499775524f7a9544008b4884e945/users/4e9f9472de7d4fd5a1c868a8e53c7ff0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:12.537022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca324d9-ef23-4bf6-96e9-7962b6e2a59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53f499775524f7a9544008b4884e945, user_id=4e9f9472de7d4fd5a1c868a8e53c7ff0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:12.538988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca324d9-ef23-4bf6-96e9-7962b6e2a59b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:12.542164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a1d8-f782-4b49-b082-61e06ab6b71d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:12.543299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a1d8-f782-4b49-b082-61e06ab6b71d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:12.543299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a1d8-f782-4b49-b082-61e06ab6b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:12.610593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-38c3a1d8-f782-4b49-b082-61e06ab6b71d None None] MFA Rules not processed for user `2ceec980f06b45a989a5cd6cbca9d5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:12.614208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-38c3a1d8-f782-4b49-b082-61e06ab6b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:12.671667 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3133/6245] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:12 2022] PUT /identity/v3/projects/b53f499775524f7a9544008b4884e945/users/4e9f9472de7d4fd5a1c868a8e53c7ff0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:12.682694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18706a4-057b-4801-82f6-f6d45079ce06 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:12.683125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18706a4-057b-4801-82f6-f6d45079ce06 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:12.683497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18706a4-057b-4801-82f6-f6d45079ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:12.738156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a18706a4-057b-4801-82f6-f6d45079ce06 None None] MFA Rules not processed for user `4e9f9472de7d4fd5a1c868a8e53c7ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:12.738156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a18706a4-057b-4801-82f6-f6d45079ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:12.777491 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3113/6246] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:12.789920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:12.790313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:12.790692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:12.846000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] MFA Rules not processed for user `2ceec980f06b45a989a5cd6cbca9d5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:12.846000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:12.860800 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:12.888887 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3134/6247] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:12.888887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18706a4-057b-4801-82f6-f6d45079ce06 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:12.905238 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:13.003715 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3114/6248] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:13.003715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:13.003715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:13.017689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18706a4-057b-4801-82f6-f6d45079ce06 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.024482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.025347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.025856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.026489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.031364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.031364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:13.042938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a806b7-2f26-48fb-836d-d1306f40af02 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.061178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.061178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.061178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.061178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] PATH_INFO: `/v3/users/c603a3dba9fa4e9db2c0ba7e1247ae72` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.061484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c603a3dba9fa4e9db2c0ba7e1247ae72)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.062608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:13.194197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3135/6249] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:12 2022] POST /identity/v3/projects => generated 379 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:13.198183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:13.277491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9a2e-4b9d-4088-bd2b-a5abfeab7a1b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.283045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.284741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.285027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.285297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.285934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.288017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:13.359539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c603a3dba9fa4e9db2c0ba7e1247ae72'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:13.382125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3136/6250] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:13 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:39:13.386518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:13.391648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c603a3dba9fa4e9db2c0ba7e1247ae72'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:13.397159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c603a3dba9fa4e9db2c0ba7e1247ae72'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:13.412764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b311deb-57d0-4ff3-82a3-5759ff3515fb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.419510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.420355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.420645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.420967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.423086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.424858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:13.442972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c603a3dba9fa4e9db2c0ba7e1247ae72'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:13.443523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2fb9222b-edd5-40bf-8283-11f27c7579ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c603a3dba9fa4e9db2c0ba7e1247ae72'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:13.450198 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3137/6251] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:13.457119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:13.462829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:13.477089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3115/6252] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:12 2022] DELETE /identity/v3/users/c603a3dba9fa4e9db2c0ba7e1247ae72 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:13.478851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.479370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.479916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.503946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8077c7c-fe54-4778-ac37-d00e1a9e9e16 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.508340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:13.510818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:13.596694 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3116/6253] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:13.603801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.605086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.605371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.605678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.606550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.608210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:13.608333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:13.610352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:13.623354 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3138/6254] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:13.627044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:13.642031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078021-b368-4f5d-899d-d0b2ff31463d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.647863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.648779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.649154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.649496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] PATH_INFO: `/v3/projects/4baeb967e6ee4f27a5f6ec990e90d60b/users/d9a51cf2e50f4729969fdb78db088dc5/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.666421 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:13.669906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baeb967e6ee4f27a5f6ec990e90d60b, user_id=d9a51cf2e50f4729969fdb78db088dc5, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.675590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:13.702965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c5ef-43e6-486a-91df-267b6edb3579 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.712142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b48c-67ce-4f6b-9162-318629ae6cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.712368 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:13.713104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b48c-67ce-4f6b-9162-318629ae6cab service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.713504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b48c-67ce-4f6b-9162-318629ae6cab service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.714003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b48c-67ce-4f6b-9162-318629ae6cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.729763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b48c-67ce-4f6b-9162-318629ae6cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.731576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b48c-67ce-4f6b-9162-318629ae6cab service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:13.750146 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3117/6255] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:13.766097 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3139/6256] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:13 2022] PUT /identity/v3/projects/4baeb967e6ee4f27a5f6ec990e90d60b/users/d9a51cf2e50f4729969fdb78db088dc5/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:13.770382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.770772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.771148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.792716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:13.803566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:13.805527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] MFA Rules not processed for user `d9a51cf2e50f4729969fdb78db088dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:13.806806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:13.963924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565ff3-7ba9-421c-94d1-aae4282d07a7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:13.977001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665113cd-52a2-4648-894f-dee60b306545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:13.981036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665113cd-52a2-4648-894f-dee60b306545 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:13.981036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665113cd-52a2-4648-894f-dee60b306545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:13.981036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665113cd-52a2-4648-894f-dee60b306545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:13.981036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-665113cd-52a2-4648-894f-dee60b306545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:13.991354 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3118/6257] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:13.995756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665113cd-52a2-4648-894f-dee60b306545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:13.996245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:14.002059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:14.015419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665113cd-52a2-4648-894f-dee60b306545 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:14.037461 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3140/6258] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:39:14.099243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3416-d496-470c-9599-fe413c114bb7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:14.104141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b167639-2596-4eba-9332-4a7048d8a608 tempest-IdentityV3ProjectsTest-895327823 tempest-IdentityV3ProjectsTest-895327823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e9f9472de7d4fd5a1c868a8e53c7ff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b53f499775524f7a9544008b4884e945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:14.106470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b167639-2596-4eba-9332-4a7048d8a608 tempest-IdentityV3ProjectsTest-895327823 tempest-IdentityV3ProjectsTest-895327823-project] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:14.107899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b167639-2596-4eba-9332-4a7048d8a608 tempest-IdentityV3ProjectsTest-895327823 tempest-IdentityV3ProjectsTest-895327823-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:14.108237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b167639-2596-4eba-9332-4a7048d8a608 tempest-IdentityV3ProjectsTest-895327823 tempest-IdentityV3ProjectsTest-895327823-project] PATH_INFO: `/v3/users/4e9f9472de7d4fd5a1c868a8e53c7ff0/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:14.110440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b167639-2596-4eba-9332-4a7048d8a608 tempest-IdentityV3ProjectsTest-895327823 tempest-IdentityV3ProjectsTest-895327823-project] RBAC: Authorizing `identity:list_user_projects(user_id=4e9f9472de7d4fd5a1c868a8e53c7ff0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:14.113357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b167639-2596-4eba-9332-4a7048d8a608 tempest-IdentityV3ProjectsTest-895327823 tempest-IdentityV3ProjectsTest-895327823-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:14.177357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18344-6151-412c-af43-a62db95a17a4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:14.177930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18344-6151-412c-af43-a62db95a17a4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:14.178235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18344-6151-412c-af43-a62db95a17a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:14.186914 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3119/6259] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:39:13 2022] GET /identity/v3/users/4e9f9472de7d4fd5a1c868a8e53c7ff0/projects => generated 515 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:39:14.227326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-83f18344-6151-412c-af43-a62db95a17a4 None None] MFA Rules not processed for user `4e9f9472de7d4fd5a1c868a8e53c7ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:14.228563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-83f18344-6151-412c-af43-a62db95a17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:14.252971 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3141/6260] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:14.257768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:14.258170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:14.259288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:14.285284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] MFA Rules not processed for user `4e9f9472de7d4fd5a1c868a8e53c7ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:14.287851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:14.339144 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:14.370858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.models.token_model [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] User 4e9f9472de7d4fd5a1c868a8e53c7ff0 has no access to project 4baeb967e6ee4f27a5f6ec990e90d60b {{(pid=81937) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 23 01:39:14.375951 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.server.flask.application [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.42: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 23 01:39:14.378343 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3120/6261] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 122 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 23 01:39:14.386079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18344-6151-412c-af43-a62db95a17a4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:14.552464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18344-6151-412c-af43-a62db95a17a4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:14.563387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:14.564709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:14.566363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:14.566363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] PATH_INFO: `/v3/users/4e9f9472de7d4fd5a1c868a8e53c7ff0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:14.567492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9f9472de7d4fd5a1c868a8e53c7ff0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:14.569849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:14.880387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9f9472de7d4fd5a1c868a8e53c7ff0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:14.889538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:14.892292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:14.894397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9f9472de7d4fd5a1c868a8e53c7ff0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:14.895519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9f9472de7d4fd5a1c868a8e53c7ff0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:14.917385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f3b6e-1c5a-46f1-9989-20e836d02924 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:14.924369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:14.925023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:14.925299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:14.925557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] PATH_INFO: `/v3/projects/eaf5f6076384433eb428f65024e99a12` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:14.927294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf5f6076384433eb428f65024e99a12)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:14.929325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:14.968882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9f9472de7d4fd5a1c868a8e53c7ff0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:14.970199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9f9472de7d4fd5a1c868a8e53c7ff0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:14.997190 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:15.023745 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3142/6262] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:14 2022] DELETE /identity/v3/users/4e9f9472de7d4fd5a1c868a8e53c7ff0 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:15.025867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:15.028095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:15.144282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf5f6076384433eb428f65024e99a12', 'request_id': 'req-00594684-93cc-4d44-a12e-f69bb91b9960'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.157121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf5f6076384433eb428f65024e99a12', 'request_id': 'req-00594684-93cc-4d44-a12e-f69bb91b9960'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.157730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5486e-dd4c-4bc8-ac4b-675cdd74e254 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:15.221832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:15.222520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:15.222830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:15.223921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] PATH_INFO: `/v3/users/e9ea0ce71ac545c995c3e75cb564674a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:15.225404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ea0ce71ac545c995c3e75cb564674a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:15.227383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:15.243515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf5f6076384433eb428f65024e99a12', 'request_id': 'req-00594684-93cc-4d44-a12e-f69bb91b9960'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.266162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] The token cache is being invalidate because project eaf5f6076384433eb428f65024e99a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:15.266590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.267247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-00594684-93cc-4d44-a12e-f69bb91b9960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.273347 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3121/6263] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:14 2022] DELETE /identity/v3/projects/eaf5f6076384433eb428f65024e99a12 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:15.278196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:15.278196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:15.278196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:15.300894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:15.302407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:15.311852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3122/6264] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:15.312912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:15.314404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:15.377335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1c57d-7fdd-40b7-8c3a-d535a39e0f02 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:15.386798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:15.387551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:15.388788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:15.388788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] PATH_INFO: `/v3/users/c7649aa81c1a4643af3d9d37a31cf387` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:15.390141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7649aa81c1a4643af3d9d37a31cf387)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:15.396714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:15.441925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ea0ce71ac545c995c3e75cb564674a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.468153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ea0ce71ac545c995c3e75cb564674a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.469028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ea0ce71ac545c995c3e75cb564674a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.524883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ea0ce71ac545c995c3e75cb564674a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.526589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ea0ce71ac545c995c3e75cb564674a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.549545 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3143/6265] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:15 2022] DELETE /identity/v3/users/e9ea0ce71ac545c995c3e75cb564674a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:15.552806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:15.555984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:15.577244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7649aa81c1a4643af3d9d37a31cf387'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.595045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7649aa81c1a4643af3d9d37a31cf387'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.596475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7649aa81c1a4643af3d9d37a31cf387'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.646998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39e67c-1126-4870-9945-782ff27c4fe0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:15.651094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:15.651789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:15.652141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:15.652488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:15.654393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:15.677329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7649aa81c1a4643af3d9d37a31cf387'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.678283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8fa9df1b-11c6-4264-9318-51475c91fe6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7649aa81c1a4643af3d9d37a31cf387'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:15.699823 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3123/6266] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:15 2022] DELETE /identity/v3/users/c7649aa81c1a4643af3d9d37a31cf387 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:15.717820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:15.718130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:15.718404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:15.778633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:15.779862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:15.783928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:15.785915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:15.803509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3144/6267] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:15.840988 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:15.888376 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3124/6268] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:15.908333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:15.929936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff20ea-0554-4e48-8bad-689ff76137fe service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:16.044548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b33113-4c95-4349-84bd-db6ba5964b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:16.045578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33113-4c95-4349-84bd-db6ba5964b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:16.046441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33113-4c95-4349-84bd-db6ba5964b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:16.047618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33113-4c95-4349-84bd-db6ba5964b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:16.066263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b33113-4c95-4349-84bd-db6ba5964b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:16.070536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b33113-4c95-4349-84bd-db6ba5964b30 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:16.109495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3145/6269] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:16.186830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:16.189043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:16.221479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ab656-8328-40e6-b3d6-d43048158925 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:16.239461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:16.247541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:16.251160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:16.252298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] PATH_INFO: `/v3/projects/0b3d490e32554248b2696947c567e417` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:16.263141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3d490e32554248b2696947c567e417)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:16.265646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:16.410619 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:16.447979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3d490e32554248b2696947c567e417', 'request_id': 'req-262953b8-9c87-4cea-aad8-a5e507eecb7b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:16.467171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3d490e32554248b2696947c567e417', 'request_id': 'req-262953b8-9c87-4cea-aad8-a5e507eecb7b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:16.547530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3d490e32554248b2696947c567e417', 'request_id': 'req-262953b8-9c87-4cea-aad8-a5e507eecb7b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:16.567822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] The token cache is being invalidate because project 0b3d490e32554248b2696947c567e417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:16.568449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:16.569342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-262953b8-9c87-4cea-aad8-a5e507eecb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:16.573361 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3125/6270] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:16 2022] DELETE /identity/v3/projects/0b3d490e32554248b2696947c567e417 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:16.578337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe99ff-baae-467a-b285-9d3e65fec4c3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:16.578869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe99ff-baae-467a-b285-9d3e65fec4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:16.579343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe99ff-baae-467a-b285-9d3e65fec4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:16.621743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4cfe99ff-baae-467a-b285-9d3e65fec4c3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:16.623242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4cfe99ff-baae-467a-b285-9d3e65fec4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:16.722957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3146/6271] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:16.723654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa6736-04f5-493e-86a4-6f15e3ab2689 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:16.724234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa6736-04f5-493e-86a4-6f15e3ab2689 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:16.724782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa6736-04f5-493e-86a4-6f15e3ab2689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:16.770821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4dfa6736-04f5-493e-86a4-6f15e3ab2689 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:16.772132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4dfa6736-04f5-493e-86a4-6f15e3ab2689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:16.803436 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3126/6272] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:16.804755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe99ff-baae-467a-b285-9d3e65fec4c3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:16.818001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe99ff-baae-467a-b285-9d3e65fec4c3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:16.827029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:16.828678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:16.829355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:16.830818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:16.835840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:16.835840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:16.835840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:16.853547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa6736-04f5-493e-86a4-6f15e3ab2689 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:16.858982 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3147/6273] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:16.864338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa6736-04f5-493e-86a4-6f15e3ab2689 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:16.871732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:16.872882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:16.873479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:16.873932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:16.874752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:16.877043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:16.956003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:16.962259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:16.986419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899be2-dc04-4999-8411-4f1c4eba23f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:17.012450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:17.012779 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3127/6274] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:16 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:17.015323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:17.015753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:17.015952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:17.016459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] PATH_INFO: `/v3/projects/b53f499775524f7a9544008b4884e945` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:17.018068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53f499775524f7a9544008b4884e945)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:17.020917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:17.023708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:17.143373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6daff-60ad-4065-bca0-70cb3a6bb8b0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:17.149017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:17.149681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:17.149963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:17.150344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] PATH_INFO: `/v3/projects/4a928ecfa41146858674739987189b9d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:17.151528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a928ecfa41146858674739987189b9d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:17.153470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:17.230098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53f499775524f7a9544008b4884e945', 'request_id': 'req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.236129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53f499775524f7a9544008b4884e945', 'request_id': 'req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.321010 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:17.332372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a928ecfa41146858674739987189b9d', 'request_id': 'req-8d51a627-1446-47e8-891a-f7716873570f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.335285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53f499775524f7a9544008b4884e945', 'request_id': 'req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.349214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a928ecfa41146858674739987189b9d', 'request_id': 'req-8d51a627-1446-47e8-891a-f7716873570f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.356713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] The token cache is being invalidate because project b53f499775524f7a9544008b4884e945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:17.357007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.358097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.359836 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3148/6275] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:16 2022] DELETE /identity/v3/projects/b53f499775524f7a9544008b4884e945 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:39:17.360582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:17.365404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:17.420282 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:17.448083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a928ecfa41146858674739987189b9d', 'request_id': 'req-8d51a627-1446-47e8-891a-f7716873570f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.472851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] The token cache is being invalidate because project 4a928ecfa41146858674739987189b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:17.473367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.477403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.485428 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3128/6276] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:17 2022] DELETE /identity/v3/projects/4a928ecfa41146858674739987189b9d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:17.488840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88cf1-4ed2-4d83-898e-5d12fd1dacb7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:17.489617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:17.493423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:17.660085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:17.660714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:17.660989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:17.661257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:17.661461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51a627-1446-47e8-891a-f7716873570f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:17.661892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:17.666050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:17.672222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:17.675655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:17.675655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:17.675655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] PATH_INFO: `/v3/users/d9a51cf2e50f4729969fdb78db088dc5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:17.676543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a51cf2e50f4729969fdb78db088dc5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:17.681516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:17.775856 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3149/6277] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:17 2022] POST /identity/v3/users => generated 290 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:17.778828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:17.778828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:17.791326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee381c31-fc3e-48cf-8cee-dc043f9faf11 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:17.795949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:17.796830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:17.797611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:17.797611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] PATH_INFO: `/v3/users/d2ca45185aa643968166b849054a262c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:17.798686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ca45185aa643968166b849054a262c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:17.800581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:17.822285 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:17.929317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a51cf2e50f4729969fdb78db088dc5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.938378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a51cf2e50f4729969fdb78db088dc5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:17.939091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a51cf2e50f4729969fdb78db088dc5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.026097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a51cf2e50f4729969fdb78db088dc5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.026823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a51cf2e50f4729969fdb78db088dc5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.054420 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3129/6278] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:17 2022] DELETE /identity/v3/users/d9a51cf2e50f4729969fdb78db088dc5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:18.056342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:18.058615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:18.064658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ca45185aa643968166b849054a262c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.092398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ca45185aa643968166b849054a262c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.094737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ca45185aa643968166b849054a262c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.163246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ca45185aa643968166b849054a262c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.164388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ca45185aa643968166b849054a262c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:18.198663 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3150/6279] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:17 2022] DELETE /identity/v3/users/d2ca45185aa643968166b849054a262c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:18.199942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e6f0f-9fdf-4408-86be-753ade642b21 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:18.278908 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:18.380123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:18.380814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:18.381132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:18.381442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:18.382338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:18.384045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:18.426131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3130/6280] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:18.431032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:18.432585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:18.458241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc74a9-b700-42a3-adf3-d16a67447507 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:18.485526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281695d2-65cb-4e89-b9ae-a9035fb45266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:18.487398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281695d2-65cb-4e89-b9ae-a9035fb45266 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:18.487832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281695d2-65cb-4e89-b9ae-a9035fb45266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:18.489269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281695d2-65cb-4e89-b9ae-a9035fb45266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:18.490271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281695d2-65cb-4e89-b9ae-a9035fb45266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:18.495069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281695d2-65cb-4e89-b9ae-a9035fb45266 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:18.522694 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3151/6281] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:39:18.526903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:18.539543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33085d88-bad5-4eae-8357-a9804e80a4a2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:18.557568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:18.558600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:18.558600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:18.558801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] PATH_INFO: `/v3/projects/b250ac54c882487db3247c0fde4c1ab4/users/b455f18039314903b017642b7ce081aa/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:18.593586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b250ac54c882487db3247c0fde4c1ab4, user_id=b455f18039314903b017642b7ce081aa, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:18.599788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:18.671476 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3131/6282] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:18 2022] PUT /identity/v3/projects/b250ac54c882487db3247c0fde4c1ab4/users/b455f18039314903b017642b7ce081aa/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:18.685119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:18.685236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:18.685562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:18.748080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] MFA Rules not processed for user `b455f18039314903b017642b7ce081aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:18.749348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:18.891514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3152/6283] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:39:18.911290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:18.913044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:18.920719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:18.923239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.075251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef1dec-e007-483a-bed4-8818caefbe5c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:19.089274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:19.090839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.091175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.106956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.125932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:19.127793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:19.150634 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3132/6284] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:19.170221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bc195-8580-4b80-ac13-8044e63e5fd7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:19.182179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:19.183414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.184036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.184626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] PATH_INFO: `/v3/projects/4baeb967e6ee4f27a5f6ec990e90d60b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.189809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baeb967e6ee4f27a5f6ec990e90d60b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:19.193039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:19.224563 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:19.263604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:19.265154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.291494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbd1a-b023-43bf-9be3-114858322f2d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:19.297391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:19.298439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.299125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.299125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] PATH_INFO: `/v3/projects/8820e661d2614998ba770aee64fe54d4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.300235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8820e661d2614998ba770aee64fe54d4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:19.308763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:19.375744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baeb967e6ee4f27a5f6ec990e90d60b', 'request_id': 'req-5fb0d323-13af-494c-8d20-2c09552f67a0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.385444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baeb967e6ee4f27a5f6ec990e90d60b', 'request_id': 'req-5fb0d323-13af-494c-8d20-2c09552f67a0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.457859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8820e661d2614998ba770aee64fe54d4', 'request_id': 'req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.463866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8820e661d2614998ba770aee64fe54d4', 'request_id': 'req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.465552 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:19.479240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baeb967e6ee4f27a5f6ec990e90d60b', 'request_id': 'req-5fb0d323-13af-494c-8d20-2c09552f67a0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.505575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] The token cache is being invalidate because project 4baeb967e6ee4f27a5f6ec990e90d60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:19.505857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.506584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5fb0d323-13af-494c-8d20-2c09552f67a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.514124 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3153/6285] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:18 2022] DELETE /identity/v3/projects/4baeb967e6ee4f27a5f6ec990e90d60b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:19.514124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f895-1a7f-41d2-82ec-daa6c2244cf2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.514124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f895-1a7f-41d2-82ec-daa6c2244cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.514124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f895-1a7f-41d2-82ec-daa6c2244cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.534373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8820e661d2614998ba770aee64fe54d4', 'request_id': 'req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.556564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] The token cache is being invalidate because project 8820e661d2614998ba770aee64fe54d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:19.556862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.557713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0ac5a4e1-6e5d-46ec-83ce-393d82945d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:19.560171 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3133/6286] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:19 2022] DELETE /identity/v3/projects/8820e661d2614998ba770aee64fe54d4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:19.561765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.562076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.562348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.568520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d734f895-1a7f-41d2-82ec-daa6c2244cf2 None None] MFA Rules not processed for user `598618fec823423d94c443aaa6d5b1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:19.570315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d734f895-1a7f-41d2-82ec-daa6c2244cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.625620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:19.628712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.691142 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3154/6287] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:19.692495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6605e-2997-4de6-aaa8-30616f2759bf None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.692735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6605e-2997-4de6-aaa8-30616f2759bf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.693113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6605e-2997-4de6-aaa8-30616f2759bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.737849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0bf6605e-2997-4de6-aaa8-30616f2759bf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:19.739296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0bf6605e-2997-4de6-aaa8-30616f2759bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.751497 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3134/6288] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:19.758223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:19.758383 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3155/6289] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:19.758474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.767091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545015-6663-40a2-b157-b29c9506a82c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.768253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545015-6663-40a2-b157-b29c9506a82c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.779476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545015-6663-40a2-b157-b29c9506a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.827099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-37545015-6663-40a2-b157-b29c9506a82c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:19.831155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-37545015-6663-40a2-b157-b29c9506a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.842104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3156/6290] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:19.842293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4638-0928-4025-97c1-77e085c3630a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.842645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4638-0928-4025-97c1-77e085c3630a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.843018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb4638-0928-4025-97c1-77e085c3630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.865506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-12bb4638-0928-4025-97c1-77e085c3630a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:19.867586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-12bb4638-0928-4025-97c1-77e085c3630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:19.880775 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3157/6291] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:19.881868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb4638-0928-4025-97c1-77e085c3630a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:19.890171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97478dff-ade1-47a1-ba76-446b22afef09 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:19.896677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:19.897307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.897875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.898126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.901591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb4638-0928-4025-97c1-77e085c3630a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:19.907616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:19.909036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:19.909940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.910506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.910719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:19.911100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.912435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:19.912846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:19.914592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:19.936534 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3158/6292] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:19.936534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:19.951310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc817d9-6c81-42e7-ae1c-e87886559987 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:19.953435 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3135/6293] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:19.954416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:19.964822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:19.968169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.968552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.976154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.976154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:19.976154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:19.976711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:19.981495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c860341-d7d6-4a6d-8bf3-6caac21ae0ea service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:19.988772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:19.989436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:19.990139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:19.990139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:19.990699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:19.992915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.015927 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3159/6294] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:20.021394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.035098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba628545-4a1a-45cc-9de5-766df9aff134 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.041366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.042051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.042401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.042770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.043494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.045479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.116154 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3136/6295] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:19 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:20.121211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.172219 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3160/6296] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:20 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:20.176859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.219147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb0cf-ed13-4a68-a1b1-229ef1f1e2a9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.234053 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:20.328665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.335911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.335911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.335911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.335911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.337001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.358008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe9f1-42b4-4c66-bb5a-fdb7c432bc7d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.392084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.397259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.397259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.399658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.402225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.406674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.484671 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3137/6297] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:20 2022] POST /identity/v3/users => generated 288 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:20.485520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.490561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:20.523668 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3161/6298] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:20 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:20.530204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.568220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228186f4-b063-4746-aad0-a5ba9c97de7d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.583054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.583824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.585483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.585854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.587816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.592298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.619731 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3162/6299] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:20.621173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.624989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f5444-eae9-49ea-906a-84cf06836c92 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.630851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.631653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.631941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.632214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.634929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:20.647902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99bd5c-b086-4d30-9a98-88a873c003c0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.659954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.660672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.662904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.663253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.664025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.665769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.666303 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:20.696990 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3163/6300] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:20.700948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.714196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:20.752872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.755489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.772550 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3138/6301] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:20.773133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.785403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1acd9d-9a1d-4af7-ab0d-3d6522ef6ab6 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.792777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.792998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.793173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.793597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.794335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.796072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.803740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cbbe5-e040-4372-b9ee-efd6c7e11fbd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.808179 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3139/6302] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:20.809617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.810466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.810919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.812054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.812487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.813939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:20.830970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eab5e-46c0-4233-95a7-5b4fbb74bd0f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.839430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.840122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.840553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.840656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.841304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.843136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.867055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3140/6303] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:20.867983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.904830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441f28f-4bd1-4e50-b40e-c415090c9a47 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.923435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:20.924987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:20.934012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7f6de-c7f2-42dc-a14a-ca4efe8a828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.934889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f6de-c7f2-42dc-a14a-ca4efe8a828d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.935279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f6de-c7f2-42dc-a14a-ca4efe8a828d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.935573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f6de-c7f2-42dc-a14a-ca4efe8a828d admin admin] PATH_INFO: `/v3/projects/1ea9bbb2aac34b59914953bea6a73ec1/users/869834fa3129457c9587731ec8a45cbb/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.937213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3164/6304] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:20.938356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:20.951723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efe42a-6135-42b4-89ee-182f0c492d2a service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:20.957900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8629e-a4bf-40f7-b92e-1ff46d63de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:20.958619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8629e-a4bf-40f7-b92e-1ff46d63de7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:20.958913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8629e-a4bf-40f7-b92e-1ff46d63de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:20.960716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8629e-a4bf-40f7-b92e-1ff46d63de7f admin admin] PATH_INFO: `/v3/projects/0bcf2c6e89274037bf64c83168e3d07b/users/1e89a0c72fb34be3be1221292adf18f5/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:20.992165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7f6de-c7f2-42dc-a14a-ca4efe8a828d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea9bbb2aac34b59914953bea6a73ec1, user_id=869834fa3129457c9587731ec8a45cbb, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:21.005253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7f6de-c7f2-42dc-a14a-ca4efe8a828d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:21.021245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8629e-a4bf-40f7-b92e-1ff46d63de7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcf2c6e89274037bf64c83168e3d07b, user_id=1e89a0c72fb34be3be1221292adf18f5, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:21.027816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8629e-a4bf-40f7-b92e-1ff46d63de7f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:21.086258 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3141/6305] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:20 2022] PUT /identity/v3/projects/1ea9bbb2aac34b59914953bea6a73ec1/users/869834fa3129457c9587731ec8a45cbb/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:21.097851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f664c0-03cf-4c82-b30f-35cb887b1f09 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:21.100214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f664c0-03cf-4c82-b30f-35cb887b1f09 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:21.102564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f664c0-03cf-4c82-b30f-35cb887b1f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:21.145552 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3165/6306] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:20 2022] PUT /identity/v3/projects/0bcf2c6e89274037bf64c83168e3d07b/users/1e89a0c72fb34be3be1221292adf18f5/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:21.147157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48299b4f-5e5d-4919-a75e-9b0aefc453b8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:21.147646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48299b4f-5e5d-4919-a75e-9b0aefc453b8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:21.148449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48299b4f-5e5d-4919-a75e-9b0aefc453b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:21.215397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-48299b4f-5e5d-4919-a75e-9b0aefc453b8 None None] MFA Rules not processed for user `1e89a0c72fb34be3be1221292adf18f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:21.218112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-48299b4f-5e5d-4919-a75e-9b0aefc453b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:21.263377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-96f664c0-03cf-4c82-b30f-35cb887b1f09 None None] MFA Rules not processed for user `869834fa3129457c9587731ec8a45cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:21.265058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96f664c0-03cf-4c82-b30f-35cb887b1f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:21.323297 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:21.434040 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3142/6307] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:21.435725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f664c0-03cf-4c82-b30f-35cb887b1f09 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:21.479594 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3166/6308] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:21.484471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48299b4f-5e5d-4919-a75e-9b0aefc453b8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:21.585704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f664c0-03cf-4c82-b30f-35cb887b1f09 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:21.587422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:21.588052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:21.588327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:21.588602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:21.589230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:21.593349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:21.638219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48299b4f-5e5d-4919-a75e-9b0aefc453b8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:21.643974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:21.646657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:21.646657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:21.646657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:21.646657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:21.648056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:21.732318 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3143/6309] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:21 2022] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:21.738580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:21.785120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3167/6310] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:21 2022] POST /identity/v3/projects => generated 375 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:21.792455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:21.911464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100107a7-07cb-441c-b88f-0da87b70bfb2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:21.917675 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:21.951126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9634-fc1e-4101-9021-2362fea17f18 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:21.969632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:21.975318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:21.975318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:21.975318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:21.975318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:21.975719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.014181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.020469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.020887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.021160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.022171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.024533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.112353 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3168/6311] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:21 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:22.113221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.130083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3144/6312] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:21 2022] POST /identity/v3/users => generated 295 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:22.133582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.138335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957a64e-36d3-48ec-a27a-4624560d3a8c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.148874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b982-ea49-4e2e-b411-4c0b157e8552 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.151499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.152311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.152968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.153403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.154373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.162697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.164098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.164628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.166211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.167647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.169740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.170527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.191878 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3145/6313] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:22.195834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.204137 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3169/6314] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:22.211592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56385a-8009-46b8-a122-66e04132ea3b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.212887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.223809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.224820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.227933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.227933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] PATH_INFO: `/v3/projects/86cc1bbbf4aa4389a354da5f983ea290/users/dc9132bfa61c4f0ba0687e85cd7a695a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.234255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a36ba-316f-4e58-aebc-a57cd8e55833 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.242883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.244690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.245740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.246655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] PATH_INFO: `/v3/projects/bb6dab53fb084335b58d3fd1141af74c/users/ac1904cd4b174c9884bd537a7e1bcf0a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.247780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cc1bbbf4aa4389a354da5f983ea290, user_id=dc9132bfa61c4f0ba0687e85cd7a695a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.251676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.297256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6dab53fb084335b58d3fd1141af74c, user_id=ac1904cd4b174c9884bd537a7e1bcf0a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.306556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.350371 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:22.390647 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3146/6315] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:22 2022] PUT /identity/v3/projects/86cc1bbbf4aa4389a354da5f983ea290/users/dc9132bfa61c4f0ba0687e85cd7a695a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:22.392082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.406611 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3170/6316] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:22 2022] PUT /identity/v3/projects/bb6dab53fb084335b58d3fd1141af74c/users/ac1904cd4b174c9884bd537a7e1bcf0a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:39:22.417897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.576022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86330d-c42a-4032-a7a6-2a2a76097b66 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.612749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.613387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.613671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.613923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.614616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.616226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.617643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbee3ac-a883-41b5-b15d-3291fd064785 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.639289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.639289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.639289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.639289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.639631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.639631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.645564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3171/6317] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:22.646637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.655935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3147/6318] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:22.658462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:22.671821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1a39e-0af6-4c4f-adb1-4c214d0aee09 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.681431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26daae3-bdd5-4c1b-ad88-057fa2159d53 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:22.684510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672d4ab-301f-4f24-8c26-6c747bb8d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.685282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d4ab-301f-4f24-8c26-6c747bb8d91a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.685624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d4ab-301f-4f24-8c26-6c747bb8d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.685987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d4ab-301f-4f24-8c26-6c747bb8d91a admin admin] PATH_INFO: `/v3/projects/bb6dab53fb084335b58d3fd1141af74c/users/ac1904cd4b174c9884bd537a7e1bcf0a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.690990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca9374-6aa4-49b8-9c59-054c3f1e69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:22.691416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d4ab-301f-4f24-8c26-6c747bb8d91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6dab53fb084335b58d3fd1141af74c, user_id=ac1904cd4b174c9884bd537a7e1bcf0a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.691898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca9374-6aa4-49b8-9c59-054c3f1e69ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.692243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca9374-6aa4-49b8-9c59-054c3f1e69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.692635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca9374-6aa4-49b8-9c59-054c3f1e69ac admin admin] PATH_INFO: `/v3/projects/86cc1bbbf4aa4389a354da5f983ea290/users/dc9132bfa61c4f0ba0687e85cd7a695a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.694552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d4ab-301f-4f24-8c26-6c747bb8d91a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.694831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca9374-6aa4-49b8-9c59-054c3f1e69ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cc1bbbf4aa4389a354da5f983ea290, user_id=dc9132bfa61c4f0ba0687e85cd7a695a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:22.697721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca9374-6aa4-49b8-9c59-054c3f1e69ac admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:22.715493 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3172/6319] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:22 2022] PUT /identity/v3/projects/bb6dab53fb084335b58d3fd1141af74c/users/ac1904cd4b174c9884bd537a7e1bcf0a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:22.719599 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3148/6320] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:22 2022] PUT /identity/v3/projects/86cc1bbbf4aa4389a354da5f983ea290/users/dc9132bfa61c4f0ba0687e85cd7a695a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:22.745636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.745932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.746228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.746435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:22.747283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:22.747789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:22.790397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] MFA Rules not processed for user `ac1904cd4b174c9884bd537a7e1bcf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:22.791650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:22.836371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] MFA Rules not processed for user `dc9132bfa61c4f0ba0687e85cd7a695a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:22.840226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:22.972073 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:22.996032 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3173/6321] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:23.008659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:23.012311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:23.072435 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3149/6322] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:23.090976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:23.092763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:23.132728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c7a7-604a-463f-8369-15bd45264e47 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:23.136942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:23.137663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:23.138065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:23.138452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:23.204258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:23.206030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:23.212105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3831e-e021-4798-a682-b37de3c9aaa1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:23.222504 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3174/6323] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:23.223212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53428f-ab1b-45ba-8578-a7b9a8cda719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:23.223903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53428f-ab1b-45ba-8578-a7b9a8cda719 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:23.224349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53428f-ab1b-45ba-8578-a7b9a8cda719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:23.225006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53428f-ab1b-45ba-8578-a7b9a8cda719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:23.245936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53428f-ab1b-45ba-8578-a7b9a8cda719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:23.247807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53428f-ab1b-45ba-8578-a7b9a8cda719 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:23.272127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3150/6324] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:39:23.308008 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:23.434510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:23.436624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:23.613835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc633-eed8-43b2-b947-99753ad1c346 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:23.621769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:23.622452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:23.622857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:23.623013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:23.625959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:23.639619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:23.641485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:23.655319 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3175/6325] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:24.277554 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:27.351653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe08565-b95e-497b-98d8-6009d622c8c9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:27.352751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe08565-b95e-497b-98d8-6009d622c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:27.353632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe08565-b95e-497b-98d8-6009d622c8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:27.413067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dbe08565-b95e-497b-98d8-6009d622c8c9 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:27.417266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dbe08565-b95e-497b-98d8-6009d622c8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:27.582177 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3151/6326] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:39:27.611242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:27.612978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:27.827094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d462b4e-f08b-4fee-b397-b6dac7770453 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:27.839513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:27.840205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:27.840538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:27.840822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:27.860110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:27.862441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:27.906871 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3176/6327] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:39:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:39:27.908099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe08565-b95e-497b-98d8-6009d622c8c9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:27.932610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe08565-b95e-497b-98d8-6009d622c8c9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:27.942051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:27.950888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:27.951176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:27.951449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:27.953386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:27.977450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:27.982602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:28.013710 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3152/6328] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:30.437926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:30.444021 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:30.460795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd894-7fb9-4517-9271-5d5c880695b6 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:30.475616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:30.476257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:30.476543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:30.476817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:30.489243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:30.491380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:30.517165 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3177/6329] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:30.863483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:30.927682 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:31.039603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2804-e3ed-43ff-8d82-d623776dcf2e service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:31.049528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:31.050226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:31.050506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:31.050778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:31.052556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:31.163565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:31.166658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:31.231042 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3153/6330] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:31.998675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:32.000132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:32.028400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02477e18-1986-4dcf-a844-3328141c3203 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:32.037959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:32.039878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:32.040356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:32.040862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:32.043186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:32.065777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:32.067479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:32.083238 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3178/6331] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:41.221024 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=45 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:42.074371 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=11 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:44.886445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:44.907024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281b97c-04a1-4a2b-a227-0c1a4efdf74a service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:44.931229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3979d-31a0-4706-a36e-89d520289605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:44.932069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3979d-31a0-4706-a36e-89d520289605 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:44.940139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3979d-31a0-4706-a36e-89d520289605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:44.940139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3979d-31a0-4706-a36e-89d520289605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:44.940139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-48a3979d-31a0-4706-a36e-89d520289605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:45.100768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3979d-31a0-4706-a36e-89d520289605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:45.102643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3979d-31a0-4706-a36e-89d520289605 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:45.116934 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3154/6332] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:51.936177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:51.937417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:51.956780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92086-680c-46a9-9f14-d3c9015a83cc service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:51.963474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:51.964352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:51.964788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:51.965214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] PATH_INFO: `/v3/users/b455f18039314903b017642b7ce081aa` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:51.967778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b455f18039314903b017642b7ce081aa)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:51.971007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:52.302764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b455f18039314903b017642b7ce081aa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:52.314973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b455f18039314903b017642b7ce081aa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:52.315977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b455f18039314903b017642b7ce081aa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:52.395731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b455f18039314903b017642b7ce081aa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:52.396602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b455f18039314903b017642b7ce081aa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:52.426694 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3179/6333] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:51 2022] DELETE /identity/v3/users/b455f18039314903b017642b7ce081aa => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:52.429256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:52.435894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:52.435894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:52.492882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:52.495223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:52.669613 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3155/6334] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:52.719389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:52.721746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:52.974110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2e170-0e56-4702-97be-f971e3a90e2d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:52.990781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c033bd-f89b-4f42-a20e-8eeb3f77e70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:52.991408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c033bd-f89b-4f42-a20e-8eeb3f77e70d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:52.991683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c033bd-f89b-4f42-a20e-8eeb3f77e70d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:52.991953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c033bd-f89b-4f42-a20e-8eeb3f77e70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:53.010205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c033bd-f89b-4f42-a20e-8eeb3f77e70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:53.011956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c033bd-f89b-4f42-a20e-8eeb3f77e70d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:53.038258 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3180/6335] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:53.890251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:53.899799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:53.969921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c5e11-eea7-415a-9dd5-e5ea55d0c4d4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:53.979565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:53.980236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:53.980513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:53.988066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] PATH_INFO: `/v3/projects/b250ac54c882487db3247c0fde4c1ab4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:53.991868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b250ac54c882487db3247c0fde4c1ab4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:53.998379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:54.194562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b250ac54c882487db3247c0fde4c1ab4', 'request_id': 'req-c668a3b4-8568-448c-b948-021f07572c7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.201719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b250ac54c882487db3247c0fde4c1ab4', 'request_id': 'req-c668a3b4-8568-448c-b948-021f07572c7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.325219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b250ac54c882487db3247c0fde4c1ab4', 'request_id': 'req-c668a3b4-8568-448c-b948-021f07572c7e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.344687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] The token cache is being invalidate because project b250ac54c882487db3247c0fde4c1ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:54.347883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.350382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.357419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3156/6336] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:53 2022] DELETE /identity/v3/projects/b250ac54c882487db3247c0fde4c1ab4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:54.362072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104b4e6-b15c-4fd8-9f39-31a32648058c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:54.362571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104b4e6-b15c-4fd8-9f39-31a32648058c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:54.362696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104b4e6-b15c-4fd8-9f39-31a32648058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:54.386863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:54.388747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:54.407918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1104b4e6-b15c-4fd8-9f39-31a32648058c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:54.413413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1104b4e6-b15c-4fd8-9f39-31a32648058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:54.444570 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:54.554963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668a3b4-8568-448c-b948-021f07572c7e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:54.567058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:54.567642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:54.567920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:54.570147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] PATH_INFO: `/v3/users/24a5c439d21241028857e51aef0d10f6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:54.572757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a5c439d21241028857e51aef0d10f6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:54.576111 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3181/6337] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:54.576404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:54.591607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061788-848b-48af-8220-1ffae82fbead None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:54.591932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061788-848b-48af-8220-1ffae82fbead None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:54.592207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061788-848b-48af-8220-1ffae82fbead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:54.625110 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:54.646865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-17061788-848b-48af-8220-1ffae82fbead None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:54.648611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-17061788-848b-48af-8220-1ffae82fbead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:54.668447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3182/6338] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:54.677655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061788-848b-48af-8220-1ffae82fbead None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:54.704137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061788-848b-48af-8220-1ffae82fbead None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:54.717918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:54.720003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:54.721029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:54.722625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:54.725687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:54.726945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:54.731835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:54.772567 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3183/6339] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:54.776969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:54.808291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0c48-8d76-4ee9-beb4-0c6e401d24e6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:54.821479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:54.822528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:54.823134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:54.823624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:54.827242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:54.830247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:54.891784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a5c439d21241028857e51aef0d10f6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.921219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a5c439d21241028857e51aef0d10f6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.923905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a5c439d21241028857e51aef0d10f6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:54.976069 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3184/6340] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:54 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:54.982071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:55.013871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a5c439d21241028857e51aef0d10f6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:55.014677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a5c439d21241028857e51aef0d10f6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:55.085068 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3157/6341] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:54 2022] DELETE /identity/v3/users/24a5c439d21241028857e51aef0d10f6 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:55.085068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:55.090875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:55.200178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972798d-c45c-441c-bc2c-97ed09d00365 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:55.356594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:55.358420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:55.358701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:55.358973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:55.360185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:55.362162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:55.396730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293df45-b9bf-4b98-a17b-f54edeb00025 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:55.409305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc9132bfa61c4f0ba0687e85cd7a695a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cc1bbbf4aa4389a354da5f983ea290', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:55.409941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:55.410262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:55.410539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:55.411200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:55.411505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:55.416394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:55.443130 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3158/6342] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:55.447547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:55.466892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296391f-39ab-421d-bcfc-e86d1537c2ec tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:55.481864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc9132bfa61c4f0ba0687e85cd7a695a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cc1bbbf4aa4389a354da5f983ea290', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:55.491771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:55.491771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:55.491771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:55.491771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:55.491771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:55.526073 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3185/6343] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:39:54 2022] POST /identity/v3/users => generated 293 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:55.531680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:55.537917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:55.577908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe472661-dbb3-4481-a8a0-b55202bdfd72 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:55.598055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:55.598812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:55.599205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:55.599588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:55.601939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:55.604848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:55.633115 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3186/6344] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:55.634807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:55.656654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631797e-bd07-4a31-b3f1-dd3acaba93e1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:55.663104 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3159/6345] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:39:55 2022] POST /identity/v3/projects => generated 349 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:39:55.664990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:55.733301 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:55.790574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b673-ac9d-4511-be12-7062f997c029 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:55.804762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc9132bfa61c4f0ba0687e85cd7a695a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cc1bbbf4aa4389a354da5f983ea290', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:55.805712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:55.806506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:55.807109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:55.807938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:39:55.808823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:55.819767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:55.833320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24d67-c100-4826-a06b-cdd5dc0a8426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:55.834175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24d67-c100-4826-a06b-cdd5dc0a8426 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:55.837304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24d67-c100-4826-a06b-cdd5dc0a8426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:55.837712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24d67-c100-4826-a06b-cdd5dc0a8426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:55.838549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24d67-c100-4826-a06b-cdd5dc0a8426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:55.846770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24d67-c100-4826-a06b-cdd5dc0a8426 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:55.860540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3160/6346] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:39:55.880698 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3187/6347] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:39:55.882399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:55.902140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98771-8ed4-4f78-a7c0-da467f338e93 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:55.917949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:55.921192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:55.921192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:55.921192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] PATH_INFO: `/v3/projects/439bb6c50fcb44a0a25688b5f9f7ac2b/users/a10a3417cf4843e0bd23967fcd8f2b5b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:55.941952 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:55.992339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=439bb6c50fcb44a0a25688b5f9f7ac2b, user_id=a10a3417cf4843e0bd23967fcd8f2b5b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:56.008510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:56.113807 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3161/6348] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:39:55 2022] PUT /identity/v3/projects/439bb6c50fcb44a0a25688b5f9f7ac2b/users/a10a3417cf4843e0bd23967fcd8f2b5b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:56.124531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:56.125009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:56.125393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:56.209725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] MFA Rules not processed for user `a10a3417cf4843e0bd23967fcd8f2b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:56.213599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:56.269051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:56.271295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:56.482599 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3188/6349] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:56.495063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde142b-8f86-4f08-99af-7b9003a311fd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:56.510900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:56.511752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:56.512224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:56.512604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] PATH_INFO: `/v3/projects/a78e75dfc0c844df9d92191c743bc540` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:56.514787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78e75dfc0c844df9d92191c743bc540)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:56.518821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:56.608741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:56.610988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:56.750436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78e75dfc0c844df9d92191c743bc540', 'request_id': 'req-85bf4325-865c-4c42-8cdf-95b5b77aa87c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:56.777138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78e75dfc0c844df9d92191c743bc540', 'request_id': 'req-85bf4325-865c-4c42-8cdf-95b5b77aa87c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:56.780219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f8fb1-14f0-4bc3-88a0-8d4b603c63f2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:56.892941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:56.893697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:56.894126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:56.894570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:56.933196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78e75dfc0c844df9d92191c743bc540', 'request_id': 'req-85bf4325-865c-4c42-8cdf-95b5b77aa87c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:56.959985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] The token cache is being invalidate because project a78e75dfc0c844df9d92191c743bc540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:56.960594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:56.962507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:56.964249 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3162/6350] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:56 2022] DELETE /identity/v3/projects/a78e75dfc0c844df9d92191c743bc540 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:56.967858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:56.973458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:56.990190 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:57.011947 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:57.041992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:57.046035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:57.070645 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3189/6351] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:39:57.128388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf4325-865c-4c42-8cdf-95b5b77aa87c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:57.144597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:57.148669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:57.148669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:57.148669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] PATH_INFO: `/v3/users/598618fec823423d94c443aaa6d5b1fa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:57.148669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598618fec823423d94c443aaa6d5b1fa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:57.150746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:57.453661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598618fec823423d94c443aaa6d5b1fa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:57.483253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598618fec823423d94c443aaa6d5b1fa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:57.495740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598618fec823423d94c443aaa6d5b1fa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:57.625312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598618fec823423d94c443aaa6d5b1fa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:57.627043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598618fec823423d94c443aaa6d5b1fa'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:57.695624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3163/6352] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:56 2022] DELETE /identity/v3/users/598618fec823423d94c443aaa6d5b1fa => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:57.792284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:57.929965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296f28e-902e-4658-8440-937dcb7a045c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:58.026892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc9132bfa61c4f0ba0687e85cd7a695a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86cc1bbbf4aa4389a354da5f983ea290', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:58.028843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:58.028843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:58.028843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] PATH_INFO: `/v3/projects/43320c26c4cd4204bf9b9ac6f779a93f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:58.030414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorizing `identity:delete_project(project_id=43320c26c4cd4204bf9b9ac6f779a93f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:58.032900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:58.149468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43320c26c4cd4204bf9b9ac6f779a93f', 'request_id': 'req-7b6769f8-e567-4e54-ab01-5226dcdc99b3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:58.186866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43320c26c4cd4204bf9b9ac6f779a93f', 'request_id': 'req-7b6769f8-e567-4e54-ab01-5226dcdc99b3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:58.220106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:58.226686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:58.264888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43320c26c4cd4204bf9b9ac6f779a93f', 'request_id': 'req-7b6769f8-e567-4e54-ab01-5226dcdc99b3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:58.283882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] The token cache is being invalidate because project 43320c26c4cd4204bf9b9ac6f779a93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:39:58.284255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:58.286183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:58.292241 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3190/6353] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:57 2022] DELETE /identity/v3/projects/43320c26c4cd4204bf9b9ac6f779a93f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:58.337321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:58.339147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:58.405101 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:58.405415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1df6e-a60f-45a2-8163-3b73ec800cd7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:58.497779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6769f8-e567-4e54-ab01-5226dcdc99b3 tempest-RoutersIpV6AdminTest-1057343647 tempest-RoutersIpV6AdminTest-1057343647-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:58.512715 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:39:58.513302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584ffb0-0aec-4669-884d-ed8ae95a8ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:58.514625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584ffb0-0aec-4669-884d-ed8ae95a8ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:58.519087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584ffb0-0aec-4669-884d-ed8ae95a8ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:58.519347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584ffb0-0aec-4669-884d-ed8ae95a8ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:58.523193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9584ffb0-0aec-4669-884d-ed8ae95a8ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:58.599876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:58.600546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:58.600829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:58.601104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] PATH_INFO: `/v3/users/a10a3417cf4843e0bd23967fcd8f2b5b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:58.602882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10a3417cf4843e0bd23967fcd8f2b5b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:58.604963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:58.727458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584ffb0-0aec-4669-884d-ed8ae95a8ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:58.733035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584ffb0-0aec-4669-884d-ed8ae95a8ea5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:58.759465 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3191/6354] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:39:58.917195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10a3417cf4843e0bd23967fcd8f2b5b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:58.941248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10a3417cf4843e0bd23967fcd8f2b5b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:58.942415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10a3417cf4843e0bd23967fcd8f2b5b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:59.072895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10a3417cf4843e0bd23967fcd8f2b5b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:59.074306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10a3417cf4843e0bd23967fcd8f2b5b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:59.142896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:59.143448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:59.143448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:59.151039 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3164/6355] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:39:58 2022] DELETE /identity/v3/users/a10a3417cf4843e0bd23967fcd8f2b5b => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:39:59.186588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:39:59.188451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:59.290346 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3192/6356] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:39:59.322489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:59.322489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:59.513497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b6e26-f029-47ed-9694-81b9703e9644 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:59.531062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1ab18-bab7-4565-af07-ee916586348d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:59.532151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1ab18-bab7-4565-af07-ee916586348d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:59.532737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1ab18-bab7-4565-af07-ee916586348d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:59.533231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1ab18-bab7-4565-af07-ee916586348d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:59.546303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1ab18-bab7-4565-af07-ee916586348d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:59.549303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1ab18-bab7-4565-af07-ee916586348d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:59.566083 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3165/6357] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:39:59.739322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:39:59.741608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:39:59.771347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c547-8e8c-46fd-a2c5-ea3512eb78fa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:39:59.773827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:39:59.774697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:39:59.774832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:39:59.775107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] PATH_INFO: `/v3/projects/319625a497ba49cb987393afd9bbf54c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:39:59.776272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319625a497ba49cb987393afd9bbf54c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:39:59.778302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:39:59.985485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319625a497ba49cb987393afd9bbf54c', 'request_id': 'req-65187246-c8ca-46ff-98be-57ebd9491b33'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:39:59.995185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319625a497ba49cb987393afd9bbf54c', 'request_id': 'req-65187246-c8ca-46ff-98be-57ebd9491b33'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:00.076698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319625a497ba49cb987393afd9bbf54c', 'request_id': 'req-65187246-c8ca-46ff-98be-57ebd9491b33'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:00.087569 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:00.095443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] The token cache is being invalidate because project 319625a497ba49cb987393afd9bbf54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:00.095746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:00.098389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-65187246-c8ca-46ff-98be-57ebd9491b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:00.100947 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3193/6358] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:39:59 2022] DELETE /identity/v3/projects/319625a497ba49cb987393afd9bbf54c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:00.105764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471654-8846-46f0-8642-c88d3b62a7bf None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:00.106387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471654-8846-46f0-8642-c88d3b62a7bf None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:00.106895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471654-8846-46f0-8642-c88d3b62a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:00.138977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4f471654-8846-46f0-8642-c88d3b62a7bf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:00.140748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4f471654-8846-46f0-8642-c88d3b62a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:00.215989 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:00.229249 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3166/6359] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:00.237204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2184e-2f82-4438-8235-42dc192e3781 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:00.237697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2184e-2f82-4438-8235-42dc192e3781 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:00.246269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2184e-2f82-4438-8235-42dc192e3781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:00.273860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e5b2184e-2f82-4438-8235-42dc192e3781 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:00.277601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e5b2184e-2f82-4438-8235-42dc192e3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:00.302767 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3194/6360] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:00.310519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f471654-8846-46f0-8642-c88d3b62a7bf None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:00.327389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f471654-8846-46f0-8642-c88d3b62a7bf None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:00.366380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:00.372184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:00.372184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:00.372184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:00.376347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:00.377726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:00.382734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:00.414599 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3167/6361] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:00.417063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2184e-2f82-4438-8235-42dc192e3781 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:00.446496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2184e-2f82-4438-8235-42dc192e3781 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:00.463793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:00.481193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:00.491926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:00.507877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:00.508873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:00.516503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:00.639882 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3195/6362] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:00 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:00.645144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:00.658383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941a8ee-5d0d-4000-a0d9-da6be484c248 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:00.852387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:00.854379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:00.856079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:00.856516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:00.861018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:00.864945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:01.055125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:01.065265 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3168/6363] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:00 2022] POST /identity/v3/users => generated 283 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:01.094381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c49fe-ac2c-4b49-be07-9ee59891e45c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:01.108787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:01.109842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:01.110857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:01.111487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:01.112473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:01.116611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:01.142219 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3196/6364] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:01.155603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:01.166827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93407a57-4958-49c6-88dc-87fb35d7f543 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:01.181202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9abe0a-8fc1-49fb-974a-bb4f3dd4c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:01.183864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9abe0a-8fc1-49fb-974a-bb4f3dd4c32b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:01.185581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9abe0a-8fc1-49fb-974a-bb4f3dd4c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:01.186079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9abe0a-8fc1-49fb-974a-bb4f3dd4c32b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:01.189244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9abe0a-8fc1-49fb-974a-bb4f3dd4c32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:01.197263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9abe0a-8fc1-49fb-974a-bb4f3dd4c32b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:01.239251 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3169/6365] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:01.244198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:01.257452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7314a1c-e544-402d-91f2-c358107ab2e7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:01.276934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:01.281333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:01.281333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:01.281333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] PATH_INFO: `/v3/projects/0f56b7f001fd496496d2b635158ddd78/users/be90af65219d44a4a5d9dbd8883ff4bf/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:01.298193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f56b7f001fd496496d2b635158ddd78, user_id=be90af65219d44a4a5d9dbd8883ff4bf, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:01.302976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:01.391698 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3197/6366] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:01 2022] PUT /identity/v3/projects/0f56b7f001fd496496d2b635158ddd78/users/be90af65219d44a4a5d9dbd8883ff4bf/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:01.396528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:01.397066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:01.397066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:01.432010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:01.442301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:01.517914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:01.522172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:01.636844 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3170/6367] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:01.710042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cca7b-25cc-4e1d-beca-68e02351d970 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:01.721590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:01.727143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:01.728769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:01.731879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:01.733092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:01.733386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] PATH_INFO: `/v3/projects/439bb6c50fcb44a0a25688b5f9f7ac2b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:01.735282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439bb6c50fcb44a0a25688b5f9f7ac2b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:01.737218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:01.857944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bcf50-8ab5-4a8f-bdc4-6843a89b3ee2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:01.866648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dcc29-782c-470c-8671-0380a0690c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:01.867293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dcc29-782c-470c-8671-0380a0690c45 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:01.867574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dcc29-782c-470c-8671-0380a0690c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:01.870791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dcc29-782c-470c-8671-0380a0690c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:01.881918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dcc29-782c-470c-8671-0380a0690c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:01.884067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dcc29-782c-470c-8671-0380a0690c45 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:01.930014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3171/6368] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:01.963878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439bb6c50fcb44a0a25688b5f9f7ac2b', 'request_id': 'req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:01.982917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439bb6c50fcb44a0a25688b5f9f7ac2b', 'request_id': 'req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:02.052223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439bb6c50fcb44a0a25688b5f9f7ac2b', 'request_id': 'req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:02.080467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] The token cache is being invalidate because project 439bb6c50fcb44a0a25688b5f9f7ac2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:02.082483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:02.084049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef4df8e1-15e4-41ea-9736-d04bbae13cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:02.086888 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3198/6369] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:01 2022] DELETE /identity/v3/projects/439bb6c50fcb44a0a25688b5f9f7ac2b => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:02.092266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244f7c-7808-4156-b69d-e5860133ab99 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.092566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244f7c-7808-4156-b69d-e5860133ab99 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.092831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244f7c-7808-4156-b69d-e5860133ab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:02.107702 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:02.114958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a8244f7c-7808-4156-b69d-e5860133ab99 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:02.116197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a8244f7c-7808-4156-b69d-e5860133ab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:02.197751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716212d-6ec8-41af-96d2-37a208f7ceb8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.198140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716212d-6ec8-41af-96d2-37a208f7ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.198490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716212d-6ec8-41af-96d2-37a208f7ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:02.204515 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3172/6370] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:02.223247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d716212d-6ec8-41af-96d2-37a208f7ceb8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:02.231308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d716212d-6ec8-41af-96d2-37a208f7ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:02.240389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8244f7c-7808-4156-b69d-e5860133ab99 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:02.241035 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3199/6371] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:02.257801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8244f7c-7808-4156-b69d-e5860133ab99 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:02.267504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:02.268203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.268544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.268881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:02.271457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:02.271607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:02.275614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:02.306173 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3173/6372] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:02.312989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716212d-6ec8-41af-96d2-37a208f7ceb8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:02.323728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716212d-6ec8-41af-96d2-37a208f7ceb8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:02.338047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:02.341653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.341653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.341653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:02.341653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:02.344513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:02.513613 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:02.528344 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3200/6373] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:02 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:02.532918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:02.550912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99a16f-f502-4f20-a92c-a1ff0170ff54 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:02.667425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:02.668131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.668588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.669001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:02.674640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:02.676835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:02.802280 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3174/6374] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:02 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:02.807739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:02.825451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442b63e-b11e-41d6-90b6-1437d15f96af admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:02.848315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:02.848947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.849231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.849506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:02.850261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:02.854669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:02.894193 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3201/6375] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:02.894506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:02.908181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa6b0-97d9-489a-98db-b1808580f935 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:02.926945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694190b3-4fe4-4fb6-bf74-cd9b17dc6b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:02.927590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694190b3-4fe4-4fb6-bf74-cd9b17dc6b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.930230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694190b3-4fe4-4fb6-bf74-cd9b17dc6b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.930230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694190b3-4fe4-4fb6-bf74-cd9b17dc6b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:02.930230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694190b3-4fe4-4fb6-bf74-cd9b17dc6b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:02.930546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694190b3-4fe4-4fb6-bf74-cd9b17dc6b5d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:02.955641 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3175/6376] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:02.956898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:02.973129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a69430-f315-42a6-9e71-a0557274e8ea admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:02.992952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:02.994854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:02.995220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:02.995563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] PATH_INFO: `/v3/projects/abfd6b69c7a04a39be967f196b135c1b/users/37d6712167f241e98d6f179493beab78/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:03.023963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfd6b69c7a04a39be967f196b135c1b, user_id=37d6712167f241e98d6f179493beab78, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:03.027153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:03.131130 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3202/6377] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:02 2022] PUT /identity/v3/projects/abfd6b69c7a04a39be967f196b135c1b/users/37d6712167f241e98d6f179493beab78/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:03.151415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d26f-29fa-4d9d-a351-dd302472a867 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:03.152017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d26f-29fa-4d9d-a351-dd302472a867 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:03.152427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d26f-29fa-4d9d-a351-dd302472a867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:03.201126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4762d26f-29fa-4d9d-a351-dd302472a867 None None] MFA Rules not processed for user `37d6712167f241e98d6f179493beab78`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:03.203268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4762d26f-29fa-4d9d-a351-dd302472a867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:03.314427 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3176/6378] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:03.353522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:03.357356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:03.597369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edba407-2fa1-478c-b113-eb82b1f2d559 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:03.604469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:03.605107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:03.605389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:03.605660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:03.636512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:03.638730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:03.666960 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3203/6379] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:09.417199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762d26f-29fa-4d9d-a351-dd302472a867 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:09.424223 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:09.440516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762d26f-29fa-4d9d-a351-dd302472a867 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:09.454982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78cddf-977b-4540-9f68-e878193abbda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:09.456032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78cddf-977b-4540-9f68-e878193abbda service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:09.456622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78cddf-977b-4540-9f68-e878193abbda service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:09.457109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78cddf-977b-4540-9f68-e878193abbda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:09.459278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5e78cddf-977b-4540-9f68-e878193abbda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:09.599402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78cddf-977b-4540-9f68-e878193abbda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:09.601311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78cddf-977b-4540-9f68-e878193abbda service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:09.617268 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3177/6380] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:13.649718 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:17.984165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:17.987369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:18.018069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329510b-cff2-4130-863d-e724b8cb756c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:18.053400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:18.058879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:18.059663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:18.060436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] PATH_INFO: `/v3/users/1e89a0c72fb34be3be1221292adf18f5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:18.063803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e89a0c72fb34be3be1221292adf18f5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:18.066242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:18.328879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e89a0c72fb34be3be1221292adf18f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:18.339320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e89a0c72fb34be3be1221292adf18f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:18.340196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e89a0c72fb34be3be1221292adf18f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:18.435062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e89a0c72fb34be3be1221292adf18f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:18.436523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e89a0c72fb34be3be1221292adf18f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:18.483544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3204/6381] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:17 2022] DELETE /identity/v3/users/1e89a0c72fb34be3be1221292adf18f5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:18.487939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:18.491055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:18.491055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:18.527612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:18.532375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:18.648022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:18.649893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:18.719951 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3178/6382] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:18.758254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:18.759904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:18.802557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e5d7-0ed5-4cef-b1ef-2f1e172cb3bd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:18.818091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:18.818810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:18.819090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:18.819361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] PATH_INFO: `/v3/users/be1759290b0b4034ad9d312abb95ef46` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:18.822558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1759290b0b4034ad9d312abb95ef46)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:18.832413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:18.932467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec30718-4cf7-45ad-857b-fe18728777b3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:18.936789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac0ded-cf75-460f-a78c-22a68aaac873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:18.937428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0ded-cf75-460f-a78c-22a68aaac873 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:18.937708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0ded-cf75-460f-a78c-22a68aaac873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:18.937982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0ded-cf75-460f-a78c-22a68aaac873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:18.964225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac0ded-cf75-460f-a78c-22a68aaac873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:18.965684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac0ded-cf75-460f-a78c-22a68aaac873 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:18.985884 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3179/6383] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:18.987264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:18.987551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:18.987827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:19.068560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] MFA Rules not processed for user `be90af65219d44a4a5d9dbd8883ff4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:19.071346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:19.156978 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:19.172989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1759290b0b4034ad9d312abb95ef46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:19.222708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1759290b0b4034ad9d312abb95ef46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:19.227475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1759290b0b4034ad9d312abb95ef46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:19.262647 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3180/6384] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:19.266327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:19.270390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:19.304431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1759290b0b4034ad9d312abb95ef46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:19.305292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1759290b0b4034ad9d312abb95ef46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:19.321061 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:19.325468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85615fed-27d4-4b28-b9ac-67f0468cc6dd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:19.346101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:19.346982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:19.353300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:19.355203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:19.356113 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3205/6385] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:18 2022] DELETE /identity/v3/users/be1759290b0b4034ad9d312abb95ef46 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:19.358359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:19.362112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:19.479125 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3181/6386] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:19 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:19.482354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:19.485621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:19.636127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05d63a-5380-4c6a-9840-f459dd4d0817 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:19.649323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50d335-f4d8-4469-9476-7ef7d994f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:19.652379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50d335-f4d8-4469-9476-7ef7d994f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:19.652619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50d335-f4d8-4469-9476-7ef7d994f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:19.652898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50d335-f4d8-4469-9476-7ef7d994f8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:19.654251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50d335-f4d8-4469-9476-7ef7d994f8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:19.657062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50d335-f4d8-4469-9476-7ef7d994f8b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:19.684854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:19.686733 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3206/6387] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:19.699385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630a7b6-c297-426e-9c65-cff2769c6b9c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:19.713107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:19.713708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:19.714021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:19.714278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] PATH_INFO: `/v3/system/users/096550dd1c374c3ea128ffa06f8a8d41/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:19.763687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=096550dd1c374c3ea128ffa06f8a8d41, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:19.765603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:19.868440 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3182/6388] 10.222.0.42 () {60 vars in 1378 bytes} [Sun Oct 23 01:40:19 2022] PUT /identity/v3/system/users/096550dd1c374c3ea128ffa06f8a8d41/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:19.879223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:19.880075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:19.880513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:19.948612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] MFA Rules not processed for user `096550dd1c374c3ea128ffa06f8a8d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:19.950158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:20.137987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:20.138592 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3207/6389] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:19 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 01:40:20.347461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:20.349051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:20.380293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375310d4-9bd2-4668-a33d-172e99068d12 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:20.399201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:20.399820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:20.400105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:20.400380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] PATH_INFO: `/v3/projects/ef4c34c1a48140f8ae5a69fa0abb2bc7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:20.403518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4c34c1a48140f8ae5a69fa0abb2bc7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:20.406089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:20.521039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d629-f3d6-4d0e-81bb-a19bb89fa085 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:20.673391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096550dd1c374c3ea128ffa06f8a8d41', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:20.676261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:20.678182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:20.678582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:20.680694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:20.684065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:20.711243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3183/6390] 10.222.0.42 () {58 vars in 1110 bytes} [Sun Oct 23 01:40:20 2022] GET /identity/v3/services => generated 2191 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:20.715198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'request_id': 'req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:20.715431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:20.725095 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:20.730768 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:20.742948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'request_id': 'req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:20.841182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4c34c1a48140f8ae5a69fa0abb2bc7', 'request_id': 'req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:20.862762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] The token cache is being invalidate because project ef4c34c1a48140f8ae5a69fa0abb2bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:20.862903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:20.870912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:20.885147 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3208/6391] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:20 2022] DELETE /identity/v3/projects/ef4c34c1a48140f8ae5a69fa0abb2bc7 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:20.891045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:20.899177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:20.990563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1073c-0954-4b07-999e-6d2e434a42af None tempest-ImageQuotaTest-1897285254-system-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:21.085396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096550dd1c374c3ea128ffa06f8a8d41', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:21.085396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:21.085396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:21.085691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] PATH_INFO: `/v3/limits` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:21.090066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:21.090354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:21.114309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf28ed5-da2d-4646-9eab-fe82dfad57a4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:21.129405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:21.130082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:21.130365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:21.130640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] PATH_INFO: `/v3/users/ef5aac3e1bda4a54846e674ffd1449d8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:21.131814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5aac3e1bda4a54846e674ffd1449d8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:21.133860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 23 01:40:21.172741 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 23 01:40:21.173808 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:40:21.175724 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3184/6392] 10.222.0.42 () {60 vars in 1126 bytes} [Sun Oct 23 01:40:20 2022] POST /identity/v3/limits => generated 124 bytes in 460 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:40:21.179817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:21.182089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:21.338179 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:21.343013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5aac3e1bda4a54846e674ffd1449d8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:21.353513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5aac3e1bda4a54846e674ffd1449d8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:21.354852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5aac3e1bda4a54846e674ffd1449d8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:21.469894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5aac3e1bda4a54846e674ffd1449d8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:21.471196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5aac3e1bda4a54846e674ffd1449d8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:21.510040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3209/6393] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:20 2022] DELETE /identity/v3/users/ef5aac3e1bda4a54846e674ffd1449d8 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:21.513168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:21.517037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a67e1-7b58-4ca3-8f4f-7824daaee34b None tempest-ImageQuotaTest-1897285254-system-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:21.517475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:21.610807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096550dd1c374c3ea128ffa06f8a8d41', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:21.611446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:21.611719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:21.615506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:21.615506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:21.615506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:21.642118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3185/6394] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:40:21 2022] GET /identity/v3/registered_limits => generated 129 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:21.650148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:21.653484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:21.688469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b7377-b800-42b5-ad75-3192c12ac106 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:21.708533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:21.709484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:21.729173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:21.729914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] PATH_INFO: `/v3/projects/0bcf2c6e89274037bf64c83168e3d07b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:21.733569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcf2c6e89274037bf64c83168e3d07b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:21.738172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:21.742731 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:21.903976 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:21.929684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcf2c6e89274037bf64c83168e3d07b', 'request_id': 'req-704fd73c-4444-469d-bdc1-b6c6f0e771bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:21.947157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcf2c6e89274037bf64c83168e3d07b', 'request_id': 'req-704fd73c-4444-469d-bdc1-b6c6f0e771bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.012196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8086a0-629d-403f-b52c-9d01fdce18ca None tempest-ImageQuotaTest-1897285254-system-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:22.025680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcf2c6e89274037bf64c83168e3d07b', 'request_id': 'req-704fd73c-4444-469d-bdc1-b6c6f0e771bc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.062993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] The token cache is being invalidate because project 0bcf2c6e89274037bf64c83168e3d07b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:22.065174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.066935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.074431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3210/6395] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:21 2022] DELETE /identity/v3/projects/0bcf2c6e89274037bf64c83168e3d07b => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:22.078025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:22.083034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:22.127220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096550dd1c374c3ea128ffa06f8a8d41', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:22.128581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:22.129532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:22.130001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:22.131451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:22.135353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:22.148544 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3186/6396] 10.222.0.42 () {58 vars in 1137 bytes} [Sun Oct 23 01:40:21 2022] GET /identity/v3/registered_limits => generated 129 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:40:22.246515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd73c-4444-469d-bdc1-b6c6f0e771bc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:22.255815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:22.256762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:22.257192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:22.257633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] PATH_INFO: `/v3/users/ac1904cd4b174c9884bd537a7e1bcf0a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:22.259149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1904cd4b174c9884bd537a7e1bcf0a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:22.262121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:22.507935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1904cd4b174c9884bd537a7e1bcf0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.531883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1904cd4b174c9884bd537a7e1bcf0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.532333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1904cd4b174c9884bd537a7e1bcf0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.620053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1904cd4b174c9884bd537a7e1bcf0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.621234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1904cd4b174c9884bd537a7e1bcf0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:22.660265 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3211/6397] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:22 2022] DELETE /identity/v3/users/ac1904cd4b174c9884bd537a7e1bcf0a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:23.244028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:23.245968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:23.461357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2310-6d8e-438d-a5fa-b3049ec529a6 None tempest-ImageQuotaTest-1897285254-system-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:23.469031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:23.470279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:23.470914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:23.471404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] PATH_INFO: `/v3/projects/95ad91db941b42d3804257fe2c7c325c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:23.473528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ad91db941b42d3804257fe2c7c325c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:23.479930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:23.678865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ad91db941b42d3804257fe2c7c325c', 'request_id': 'req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:23.686762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ad91db941b42d3804257fe2c7c325c', 'request_id': 'req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:23.760552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ad91db941b42d3804257fe2c7c325c', 'request_id': 'req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:23.810610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] The token cache is being invalidate because project 95ad91db941b42d3804257fe2c7c325c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:23.811071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:23.811838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:23.813794 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3187/6398] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:23 2022] DELETE /identity/v3/projects/95ad91db941b42d3804257fe2c7c325c => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:24.165191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:24.172360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:24.208966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42f36a-b156-4218-a418-5519105a053a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:24.234378 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:24.445769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:24.445769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:24.445769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:24.445769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] PATH_INFO: `/v3/users/bb03047092f64e2abbf78e9db1a06e0a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:24.446862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb03047092f64e2abbf78e9db1a06e0a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:24.448102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:24.718057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb03047092f64e2abbf78e9db1a06e0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:24.742860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb03047092f64e2abbf78e9db1a06e0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:24.743338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb03047092f64e2abbf78e9db1a06e0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:24.852286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb03047092f64e2abbf78e9db1a06e0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:24.852826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e6664a70-3d20-409a-90c3-bbcc2cde0951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb03047092f64e2abbf78e9db1a06e0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:24.900595 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3212/6399] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:24 2022] DELETE /identity/v3/users/bb03047092f64e2abbf78e9db1a06e0a => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:25.167956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:25.169430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:25.188627 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:25.195316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f6f59-ed37-4f0c-b3fb-da3fc55faf39 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:25.361192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:25.361874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:25.362174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:25.362445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] PATH_INFO: `/v3/projects/bb6dab53fb084335b58d3fd1141af74c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:25.366273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6dab53fb084335b58d3fd1141af74c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:25.368181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:25.578323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6dab53fb084335b58d3fd1141af74c', 'request_id': 'req-3300d110-d8df-4d81-af03-a9ce35ce7b85'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:25.585194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6dab53fb084335b58d3fd1141af74c', 'request_id': 'req-3300d110-d8df-4d81-af03-a9ce35ce7b85'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:25.679117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6dab53fb084335b58d3fd1141af74c', 'request_id': 'req-3300d110-d8df-4d81-af03-a9ce35ce7b85'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:25.713806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] The token cache is being invalidate because project bb6dab53fb084335b58d3fd1141af74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:25.714152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:25.718486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3300d110-d8df-4d81-af03-a9ce35ce7b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:25.721623 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3188/6400] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:25 2022] DELETE /identity/v3/projects/bb6dab53fb084335b58d3fd1141af74c => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:25.729489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62198-ad6a-4b2c-826a-775b276ad75b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:25.730441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62198-ad6a-4b2c-826a-775b276ad75b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:25.730441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62198-ad6a-4b2c-826a-775b276ad75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:25.771556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-04d62198-ad6a-4b2c-826a-775b276ad75b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:25.773091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-04d62198-ad6a-4b2c-826a-775b276ad75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:25.892538 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3213/6401] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:25.900415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:25.900667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:25.901407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:25.925793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:25.927629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:25.939338 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3189/6402] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:25.944470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62198-ad6a-4b2c-826a-775b276ad75b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:25.948232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:25.950300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:25.971862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b706e6-d306-4924-8030-2a3a71f5e761 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:25.974864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62198-ad6a-4b2c-826a-775b276ad75b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:25.979843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:25.981015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:25.981423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:25.982092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] PATH_INFO: `/v3/projects/aa4e3018a6ca477c9a1d7215ad98d9e9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:25.984411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4e3018a6ca477c9a1d7215ad98d9e9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:25.987228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:25.990068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:25.992102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:25.993156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:25.994296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:25.996984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:25.997494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:25.999430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.021395 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3214/6403] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:26.025872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.044535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0b658-810e-4ada-97fb-cfc2c18891a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:26.051463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:26.052124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.052411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.053015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.053668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:26.055903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.097172 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:26.158965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'request_id': 'req-4a4c177a-dbfb-4478-ac18-aca6aecbd444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:26.166078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'request_id': 'req-4a4c177a-dbfb-4478-ac18-aca6aecbd444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:26.217318 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3215/6404] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:26 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:26.219363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.286020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4e3018a6ca477c9a1d7215ad98d9e9', 'request_id': 'req-4a4c177a-dbfb-4478-ac18-aca6aecbd444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:26.313082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] The token cache is being invalidate because project aa4e3018a6ca477c9a1d7215ad98d9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:26.313388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:26.314688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4a4c177a-dbfb-4478-ac18-aca6aecbd444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:26.319784 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3190/6405] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:25 2022] DELETE /identity/v3/projects/aa4e3018a6ca477c9a1d7215ad98d9e9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:26.326056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da95c51-7340-4ead-9ede-0f8373554712 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.326457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da95c51-7340-4ead-9ede-0f8373554712 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.326894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da95c51-7340-4ead-9ede-0f8373554712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.373793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6da95c51-7340-4ead-9ede-0f8373554712 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:26.377840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6da95c51-7340-4ead-9ede-0f8373554712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:26.388548 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:26.438100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1133-56ac-4256-9e8a-ed5970076878 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:26.450989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:26.453825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.455996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.456450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.457134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:26.464361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.533481 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3191/6406] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:26.542597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875dab-5b56-426d-a227-ffd9cf4da15f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.542896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875dab-5b56-426d-a227-ffd9cf4da15f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.543177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875dab-5b56-426d-a227-ffd9cf4da15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.573870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f0875dab-5b56-426d-a227-ffd9cf4da15f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:26.576170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f0875dab-5b56-426d-a227-ffd9cf4da15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:26.591032 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3216/6407] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:26 2022] POST /identity/v3/users => generated 285 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:26.596606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.599825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:26.610159 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3192/6408] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:26.625607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875dab-5b56-426d-a227-ffd9cf4da15f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.640567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875dab-5b56-426d-a227-ffd9cf4da15f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:26.649394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:26.653955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.653955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.653955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.653955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:26.653955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:26.655022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bb3bb-af5e-4a9f-9b1f-4fb545e84bfb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:26.658521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.664870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:26.667232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.674237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.674587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.676389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:26.679311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.689442 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3193/6409] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:26.693307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.717869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a6daf-5c02-485c-91e0-55a3a457386f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:26.718126 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3217/6410] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:40:26.718220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:26.718220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.718220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.718220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.718584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:26.719729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.721537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.742691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cf127-a3e0-43d9-93be-4c91a563a477 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:26.759538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:26.760174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.760459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.760732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.761522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:26.766381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.798184 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3218/6411] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:26.799260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.820447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81afb1-1142-49df-ac39-23cc342ae22d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:26.839472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90e0f-99bd-4793-bba7-1356f7053b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:26.839472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90e0f-99bd-4793-bba7-1356f7053b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.839472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90e0f-99bd-4793-bba7-1356f7053b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.839472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90e0f-99bd-4793-bba7-1356f7053b81 admin admin] PATH_INFO: `/v3/projects/90767f0280c840f6bac352ed39e20204/users/a6d614e27dad408186b74b9e7da72783/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.876340 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3194/6412] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:26 2022] POST /identity/v3/projects => generated 395 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:26.877684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:26.883084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90e0f-99bd-4793-bba7-1356f7053b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90767f0280c840f6bac352ed39e20204, user_id=a6d614e27dad408186b74b9e7da72783, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:26.893736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90e0f-99bd-4793-bba7-1356f7053b81 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:26.983380 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3219/6413] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:26 2022] PUT /identity/v3/projects/90767f0280c840f6bac352ed39e20204/users/a6d614e27dad408186b74b9e7da72783/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:26.994281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9f5f-fd92-4970-b367-196f3a8bc363 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:26.994574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9f5f-fd92-4970-b367-196f3a8bc363 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:26.994855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9f5f-fd92-4970-b367-196f3a8bc363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:26.998774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71efc45-eefd-4397-b2af-ee19ac9b7fb5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:27.082025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7feb9f5f-fd92-4970-b367-196f3a8bc363 None None] MFA Rules not processed for user `a6d614e27dad408186b74b9e7da72783`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:27.082425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7feb9f5f-fd92-4970-b367-196f3a8bc363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:27.146044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:27.146648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.146929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.147729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.147945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:27.150056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:27.243653 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3220/6414] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:27.244799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9f5f-fd92-4970-b367-196f3a8bc363 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:27.270313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9f5f-fd92-4970-b367-196f3a8bc363 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:27.281714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:27.281714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.281714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.281714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.282398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:27.282837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:27.287070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3195/6415] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:26 2022] POST /identity/v3/users => generated 298 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:27.290895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:27.312120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0c2a7-571b-4721-aa79-1dfb0eca7257 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:27.323636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:27.324264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.324536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.324808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.327784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:27.331429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:27.335857 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:27.368216 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3196/6416] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:40:27.372531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:27.384879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3d866-4d38-4f1e-8a89-5c83bba6f8b8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:27.405484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:27.405963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.406296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.406554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.407255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:27.410687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:27.439221 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3197/6417] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:40:27.443914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:27.459047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b352b1-472b-422f-8ef8-8b36a2b1a803 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:27.461373 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3221/6418] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:27 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:27.470899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:27.497386 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:27.616838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdfd7e-3d20-4c8c-be73-4ef8bff2c3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:27.617715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdfd7e-3d20-4c8c-be73-4ef8bff2c3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.617949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdfd7e-3d20-4c8c-be73-4ef8bff2c3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.619399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdfd7e-3d20-4c8c-be73-4ef8bff2c3f4 admin admin] PATH_INFO: `/v3/projects/c36e0a78b98040598bfa5fac4fe95cf8/users/85e367cf6f3b4259902ac1f5f9918391/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.627785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f113-376f-45a9-99ca-0f0e708d469f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:27.641453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:27.642301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.642651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.642995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.643704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:27.646141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:27.656907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdfd7e-3d20-4c8c-be73-4ef8bff2c3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36e0a78b98040598bfa5fac4fe95cf8, user_id=85e367cf6f3b4259902ac1f5f9918391, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:27.659825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdfd7e-3d20-4c8c-be73-4ef8bff2c3f4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:27.772573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3198/6419] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:27 2022] PUT /identity/v3/projects/c36e0a78b98040598bfa5fac4fe95cf8/users/85e367cf6f3b4259902ac1f5f9918391/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:27.777855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876a71-75a8-417d-a38a-488bfa3b9590 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.778216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876a71-75a8-417d-a38a-488bfa3b9590 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.778493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876a71-75a8-417d-a38a-488bfa3b9590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.804809 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3222/6420] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:27 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:27.805579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ce876a71-75a8-417d-a38a-488bfa3b9590 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:27.807265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ce876a71-75a8-417d-a38a-488bfa3b9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:27.809091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:27.830417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3b2a3-37f1-4db9-aae5-60787ccc7fb6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:27.957630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:27.957958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:27.958285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:27.958554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:27.959286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:27.961117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:27.970744 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3199/6421] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:27.980912 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3223/6422] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:27.981703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876a71-75a8-417d-a38a-488bfa3b9590 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:28.003051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:28.003169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876a71-75a8-417d-a38a-488bfa3b9590 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:28.003282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:28.006686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:28.007570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:28.007853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:28.008126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] PATH_INFO: `/v3/projects/cb56c8a9319545a69ad96e2f8927a996/users/148095953c5745128d22795201bfa33d/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:28.053953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb56c8a9319545a69ad96e2f8927a996, user_id=148095953c5745128d22795201bfa33d, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:28.059020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:28.102953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9a703-84df-405f-adfa-667be42d1cf9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:28.106966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:28.109391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:28.109391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:28.109391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:28.124954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:28.126714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:28.132488 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3200/6423] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:27 2022] PUT /identity/v3/projects/cb56c8a9319545a69ad96e2f8927a996/users/148095953c5745128d22795201bfa33d/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:28.135483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:28.143038 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3224/6424] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:28.245002 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:28.268796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017df980-72b3-4a2d-b1bf-71c61b8250c9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:28.276336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01f3ec-c99a-407c-9179-a1696ff303b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:28.277091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f3ec-c99a-407c-9179-a1696ff303b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:28.277561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f3ec-c99a-407c-9179-a1696ff303b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:28.277900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f3ec-c99a-407c-9179-a1696ff303b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:28.278657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01f3ec-c99a-407c-9179-a1696ff303b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:28.280918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01f3ec-c99a-407c-9179-a1696ff303b9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:28.294504 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3201/6425] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:28.301096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:28.317671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ee920-b442-47ad-aa4a-b34ca12a89fb service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:28.331311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:28.332468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:28.333057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:28.333399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] PATH_INFO: `/v3/projects/cb56c8a9319545a69ad96e2f8927a996/users/148095953c5745128d22795201bfa33d/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:28.341769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb56c8a9319545a69ad96e2f8927a996, user_id=148095953c5745128d22795201bfa33d, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:28.346033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:28.363037 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3225/6426] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:28 2022] PUT /identity/v3/projects/cb56c8a9319545a69ad96e2f8927a996/users/148095953c5745128d22795201bfa33d/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:28.382126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:28.382482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:28.382765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:28.444880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] MFA Rules not processed for user `148095953c5745128d22795201bfa33d`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:28.446220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:28.566586 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3202/6427] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:28.580569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:28.583015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:28.626236 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:28.726934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2dd4-f7f2-4e44-89b8-53bde8ea9b63 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:28.738302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:28.738987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:28.739263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:28.739532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:28.757749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:28.757749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:28.775637 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3226/6428] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:28.960833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:28.966336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:28.989877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd75424-2324-4e0e-8c4b-3cc32232dc86 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:28.998395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:28.999393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:28.999875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:29.001772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:29.081566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:29.083416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:29.099203 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3203/6429] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:30.487014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:30.489716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:30.604293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8e35-282d-41de-862d-75d24e94738f service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:30.623807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:30.624910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:30.625348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:30.625793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] PATH_INFO: `/v3/users/6e9f6fbfc6484cbfb60167b73e87a768` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:30.628255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9f6fbfc6484cbfb60167b73e87a768)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:30.632398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:30.828483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9f6fbfc6484cbfb60167b73e87a768'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:30.837032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9f6fbfc6484cbfb60167b73e87a768'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:30.837862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9f6fbfc6484cbfb60167b73e87a768'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:30.972562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9f6fbfc6484cbfb60167b73e87a768'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:30.973523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9f6fbfc6484cbfb60167b73e87a768'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:31.001822 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3227/6430] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:30 2022] DELETE /identity/v3/users/6e9f6fbfc6484cbfb60167b73e87a768 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:31.498458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:31.511855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0282-5456-433d-885f-b60f5cd44380 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:31.650499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:31.651414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:31.651932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:31.652479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] PATH_INFO: `/v3/projects/d53e92891fa74db68db5554878af0adf` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:31.654901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53e92891fa74db68db5554878af0adf)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:31.658558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:31.675945 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:31.877436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53e92891fa74db68db5554878af0adf', 'request_id': 'req-7c2676aa-1616-4ca1-ae2e-4c3124240508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:31.884144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53e92891fa74db68db5554878af0adf', 'request_id': 'req-7c2676aa-1616-4ca1-ae2e-4c3124240508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:31.983357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53e92891fa74db68db5554878af0adf', 'request_id': 'req-7c2676aa-1616-4ca1-ae2e-4c3124240508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:31.995594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] The token cache is being invalidate because project d53e92891fa74db68db5554878af0adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:31.996089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:31.996914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.001910 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3204/6431] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:31 2022] DELETE /identity/v3/projects/d53e92891fa74db68db5554878af0adf => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:32.003094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:32.004642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:32.019125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8a14-917c-4ed8-88b6-fc49954b5617 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:32.088517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:32.089267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:32.098564 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:32.174249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:32.175325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:32.180177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:32.180553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] PATH_INFO: `/v3/users/fafd69cbb8644b55a058bfb4e8d12604` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:32.181781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafd69cbb8644b55a058bfb4e8d12604)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:32.183795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:32.218456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2676aa-1616-4ca1-ae2e-4c3124240508 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:32.223484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:32.224316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:32.225141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:32.226087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] PATH_INFO: `/v3/users/be90af65219d44a4a5d9dbd8883ff4bf` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:32.229238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=be90af65219d44a4a5d9dbd8883ff4bf)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:32.229355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:32.341071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafd69cbb8644b55a058bfb4e8d12604'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.354894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafd69cbb8644b55a058bfb4e8d12604'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.356006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafd69cbb8644b55a058bfb4e8d12604'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.445207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be90af65219d44a4a5d9dbd8883ff4bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.455051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be90af65219d44a4a5d9dbd8883ff4bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.458124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be90af65219d44a4a5d9dbd8883ff4bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.480570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafd69cbb8644b55a058bfb4e8d12604'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.482579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafd69cbb8644b55a058bfb4e8d12604'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.507800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3228/6432] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:32 2022] DELETE /identity/v3/users/fafd69cbb8644b55a058bfb4e8d12604 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:32.510173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:32.510173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:32.575460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31881678-1a81-4f15-8c44-3d754001dd1b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:32.580943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:32.581580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:32.581856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:32.582162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] PATH_INFO: `/v3/users/37d6712167f241e98d6f179493beab78` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:32.583409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d6712167f241e98d6f179493beab78)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:32.585319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:32.645907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be90af65219d44a4a5d9dbd8883ff4bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.646694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c83636fc-e34c-465b-9645-26e375482cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be90af65219d44a4a5d9dbd8883ff4bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.669555 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3205/6433] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:32 2022] DELETE /identity/v3/users/be90af65219d44a4a5d9dbd8883ff4bf => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:32.786820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d6712167f241e98d6f179493beab78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.796191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d6712167f241e98d6f179493beab78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.797862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d6712167f241e98d6f179493beab78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.858065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d6712167f241e98d6f179493beab78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.858858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d6712167f241e98d6f179493beab78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:32.894272 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3229/6434] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:32 2022] DELETE /identity/v3/users/37d6712167f241e98d6f179493beab78 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:32.899214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:32.900101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:32.900269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:32.906439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:32.917114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:32.960222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:32.961276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:32.972046 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:33.016584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d704e6-d581-4eee-8a1d-87a16aa020be admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.021463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.022322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.022606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.024333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] PATH_INFO: `/v3/projects/3c1bf01c3f9846fd87558dc6cd2ead8b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.024333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1bf01c3f9846fd87558dc6cd2ead8b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.025917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.035688 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3206/6435] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:33.036625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:33.040305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.118484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e08c0-5a0e-48cf-b450-f7058efbf6a9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.122360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.123585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.123925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.124258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.126745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.151473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1bf01c3f9846fd87558dc6cd2ead8b', 'request_id': 'req-46043741-c4c8-419f-bbd3-8b35d8f0c01f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.157948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1bf01c3f9846fd87558dc6cd2ead8b', 'request_id': 'req-46043741-c4c8-419f-bbd3-8b35d8f0c01f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.207274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.208752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.222980 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3207/6436] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:33.223257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1bf01c3f9846fd87558dc6cd2ead8b', 'request_id': 'req-46043741-c4c8-419f-bbd3-8b35d8f0c01f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.224043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:33.225662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.237806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] The token cache is being invalidate because project 3c1bf01c3f9846fd87558dc6cd2ead8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:33.238386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.239312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.241117 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3230/6437] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:32 2022] DELETE /identity/v3/projects/3c1bf01c3f9846fd87558dc6cd2ead8b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:33.242320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:33.243822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.246188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ba12-c945-4b5a-b636-4ef64f1aeb66 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.316777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043741-c4c8-419f-bbd3-8b35d8f0c01f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.321356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b0741-a12b-424d-a3d5-06b86a74d5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.322306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b0741-a12b-424d-a3d5-06b86a74d5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.322586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b0741-a12b-424d-a3d5-06b86a74d5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.322859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b0741-a12b-424d-a3d5-06b86a74d5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.323277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.324019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.324497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.324773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] PATH_INFO: `/v3/projects/0f56b7f001fd496496d2b635158ddd78` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.325073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-680b0741-a12b-424d-a3d5-06b86a74d5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.325960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f56b7f001fd496496d2b635158ddd78)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.328245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.340361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b0741-a12b-424d-a3d5-06b86a74d5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.342922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b0741-a12b-424d-a3d5-06b86a74d5f3 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.358018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3231/6438] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:33.360534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5627-9b56-46ef-a1d2-f38afc201e3b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.365357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5627-9b56-46ef-a1d2-f38afc201e3b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.365357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5627-9b56-46ef-a1d2-f38afc201e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.387424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f45c5627-9b56-46ef-a1d2-f38afc201e3b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:33.390038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f45c5627-9b56-46ef-a1d2-f38afc201e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.406367 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3232/6439] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:33.408498 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:33.416655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516dc75-fb0f-4410-9f8b-e51c6f380ed0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.417033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516dc75-fb0f-4410-9f8b-e51c6f380ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.417930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516dc75-fb0f-4410-9f8b-e51c6f380ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.455269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5516dc75-fb0f-4410-9f8b-e51c6f380ed0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:33.457521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5516dc75-fb0f-4410-9f8b-e51c6f380ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.469496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f56b7f001fd496496d2b635158ddd78', 'request_id': 'req-63785543-258a-42e8-ac53-d8ec43647b58'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.484047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f56b7f001fd496496d2b635158ddd78', 'request_id': 'req-63785543-258a-42e8-ac53-d8ec43647b58'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.564801 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3233/6440] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:33.569406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516dc75-fb0f-4410-9f8b-e51c6f380ed0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:33.582720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516dc75-fb0f-4410-9f8b-e51c6f380ed0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.594150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.594150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.594150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.594150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.594601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:33.594601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.594601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.599761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f56b7f001fd496496d2b635158ddd78', 'request_id': 'req-63785543-258a-42e8-ac53-d8ec43647b58'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.625678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] The token cache is being invalidate because project 0f56b7f001fd496496d2b635158ddd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:33.625678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.626385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.626656 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3234/6441] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:33.627677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:33.627913 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3208/6442] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:33 2022] DELETE /identity/v3/projects/0f56b7f001fd496496d2b635158ddd78 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:33.633458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:33.634179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.635125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.661901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25061a55-a33f-4005-ae49-dc7afc3fbca0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.661901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.661901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.661901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.663137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.663137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.664714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.665297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63785543-258a-42e8-ac53-d8ec43647b58 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.672557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.673198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.673476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.673920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] PATH_INFO: `/v3/users/096550dd1c374c3ea128ffa06f8a8d41` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.675154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096550dd1c374c3ea128ffa06f8a8d41)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.677078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.822265 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3235/6443] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:33 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:33.823748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:33.827901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:33.900200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af3b2-86dc-42a3-b301-f590268a479e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:33.905955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:33.906808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:33.907125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:33.907471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] PATH_INFO: `/v3/projects/abfd6b69c7a04a39be967f196b135c1b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:33.908702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfd6b69c7a04a39be967f196b135c1b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:33.910894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:33.936671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096550dd1c374c3ea128ffa06f8a8d41'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.944231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096550dd1c374c3ea128ffa06f8a8d41'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:33.945119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096550dd1c374c3ea128ffa06f8a8d41'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.007113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfd6b69c7a04a39be967f196b135c1b', 'request_id': 'req-887bda47-ab42-4d4a-9328-8647a0a4d32e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.014304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfd6b69c7a04a39be967f196b135c1b', 'request_id': 'req-887bda47-ab42-4d4a-9328-8647a0a4d32e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.029393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096550dd1c374c3ea128ffa06f8a8d41'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.030123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096550dd1c374c3ea128ffa06f8a8d41'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.050445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3209/6444] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:33 2022] DELETE /identity/v3/users/096550dd1c374c3ea128ffa06f8a8d41 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:34.051339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.052657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:34.120370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfd6b69c7a04a39be967f196b135c1b', 'request_id': 'req-887bda47-ab42-4d4a-9328-8647a0a4d32e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.155243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] The token cache is being invalidate because project abfd6b69c7a04a39be967f196b135c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:34.155690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.156681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-887bda47-ab42-4d4a-9328-8647a0a4d32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:34.158514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3236/6445] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:33 2022] DELETE /identity/v3/projects/abfd6b69c7a04a39be967f196b135c1b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:34.164392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7463eb-d77f-414b-b38f-d6e07272aacd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.164392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7463eb-d77f-414b-b38f-d6e07272aacd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.164699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7463eb-d77f-414b-b38f-d6e07272aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.171605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18f38c-a79f-41cb-9de7-fc1feab8b1e7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.184287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.186517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.186517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.186517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.187399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.190040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.199719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3d7463eb-d77f-414b-b38f-d6e07272aacd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:34.201430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d7463eb-d77f-414b-b38f-d6e07272aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:34.216709 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3237/6446] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:34.229680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5cffd-f196-46fb-92d4-15fd34bb413c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.230059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5cffd-f196-46fb-92d4-15fd34bb413c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.230405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5cffd-f196-46fb-92d4-15fd34bb413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.260985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5ed5cffd-f196-46fb-92d4-15fd34bb413c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:34.263884 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:34.266175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5ed5cffd-f196-46fb-92d4-15fd34bb413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:34.281773 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3238/6447] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:34.283229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5cffd-f196-46fb-92d4-15fd34bb413c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.296689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5cffd-f196-46fb-92d4-15fd34bb413c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.303855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.305227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.305227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.305517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.306943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:34.313060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.324740 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3210/6448] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:34 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:34.328802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.334264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:34.335854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.365472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dfda7-2186-4e55-a5d3-b695c504982b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.374598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.375308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.375591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.375898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.376555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.379476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.385573 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3239/6449] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:34.390652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.410493 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3211/6450] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:34.411937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.426804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13970fab-77d7-4086-ae50-c7d742af45a6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.432878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.433963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.434381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.434723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.436113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.438264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.451722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103e95-a333-45c4-bc76-7ad685861d59 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.459230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.460554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.461681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.462326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.463391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.465344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.488322 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3212/6451] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:34.493722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.510175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4e63c-2a4e-469c-83ea-fb57d9077d94 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.520613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.521659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.522250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.522620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] PATH_INFO: `/v3/projects/4d1bdfc1bddf4e25b124b6388df72e22/users/cbe17991b92f4b4ea6abcca17ddd2090/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.550699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1bdfc1bddf4e25b124b6388df72e22, user_id=cbe17991b92f4b4ea6abcca17ddd2090, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.550946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.551465 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3240/6452] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:34 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:34.552568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.646933 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3213/6453] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:34 2022] PUT /identity/v3/projects/4d1bdfc1bddf4e25b124b6388df72e22/users/cbe17991b92f4b4ea6abcca17ddd2090/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:34.648034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.650436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:34.653096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715674-8207-48d0-af8e-325c2752bdd0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.705747 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:34.721521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27a55-56d0-48bc-91df-1f7eac1e972f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.724539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.725463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.725590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94226c68-cb86-4a20-8c24-fa6127e1487e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.726260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.726387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226c68-cb86-4a20-8c24-fa6127e1487e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.726686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226c68-cb86-4a20-8c24-fa6127e1487e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.727045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.727157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226c68-cb86-4a20-8c24-fa6127e1487e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.727920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.729146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94226c68-cb86-4a20-8c24-fa6127e1487e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:34.730694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.744646 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:34.813014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94226c68-cb86-4a20-8c24-fa6127e1487e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.814567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94226c68-cb86-4a20-8c24-fa6127e1487e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.828410 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3214/6454] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:34.830881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1101-41cb-4d9b-bc2e-1fde6b93355e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.831331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1101-41cb-4d9b-bc2e-1fde6b93355e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.831764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe1101-41cb-4d9b-bc2e-1fde6b93355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.867635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-18fe1101-41cb-4d9b-bc2e-1fde6b93355e None None] MFA Rules not processed for user `cbe17991b92f4b4ea6abcca17ddd2090`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:34.869229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-18fe1101-41cb-4d9b-bc2e-1fde6b93355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:34.924803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3241/6455] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:34 2022] POST /identity/v3/users => generated 285 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:34.926120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.939674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e7f0e-07e3-4eec-8483-d14c63fb991e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.946432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.947342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.947622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.947891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.948583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.951941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.952793 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3215/6456] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:34.958135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe1101-41cb-4d9b-bc2e-1fde6b93355e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:34.979734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe1101-41cb-4d9b-bc2e-1fde6b93355e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:34.981317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:34.982839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:34.982839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:34.983103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:34.984287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:34.989037 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3242/6457] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:34.989626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:34.990726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.010771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbe407-f2be-4e3d-b622-e806552bd677 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.018255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.019868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.020344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.020715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.021555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.023266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.035532 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3243/6458] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:35.039766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.051424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388aafa-f022-4c83-bf4d-d4651694798d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.059729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.060552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.061022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.062739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] PATH_INFO: `/v3/projects/0aaee4f9a8e84dddb66deb9e2c6a4016/users/3a64aa804d7d4902bad1691fefcb7743/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.082447 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3216/6459] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:34 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:35.083558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.097714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aaee4f9a8e84dddb66deb9e2c6a4016, user_id=3a64aa804d7d4902bad1691fefcb7743, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.100873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.152036 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3244/6460] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:35 2022] PUT /identity/v3/projects/0aaee4f9a8e84dddb66deb9e2c6a4016/users/3a64aa804d7d4902bad1691fefcb7743/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:35.153065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.162442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:35.169578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a99a4e-13ad-424b-a8cc-aba1a062349d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.229953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b8414-2093-4865-9a40-88424fa2a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.231433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b8414-2093-4865-9a40-88424fa2a2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.231433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b8414-2093-4865-9a40-88424fa2a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.231652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b8414-2093-4865-9a40-88424fa2a2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.232183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b8414-2093-4865-9a40-88424fa2a2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.234103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b8414-2093-4865-9a40-88424fa2a2d1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.245031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0ad1f-a024-4572-b16a-21294fc79cb8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.250668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.251312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.251593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.251866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] PATH_INFO: `/v3/users/a6d614e27dad408186b74b9e7da72783` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.253016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d614e27dad408186b74b9e7da72783)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.255327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.352535 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3217/6461] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:35 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:35.352535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc16bb-f57b-4ce1-8687-d13ae6dcc5c2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.352535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc16bb-f57b-4ce1-8687-d13ae6dcc5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.352535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc16bb-f57b-4ce1-8687-d13ae6dcc5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.379126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-95fc16bb-f57b-4ce1-8687-d13ae6dcc5c2 None None] MFA Rules not processed for user `3a64aa804d7d4902bad1691fefcb7743`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:35.380341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-95fc16bb-f57b-4ce1-8687-d13ae6dcc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:35.447059 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3218/6462] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:35.447931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc16bb-f57b-4ce1-8687-d13ae6dcc5c2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.460747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc16bb-f57b-4ce1-8687-d13ae6dcc5c2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.465455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.466138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.466450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.466721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.467751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.469366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.481000 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3219/6463] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:35.482062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.494508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c4cee-c9ff-4318-8e2f-c6d3d800b4ad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.495265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d614e27dad408186b74b9e7da72783'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:35.500785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffcdc2-0574-4b0d-b416-3557d3baa69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.501423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffcdc2-0574-4b0d-b416-3557d3baa69d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.501816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffcdc2-0574-4b0d-b416-3557d3baa69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.502874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffcdc2-0574-4b0d-b416-3557d3baa69d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.502874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffcdc2-0574-4b0d-b416-3557d3baa69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.504980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffcdc2-0574-4b0d-b416-3557d3baa69d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.505153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d614e27dad408186b74b9e7da72783'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:35.505689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d614e27dad408186b74b9e7da72783'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:35.571298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d614e27dad408186b74b9e7da72783'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:35.571943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d614e27dad408186b74b9e7da72783'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:35.594420 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3245/6464] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:35 2022] DELETE /identity/v3/users/a6d614e27dad408186b74b9e7da72783 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:35.596119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.598821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:35.616186 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3220/6465] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:35 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:35.617567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.620851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.620851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.638853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:35.640292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:35.685415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302e201-ba24-422c-9534-2a0a06654037 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.722198 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3221/6466] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:35.722198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.726876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:35.742047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612230a8-d6d4-4be9-b1c2-acb633c1870d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:35.749555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.750484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.751328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.751971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.753005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.755750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.768963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:35.768963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:35.768963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:35.769713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] PATH_INFO: `/v3/projects/c141ec4a8edf4d13a084945b7896635c/users/c169154d8f584b3290121f82a721a74a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:35.787203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c141ec4a8edf4d13a084945b7896635c, user_id=c169154d8f584b3290121f82a721a74a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:35.790542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:35.847004 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3222/6467] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:35 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:35.848046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.850904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:35.875460 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3246/6468] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:35 2022] PUT /identity/v3/projects/c141ec4a8edf4d13a084945b7896635c/users/c169154d8f584b3290121f82a721a74a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:35.876612 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:35.877599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:35.927756 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:35.948649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228749ca-b243-445c-9236-5a276e5d6947 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.036779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410f42e-f5f5-470d-a312-c1f06dddb269 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.039567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.040212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.040496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.040849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.042166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.042775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.043054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.043423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.044068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.049268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.057947 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3247/6469] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:36.062775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:36.064822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.066506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.073894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece55855-6277-492a-a0de-330aee75f33e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.079732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.080529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.080892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.081239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.083653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.085521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.105826 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3223/6470] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:36.107518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:36.109871 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3248/6471] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:36.115300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:36.127110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4f28-e4aa-4431-9a06-23c08e7a873c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.136098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb7ec-5c3b-481e-92bb-0991ffad65f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.141565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.142289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.142571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.142843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] PATH_INFO: `/v3/projects/30473dda955c45beb68fa18cf88dcc90/users/f23351a2abd246a9aa9d8c9ec7780962/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.151777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d85fa9-5bff-4056-863d-34b3c81fa764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.152477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85fa9-5bff-4056-863d-34b3c81fa764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.153050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85fa9-5bff-4056-863d-34b3c81fa764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.153050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d85fa9-5bff-4056-863d-34b3c81fa764 admin admin] PATH_INFO: `/v3/projects/c141ec4a8edf4d13a084945b7896635c/users/c169154d8f584b3290121f82a721a74a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.159250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d85fa9-5bff-4056-863d-34b3c81fa764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c141ec4a8edf4d13a084945b7896635c, user_id=c169154d8f584b3290121f82a721a74a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.162767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d85fa9-5bff-4056-863d-34b3c81fa764 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.168060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30473dda955c45beb68fa18cf88dcc90, user_id=f23351a2abd246a9aa9d8c9ec7780962, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.174993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.194024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3249/6472] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:36 2022] PUT /identity/v3/projects/c141ec4a8edf4d13a084945b7896635c/users/c169154d8f584b3290121f82a721a74a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:36.197676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.198067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.198317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.241417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] MFA Rules not processed for user `c169154d8f584b3290121f82a721a74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:36.242996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:36.256062 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3224/6473] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:36 2022] PUT /identity/v3/projects/30473dda955c45beb68fa18cf88dcc90/users/f23351a2abd246a9aa9d8c9ec7780962/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:36.257788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:36.328098 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:36.355691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe1c64-33fc-48f4-bf42-147e6e5ca833 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.362974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.364005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.364788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.367766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.367766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.367963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.382957 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3225/6474] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:36.387333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:36.399375 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3250/6475] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:36.400401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:36.402268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:36.403055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670f637-dab6-42a0-8d1b-703710cb1dab admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.408657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c764-cfdc-4827-a070-86f19309ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.410151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c764-cfdc-4827-a070-86f19309ae10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.410430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c764-cfdc-4827-a070-86f19309ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.410698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c764-cfdc-4827-a070-86f19309ae10 admin admin] PATH_INFO: `/v3/projects/30473dda955c45beb68fa18cf88dcc90/users/f23351a2abd246a9aa9d8c9ec7780962/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.413634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c764-cfdc-4827-a070-86f19309ae10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30473dda955c45beb68fa18cf88dcc90, user_id=f23351a2abd246a9aa9d8c9ec7780962, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.416258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c764-cfdc-4827-a070-86f19309ae10 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.427392 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:36.435547 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3226/6476] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:36 2022] PUT /identity/v3/projects/30473dda955c45beb68fa18cf88dcc90/users/f23351a2abd246a9aa9d8c9ec7780962/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:36.445375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.445707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.446026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.460867 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:36.495179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] MFA Rules not processed for user `f23351a2abd246a9aa9d8c9ec7780962`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:36.497957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:36.556220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324eaa9-2db6-41ef-a9c6-839ca950ca84 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.629693 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:36.631873 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3227/6477] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:36.645570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:36.647324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:36.662012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.662499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.668045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.668045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.675107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:36.727020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83b086-8ee1-44cb-a7bd-a3e0702fc13b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:36.732572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:36.733602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:36.734071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:36.734499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:36.757947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.757947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.765285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3228/6478] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:40:36.817756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:36.819584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:36.834993 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:36.845705 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3251/6479] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:37.233633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:37.235298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:37.343326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a902f5e-f116-445c-b954-058aa86509eb service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:37.346536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:37.347379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:37.347751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:37.348131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] PATH_INFO: `/v3/projects/90767f0280c840f6bac352ed39e20204` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:37.350172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90767f0280c840f6bac352ed39e20204)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:37.352360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:37.521804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90767f0280c840f6bac352ed39e20204', 'request_id': 'req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:37.533593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90767f0280c840f6bac352ed39e20204', 'request_id': 'req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:37.662667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90767f0280c840f6bac352ed39e20204', 'request_id': 'req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:37.691545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] The token cache is being invalidate because project 90767f0280c840f6bac352ed39e20204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:37.691845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:37.692659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:37.698461 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3229/6480] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:37 2022] DELETE /identity/v3/projects/90767f0280c840f6bac352ed39e20204 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:37.699852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:37.712618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9d31-e11c-42c3-97f7-67bae0b0fefa service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:37.785965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:37.786649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:37.787101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:37.787426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] PATH_INFO: `/v3/users/148095953c5745128d22795201bfa33d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:37.788576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=148095953c5745128d22795201bfa33d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:37.790742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:38.115822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148095953c5745128d22795201bfa33d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:38.130163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148095953c5745128d22795201bfa33d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:38.135690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148095953c5745128d22795201bfa33d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:38.266796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148095953c5745128d22795201bfa33d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:38.267749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-935be059-033d-4a93-86a4-60f7bc675f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148095953c5745128d22795201bfa33d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:38.293784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3252/6481] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:37 2022] DELETE /identity/v3/users/148095953c5745128d22795201bfa33d => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:38.411692 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:38.965517 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:39.344084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:39.346236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:39.361369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44375dd-5d4e-4ca1-95a4-0518a46fdb68 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:39.403205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209a544-4661-4e0d-854f-51e4e5e0faeb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:39.403626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209a544-4661-4e0d-854f-51e4e5e0faeb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:39.403996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209a544-4661-4e0d-854f-51e4e5e0faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:39.455416 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:39.462399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3209a544-4661-4e0d-854f-51e4e5e0faeb None None] MFA Rules not processed for user `85e367cf6f3b4259902ac1f5f9918391`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:39.462399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3209a544-4661-4e0d-854f-51e4e5e0faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:39.495176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:39.495765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:39.496109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:39.496309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] PATH_INFO: `/v3/projects/cb56c8a9319545a69ad96e2f8927a996` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:39.498321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb56c8a9319545a69ad96e2f8927a996)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:39.502174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:39.591945 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3253/6482] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:39.602936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:39.607112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:39.607112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:39.625036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] MFA Rules not processed for user `85e367cf6f3b4259902ac1f5f9918391`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:39.629647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:39.637690 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3254/6483] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:39.649474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:39.652502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:39.659881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb56c8a9319545a69ad96e2f8927a996', 'request_id': 'req-41ec0ee5-275f-4685-956a-b1ce05df282c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:39.678177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb56c8a9319545a69ad96e2f8927a996', 'request_id': 'req-41ec0ee5-275f-4685-956a-b1ce05df282c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:39.763182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea919d-a756-4bed-930a-ea3452fe9aae None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:39.773149 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:39.783016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb56c8a9319545a69ad96e2f8927a996', 'request_id': 'req-41ec0ee5-275f-4685-956a-b1ce05df282c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:39.800391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] The token cache is being invalidate because project cb56c8a9319545a69ad96e2f8927a996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:39.800681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:39.801550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-41ec0ee5-275f-4685-956a-b1ce05df282c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:39.803072 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3230/6484] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:39 2022] DELETE /identity/v3/projects/cb56c8a9319545a69ad96e2f8927a996 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:39.810779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937ae6-31ca-42ba-8192-eae5f277a88f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:39.811692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937ae6-31ca-42ba-8192-eae5f277a88f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:39.812318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71937ae6-31ca-42ba-8192-eae5f277a88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:39.838350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:39.838976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:39.839259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:39.839535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:39.841075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-71937ae6-31ca-42ba-8192-eae5f277a88f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:39.841430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:39.842312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-71937ae6-31ca-42ba-8192-eae5f277a88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:39.933957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:39.936812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:39.975890 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3231/6485] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:39.976068 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3255/6486] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:40:39.981030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3193e7-a8d0-41d4-b83e-6a0b402b73d6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:39.982498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3193e7-a8d0-41d4-b83e-6a0b402b73d6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:39.983880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3193e7-a8d0-41d4-b83e-6a0b402b73d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.015004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1a3193e7-a8d0-41d4-b83e-6a0b402b73d6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:40.018283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a3193e7-a8d0-41d4-b83e-6a0b402b73d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:40.031802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3232/6487] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:40.036136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:40.061924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e76e-50eb-4ac8-a3d7-fed57e7238f1 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:40.073338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:40.076353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.076649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.078025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.079190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:40.079571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:40.087337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:40.122054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3256/6488] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:40.125731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3193e7-a8d0-41d4-b83e-6a0b402b73d6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:40.138222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3193e7-a8d0-41d4-b83e-6a0b402b73d6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:40.144218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:40.145042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.145534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.146024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.146862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:40.148996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:40.288414 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3233/6489] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:40 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:40.292372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:40.304167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c9ef-9527-4d57-ab91-b8fafcfc2000 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:40.462239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:40.466610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.474047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.474047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.474047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:40.480723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:40.580655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:40.584011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:40.596740 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3257/6490] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:40 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:40.603327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:40.608938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2c57f-61fa-4525-afe7-f2c2621d4a01 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:40.615741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:40.618025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.618609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.619541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] PATH_INFO: `/v3/users/3a64aa804d7d4902bad1691fefcb7743` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.623227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a64aa804d7d4902bad1691fefcb7743)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:40.627760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e33c9-b1e8-4d57-a723-1262bffde99c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:40.627988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:40.635957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:40.637084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.639228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.639616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.640349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:40.643288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:40.667044 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3258/6491] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:40.671402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:40.687284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55111fc-337e-4199-9025-a5f5cac4d79d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:40.693503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:40.694426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.694805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.695244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.696715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:40.698655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:40.732487 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3259/6492] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:40.749697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:40.756351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90cd8-c953-4646-8ddc-6abeaf605a09 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:40.761722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb774-c92c-4302-8af3-57bef7ae2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:40.762476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb774-c92c-4302-8af3-57bef7ae2503 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.762787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb774-c92c-4302-8af3-57bef7ae2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.763066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb774-c92c-4302-8af3-57bef7ae2503 admin admin] PATH_INFO: `/v3/projects/a1f1fdeb0c1a485bb67dd16576655e7b/users/c8a8e2fe1c8a42b39af7c1c697f68852/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:40.780409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feb774-c92c-4302-8af3-57bef7ae2503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f1fdeb0c1a485bb67dd16576655e7b, user_id=c8a8e2fe1c8a42b39af7c1c697f68852, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:40.784794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feb774-c92c-4302-8af3-57bef7ae2503 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:40.955714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3260/6493] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:40 2022] PUT /identity/v3/projects/a1f1fdeb0c1a485bb67dd16576655e7b/users/c8a8e2fe1c8a42b39af7c1c697f68852/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:40.966241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:40.966533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:40.966908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:41.000447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] MFA Rules not processed for user `c8a8e2fe1c8a42b39af7c1c697f68852`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:41.001808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:41.002453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a64aa804d7d4902bad1691fefcb7743'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:41.004183 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:41.021782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a64aa804d7d4902bad1691fefcb7743'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:41.023235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a64aa804d7d4902bad1691fefcb7743'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:41.140518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a64aa804d7d4902bad1691fefcb7743'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:41.141678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0357161f-1c4a-4e48-8119-bb010ac285e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a64aa804d7d4902bad1691fefcb7743'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:41.165480 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3261/6494] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:41.165901 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3234/6495] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:40 2022] DELETE /identity/v3/users/3a64aa804d7d4902bad1691fefcb7743 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:41.169882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:41.170453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:41.170732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:41.174505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:41.179629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:41.192008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:41.193445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:41.204979 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:41.254343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a74f9-8436-4336-b42e-df9b4efe9adb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:41.319790 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3235/6496] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:41.324809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:41.327472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:41.345553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:41.345553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:41.345962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:41.345962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:41.354539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:41.357371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:41.430937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7e25-d37d-43fb-b69e-b9ca7dce7e6d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:41.435635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:41.438560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:41.438560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:41.438560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:41.448244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:41.450939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:41.463963 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3236/6497] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:40:41.501295 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3262/6498] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:41 2022] POST /identity/v3/projects => generated 385 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:41.505635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:41.521594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838373b-42cf-4c16-b991-b7c621640b48 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:41.650972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:41.650972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:41.650972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:41.650972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:41.653145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:41.653145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:41.838107 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3237/6499] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:41 2022] POST /identity/v3/users => generated 299 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:41.842314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:41.859389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a430-40f1-467e-a6cd-539e4e630242 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:41.865491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:41.866147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:41.866515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:41.866800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:41.867871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:41.870084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:41.889245 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3263/6500] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:40:41.894728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:41.936222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682eab-08bc-4c8a-8f7d-8c421ac9c8a9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:41.950493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:41.951009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:41.951288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:41.951561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] PATH_INFO: `/v3/projects/8b38f28f67d44794ba60363181877c7a/users/3956a28cecaa4f86952d3026918ec4d2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:41.990483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b38f28f67d44794ba60363181877c7a, user_id=3956a28cecaa4f86952d3026918ec4d2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:42.002472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:42.150263 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3238/6501] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:41 2022] PUT /identity/v3/projects/8b38f28f67d44794ba60363181877c7a/users/3956a28cecaa4f86952d3026918ec4d2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:42.150947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:42.159902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069f88-d490-4f03-a286-f3dc37be86d5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:42.246176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:42.249179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:42.342628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:42.343241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:42.343579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:42.343923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:42.345799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:42.348275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:42.361143 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3264/6502] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:42.365684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:42.378084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e430-1644-4241-ba6f-4a32e92b0d17 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:42.384530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196573b-8d9a-496d-a8f5-218132f3ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:42.386081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196573b-8d9a-496d-a8f5-218132f3ef3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:42.386372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196573b-8d9a-496d-a8f5-218132f3ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:42.386644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196573b-8d9a-496d-a8f5-218132f3ef3f admin admin] PATH_INFO: `/v3/projects/8b38f28f67d44794ba60363181877c7a/users/3956a28cecaa4f86952d3026918ec4d2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:42.389716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196573b-8d9a-496d-a8f5-218132f3ef3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b38f28f67d44794ba60363181877c7a, user_id=3956a28cecaa4f86952d3026918ec4d2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:42.392515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196573b-8d9a-496d-a8f5-218132f3ef3f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:42.395638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a345be-8628-4f0f-bd6c-e72bb91b4068 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:42.401161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:42.402770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:42.403295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:42.403638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] PATH_INFO: `/v3/projects/0aaee4f9a8e84dddb66deb9e2c6a4016` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:42.405136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aaee4f9a8e84dddb66deb9e2c6a4016)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:42.407306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:42.427685 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3265/6503] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:42 2022] PUT /identity/v3/projects/8b38f28f67d44794ba60363181877c7a/users/3956a28cecaa4f86952d3026918ec4d2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:42.519933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:42.520311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:42.520541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:42.549145 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:42.560519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] MFA Rules not processed for user `3956a28cecaa4f86952d3026918ec4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:42.562049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:42.652221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aaee4f9a8e84dddb66deb9e2c6a4016', 'request_id': 'req-0480e025-4c65-4d57-96a3-3f646f6954e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:42.659287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aaee4f9a8e84dddb66deb9e2c6a4016', 'request_id': 'req-0480e025-4c65-4d57-96a3-3f646f6954e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:42.660463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3266/6504] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:42.672920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:42.674407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:42.773399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aaee4f9a8e84dddb66deb9e2c6a4016', 'request_id': 'req-0480e025-4c65-4d57-96a3-3f646f6954e7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:42.793556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec035-c969-4858-8b4b-7676f0cf9319 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:42.794422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] The token cache is being invalidate because project 0aaee4f9a8e84dddb66deb9e2c6a4016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:42.796671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:42.799630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:42.801523 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3239/6505] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:42 2022] DELETE /identity/v3/projects/0aaee4f9a8e84dddb66deb9e2c6a4016 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:42.805470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:42.806939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:42.815009 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:42.914118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e025-4c65-4d57-96a3-3f646f6954e7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:42.927275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:42.928137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:42.928768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:42.929126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:42.929248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:42.929403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:42.929931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:42.931563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:42.943567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] PATH_INFO: `/v3/users/f23351a2abd246a9aa9d8c9ec7780962` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:42.945623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23351a2abd246a9aa9d8c9ec7780962)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:42.949406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:43.030413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:43.031900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:43.052482 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3267/6506] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:40:43.198084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23351a2abd246a9aa9d8c9ec7780962'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.216669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23351a2abd246a9aa9d8c9ec7780962'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.217441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23351a2abd246a9aa9d8c9ec7780962'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.291759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:43.293179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:43.318306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33fac1-cf2e-42c9-b2fb-0c8ada25f643 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:43.323851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:43.325101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:43.325101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:43.326021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] PATH_INFO: `/v3/users/c8a8e2fe1c8a42b39af7c1c697f68852` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:43.328563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a8e2fe1c8a42b39af7c1c697f68852)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:43.340542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:43.361329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23351a2abd246a9aa9d8c9ec7780962'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.362633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b443296-16ec-46fc-885f-8ce5658913c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23351a2abd246a9aa9d8c9ec7780962'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.413112 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3240/6507] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:42 2022] DELETE /identity/v3/users/f23351a2abd246a9aa9d8c9ec7780962 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:43.476491 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:43.651529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a8e2fe1c8a42b39af7c1c697f68852'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.659456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a8e2fe1c8a42b39af7c1c697f68852'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.660179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a8e2fe1c8a42b39af7c1c697f68852'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.748560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a8e2fe1c8a42b39af7c1c697f68852'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.749992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a8e2fe1c8a42b39af7c1c697f68852'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:43.801292 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3268/6508] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:43 2022] DELETE /identity/v3/users/c8a8e2fe1c8a42b39af7c1c697f68852 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:43.802981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:43.803401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:43.803506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:43.841239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:43.843553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:43.974294 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3241/6509] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:43.986561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:43.988735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:44.003541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:44.006863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:44.020520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cd32b-235e-4937-ad19-dec7f3dbbd5b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:44.034837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:44.035395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:44.036039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:44.036596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] PATH_INFO: `/v3/projects/30473dda955c45beb68fa18cf88dcc90` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:44.040628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30473dda955c45beb68fa18cf88dcc90)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:44.054881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:44.099635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee8ac5-d704-4c10-b19f-2e0a41cc5b99 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:44.104436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f7daa-3eaa-4228-93e5-d7d26fb5df6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:44.105411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7daa-3eaa-4228-93e5-d7d26fb5df6d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:44.105896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7daa-3eaa-4228-93e5-d7d26fb5df6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:44.106494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7daa-3eaa-4228-93e5-d7d26fb5df6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:44.119626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f7daa-3eaa-4228-93e5-d7d26fb5df6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:44.121225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f7daa-3eaa-4228-93e5-d7d26fb5df6d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:44.133876 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3269/6510] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:44.238775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30473dda955c45beb68fa18cf88dcc90', 'request_id': 'req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:44.244844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30473dda955c45beb68fa18cf88dcc90', 'request_id': 'req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:44.360315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30473dda955c45beb68fa18cf88dcc90', 'request_id': 'req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:44.380056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] The token cache is being invalidate because project 30473dda955c45beb68fa18cf88dcc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:44.380349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:44.382393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ee00b2cb-f3e2-4f03-9ac1-be598abc06e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:44.390228 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3242/6511] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:44 2022] DELETE /identity/v3/projects/30473dda955c45beb68fa18cf88dcc90 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:44.395479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5dca7-a451-44d9-92bb-40060fc13845 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:44.395963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5dca7-a451-44d9-92bb-40060fc13845 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:44.396078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5dca7-a451-44d9-92bb-40060fc13845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:44.443028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c0b5dca7-a451-44d9-92bb-40060fc13845 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:44.446415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0b5dca7-a451-44d9-92bb-40060fc13845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:44.468683 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:44.601832 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3270/6512] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:44.614691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafda4d-a2c2-4ba6-ada9-29babce1dbe8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:44.614981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafda4d-a2c2-4ba6-ada9-29babce1dbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:44.615256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafda4d-a2c2-4ba6-ada9-29babce1dbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:44.664626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7cafda4d-a2c2-4ba6-ada9-29babce1dbe8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:44.671698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7cafda4d-a2c2-4ba6-ada9-29babce1dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:44.704156 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3243/6513] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:44.705424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5dca7-a451-44d9-92bb-40060fc13845 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:44.718989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5dca7-a451-44d9-92bb-40060fc13845 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:44.740752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:44.742178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:44.746424 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:44.749920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:44.749920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:44.749920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:44.750719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:44.754120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:44.785467 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3271/6514] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:44.791480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafda4d-a2c2-4ba6-ada9-29babce1dbe8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:44.806298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafda4d-a2c2-4ba6-ada9-29babce1dbe8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:44.834151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:44.834151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:44.834151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:44.834151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:44.834877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:44.834877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:44.948995 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3244/6515] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:44 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:44.953350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:44.966651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029649-663b-4f8b-99e2-94c6c93fb5f2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.057183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.057946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.058299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.063736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.064573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.067874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.158750 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3272/6516] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:44 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:45.163150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:45.174626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159dacc-9ff0-4366-ad03-574426426a03 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.179650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.180251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.180786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.181052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.181733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.183345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.194579 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3245/6517] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:45.198712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:45.208950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a8350-dc57-4f67-ba80-9950d277786e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.213641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.214330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.214635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.214918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.216124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.217747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.229495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3273/6518] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:45.234499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:45.248963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ef18f-d992-45a5-964b-d7e0e8bd5bfa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.251173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:45.254165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:45.260205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f947c-5d4e-4912-871b-bdc89a12c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.261303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f947c-5d4e-4912-871b-bdc89a12c120 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.261747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f947c-5d4e-4912-871b-bdc89a12c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.262260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f947c-5d4e-4912-871b-bdc89a12c120 admin admin] PATH_INFO: `/v3/projects/9435420b258945eaae003b0cd6aa6302/users/d466ec12e8e34525a0e4cb53e1301a89/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.277291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c590319-d924-45a7-b5c4-e5119f761a26 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.284965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.285768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.286120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.286466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] PATH_INFO: `/v3/projects/a1f1fdeb0c1a485bb67dd16576655e7b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.288583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f1fdeb0c1a485bb67dd16576655e7b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.290925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.304541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f947c-5d4e-4912-871b-bdc89a12c120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9435420b258945eaae003b0cd6aa6302, user_id=d466ec12e8e34525a0e4cb53e1301a89, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.308375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f947c-5d4e-4912-871b-bdc89a12c120 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.409284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3246/6519] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:45 2022] PUT /identity/v3/projects/9435420b258945eaae003b0cd6aa6302/users/d466ec12e8e34525a0e4cb53e1301a89/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:45.421030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948773-f419-4efc-a299-4ef9dec7ed74 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.421364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948773-f419-4efc-a299-4ef9dec7ed74 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.421596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948773-f419-4efc-a299-4ef9dec7ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.466917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f1fdeb0c1a485bb67dd16576655e7b', 'request_id': 'req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:45.480893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f7948773-f419-4efc-a299-4ef9dec7ed74 None None] MFA Rules not processed for user `d466ec12e8e34525a0e4cb53e1301a89`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:45.482769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f7948773-f419-4efc-a299-4ef9dec7ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:45.484988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f1fdeb0c1a485bb67dd16576655e7b', 'request_id': 'req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:45.555895 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3247/6520] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:45.560348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7948773-f419-4efc-a299-4ef9dec7ed74 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:45.572552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f1fdeb0c1a485bb67dd16576655e7b', 'request_id': 'req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:45.587415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] The token cache is being invalidate because project a1f1fdeb0c1a485bb67dd16576655e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:45.587817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:45.588548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:45.591122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3274/6521] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:45 2022] DELETE /identity/v3/projects/a1f1fdeb0c1a485bb67dd16576655e7b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:45.595036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:45.596460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:45.642923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7948773-f419-4efc-a299-4ef9dec7ed74 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.647928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.648545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.648826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.649253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.649845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.651932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.666940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5115413-4ea2-4c9b-a30f-62c0da5b56f5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.673018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.673790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.674115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.674388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] PATH_INFO: `/v3/users/3956a28cecaa4f86952d3026918ec4d2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.675556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3956a28cecaa4f86952d3026918ec4d2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.677530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.778599 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3248/6522] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:45 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:45.782547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:45.784309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:45.852226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad64c11-083a-400b-bee5-c778c6b79cb2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:45.861956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:45.862297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:45.862644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:45.862919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:45.863553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:45.865598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:45.892272 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:45.998498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3956a28cecaa4f86952d3026918ec4d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:46.000870 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3249/6523] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:45 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:46.003498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:46.008535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:46.012569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3956a28cecaa4f86952d3026918ec4d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:46.014659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3956a28cecaa4f86952d3026918ec4d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:46.090380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf9bae-02e4-4229-9fc6-d1488c465781 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:46.094830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:46.095598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.095951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.096288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.098289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:46.108751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3956a28cecaa4f86952d3026918ec4d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:46.109471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3956a28cecaa4f86952d3026918ec4d2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:46.130129 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3275/6524] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:45 2022] DELETE /identity/v3/users/3956a28cecaa4f86952d3026918ec4d2 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:46.131388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:46.132913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:46.207827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:46.209424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:46.225556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd19a41-4134-4c38-a558-748ac9ca7ac8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:46.233494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:46.234176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.234454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.234726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.235536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:46.237157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:46.250119 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3250/6525] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:40:46.252056 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3276/6526] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:46.257887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:46.274888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bcd4f-0b8c-48a6-9df5-e2e7e905009f service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:46.281186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:46.281869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.282176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.282444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] PATH_INFO: `/v3/projects/fc4f0d1ed74e496984c14a2978acdbd7/users/f4d7c906127d4bbc9c22a7309d47e5c1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.307740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4f0d1ed74e496984c14a2978acdbd7, user_id=f4d7c906127d4bbc9c22a7309d47e5c1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:46.313145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:46.318702 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:46.386158 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3251/6527] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:46 2022] PUT /identity/v3/projects/fc4f0d1ed74e496984c14a2978acdbd7/users/f4d7c906127d4bbc9c22a7309d47e5c1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:46.390261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:46.404664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777f304-27cc-4e35-a59b-4f24bdefc8e4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:46.483099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e9eba-d1b2-4e5a-ac1f-8fb48dffac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:46.483948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e9eba-d1b2-4e5a-ac1f-8fb48dffac50 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.484125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e9eba-d1b2-4e5a-ac1f-8fb48dffac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.484357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e9eba-d1b2-4e5a-ac1f-8fb48dffac50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.485251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e9eba-d1b2-4e5a-ac1f-8fb48dffac50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:46.487052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e9eba-d1b2-4e5a-ac1f-8fb48dffac50 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:46.520967 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3277/6528] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:46.525526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:46.538475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132521a-4f95-42a2-9307-bb11b0d86911 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:46.544811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:46.545862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.546305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.546782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] PATH_INFO: `/v3/projects/fc4f0d1ed74e496984c14a2978acdbd7/users/f4d7c906127d4bbc9c22a7309d47e5c1/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.549611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4f0d1ed74e496984c14a2978acdbd7, user_id=f4d7c906127d4bbc9c22a7309d47e5c1, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:46.552444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:46.573131 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3252/6529] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:46 2022] PUT /identity/v3/projects/fc4f0d1ed74e496984c14a2978acdbd7/users/f4d7c906127d4bbc9c22a7309d47e5c1/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:46.575622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f61a63-4ca0-4b02-96ac-e89092144144 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.575902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f61a63-4ca0-4b02-96ac-e89092144144 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.576077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f61a63-4ca0-4b02-96ac-e89092144144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.612354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b1f61a63-4ca0-4b02-96ac-e89092144144 None None] MFA Rules not processed for user `f4d7c906127d4bbc9c22a7309d47e5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:46.612354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b1f61a63-4ca0-4b02-96ac-e89092144144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:46.691882 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3278/6530] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:46.703802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:46.705920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:46.768727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80e3a-e570-49b7-a01e-665427e4bc13 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:46.772662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:46.773347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.773626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.773940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.786000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:46.787483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:46.798829 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3253/6531] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:46.872047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f61a63-4ca0-4b02-96ac-e89092144144 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:46.935985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f61a63-4ca0-4b02-96ac-e89092144144 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:46.941206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:46.942598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:46.942598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:46.942598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] PATH_INFO: `/v3/users/d466ec12e8e34525a0e4cb53e1301a89` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:46.943869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d466ec12e8e34525a0e4cb53e1301a89)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:46.945936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:47.117518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:47.119261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.128029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd466ec12e8e34525a0e4cb53e1301a89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.147594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05158bb-51d2-43a4-ab1b-52f80e1f3e0c service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:47.160804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd466ec12e8e34525a0e4cb53e1301a89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.161801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:47.162245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd466ec12e8e34525a0e4cb53e1301a89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.169673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.170468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.171585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] PATH_INFO: `/v3/projects/8b38f28f67d44794ba60363181877c7a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.175946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b38f28f67d44794ba60363181877c7a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:47.180949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:47.251880 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:47.252329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd466ec12e8e34525a0e4cb53e1301a89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.253930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cec7e8e-5f54-4978-9d50-a07669abd646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd466ec12e8e34525a0e4cb53e1301a89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.289080 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3279/6532] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:46 2022] DELETE /identity/v3/users/d466ec12e8e34525a0e4cb53e1301a89 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:47.290678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089016-f92a-41b8-afc8-80405e378209 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.291123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089016-f92a-41b8-afc8-80405e378209 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.291484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089016-f92a-41b8-afc8-80405e378209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.323287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-53089016-f92a-41b8-afc8-80405e378209 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:47.324595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-53089016-f92a-41b8-afc8-80405e378209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.343828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b38f28f67d44794ba60363181877c7a', 'request_id': 'req-f9c3332c-a689-4d97-9208-2e5b51361df1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.354054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b38f28f67d44794ba60363181877c7a', 'request_id': 'req-f9c3332c-a689-4d97-9208-2e5b51361df1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.428415 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3280/6533] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:47.432141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089016-f92a-41b8-afc8-80405e378209 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:47.435341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-53089016-f92a-41b8-afc8-80405e378209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.447850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b38f28f67d44794ba60363181877c7a', 'request_id': 'req-f9c3332c-a689-4d97-9208-2e5b51361df1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.478029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] The token cache is being invalidate because project 8b38f28f67d44794ba60363181877c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:47.478340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.479008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f9c3332c-a689-4d97-9208-2e5b51361df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:47.482508 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3254/6534] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:47 2022] DELETE /identity/v3/projects/8b38f28f67d44794ba60363181877c7a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:47.490250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddea22-60e7-4214-a724-69bcb4ab535d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.490545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddea22-60e7-4214-a724-69bcb4ab535d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.490847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddea22-60e7-4214-a724-69bcb4ab535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.532434 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:47.539334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1bddea22-60e7-4214-a724-69bcb4ab535d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:47.540564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1bddea22-60e7-4214-a724-69bcb4ab535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.541744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089016-f92a-41b8-afc8-80405e378209 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:47.564703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:47.565346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.565628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.565895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.570040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.576657 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3255/6535] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:47.585389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc702b-c017-41a5-b9d9-e5a9788f64ef None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.585674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc702b-c017-41a5-b9d9-e5a9788f64ef None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.585948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc702b-c017-41a5-b9d9-e5a9788f64ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.603810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:47.605741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:47.630271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-90bc702b-c017-41a5-b9d9-e5a9788f64ef None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:47.631428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90bc702b-c017-41a5-b9d9-e5a9788f64ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.632654 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3281/6536] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:47.645879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:47.650860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3256/6537] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:47.656892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2654-7a04-4c76-88d6-c273434921df service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:47.669047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:47.669678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.676430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.676430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.676430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:47.676430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:47.676430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:47.702121 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3282/6538] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:40:47.706645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc702b-c017-41a5-b9d9-e5a9788f64ef None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:47.722735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc702b-c017-41a5-b9d9-e5a9788f64ef None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:47.734851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:47.735541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.738652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.738652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.738652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:47.744030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:47.843904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:47.845857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.861281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24d4ae-6f49-4052-b899-68ddccc34f37 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:47.867164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:47.867878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:47.868254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:47.868616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:47.870754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:47.886803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:47.889372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:47.906108 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3283/6539] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:40:47.925015 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3257/6540] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:47 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:47.926520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:47.945030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed59e1-a2e3-4276-97ac-060607579fde service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.019526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.020513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.021679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.022295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.023177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:48.025359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:48.167207 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3284/6541] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:47 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:48.173526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:48.184007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916fe49-133e-4f58-bb8c-f45df8ba8126 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.210219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.212258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.214696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.215590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.220283 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:48.220894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:48.223475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:48.245286 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3258/6542] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:48.249735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:48.260616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b953-52fa-4470-ab4b-242104802516 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.266251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.266928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.267354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.267532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.268237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:48.269790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:48.283340 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3285/6543] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:48.287376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:48.297848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410e4c7-bc8a-4fb4-a901-9ad372d9f6cb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.303820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667cd6-aa8f-4b3e-a7b1-4fd8953976a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.304504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667cd6-aa8f-4b3e-a7b1-4fd8953976a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.304784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667cd6-aa8f-4b3e-a7b1-4fd8953976a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.305722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667cd6-aa8f-4b3e-a7b1-4fd8953976a6 admin admin] PATH_INFO: `/v3/projects/b50c9b3dd6a74c63aef43e14502e747e/users/f177ebc1a2e6468ba2b7bce8efd1e59d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.337433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c667cd6-aa8f-4b3e-a7b1-4fd8953976a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50c9b3dd6a74c63aef43e14502e747e, user_id=f177ebc1a2e6468ba2b7bce8efd1e59d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:48.340349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c667cd6-aa8f-4b3e-a7b1-4fd8953976a6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:48.385474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:48.390280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:48.423052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550e3f-75e8-4405-909e-f7434ab2c67a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.435636 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3259/6544] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:48 2022] PUT /identity/v3/projects/b50c9b3dd6a74c63aef43e14502e747e/users/f177ebc1a2e6468ba2b7bce8efd1e59d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:48.445873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3bb7-d6a4-43a0-b3c0-f51ecf228fff None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.446640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3bb7-d6a4-43a0-b3c0-f51ecf228fff None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.447177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3bb7-d6a4-43a0-b3c0-f51ecf228fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.516963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a1eb3bb7-d6a4-43a0-b3c0-f51ecf228fff None None] MFA Rules not processed for user `f177ebc1a2e6468ba2b7bce8efd1e59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:48.518400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a1eb3bb7-d6a4-43a0-b3c0-f51ecf228fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:48.580168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.582109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.582594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.583062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] PATH_INFO: `/v3/projects/9435420b258945eaae003b0cd6aa6302` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.584746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9435420b258945eaae003b0cd6aa6302)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:48.587758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:48.676666 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3260/6545] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:48.681430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb3bb7-d6a4-43a0-b3c0-f51ecf228fff None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:48.696685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb3bb7-d6a4-43a0-b3c0-f51ecf228fff None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.702978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.703244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.703477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.703757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.704732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:48.706375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:48.765823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9435420b258945eaae003b0cd6aa6302', 'request_id': 'req-0763aefd-0fe0-454e-8030-9e9f6491590f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:48.772009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9435420b258945eaae003b0cd6aa6302', 'request_id': 'req-0763aefd-0fe0-454e-8030-9e9f6491590f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:48.852145 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3261/6546] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:48 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:48.853165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:48.868850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9435420b258945eaae003b0cd6aa6302', 'request_id': 'req-0763aefd-0fe0-454e-8030-9e9f6491590f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:48.871909 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:48.888074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] The token cache is being invalidate because project 9435420b258945eaae003b0cd6aa6302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:48.889148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:48.890613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:48.892776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3286/6547] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:48 2022] DELETE /identity/v3/projects/9435420b258945eaae003b0cd6aa6302 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:48.896459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:48.898679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:48.948730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcaf6-ba48-48fe-ab11-2f1f4e4dd6ed admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.958984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.959751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.960092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.960432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:48.961484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:48.963835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:48.990649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763aefd-0fe0-454e-8030-9e9f6491590f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:48.996308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:48.997020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:48.997756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:48.998197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] PATH_INFO: `/v3/users/f4d7c906127d4bbc9c22a7309d47e5c1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:49.003137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d7c906127d4bbc9c22a7309d47e5c1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:49.003137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:49.074872 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3262/6548] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:48 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:49.078882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:49.080641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:49.112718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66fba-259d-4b85-bc2c-c45b95acddfd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:49.126630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:49.127483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:49.127819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:49.128177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:49.129066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:49.131132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:49.154217 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3263/6549] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:49.158520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:49.180290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77167a0-f941-4d9e-8bfa-a2d1d34712d3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:49.199060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:49.199600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:49.199887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:49.200161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] PATH_INFO: `/v3/projects/cb399645ca8844749487f0ea766aa095/users/0323174437f5404a9f5101b4aba46719/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:49.208124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d7c906127d4bbc9c22a7309d47e5c1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:49.219475 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:49.224487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d7c906127d4bbc9c22a7309d47e5c1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:49.225594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d7c906127d4bbc9c22a7309d47e5c1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:49.234861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb399645ca8844749487f0ea766aa095, user_id=0323174437f5404a9f5101b4aba46719, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:49.238363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:49.314256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d7c906127d4bbc9c22a7309d47e5c1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:49.315015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d7c906127d4bbc9c22a7309d47e5c1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:49.347129 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:49.356042 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3287/6550] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:48 2022] DELETE /identity/v3/users/f4d7c906127d4bbc9c22a7309d47e5c1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:49.359673 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3264/6551] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:49 2022] PUT /identity/v3/projects/cb399645ca8844749487f0ea766aa095/users/0323174437f5404a9f5101b4aba46719/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:49.363522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:49.365056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:49.462877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f0b1e-49a1-493a-9ed4-c5eeca76b9e2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:49.468307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b39788-f061-481e-a587-f8e7c9eaec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:49.472630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39788-f061-481e-a587-f8e7c9eaec37 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:49.472630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39788-f061-481e-a587-f8e7c9eaec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:49.472630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39788-f061-481e-a587-f8e7c9eaec37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:49.472630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b39788-f061-481e-a587-f8e7c9eaec37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:49.473107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b39788-f061-481e-a587-f8e7c9eaec37 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:49.486182 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3288/6552] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:40:49.488625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:49.602055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d35895-ede4-474c-8101-a04df71e58c1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:49.608960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:49.609811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:49.617923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:49.617923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] PATH_INFO: `/v3/projects/cb399645ca8844749487f0ea766aa095/users/0323174437f5404a9f5101b4aba46719/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:49.617923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb399645ca8844749487f0ea766aa095, user_id=0323174437f5404a9f5101b4aba46719, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:49.617923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:49.630120 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3265/6553] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:49 2022] PUT /identity/v3/projects/cb399645ca8844749487f0ea766aa095/users/0323174437f5404a9f5101b4aba46719/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:49.642356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:49.643275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:49.643707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:49.704412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] MFA Rules not processed for user `0323174437f5404a9f5101b4aba46719`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:49.707852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:49.897569 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3289/6554] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:49.909457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:49.912179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:50.034349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc15a-2079-4123-984b-dafbb5de1a61 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:50.050289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2caa1-0149-4fab-93b3-48be56c5d925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:50.055725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2caa1-0149-4fab-93b3-48be56c5d925 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:50.057067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:50.059470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:50.063362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2caa1-0149-4fab-93b3-48be56c5d925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:50.064054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2caa1-0149-4fab-93b3-48be56c5d925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:50.099997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2caa1-0149-4fab-93b3-48be56c5d925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:50.101362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2caa1-0149-4fab-93b3-48be56c5d925 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:50.126463 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3266/6555] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:50.199198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afe7f9-5dd1-4b61-9a77-cd8d28867204 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:50.217848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:50.218926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:50.219357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:50.219780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] PATH_INFO: `/v3/projects/fc4f0d1ed74e496984c14a2978acdbd7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:50.226942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4f0d1ed74e496984c14a2978acdbd7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:50.226942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:50.405922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4f0d1ed74e496984c14a2978acdbd7', 'request_id': 'req-ddc94da3-a510-4c5b-90ca-af33456b6d87'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:50.413939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4f0d1ed74e496984c14a2978acdbd7', 'request_id': 'req-ddc94da3-a510-4c5b-90ca-af33456b6d87'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:50.491331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4f0d1ed74e496984c14a2978acdbd7', 'request_id': 'req-ddc94da3-a510-4c5b-90ca-af33456b6d87'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:50.513024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] The token cache is being invalidate because project fc4f0d1ed74e496984c14a2978acdbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:50.513573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:50.514521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ddc94da3-a510-4c5b-90ca-af33456b6d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:50.516243 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3290/6556] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:50 2022] DELETE /identity/v3/projects/fc4f0d1ed74e496984c14a2978acdbd7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:50.521680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a428ec-27a9-4e45-8a47-a3b48cd95b1b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:50.522183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a428ec-27a9-4e45-8a47-a3b48cd95b1b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:50.522267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a428ec-27a9-4e45-8a47-a3b48cd95b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:50.552406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a6a428ec-27a9-4e45-8a47-a3b48cd95b1b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:50.555260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a6a428ec-27a9-4e45-8a47-a3b48cd95b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:50.745354 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3267/6557] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:50.747245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571e838-cbe7-4967-8963-252d648355af None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:50.747745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571e838-cbe7-4967-8963-252d648355af None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:50.747960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571e838-cbe7-4967-8963-252d648355af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:50.801433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6571e838-cbe7-4967-8963-252d648355af None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:50.803448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6571e838-cbe7-4967-8963-252d648355af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:50.815682 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:50.840741 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3291/6558] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:50.841901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a428ec-27a9-4e45-8a47-a3b48cd95b1b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:50.856842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a428ec-27a9-4e45-8a47-a3b48cd95b1b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:50.873798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:50.875233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:50.875650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:50.876107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:50.876980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:50.877510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:50.880725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:50.938002 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:50.960894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3268/6559] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:50.961026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571e838-cbe7-4967-8963-252d648355af None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:50.961026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571e838-cbe7-4967-8963-252d648355af None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:50.965848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:50.966765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:50.967188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:50.967911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:50.968714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:50.970941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:51.079208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:51.079541 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3292/6560] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:50 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:51.095274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8407784-fccb-4f0a-ac71-411ad8239d6a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:51.193048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:51.193733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:51.194038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:51.194400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:51.195415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:51.198436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:51.282968 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3269/6561] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:51 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:51.287122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:51.302102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375b57-18e3-441b-9c75-563eea05b17d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:51.318890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:51.318890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:51.318890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:51.318890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:51.319334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:51.320064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:51.349785 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3293/6562] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:51.351112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:51.370498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe68b8-30ff-4f76-9ecc-7e33028db302 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:51.387975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10021891-24ec-4343-bc01-ab04ef92529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:51.388616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10021891-24ec-4343-bc01-ab04ef92529d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:51.398676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10021891-24ec-4343-bc01-ab04ef92529d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:51.398676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10021891-24ec-4343-bc01-ab04ef92529d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:51.398676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10021891-24ec-4343-bc01-ab04ef92529d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:51.398676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10021891-24ec-4343-bc01-ab04ef92529d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:51.427011 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:51.442854 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3270/6563] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:51.446665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:51.459966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caf089-f220-4034-8ad8-698123311ec6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:51.465163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:51.465883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:51.466202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:51.466472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] PATH_INFO: `/v3/projects/103698b9916a4cd2b3644f2b64f11f4d/users/54a76ab67a094270bab778fc674461a4/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:51.489740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103698b9916a4cd2b3644f2b64f11f4d, user_id=54a76ab67a094270bab778fc674461a4, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:51.492644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:51.572055 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3294/6564] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:51 2022] PUT /identity/v3/projects/103698b9916a4cd2b3644f2b64f11f4d/users/54a76ab67a094270bab778fc674461a4/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:51.584351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:51.584805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:51.584919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:51.691544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] MFA Rules not processed for user `54a76ab67a094270bab778fc674461a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:51.701454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:51.811917 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:51.866034 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3271/6565] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:51.867936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:51.887525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:51.889574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:52.052488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a4391-7d13-4957-9502-f4f6355eda90 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.074770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.075007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.075256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.075522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.076157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:52.080231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:52.101922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609ef01-930a-464b-bf44-a2e00b73c23e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.118680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.119637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.120080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.120559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] PATH_INFO: `/v3/users/f177ebc1a2e6468ba2b7bce8efd1e59d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.122060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f177ebc1a2e6468ba2b7bce8efd1e59d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:52.126912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:52.196274 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3295/6566] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:51 2022] POST /identity/v3/projects => generated 393 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:52.199949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:52.347954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bee8e-edee-4c15-93f1-094210788276 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.361707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.362399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.362674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.362990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.365599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f177ebc1a2e6468ba2b7bce8efd1e59d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:52.372685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:52.374821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:52.376337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f177ebc1a2e6468ba2b7bce8efd1e59d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:52.377372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f177ebc1a2e6468ba2b7bce8efd1e59d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:52.457609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f177ebc1a2e6468ba2b7bce8efd1e59d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:52.458689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-99e79fda-3879-411e-8401-beffd65b2949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f177ebc1a2e6468ba2b7bce8efd1e59d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:52.477338 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3296/6567] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:52 2022] POST /identity/v3/users => generated 303 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:52.489647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:52.492767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:52.517624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1025-dad0-4588-af29-ee433335ce75 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.527665 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3272/6568] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:51 2022] DELETE /identity/v3/users/f177ebc1a2e6468ba2b7bce8efd1e59d => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:52.530068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.530690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.530973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.531246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.531895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:52.533655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:52.534508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.535787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.536309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.548237 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3297/6569] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:40:52.552063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:52.565202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bdee-fc18-4019-90f2-7d53677d6517 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.578413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:52.580118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:52.585118 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:52.647758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.649175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.649448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.649729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] PATH_INFO: `/v3/projects/8779dad2785044c19987e58c3961cce5/users/432456db61cd46a59136fdce0d7ef5f0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.679924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8779dad2785044c19987e58c3961cce5, user_id=432456db61cd46a59136fdce0d7ef5f0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:52.685665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:52.692600 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3273/6570] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:40:52.703181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:52.706175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:52.815661 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3298/6571] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:52 2022] PUT /identity/v3/projects/8779dad2785044c19987e58c3961cce5/users/432456db61cd46a59136fdce0d7ef5f0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:52.817115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:52.820213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4d3b8-6c09-4a1e-ac8e-ecd7cd083011 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.856625 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:52.884729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.885678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.886188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.886623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.903667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd441f-e8d9-4d83-b271-38a868d6cdb9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.908766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.909540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.909945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.910360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.911113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:52.913404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:52.928285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3299/6572] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:52.932295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:52.950538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e560-2830-4a51-b3b3-3cb4ca55d6b0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:52.961053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52102ca9-1a90-434e-851c-b034154e0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:52.962502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102ca9-1a90-434e-851c-b034154e0b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:52.962502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102ca9-1a90-434e-851c-b034154e0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:52.962925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102ca9-1a90-434e-851c-b034154e0b47 admin admin] PATH_INFO: `/v3/projects/8779dad2785044c19987e58c3961cce5/users/432456db61cd46a59136fdce0d7ef5f0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:52.970007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52102ca9-1a90-434e-851c-b034154e0b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8779dad2785044c19987e58c3961cce5, user_id=432456db61cd46a59136fdce0d7ef5f0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:52.970859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52102ca9-1a90-434e-851c-b034154e0b47 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:52.984904 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3300/6573] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:52 2022] PUT /identity/v3/projects/8779dad2785044c19987e58c3961cce5/users/432456db61cd46a59136fdce0d7ef5f0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:40:53.000176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:53.000176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:53.000176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:53.002258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:53.003836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:53.016751 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3274/6574] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:40:53.034317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] MFA Rules not processed for user `432456db61cd46a59136fdce0d7ef5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:53.035877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:53.171029 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3301/6575] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:53.186715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:53.188366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:53.311739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75c191-c673-4598-9b91-a3c0f6ce7b86 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:53.407458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:53.408083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:53.408360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:53.408632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:53.429221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:53.430732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:53.444375 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3275/6576] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:53.522824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:53.525590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:53.550726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14599e-0dd6-4fe3-a6cc-d5302458ae52 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:53.559475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:53.560454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:53.560988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:53.561546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:53.566893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:53.643334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:53.645115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:53.656071 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3302/6577] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:40:54.019917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:54.021420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:54.132923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd90bbb-6c30-4ceb-b9d9-686b96a216fd service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:54.138835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:54.139505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:54.139788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:54.140125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] PATH_INFO: `/v3/projects/b50c9b3dd6a74c63aef43e14502e747e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:54.141343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50c9b3dd6a74c63aef43e14502e747e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:54.144184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:54.299889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50c9b3dd6a74c63aef43e14502e747e', 'request_id': 'req-2bdac950-53e9-47ba-8137-c7928843bbe5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:54.306806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50c9b3dd6a74c63aef43e14502e747e', 'request_id': 'req-2bdac950-53e9-47ba-8137-c7928843bbe5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:54.405372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50c9b3dd6a74c63aef43e14502e747e', 'request_id': 'req-2bdac950-53e9-47ba-8137-c7928843bbe5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:54.408938 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:54.420882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] The token cache is being invalidate because project b50c9b3dd6a74c63aef43e14502e747e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:54.421277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:54.422007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:54.423565 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3276/6578] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:54 2022] DELETE /identity/v3/projects/b50c9b3dd6a74c63aef43e14502e747e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:54.427957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:54.464286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d103589-3bad-4676-9558-37a42682de46 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:54.613723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:54.613723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:54.614608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:54.614897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] PATH_INFO: `/v3/users/0323174437f5404a9f5101b4aba46719` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:54.618239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0323174437f5404a9f5101b4aba46719)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:54.620949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:55.018338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0323174437f5404a9f5101b4aba46719'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:55.028247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0323174437f5404a9f5101b4aba46719'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:55.029661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0323174437f5404a9f5101b4aba46719'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:55.103834 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:55.104552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0323174437f5404a9f5101b4aba46719'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:55.106245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f429dbf4-eb08-4000-aeeb-a0deb298a729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0323174437f5404a9f5101b4aba46719'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:55.155761 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3303/6579] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:40:54 2022] DELETE /identity/v3/users/0323174437f5404a9f5101b4aba46719 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:55.726353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:55.729225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:55.758369 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:55.776061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac950-53e9-47ba-8137-c7928843bbe5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:55.867438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:55.868272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:55.868633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:55.868983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] PATH_INFO: `/v3/projects/cb399645ca8844749487f0ea766aa095` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:55.870534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb399645ca8844749487f0ea766aa095)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:55.873352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:56.019208 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:56.051121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb399645ca8844749487f0ea766aa095', 'request_id': 'req-f3dc461d-2511-4d16-a24f-e4f3317552ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:56.063026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb399645ca8844749487f0ea766aa095', 'request_id': 'req-f3dc461d-2511-4d16-a24f-e4f3317552ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:56.148804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb399645ca8844749487f0ea766aa095', 'request_id': 'req-f3dc461d-2511-4d16-a24f-e4f3317552ef'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:56.169554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] The token cache is being invalidate because project cb399645ca8844749487f0ea766aa095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:40:56.172070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:56.172070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f3dc461d-2511-4d16-a24f-e4f3317552ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:40:56.177368 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3277/6580] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:40:55 2022] DELETE /identity/v3/projects/cb399645ca8844749487f0ea766aa095 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:56.180550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc6ab4-024a-4761-a6c5-793f9e02f780 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:56.180550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc6ab4-024a-4761-a6c5-793f9e02f780 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:56.180781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc6ab4-024a-4761-a6c5-793f9e02f780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:56.222861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-32dc6ab4-024a-4761-a6c5-793f9e02f780 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:56.224344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-32dc6ab4-024a-4761-a6c5-793f9e02f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:56.415431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3304/6581] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:56.425062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe2b4-34a2-4de3-9e02-8e3609c39017 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:56.425361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe2b4-34a2-4de3-9e02-8e3609c39017 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:56.425639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe2b4-34a2-4de3-9e02-8e3609c39017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:56.451560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cfbbe2b4-34a2-4de3-9e02-8e3609c39017 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:56.452178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cfbbe2b4-34a2-4de3-9e02-8e3609c39017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:56.466617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3278/6582] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:56.467089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc6ab4-024a-4761-a6c5-793f9e02f780 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:56.480265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc6ab4-024a-4761-a6c5-793f9e02f780 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:56.492625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:56.493327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:56.493678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:56.494067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:56.494801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:40:56.495181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:56.497456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:56.517123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe2b4-34a2-4de3-9e02-8e3609c39017 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:56.523095 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3305/6583] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:40:56.531852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe2b4-34a2-4de3-9e02-8e3609c39017 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:56.537230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:56.539870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:56.539870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:56.539870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:56.539870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:56.542506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:56.643353 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3279/6584] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:56 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:40:56.647904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:56.658217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf5daa-ea44-4a64-8d6c-752fab8a87f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:56.753074 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:56.783960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:56.784721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:56.785231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:56.785705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:56.786516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:56.789301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:56.934329 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3306/6585] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:56 2022] POST /identity/v3/users => generated 296 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:56.936110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:56.951609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b339-8bd9-4db7-a8af-e227a49a24c2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:56.956945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:56.957696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:56.958014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:56.958404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:56.959164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:56.961014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:56.976664 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3280/6586] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:56.977909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:56.991712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efda3e-8124-4bbf-9ff2-7c4acdfbfe59 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:56.999559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cdd2e-c75d-448f-8839-861e17772a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:57.002022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdd2e-c75d-448f-8839-861e17772a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:57.002022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdd2e-c75d-448f-8839-861e17772a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:57.002022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdd2e-c75d-448f-8839-861e17772a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:57.002022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cdd2e-c75d-448f-8839-861e17772a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:57.003781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cdd2e-c75d-448f-8839-861e17772a86 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:57.016582 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3307/6587] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:57.020777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:57.030919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d14b-5da1-439b-b7b3-cbf4991d7541 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:57.035522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:57.036244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:57.036591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:57.036931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] PATH_INFO: `/v3/projects/0c7f734a12da437e806e4c791d27d615/users/037ed342980a4de9a2dfc8d576293aba/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:57.052578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7f734a12da437e806e4c791d27d615, user_id=037ed342980a4de9a2dfc8d576293aba, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:57.059405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:57.186639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3281/6588] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:57 2022] PUT /identity/v3/projects/0c7f734a12da437e806e4c791d27d615/users/037ed342980a4de9a2dfc8d576293aba/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:57.200275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33aa1-4400-491d-b38f-f36bbcd9c2c0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:57.201195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33aa1-4400-491d-b38f-f36bbcd9c2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:57.201667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33aa1-4400-491d-b38f-f36bbcd9c2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:57.240215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cdb33aa1-4400-491d-b38f-f36bbcd9c2c0 None None] MFA Rules not processed for user `037ed342980a4de9a2dfc8d576293aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:57.241824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cdb33aa1-4400-491d-b38f-f36bbcd9c2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:57.360487 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3308/6589] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:57.367320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:57.414637 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:57.503184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b254e-b134-4521-beb0-def86d6f725e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:57.509033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:57.509659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:57.510257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:57.510257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:57.510850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:57.513324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:57.652595 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3282/6590] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:40:57 2022] POST /identity/v3/projects => generated 393 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:57.656572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb33aa1-4400-491d-b38f-f36bbcd9c2c0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:57.669087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb33aa1-4400-491d-b38f-f36bbcd9c2c0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:57.764898 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:40:57.795681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:57.796630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:57.796912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:57.797262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:57.804034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:57.804527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:57.917043 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3309/6591] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:40:57 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:40:57.920882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:57.942998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ab12b-7e5e-4f77-b10e-ad7240620d9a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:57.969438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:57.969438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:57.969438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:57.969438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:57.969800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:57.972603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:57.999695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3283/6592] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:40:58.003582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:58.021258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a440b0-b03e-4216-b03d-d52486d24065 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:58.037736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:58.038702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:58.039165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:58.039605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] PATH_INFO: `/v3/projects/e9a93c06024b4898ba981e02f9874d43/users/d72ce81cad3c4014b4071ed5660e0ec4/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:58.069089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a93c06024b4898ba981e02f9874d43, user_id=d72ce81cad3c4014b4071ed5660e0ec4, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:58.072579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:58.210463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3310/6593] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:58 2022] PUT /identity/v3/projects/e9a93c06024b4898ba981e02f9874d43/users/d72ce81cad3c4014b4071ed5660e0ec4/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:58.214397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:58.249118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa51bc2-2a6b-4a5d-8e6d-73aa1654f1ee admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:58.343674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337a8f7-d5b2-4d5a-aaa3-129ccbcee648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:58.346162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a8f7-d5b2-4d5a-aaa3-129ccbcee648 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:58.346162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a8f7-d5b2-4d5a-aaa3-129ccbcee648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:58.346162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a8f7-d5b2-4d5a-aaa3-129ccbcee648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:58.346162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a8f7-d5b2-4d5a-aaa3-129ccbcee648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:58.348698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a8f7-d5b2-4d5a-aaa3-129ccbcee648 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:58.382315 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3284/6594] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:40:58.385650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:58.413739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26dbd7-a53a-46f3-a25f-c25dd8741fa4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:58.418913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:58.420294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:58.420735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:58.421911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] PATH_INFO: `/v3/projects/e9a93c06024b4898ba981e02f9874d43/users/d72ce81cad3c4014b4071ed5660e0ec4/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:58.424206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a93c06024b4898ba981e02f9874d43, user_id=d72ce81cad3c4014b4071ed5660e0ec4, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:58.429560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:58.452582 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3311/6595] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:40:58 2022] PUT /identity/v3/projects/e9a93c06024b4898ba981e02f9874d43/users/d72ce81cad3c4014b4071ed5660e0ec4/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:40:58.463380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:58.463673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:58.463937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:58.515066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] MFA Rules not processed for user `d72ce81cad3c4014b4071ed5660e0ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:40:58.516760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:58.650303 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3285/6596] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:40:58.666046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:40:58.668331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:40:58.828901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fd82e-cd59-465b-be98-df66fb30abe9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:40:58.838481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa9c44-4c81-4a28-be50-df697b125c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:40:58.843225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9c44-4c81-4a28-be50-df697b125c68 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:40:58.843225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9c44-4c81-4a28-be50-df697b125c68 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:40:58.843225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9c44-4c81-4a28-be50-df697b125c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:40:58.915181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa9c44-4c81-4a28-be50-df697b125c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:40:58.917211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa9c44-4c81-4a28-be50-df697b125c68 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:40:58.959303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3312/6597] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:40:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:01.664079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:01.666789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:01.698701 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:01.747251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff91b37-f302-4171-998c-5f2285539284 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:01.752128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:01.759551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:01.759551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:01.759551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] PATH_INFO: `/v3/users/cbe17991b92f4b4ea6abcca17ddd2090` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:01.759551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe17991b92f4b4ea6abcca17ddd2090)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:01.759551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:02.012243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe17991b92f4b4ea6abcca17ddd2090'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:02.020236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe17991b92f4b4ea6abcca17ddd2090'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:02.021211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe17991b92f4b4ea6abcca17ddd2090'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:02.113766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe17991b92f4b4ea6abcca17ddd2090'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:02.114553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe17991b92f4b4ea6abcca17ddd2090'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:02.159400 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3286/6598] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:01 2022] DELETE /identity/v3/users/cbe17991b92f4b4ea6abcca17ddd2090 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:02.169185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:02.169185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:02.169185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:02.199603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:02.200673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:02.293824 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:02.373434 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3313/6599] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:02.411045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:02.413954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:02.532171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19489cc4-716f-43c0-9dab-2c59dbc72fdb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:02.538592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2aa9-9ddf-4471-8954-3e481959428d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:02.539485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2aa9-9ddf-4471-8954-3e481959428d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:02.540036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2aa9-9ddf-4471-8954-3e481959428d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:02.540692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2aa9-9ddf-4471-8954-3e481959428d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:02.554322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2aa9-9ddf-4471-8954-3e481959428d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:02.556513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2aa9-9ddf-4471-8954-3e481959428d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:02.609630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3287/6600] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:02.818295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:02.820634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:02.835170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223faa66-a8f0-4c91-8e52-3058f0e6a7c9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:02.850833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:02.851937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:02.855985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:02.855985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] PATH_INFO: `/v3/users/54a76ab67a094270bab778fc674461a4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:02.855985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a76ab67a094270bab778fc674461a4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:02.855985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:03.109010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a76ab67a094270bab778fc674461a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.120657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a76ab67a094270bab778fc674461a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.120657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a76ab67a094270bab778fc674461a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.193833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a76ab67a094270bab778fc674461a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.195265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a76ab67a094270bab778fc674461a4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.215819 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3314/6601] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:02 2022] DELETE /identity/v3/users/54a76ab67a094270bab778fc674461a4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:03.220196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:03.221077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:03.221527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:03.242823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:03.250237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:03.283158 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:03.324790 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3288/6602] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:03.335270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:03.336915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:03.396938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcdf29-8cbe-4d98-9845-055eeb1d4b3d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:03.401366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:03.402629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:03.402906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:03.403228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:03.413528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:03.415409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:03.430192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3315/6603] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:03.544343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:03.546150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:03.558996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782a517-efd0-454a-9e2a-b0f3161321e1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:03.564017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:03.564661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:03.564941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:03.565209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] PATH_INFO: `/v3/projects/4d1bdfc1bddf4e25b124b6388df72e22` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:03.566357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1bdfc1bddf4e25b124b6388df72e22)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:03.568255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:03.730664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1bdfc1bddf4e25b124b6388df72e22', 'request_id': 'req-13df812c-ed8b-4820-b376-e6e0b9d90be4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.748327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1bdfc1bddf4e25b124b6388df72e22', 'request_id': 'req-13df812c-ed8b-4820-b376-e6e0b9d90be4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.936343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1bdfc1bddf4e25b124b6388df72e22', 'request_id': 'req-13df812c-ed8b-4820-b376-e6e0b9d90be4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.954996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] The token cache is being invalidate because project 4d1bdfc1bddf4e25b124b6388df72e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:03.955592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.956651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:03.958284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3289/6604] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:03 2022] DELETE /identity/v3/projects/4d1bdfc1bddf4e25b124b6388df72e22 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:03.962305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:03.972155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb72-8cb2-44f2-964e-868db4b741fb service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:04.041793 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:04.052101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:04.052819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:04.053228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:04.059064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] PATH_INFO: `/v3/users/c169154d8f584b3290121f82a721a74a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:04.059064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c169154d8f584b3290121f82a721a74a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:04.059064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:04.117937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:04.119551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:04.133315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df812c-ed8b-4820-b376-e6e0b9d90be4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:04.138719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:04.139376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:04.139718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:04.139954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] PATH_INFO: `/v3/projects/103698b9916a4cd2b3644f2b64f11f4d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:04.141144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103698b9916a4cd2b3644f2b64f11f4d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:04.143101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:04.247223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c169154d8f584b3290121f82a721a74a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.255975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c169154d8f584b3290121f82a721a74a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.256879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c169154d8f584b3290121f82a721a74a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.276189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103698b9916a4cd2b3644f2b64f11f4d', 'request_id': 'req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.282801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103698b9916a4cd2b3644f2b64f11f4d', 'request_id': 'req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.353563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c169154d8f584b3290121f82a721a74a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.354771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c169154d8f584b3290121f82a721a74a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.379889 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3316/6605] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:03 2022] DELETE /identity/v3/users/c169154d8f584b3290121f82a721a74a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:04.405938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103698b9916a4cd2b3644f2b64f11f4d', 'request_id': 'req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.421520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] The token cache is being invalidate because project 103698b9916a4cd2b3644f2b64f11f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:04.421912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.422716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.424744 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3290/6606] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:04 2022] DELETE /identity/v3/projects/103698b9916a4cd2b3644f2b64f11f4d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:04.428961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:04.430631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:04.574016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0f52-37f4-46de-911b-d319243db5f8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:04.580223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:04.580223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:04.580223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:04.580223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] PATH_INFO: `/v3/users/432456db61cd46a59136fdce0d7ef5f0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:04.580642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432456db61cd46a59136fdce0d7ef5f0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:04.582526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:04.789762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432456db61cd46a59136fdce0d7ef5f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.798674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432456db61cd46a59136fdce0d7ef5f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.802537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432456db61cd46a59136fdce0d7ef5f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.884019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432456db61cd46a59136fdce0d7ef5f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.884019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432456db61cd46a59136fdce0d7ef5f0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:04.903882 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3317/6607] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:04 2022] DELETE /identity/v3/users/432456db61cd46a59136fdce0d7ef5f0 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:04.959237 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:05.321654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:05.323226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:05.404784 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:05.421792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb026e7b-fbf6-46df-b301-38f9d3e6c2e5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:05.496550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:05.497720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:05.498236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:05.498686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] PATH_INFO: `/v3/projects/c141ec4a8edf4d13a084945b7896635c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:05.505133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c141ec4a8edf4d13a084945b7896635c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:05.507930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:05.712530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:05.712530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:05.713560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c141ec4a8edf4d13a084945b7896635c', 'request_id': 'req-363fbf25-fade-4f67-9d39-0960a399ce5a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:05.714563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c141ec4a8edf4d13a084945b7896635c', 'request_id': 'req-363fbf25-fade-4f67-9d39-0960a399ce5a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:05.725377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814fb4-58d9-474e-9447-710661cb8641 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:05.781691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c141ec4a8edf4d13a084945b7896635c', 'request_id': 'req-363fbf25-fade-4f67-9d39-0960a399ce5a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:05.786956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:05.789919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:05.789919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:05.789919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] PATH_INFO: `/v3/users/869834fa3129457c9587731ec8a45cbb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:05.790339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=869834fa3129457c9587731ec8a45cbb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:05.792302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:05.798166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] The token cache is being invalidate because project c141ec4a8edf4d13a084945b7896635c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:05.798641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:05.799329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-363fbf25-fade-4f67-9d39-0960a399ce5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:05.801204 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3291/6608] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:05 2022] DELETE /identity/v3/projects/c141ec4a8edf4d13a084945b7896635c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:05.806947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624122b0-70cc-4d38-a8a2-05cb46f0726f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:05.807224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624122b0-70cc-4d38-a8a2-05cb46f0726f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:05.807546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624122b0-70cc-4d38-a8a2-05cb46f0726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:05.829358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-624122b0-70cc-4d38-a8a2-05cb46f0726f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:05.830443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-624122b0-70cc-4d38-a8a2-05cb46f0726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:05.838679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3292/6609] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:05.848318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65798-0641-4325-b399-ce67c69c3b49 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:05.848601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65798-0641-4325-b399-ce67c69c3b49 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:05.848877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65798-0641-4325-b399-ce67c69c3b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:05.871247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-62f65798-0641-4325-b399-ce67c69c3b49 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:05.876157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62f65798-0641-4325-b399-ce67c69c3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:05.883926 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3293/6610] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:05.884735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f65798-0641-4325-b399-ce67c69c3b49 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:05.893938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f65798-0641-4325-b399-ce67c69c3b49 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:05.899926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:05.901028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:05.901028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:05.901028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:05.901681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:05.902035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:05.903626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:05.915854 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3294/6611] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:41:05.921052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:05.931008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe65e33-dc05-4b0a-9901-65f0116324bc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:05.936434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:05.937042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:05.937666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:05.937666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:05.938214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:05.940097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.036685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869834fa3129457c9587731ec8a45cbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.044284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869834fa3129457c9587731ec8a45cbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.045230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869834fa3129457c9587731ec8a45cbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.090969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3295/6612] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:05 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:06.093245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.094956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.147310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869834fa3129457c9587731ec8a45cbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.148020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869834fa3129457c9587731ec8a45cbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.178486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3318/6613] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:05 2022] DELETE /identity/v3/users/869834fa3129457c9587731ec8a45cbb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:06.179609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.181478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.181639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d899f9-7e82-4cd4-8087-e6e40c35358f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.246403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.246974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.247251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.247525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] PATH_INFO: `/v3/projects/8779dad2785044c19987e58c3961cce5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.248870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8779dad2785044c19987e58c3961cce5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.251111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.281335 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:06.283576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8dee-7901-4e4f-997c-9216ad7ce426 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.288907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbc476-e8b0-424f-9b88-d9f85afa7389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.289593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbc476-e8b0-424f-9b88-d9f85afa7389 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.289911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbc476-e8b0-424f-9b88-d9f85afa7389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.290621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbc476-e8b0-424f-9b88-d9f85afa7389 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.291267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbc476-e8b0-424f-9b88-d9f85afa7389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.295616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbc476-e8b0-424f-9b88-d9f85afa7389 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.357783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8779dad2785044c19987e58c3961cce5', 'request_id': 'req-0b684382-c54c-4f87-b5ba-a82e86d25ce6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.362000 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:06.366413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8779dad2785044c19987e58c3961cce5', 'request_id': 'req-0b684382-c54c-4f87-b5ba-a82e86d25ce6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.375062 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3319/6614] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:06 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:06.378181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353649e-4fd2-4745-91f7-d82a2e67138e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.378713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353649e-4fd2-4745-91f7-d82a2e67138e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.379206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353649e-4fd2-4745-91f7-d82a2e67138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.402325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f353649e-4fd2-4745-91f7-d82a2e67138e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:06.403564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f353649e-4fd2-4745-91f7-d82a2e67138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.450231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8779dad2785044c19987e58c3961cce5', 'request_id': 'req-0b684382-c54c-4f87-b5ba-a82e86d25ce6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.477663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] The token cache is being invalidate because project 8779dad2785044c19987e58c3961cce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:06.481277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.482611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:06.484309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3296/6615] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:06 2022] DELETE /identity/v3/projects/8779dad2785044c19987e58c3961cce5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:06.485340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.488684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.503868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3320/6616] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:06.504887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.505169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.505437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.530574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:06.531206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.547814 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3321/6617] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:06.554980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.557092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.607367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b684382-c54c-4f87-b5ba-a82e86d25ce6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.623240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0617f-2388-4cf8-96b5-5c0e6fb41ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.623240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0617f-2388-4cf8-96b5-5c0e6fb41ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.623672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0617f-2388-4cf8-96b5-5c0e6fb41ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.624012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0617f-2388-4cf8-96b5-5c0e6fb41ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.626052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0617f-2388-4cf8-96b5-5c0e6fb41ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.628706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0617f-2388-4cf8-96b5-5c0e6fb41ee0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.633181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fe9d7-c2fd-4b5a-b7e9-16297e4f2ffa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.644317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.644951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.645227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.645496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.653343 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3297/6618] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:06.656084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873702-4c60-44ad-a941-028c614bc8d8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.663386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873702-4c60-44ad-a941-028c614bc8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.663386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe873702-4c60-44ad-a941-028c614bc8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.663599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.663599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.669551 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3322/6619] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:06.670757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.681177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e4c73-cfce-43f8-a4c9-c145fc3ff352 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.684128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fe873702-4c60-44ad-a941-028c614bc8d8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:06.685623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe873702-4c60-44ad-a941-028c614bc8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.687812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.688435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.688715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.689142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.689871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.691568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.697432 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3298/6620] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:06.703337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873702-4c60-44ad-a941-028c614bc8d8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.710923 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3323/6621] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:06.712898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.715555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe873702-4c60-44ad-a941-028c614bc8d8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.722784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.723469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.723756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.724030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.724690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:06.724838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606ebf-4332-478f-9e04-1245a89f29a2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.724991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.727039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.730625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5eb661-bd9b-4eb7-b266-93e62c1d6367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.731751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb661-bd9b-4eb7-b266-93e62c1d6367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.732032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb661-bd9b-4eb7-b266-93e62c1d6367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.734620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb661-bd9b-4eb7-b266-93e62c1d6367 admin admin] PATH_INFO: `/v3/projects/eee206344cdd47389ecb5421cd45d85d/users/9fde6c068f164c52924d55110721d1f8/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.746894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3299/6622] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:41:06.755713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.764254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f04b38-ac5b-426f-a979-0cfc2d1c4bab admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:06.770997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:06.771644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.772337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.772337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.772967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.775752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.790414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb661-bd9b-4eb7-b266-93e62c1d6367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee206344cdd47389ecb5421cd45d85d, user_id=9fde6c068f164c52924d55110721d1f8, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:06.790414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb661-bd9b-4eb7-b266-93e62c1d6367 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:06.900653 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3324/6623] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:06 2022] PUT /identity/v3/projects/eee206344cdd47389ecb5421cd45d85d/users/9fde6c068f164c52924d55110721d1f8/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:06.905552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:06.905552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:06.905552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:06.907415 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3300/6624] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:06 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:06.911473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:06.939495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] MFA Rules not processed for user `9fde6c068f164c52924d55110721d1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:06.940785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:06.988972 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:07.014719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575f13-8521-4ec8-bd5b-49ceaf643063 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.033399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.035011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.037727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.038309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.038473 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3325/6625] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:07.040403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.044036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.047323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.049466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:07.145851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b09d72-7030-4bb3-b018-7d79285485f4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.148467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.149334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.149785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.150471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.167388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.170107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.174049 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3301/6626] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:06 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:07.176524 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:07.178339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.196256 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3326/6627] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:41:07.199008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2a529-b8ba-4b36-b6f1-7ae0f19ca79a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.206896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.207685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.208128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.208648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.209422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.214863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.225959 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3302/6628] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:07.229778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.247873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0144c2-121f-4393-b268-ee966d5b419d service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.254338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.255129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.255584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.256002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.257572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.259673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.275349 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3327/6629] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:41:07.280165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.297383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e43f8-de70-41ec-8057-c8c2b1228c26 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.306610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57c56c-82ae-47cd-b674-98cf700f5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.308405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57c56c-82ae-47cd-b674-98cf700f5f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.308736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57c56c-82ae-47cd-b674-98cf700f5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.309021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57c56c-82ae-47cd-b674-98cf700f5f34 admin admin] PATH_INFO: `/v3/projects/0b764ed6647540f6801d5af290460e01/users/88e94f0a19564056a4ecd4c23c333a47/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.330870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57c56c-82ae-47cd-b674-98cf700f5f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b764ed6647540f6801d5af290460e01, user_id=88e94f0a19564056a4ecd4c23c333a47, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.333965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57c56c-82ae-47cd-b674-98cf700f5f34 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.400871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.404317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:07.425894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01ebe3-976d-405f-81f8-e1531a940e8e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.426719 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3303/6630] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:07 2022] PUT /identity/v3/projects/0b764ed6647540f6801d5af290460e01/users/88e94f0a19564056a4ecd4c23c333a47/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:07.441105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0473-d4a3-48b3-b27a-8b941559fa61 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.441612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0473-d4a3-48b3-b27a-8b941559fa61 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.442221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0473-d4a3-48b3-b27a-8b941559fa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.497724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-986b0473-d4a3-48b3-b27a-8b941559fa61 None None] MFA Rules not processed for user `88e94f0a19564056a4ecd4c23c333a47`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:07.499235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-986b0473-d4a3-48b3-b27a-8b941559fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:07.538621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.539682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.540158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.541257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] PATH_INFO: `/v3/projects/1ea9bbb2aac34b59914953bea6a73ec1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.542797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea9bbb2aac34b59914953bea6a73ec1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.546061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.622269 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3304/6631] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:07.626947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0473-d4a3-48b3-b27a-8b941559fa61 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.638290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0473-d4a3-48b3-b27a-8b941559fa61 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.644930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.645335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.645548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.646128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.646953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.648892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.696335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea9bbb2aac34b59914953bea6a73ec1', 'request_id': 'req-f3819d7b-d991-4c14-87bf-63e306c03734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:07.704864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea9bbb2aac34b59914953bea6a73ec1', 'request_id': 'req-f3819d7b-d991-4c14-87bf-63e306c03734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:07.787699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea9bbb2aac34b59914953bea6a73ec1', 'request_id': 'req-f3819d7b-d991-4c14-87bf-63e306c03734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:07.804516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] The token cache is being invalidate because project 1ea9bbb2aac34b59914953bea6a73ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:07.804808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:07.805467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:07.814257 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3305/6633] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:07 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:07.814450 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3328/6633] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:07 2022] DELETE /identity/v3/projects/1ea9bbb2aac34b59914953bea6a73ec1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:07.814541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.814541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:07.814732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:07.816023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:07.832898 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:07.873859 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:07.891259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef244eb-4243-4114-9e31-514624ec2a81 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.896225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:07.896858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:07.897282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:07.897717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:07.899727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:07.917255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819d7b-d991-4c14-87bf-63e306c03734 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:07.984585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:07.986113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:07.997952 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3306/6634] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:07.999171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:08.000975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:08.073042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:08.074720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.075872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.076321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] PATH_INFO: `/v3/users/dc9132bfa61c4f0ba0687e85cd7a695a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.078403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9132bfa61c4f0ba0687e85cd7a695a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:08.084557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:08.084711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7641c2a-9b5a-4073-834c-40f844decde4 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:08.088883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:08.090240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.090516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.090813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.091407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:08.093353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:08.213421 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3307/6635] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:07 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:08.218534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:08.237021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb9d07-0437-4d9c-b1a7-957d5180168f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:08.250472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:08.251114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.251393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.251666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.252323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:08.254081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:08.290750 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3308/6636] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:41:08.295128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:08.307490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1257fc-c773-4f0b-873a-777f38d1e539 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:08.313421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:08.314763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.315114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.315865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.316198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:08.318129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:08.332855 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3309/6637] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:41:08.336674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:08.358362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb1b2-6ef3-4614-8389-3dae401ce348 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:08.373705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd3d2d-34a4-4021-bf25-aff593a697dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:08.373705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3d2d-34a4-4021-bf25-aff593a697dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.373705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3d2d-34a4-4021-bf25-aff593a697dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.373705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3d2d-34a4-4021-bf25-aff593a697dc admin admin] PATH_INFO: `/v3/projects/8244e2fae21f4ce2a029eaedd1048826/users/1bd38a9824c64aaa8c94f7531d6fa640/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.385851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd3d2d-34a4-4021-bf25-aff593a697dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8244e2fae21f4ce2a029eaedd1048826, user_id=1bd38a9824c64aaa8c94f7531d6fa640, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:08.389069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd3d2d-34a4-4021-bf25-aff593a697dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:08.392237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9132bfa61c4f0ba0687e85cd7a695a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:08.397659 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:08.400785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9132bfa61c4f0ba0687e85cd7a695a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:08.402324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9132bfa61c4f0ba0687e85cd7a695a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:08.503633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9132bfa61c4f0ba0687e85cd7a695a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:08.504526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9132bfa61c4f0ba0687e85cd7a695a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:08.521591 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3310/6638] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:08 2022] PUT /identity/v3/projects/8244e2fae21f4ce2a029eaedd1048826/users/1bd38a9824c64aaa8c94f7531d6fa640/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:08.523516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f88e-4b8f-433b-9605-b16491b3d742 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.524004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f88e-4b8f-433b-9605-b16491b3d742 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.529604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f88e-4b8f-433b-9605-b16491b3d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.544557 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3329/6639] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:07 2022] DELETE /identity/v3/users/dc9132bfa61c4f0ba0687e85cd7a695a => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:08.557591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fa18f88e-4b8f-433b-9605-b16491b3d742 None None] MFA Rules not processed for user `1bd38a9824c64aaa8c94f7531d6fa640`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:08.559013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fa18f88e-4b8f-433b-9605-b16491b3d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:08.630233 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3311/6640] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:08.634402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:08.635923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:08.689293 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:08.734542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47093a13-e523-4f75-8f3b-fa15f808fb45 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:08.741879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:08.742544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.742820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.743091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.744382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:08.747200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:08.854688 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3330/6641] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:08 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:08.859318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f88e-4b8f-433b-9605-b16491b3d742 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:08.871247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f88e-4b8f-433b-9605-b16491b3d742 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:08.939882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:08.941863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:08.942181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:08.942459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:08.943133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:08.946195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:09.081096 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3312/6642] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:08 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:09.086191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:09.098919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfcc4c-3ece-4f78-b905-22d7f2af7f41 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:09.108731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:09.113745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:09.113745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:09.113745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:09.113745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:09.113745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:09.128969 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3331/6643] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:41:09.133027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:09.144132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07142f42-98ac-4170-a9cb-f3d00cb55fbc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:09.149561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:09.150378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:09.150752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:09.151142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] PATH_INFO: `/v3/projects/8e4146d3401844d880ec8721ff897d93/users/ab985bfe15ce47dc83dd7c297999d4d3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:09.203782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4146d3401844d880ec8721ff897d93, user_id=ab985bfe15ce47dc83dd7c297999d4d3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:09.203782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:09.280937 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3313/6644] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:09 2022] PUT /identity/v3/projects/8e4146d3401844d880ec8721ff897d93/users/ab985bfe15ce47dc83dd7c297999d4d3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:09.284599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:09.303501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b414e-df88-4094-97ba-c337143c9dce admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:09.367585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:09.369968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:09.504920 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:09.517545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:09.518199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:09.518688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:09.519207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:09.520398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:09.523261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:09.554756 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3332/6645] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:41:09.558413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:09.563922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15227e3-f4b8-4f1d-871b-b87aa03ef025 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:09.575658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:09.577017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:09.579653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:09.584592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] PATH_INFO: `/v3/projects/86cc1bbbf4aa4389a354da5f983ea290` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:09.585788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f567c9-e4be-43da-bb89-bdf1f51036b5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:09.587460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86cc1bbbf4aa4389a354da5f983ea290)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:09.591546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:09.598983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab792d03-9853-4c3f-9771-3cd2824a11cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:09.599756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792d03-9853-4c3f-9771-3cd2824a11cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:09.602143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792d03-9853-4c3f-9771-3cd2824a11cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:09.602459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792d03-9853-4c3f-9771-3cd2824a11cf admin admin] PATH_INFO: `/v3/projects/8e4146d3401844d880ec8721ff897d93/users/ab985bfe15ce47dc83dd7c297999d4d3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:09.611760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab792d03-9853-4c3f-9771-3cd2824a11cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4146d3401844d880ec8721ff897d93, user_id=ab985bfe15ce47dc83dd7c297999d4d3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:09.624654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab792d03-9853-4c3f-9771-3cd2824a11cf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:09.651352 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3333/6646] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:09 2022] PUT /identity/v3/projects/8e4146d3401844d880ec8721ff897d93/users/ab985bfe15ce47dc83dd7c297999d4d3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:09.779219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:09.779852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:09.780127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:09.810293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cc1bbbf4aa4389a354da5f983ea290', 'request_id': 'req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:09.819709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cc1bbbf4aa4389a354da5f983ea290', 'request_id': 'req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:09.836634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] MFA Rules not processed for user `ab985bfe15ce47dc83dd7c297999d4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:09.838178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:09.947697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cc1bbbf4aa4389a354da5f983ea290', 'request_id': 'req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:09.971754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] The token cache is being invalidate because project 86cc1bbbf4aa4389a354da5f983ea290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:09.972380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:09.973820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc5579b0-cf5f-456d-b4c4-92e6eafb9bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:09.978367 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3314/6647] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:09 2022] DELETE /identity/v3/projects/86cc1bbbf4aa4389a354da5f983ea290 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:09.987531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bda34-7b4d-4146-9a7f-b0fc7d552dae None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:09.988372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bda34-7b4d-4146-9a7f-b0fc7d552dae None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:09.989813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bda34-7b4d-4146-9a7f-b0fc7d552dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.005867 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3334/6648] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:10.013877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-682bda34-7b4d-4146-9a7f-b0fc7d552dae None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:10.015401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-682bda34-7b4d-4146-9a7f-b0fc7d552dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:10.019055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:10.021005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:10.082625 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:10.191688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62a9b3-d354-434c-84bd-19f54075c1f6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:10.196120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:10.197343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:10.197784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:10.199146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.209208 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3315/6649] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:10.210816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:10.212472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:10.218070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d52841-c191-405e-b056-ba45763febb0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:10.218444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d52841-c191-405e-b056-ba45763febb0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:10.219083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d52841-c191-405e-b056-ba45763febb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.226750 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3335/6650] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:10.273644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-18d52841-c191-405e-b056-ba45763febb0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:10.276344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-18d52841-c191-405e-b056-ba45763febb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:10.306153 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3316/6651] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:10.307027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:10.327169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72484a6-8fcf-4a21-8663-6645a179eb33 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:10.343214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:10.343844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:10.344124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:10.344396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.345053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:10.345361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:10.346998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:10.369794 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3336/6652] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:41:10.374927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d52841-c191-405e-b056-ba45763febb0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:10.386617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d52841-c191-405e-b056-ba45763febb0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:10.412079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:10.413162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:10.413354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:10.420687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.421538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:10.423421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:10.428295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:10.451280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220569a6-ab10-42d5-9792-8ecf39009a2c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:10.470489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:10.470489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:10.470489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:10.470489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.481464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:10.572191 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3317/6653] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:10 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:10.577099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:10.666642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:10.668156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:10.679400 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:10.697242 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3337/6654] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:41:10.724324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fe65d-37b8-4aaa-96b5-a573bd8a4833 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:10.737910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:10.738580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:10.738898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:10.739130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.739767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:10.741689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:10.938285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3318/6655] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:10 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:10.942322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:10.961381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe9b24-6778-4ab0-b54a-efcf2241011a service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:10.978903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:10.981602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:10.982018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:10.983195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:10.983981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:11.005235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:11.028369 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3338/6656] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:11.032221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:11.050322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd9223-e06a-4428-a958-1881d66ea461 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:11.075541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaea5c-5006-438d-aa5f-6fd5d8346ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:11.076546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaea5c-5006-438d-aa5f-6fd5d8346ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:11.076977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaea5c-5006-438d-aa5f-6fd5d8346ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:11.079651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaea5c-5006-438d-aa5f-6fd5d8346ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:11.081353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaea5c-5006-438d-aa5f-6fd5d8346ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:11.084934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaea5c-5006-438d-aa5f-6fd5d8346ea1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:11.110029 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3319/6657] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:11.114005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:11.127723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db06fe-f0fe-4bf7-b23f-72da60293d3a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:11.144591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:11.145479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:11.145825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:11.146143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] PATH_INFO: `/v3/projects/d2ceb9d33fbf4f77983aef93cde5556c/users/160fbc817e8c40388a7d9a238ee88282/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:11.187636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ceb9d33fbf4f77983aef93cde5556c, user_id=160fbc817e8c40388a7d9a238ee88282, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:11.191149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:11.279056 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3339/6658] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:11 2022] PUT /identity/v3/projects/d2ceb9d33fbf4f77983aef93cde5556c/users/160fbc817e8c40388a7d9a238ee88282/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:11.284511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2875-dc25-48b0-83df-a08771371de5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:11.284511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2875-dc25-48b0-83df-a08771371de5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:11.284511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2875-dc25-48b0-83df-a08771371de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:11.325841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6f8b2875-dc25-48b0-83df-a08771371de5 None None] MFA Rules not processed for user `160fbc817e8c40388a7d9a238ee88282`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:11.327100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6f8b2875-dc25-48b0-83df-a08771371de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:11.459587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3320/6659] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:11.471035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:11.474562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:11.576176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491225-b567-495d-a7bf-84ac1e949434 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:11.581994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7285a86-beef-4d61-8e2e-d7b197af3796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:11.582635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285a86-beef-4d61-8e2e-d7b197af3796 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:11.583012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285a86-beef-4d61-8e2e-d7b197af3796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:11.583288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285a86-beef-4d61-8e2e-d7b197af3796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:11.599816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7285a86-beef-4d61-8e2e-d7b197af3796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:11.601884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7285a86-beef-4d61-8e2e-d7b197af3796 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:11.613789 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3340/6660] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:11.632138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2875-dc25-48b0-83df-a08771371de5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:11.744682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2875-dc25-48b0-83df-a08771371de5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:11.753348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:11.753929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:11.754240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:11.754513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] PATH_INFO: `/v3/users/160fbc817e8c40388a7d9a238ee88282` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:11.755956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] RBAC: Authorizing `identity:delete_user(user_id=160fbc817e8c40388a7d9a238ee88282)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:11.758381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:12.043281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160fbc817e8c40388a7d9a238ee88282'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:12.049742 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:12.053233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160fbc817e8c40388a7d9a238ee88282'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:12.054633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160fbc817e8c40388a7d9a238ee88282'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:12.141668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160fbc817e8c40388a7d9a238ee88282'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:12.142390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160fbc817e8c40388a7d9a238ee88282'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:12.171476 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3321/6661] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:11 2022] DELETE /identity/v3/users/160fbc817e8c40388a7d9a238ee88282 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:12.172411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:12.172863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:12.172974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:12.203327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:12.204766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:12.217011 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:12.284961 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3341/6662] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:12.295933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:12.298575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:12.382600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a1099-ea4e-4640-9711-bcb80a8e06be admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:12.393393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2aa57-fe8f-49e8-96f6-eca64f041b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:12.394091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aa57-fe8f-49e8-96f6-eca64f041b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:12.394377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aa57-fe8f-49e8-96f6-eca64f041b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:12.396072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2aa57-fe8f-49e8-96f6-eca64f041b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:12.413598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2aa57-fe8f-49e8-96f6-eca64f041b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:12.421415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2aa57-fe8f-49e8-96f6-eca64f041b91 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:12.450954 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3322/6663] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:13.368497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:13.381137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:13.421136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230383-3a1f-47c5-bd64-886993e18867 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:13.437043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:13.438390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:13.438846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:13.439385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] PATH_INFO: `/v3/projects/d2ceb9d33fbf4f77983aef93cde5556c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:13.440968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ceb9d33fbf4f77983aef93cde5556c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:13.448905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:13.621550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ceb9d33fbf4f77983aef93cde5556c', 'request_id': 'req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:13.628511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ceb9d33fbf4f77983aef93cde5556c', 'request_id': 'req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:13.726329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ceb9d33fbf4f77983aef93cde5556c', 'request_id': 'req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:13.748173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] The token cache is being invalidate because project d2ceb9d33fbf4f77983aef93cde5556c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:13.748953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:13.749859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9ef72d81-ca86-4a9a-ba3c-cf3a224a65f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:13.755363 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3342/6664] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:13 2022] DELETE /identity/v3/projects/d2ceb9d33fbf4f77983aef93cde5556c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:13.763403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996437a-efe3-47f3-aea7-c45d57536d18 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:13.763403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996437a-efe3-47f3-aea7-c45d57536d18 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:13.764293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996437a-efe3-47f3-aea7-c45d57536d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:13.794376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7996437a-efe3-47f3-aea7-c45d57536d18 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:13.794376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7996437a-efe3-47f3-aea7-c45d57536d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:13.889400 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3323/6665] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:13.898713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c2ba-c3c6-4c36-bb2d-8ecf45a55a63 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:13.899035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c2ba-c3c6-4c36-bb2d-8ecf45a55a63 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:13.899312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753c2ba-c3c6-4c36-bb2d-8ecf45a55a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:13.935706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f753c2ba-c3c6-4c36-bb2d-8ecf45a55a63 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:13.941094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f753c2ba-c3c6-4c36-bb2d-8ecf45a55a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:13.949158 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3343/6666] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:13.954106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996437a-efe3-47f3-aea7-c45d57536d18 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:13.965769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996437a-efe3-47f3-aea7-c45d57536d18 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:13.970991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:13.971463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:13.971739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:13.972008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:13.972665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:13.973012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:13.974649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:13.994557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c2ba-c3c6-4c36-bb2d-8ecf45a55a63 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:13.995594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3324/6667] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:41:14.009445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753c2ba-c3c6-4c36-bb2d-8ecf45a55a63 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:14.017531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5c98e-a886-4a8f-9b73-a72834f44a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:14.019759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c98e-a886-4a8f-9b73-a72834f44a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:14.019759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c98e-a886-4a8f-9b73-a72834f44a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:14.019759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c98e-a886-4a8f-9b73-a72834f44a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:14.019759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5c98e-a886-4a8f-9b73-a72834f44a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:14.023878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5c98e-a886-4a8f-9b73-a72834f44a9a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:14.130300 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3344/6668] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:13 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:14.137195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:14.154812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a15c4-bad9-49de-9347-58680b92dcbd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:14.251500 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:14.262387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:14.264234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:14.267737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:14.270115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:14.271470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:14.278683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:14.355623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382796-664e-499d-b4a4-da55e7d44a6b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:14.355904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382796-664e-499d-b4a4-da55e7d44a6b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:14.356175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382796-664e-499d-b4a4-da55e7d44a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:14.392101 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3325/6669] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:14 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:14.394006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:14.429874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f612-aa5d-4d47-b471-7012e0aa48da admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:14.435188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fd382796-664e-499d-b4a4-da55e7d44a6b None None] MFA Rules not processed for user `037ed342980a4de9a2dfc8d576293aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:14.439527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd382796-664e-499d-b4a4-da55e7d44a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:14.456473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:14.456473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:14.456473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:14.456473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:14.457399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:14.457399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:14.478452 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3326/6670] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:14.486579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:14.501570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc256-0374-465a-9fa5-9114d3c2dbe7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:14.509408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:14.510502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:14.511005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:14.511572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:14.513782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:14.516318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:14.536703 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3327/6671] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:14.543392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:14.561430 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3345/6672] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:14.577478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b99cb-b128-428f-a03c-e2de095fc84f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:14.589728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:14.590511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:14.595555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:14.596285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] PATH_INFO: `/v3/projects/9f3df7d7b5814bdd82e83b75390a7483/users/1a67c11937844d7ba842ca6b5ac30130/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:14.631363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3df7d7b5814bdd82e83b75390a7483, user_id=1a67c11937844d7ba842ca6b5ac30130, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:14.635383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:14.705883 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3328/6673] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:14 2022] PUT /identity/v3/projects/9f3df7d7b5814bdd82e83b75390a7483/users/1a67c11937844d7ba842ca6b5ac30130/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:14.717216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:14.717554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:14.717831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:14.779529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] MFA Rules not processed for user `1a67c11937844d7ba842ca6b5ac30130`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:14.781011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:14.791107 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:14.953835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3346/6674] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:14.965404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:14.967374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:15.103914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd050a-843d-4f28-b9bf-7c7f78151619 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:15.113590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:15.114690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:15.115183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:15.115703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:15.135086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:15.141173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:15.162298 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3329/6675] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:41:16.249321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:16.249321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:16.427803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742d46b-094a-48e9-8147-69f65b23bc90 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:16.447702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d6eed-4e82-40e2-9488-0cdb53e500f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:16.448391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6eed-4e82-40e2-9488-0cdb53e500f9 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:16.448674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6eed-4e82-40e2-9488-0cdb53e500f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:16.448945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d6eed-4e82-40e2-9488-0cdb53e500f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:16.450964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-188d6eed-4e82-40e2-9488-0cdb53e500f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:16.480248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6eed-4e82-40e2-9488-0cdb53e500f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:16.481873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d6eed-4e82-40e2-9488-0cdb53e500f9 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:16.508197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3347/6676] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:19.134457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:19.135954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:19.268988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e236-bd70-4152-88ef-8633d4c78e12 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:19.281046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:19.282962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:19.283464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:19.284241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] PATH_INFO: `/v3/users/88e94f0a19564056a4ecd4c23c333a47` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:19.286079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e94f0a19564056a4ecd4c23c333a47)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:19.289887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:19.532475 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:19.542771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e94f0a19564056a4ecd4c23c333a47'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:19.561942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e94f0a19564056a4ecd4c23c333a47'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:19.563484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e94f0a19564056a4ecd4c23c333a47'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:19.644172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e94f0a19564056a4ecd4c23c333a47'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:19.645085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e94f0a19564056a4ecd4c23c333a47'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:19.689472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3330/6677] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:19 2022] DELETE /identity/v3/users/88e94f0a19564056a4ecd4c23c333a47 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:19.693859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:19.694746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:19.695175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:19.755295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:19.759788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:19.907954 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3348/6678] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:19.924415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:19.926081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:20.060624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceede3-23db-4cb7-8ef3-76967fe18d97 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:20.072125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:20.074662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:20.076143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:20.076261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:20.101376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:20.102898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:20.127168 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3331/6679] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:21.388371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:21.389853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:21.422699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:21.436148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cee44a-dae4-4b78-87a5-a056e9083d8b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:21.444204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:21.445219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:21.445740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:21.446280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] PATH_INFO: `/v3/projects/0b764ed6647540f6801d5af290460e01` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:21.447815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b764ed6647540f6801d5af290460e01)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:21.453271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ecf8-1231-4e0e-9175-7215e4c417cd service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:21.455625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:21.460799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:21.461425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:21.461745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:21.466329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:21.466329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:21.524165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:21.532288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:21.549697 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3332/6680] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:41:21.582430 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:21.657174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b764ed6647540f6801d5af290460e01', 'request_id': 'req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:21.684639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b764ed6647540f6801d5af290460e01', 'request_id': 'req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:21.748145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b764ed6647540f6801d5af290460e01', 'request_id': 'req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:21.768675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] The token cache is being invalidate because project 0b764ed6647540f6801d5af290460e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:21.769208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:21.770609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:21.775479 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3349/6681] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:21 2022] DELETE /identity/v3/projects/0b764ed6647540f6801d5af290460e01 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:21.780171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:21.803083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3dc31-8c18-45bc-b289-c2cb2a525792 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:21.951405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:21.952000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:21.952288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:21.952565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] PATH_INFO: `/v3/users/1bd38a9824c64aaa8c94f7531d6fa640` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:21.958885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd38a9824c64aaa8c94f7531d6fa640)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:21.962134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:22.201935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd38a9824c64aaa8c94f7531d6fa640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:22.217717 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:22.220504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd38a9824c64aaa8c94f7531d6fa640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:22.221949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd38a9824c64aaa8c94f7531d6fa640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:22.303389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd38a9824c64aaa8c94f7531d6fa640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:22.303389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd38a9824c64aaa8c94f7531d6fa640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:22.341543 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3333/6682] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:21 2022] DELETE /identity/v3/users/1bd38a9824c64aaa8c94f7531d6fa640 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:23.711162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:23.712688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:23.746960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774a824-2d4e-43a8-9df9-ed6cd02af2a2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:23.935818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:23.936232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:23.936511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:23.936830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] PATH_INFO: `/v3/projects/8244e2fae21f4ce2a029eaedd1048826` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:23.940656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8244e2fae21f4ce2a029eaedd1048826)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:23.943706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:24.127997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8244e2fae21f4ce2a029eaedd1048826', 'request_id': 'req-6c3471c6-b864-4888-88e6-7393cd6054b2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:24.141552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8244e2fae21f4ce2a029eaedd1048826', 'request_id': 'req-6c3471c6-b864-4888-88e6-7393cd6054b2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:24.204281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8244e2fae21f4ce2a029eaedd1048826', 'request_id': 'req-6c3471c6-b864-4888-88e6-7393cd6054b2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:24.233813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] The token cache is being invalidate because project 8244e2fae21f4ce2a029eaedd1048826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:24.234336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:24.236311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:24.241512 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3350/6683] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:23 2022] DELETE /identity/v3/projects/8244e2fae21f4ce2a029eaedd1048826 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:24.245348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:24.247694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:24.270162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74943f5-8d7a-4f81-afb4-e7b2bfd56fa3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:24.409367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:24.409367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:24.409633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:24.410049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] PATH_INFO: `/v3/users/ab985bfe15ce47dc83dd7c297999d4d3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:24.418634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab985bfe15ce47dc83dd7c297999d4d3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:24.421320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:24.882963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab985bfe15ce47dc83dd7c297999d4d3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:24.897921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab985bfe15ce47dc83dd7c297999d4d3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:24.901616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab985bfe15ce47dc83dd7c297999d4d3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:25.215869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab985bfe15ce47dc83dd7c297999d4d3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:25.225607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c940a93-9840-44e7-9c60-6e069f26d0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab985bfe15ce47dc83dd7c297999d4d3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:25.269114 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3334/6684] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:24 2022] DELETE /identity/v3/users/ab985bfe15ce47dc83dd7c297999d4d3 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:26.240170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:26.242512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:26.265150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3471c6-b864-4888-88e6-7393cd6054b2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:26.354702 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:26.371113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:26.372128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:26.372575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:26.373147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] PATH_INFO: `/v3/projects/8e4146d3401844d880ec8721ff897d93` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:26.374702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4146d3401844d880ec8721ff897d93)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:26.377409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:26.516565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4146d3401844d880ec8721ff897d93', 'request_id': 'req-c9d5b077-446a-4143-8fc2-98a27175100a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:26.525030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4146d3401844d880ec8721ff897d93', 'request_id': 'req-c9d5b077-446a-4143-8fc2-98a27175100a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:26.587394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4146d3401844d880ec8721ff897d93', 'request_id': 'req-c9d5b077-446a-4143-8fc2-98a27175100a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:26.613177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] The token cache is being invalidate because project 8e4146d3401844d880ec8721ff897d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:26.614466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:26.624139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c9d5b077-446a-4143-8fc2-98a27175100a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:26.628415 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3351/6685] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:26 2022] DELETE /identity/v3/projects/8e4146d3401844d880ec8721ff897d93 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:26.634699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18cf45-890c-42e9-b130-48d4b19c54bc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:26.636415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18cf45-890c-42e9-b130-48d4b19c54bc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:26.636718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18cf45-890c-42e9-b130-48d4b19c54bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:26.660081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2f18cf45-890c-42e9-b130-48d4b19c54bc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:26.663276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f18cf45-890c-42e9-b130-48d4b19c54bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:26.728575 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:26.748941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3335/6686] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:26.758401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23d84c-21da-4455-b23a-515501f64484 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:26.758792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23d84c-21da-4455-b23a-515501f64484 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:26.763649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23d84c-21da-4455-b23a-515501f64484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:26.784431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-eb23d84c-21da-4455-b23a-515501f64484 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:26.786375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eb23d84c-21da-4455-b23a-515501f64484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:26.796651 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3352/6687] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:26.806261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18cf45-890c-42e9-b130-48d4b19c54bc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:26.823277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18cf45-890c-42e9-b130-48d4b19c54bc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:26.834691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:26.835337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:26.835615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:26.835889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:26.836551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:26.838479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:26.841826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:26.872771 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3336/6688] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:41:26.876951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23d84c-21da-4455-b23a-515501f64484 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:26.888098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23d84c-21da-4455-b23a-515501f64484 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:26.902988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:26.903609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:26.904308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:26.904434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:26.905063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:26.907394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:27.035505 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3353/6689] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:26 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:27.036846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:27.063429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed31ffd-9800-444c-b96c-89eb71cdac19 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:27.176034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:27.176554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:27.177088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:27.177495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:27.179298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:27.181046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:27.283036 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3337/6690] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:27 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:27.284110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:27.298362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae454b-b459-4ca8-9b2e-e325c88b72f4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:27.303387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:27.304009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:27.304290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:27.304587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:27.305256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:27.306971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:27.318669 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3354/6691] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:27.322691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:27.336084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050b9e6-3fbf-4d6a-b4fe-9f3f1b6843d3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:27.347622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe817b-ed9d-41b9-a49a-366693f2b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:27.347622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe817b-ed9d-41b9-a49a-366693f2b7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:27.347622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe817b-ed9d-41b9-a49a-366693f2b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:27.347622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe817b-ed9d-41b9-a49a-366693f2b7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:27.348680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe817b-ed9d-41b9-a49a-366693f2b7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:27.348680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe817b-ed9d-41b9-a49a-366693f2b7e5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:27.381755 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3338/6692] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:27.387464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:27.405098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc771-914c-4acf-8f1e-c58347cd4ab2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:27.407766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:27.408658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:27.409044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:27.409456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] PATH_INFO: `/v3/projects/26c5e08c6e524aa381e028f910ba63fc/users/d2c2d14de3694c4c976121f601614270/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:27.438647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c5e08c6e524aa381e028f910ba63fc, user_id=d2c2d14de3694c4c976121f601614270, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:27.442552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:27.549377 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3355/6693] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:27 2022] PUT /identity/v3/projects/26c5e08c6e524aa381e028f910ba63fc/users/d2c2d14de3694c4c976121f601614270/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:27.562928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9131bbf-de09-4abe-8a22-0dd3c807fc50 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:27.563206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9131bbf-de09-4abe-8a22-0dd3c807fc50 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:27.563480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9131bbf-de09-4abe-8a22-0dd3c807fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:27.599591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a9131bbf-de09-4abe-8a22-0dd3c807fc50 None None] MFA Rules not processed for user `d2c2d14de3694c4c976121f601614270`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:27.600919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a9131bbf-de09-4abe-8a22-0dd3c807fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:27.675385 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3339/6694] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:27.680067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:27.758285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219c37-4000-4750-b4e2-267ee5f1fd82 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:27.765405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:27.766050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:27.766411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:27.766684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:27.767354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:27.769314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:27.904741 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:27.916065 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3356/6695] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:27 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:27.921769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9131bbf-de09-4abe-8a22-0dd3c807fc50 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:27.942671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9131bbf-de09-4abe-8a22-0dd3c807fc50 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:28.075682 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:28.111039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:28.111801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:28.112243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:28.112769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:28.113911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:28.119862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:28.200448 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3340/6696] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:27 2022] POST /identity/v3/users => generated 298 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:28.204447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:28.224544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21261a2-a75b-46f2-a768-837eb105cd5b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:28.241010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:28.241718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:28.242019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:28.242341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:28.242999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:28.244703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:28.256257 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3357/6697] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:41:28.260690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:28.276674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022d06-9a38-4f2b-ac6b-7a79ba4a258b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:28.282712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:28.283713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:28.284227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:28.284713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] PATH_INFO: `/v3/projects/c11aaf5795364b599dff27b44b491e56/users/a54961ca03c1416f8dd1dea1e1531be2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:28.303095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11aaf5795364b599dff27b44b491e56, user_id=a54961ca03c1416f8dd1dea1e1531be2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:28.309815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:28.410375 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3341/6698] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:28 2022] PUT /identity/v3/projects/c11aaf5795364b599dff27b44b491e56/users/a54961ca03c1416f8dd1dea1e1531be2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:28.412173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:28.442901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557c1d-d6bd-4aff-bef5-867a45b29b94 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:28.611108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da34c39-4021-4dc0-873e-a94152e6dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:28.612060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34c39-4021-4dc0-873e-a94152e6dc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:28.612559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34c39-4021-4dc0-873e-a94152e6dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:28.613035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34c39-4021-4dc0-873e-a94152e6dc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:28.613901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da34c39-4021-4dc0-873e-a94152e6dc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:28.617858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da34c39-4021-4dc0-873e-a94152e6dc50 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:28.638539 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3358/6699] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:28.639906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:28.657522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb20e6-ea9c-4636-9635-01e1bedc89da admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:28.664913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:28.668845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:28.669824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:28.670528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] PATH_INFO: `/v3/projects/c11aaf5795364b599dff27b44b491e56/users/a54961ca03c1416f8dd1dea1e1531be2/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:28.674093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11aaf5795364b599dff27b44b491e56, user_id=a54961ca03c1416f8dd1dea1e1531be2, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:28.677509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:28.706885 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3342/6700] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:28 2022] PUT /identity/v3/projects/c11aaf5795364b599dff27b44b491e56/users/a54961ca03c1416f8dd1dea1e1531be2/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:28.710428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:28.710945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:28.714729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:28.751989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] MFA Rules not processed for user `a54961ca03c1416f8dd1dea1e1531be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:28.753349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:28.846159 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3359/6701] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:28.858267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:28.860068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:28.967704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0e43-1f37-4ea1-9420-d54e80c073a8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:28.973819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:28.975241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:28.977061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:28.977603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:29.077431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:29.079200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:29.092176 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3343/6702] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:38.837317 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=68 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:39.090397 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:45.353673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:45.355250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:45.444767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526561d1-99b6-46cc-85ed-d7432d05c2d7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:45.458986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea3a96-b307-4a25-9346-b5f7c3d0e940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:45.458986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3a96-b307-4a25-9346-b5f7c3d0e940 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:45.458986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3a96-b307-4a25-9346-b5f7c3d0e940 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:45.458986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3a96-b307-4a25-9346-b5f7c3d0e940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:45.461923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea3a96-b307-4a25-9346-b5f7c3d0e940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:45.463580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea3a96-b307-4a25-9346-b5f7c3d0e940 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:45.472613 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3360/6703] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:41:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:41:47.952791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:47.954284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:48.030535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69a7a0-7419-4d1e-a053-24b88a26d16d service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:48.035184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:48.035875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:48.036148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:48.036415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] PATH_INFO: `/v3/users/1a67c11937844d7ba842ca6b5ac30130` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:48.037552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a67c11937844d7ba842ca6b5ac30130)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:48.039488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:48.364525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a67c11937844d7ba842ca6b5ac30130'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:48.372954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a67c11937844d7ba842ca6b5ac30130'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:48.373810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a67c11937844d7ba842ca6b5ac30130'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:48.506111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a67c11937844d7ba842ca6b5ac30130'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:48.506797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a67c11937844d7ba842ca6b5ac30130'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:48.534741 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3344/6704] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:47 2022] DELETE /identity/v3/users/1a67c11937844d7ba842ca6b5ac30130 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:48.539285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17624-d713-4355-9e79-e6319196b105 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:48.539840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17624-d713-4355-9e79-e6319196b105 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:48.540510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17624-d713-4355-9e79-e6319196b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:48.563735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-07f17624-d713-4355-9e79-e6319196b105 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:48.564947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-07f17624-d713-4355-9e79-e6319196b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:48.631711 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3361/6705] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:48.643547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:48.645074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:48.708400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97a3e-194e-4303-8b94-5b2d4b4b9b22 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:48.712630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d3e77-e675-488c-9669-f2a4552f5942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:48.714506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3e77-e675-488c-9669-f2a4552f5942 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:48.714796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3e77-e675-488c-9669-f2a4552f5942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:48.715053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d3e77-e675-488c-9669-f2a4552f5942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:48.725519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d3e77-e675-488c-9669-f2a4552f5942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:48.726977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d3e77-e675-488c-9669-f2a4552f5942 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:48.738610 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3345/6706] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:49.022777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17624-d713-4355-9e79-e6319196b105 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:49.024321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-07f17624-d713-4355-9e79-e6319196b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:49.037594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17624-d713-4355-9e79-e6319196b105 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:49.047299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:49.047987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:49.048852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:49.049202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] PATH_INFO: `/v3/projects/9f3df7d7b5814bdd82e83b75390a7483` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:49.050670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3df7d7b5814bdd82e83b75390a7483)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:49.054659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:49.246102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3df7d7b5814bdd82e83b75390a7483', 'request_id': 'req-fa653296-e41f-4ee7-84b3-25cbf24983ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:49.251674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3df7d7b5814bdd82e83b75390a7483', 'request_id': 'req-fa653296-e41f-4ee7-84b3-25cbf24983ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:49.352102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3df7d7b5814bdd82e83b75390a7483', 'request_id': 'req-fa653296-e41f-4ee7-84b3-25cbf24983ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:49.365433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] The token cache is being invalidate because project 9f3df7d7b5814bdd82e83b75390a7483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:49.365718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:49.366444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa653296-e41f-4ee7-84b3-25cbf24983ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:49.368604 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3362/6707] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:49 2022] DELETE /identity/v3/projects/9f3df7d7b5814bdd82e83b75390a7483 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:49.373473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bebdad-e1e7-4225-8a64-edf6ea6fd09d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:49.373968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bebdad-e1e7-4225-8a64-edf6ea6fd09d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:49.374113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bebdad-e1e7-4225-8a64-edf6ea6fd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:49.394348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-63bebdad-e1e7-4225-8a64-edf6ea6fd09d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:49.395548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-63bebdad-e1e7-4225-8a64-edf6ea6fd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:49.414484 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:49.459167 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3346/6708] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:49.474958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e57c1-f08e-4beb-8955-2c136362da9f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:49.475198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e57c1-f08e-4beb-8955-2c136362da9f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:49.475451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e57c1-f08e-4beb-8955-2c136362da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:49.483833 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:49.498092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-533e57c1-f08e-4beb-8955-2c136362da9f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:49.499267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-533e57c1-f08e-4beb-8955-2c136362da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:49.507689 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3363/6709] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:49.512376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bebdad-e1e7-4225-8a64-edf6ea6fd09d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:49.523000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bebdad-e1e7-4225-8a64-edf6ea6fd09d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:49.529210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:49.530659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:49.531639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:49.531639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:49.536757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:49.536757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:49.536757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:49.549072 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3347/6710] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:41:49.553184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e57c1-f08e-4beb-8955-2c136362da9f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:49.564808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e57c1-f08e-4beb-8955-2c136362da9f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:49.572170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:49.572170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:49.572170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:49.572170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:49.572663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:49.574715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:49.662586 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3364/6711] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:49 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:49.667392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:49.678782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2765fde-453f-4ec8-9704-66b0894d54fc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:49.750179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:49.750777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:49.751088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:49.751411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:49.752079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:49.754114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:49.958588 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3348/6712] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:49 2022] POST /identity/v3/users => generated 281 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:41:49.963043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:49.974277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8de8c-be95-459d-a143-67eb44fb5773 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:49.980756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:49.981578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:49.982191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:49.982536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:49.983272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:49.985059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:49.997051 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3365/6713] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:50.001330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:50.013171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a84f-7b79-41ce-90be-bc85939ee0fd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:50.018602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3274b-8a96-4d13-948b-85f944e419bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:50.019518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3274b-8a96-4d13-948b-85f944e419bb admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:50.019816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3274b-8a96-4d13-948b-85f944e419bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:50.020160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3274b-8a96-4d13-948b-85f944e419bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:50.020980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3274b-8a96-4d13-948b-85f944e419bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:50.022799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3274b-8a96-4d13-948b-85f944e419bb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:50.042044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3349/6714] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:50.044410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:50.054732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aba9fd-fad6-4d84-81bd-a7a23fa0ac81 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:50.060672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:50.061516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:50.061797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:50.062115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] PATH_INFO: `/v3/projects/4c8546cf0f7a411f90a94465d6dfb7b8/users/ca73c0dec0d84a1987dba2667d0f9c74/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:50.090721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8546cf0f7a411f90a94465d6dfb7b8, user_id=ca73c0dec0d84a1987dba2667d0f9c74, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:50.093374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:50.237897 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3366/6715] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:50 2022] PUT /identity/v3/projects/4c8546cf0f7a411f90a94465d6dfb7b8/users/ca73c0dec0d84a1987dba2667d0f9c74/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:50.248354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:50.248633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:50.248902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:50.278725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] MFA Rules not processed for user `ca73c0dec0d84a1987dba2667d0f9c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:50.279870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:50.345074 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3350/6716] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:50.358284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:50.360201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:50.428186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c392cc-41c0-4f6d-b3dc-625e96253f28 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:50.432945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:50.433560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:50.433836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:50.434151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:50.444437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:50.445867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:50.456549 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3367/6717] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:53.276852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:53.278556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:53.303765 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:53.372700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a587-96e7-448c-a079-e696036a5847 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:53.377587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:53.378375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:53.378614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:53.379026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] PATH_INFO: `/v3/users/85e367cf6f3b4259902ac1f5f9918391` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:53.380155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e367cf6f3b4259902ac1f5f9918391)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:53.382082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:53.658570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e367cf6f3b4259902ac1f5f9918391'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:53.666083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e367cf6f3b4259902ac1f5f9918391'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:53.670809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e367cf6f3b4259902ac1f5f9918391'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:53.802924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e367cf6f3b4259902ac1f5f9918391'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:53.803558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-64ef8c11-5171-4012-b570-ae668dd5a8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e367cf6f3b4259902ac1f5f9918391'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:53.823820 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3351/6718] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:53 2022] DELETE /identity/v3/users/85e367cf6f3b4259902ac1f5f9918391 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:54.176676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:54.203931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eacd76-83fa-4fcb-a9fc-1991720f5ee3 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:54.272424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:54.273139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:54.273478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:54.273853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] PATH_INFO: `/v3/projects/c36e0a78b98040598bfa5fac4fe95cf8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:54.275071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36e0a78b98040598bfa5fac4fe95cf8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:54.277128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:54.400012 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:54.403926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36e0a78b98040598bfa5fac4fe95cf8', 'request_id': 'req-baf2904c-df91-40d3-9925-b20cbcf4f160'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:54.409909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36e0a78b98040598bfa5fac4fe95cf8', 'request_id': 'req-baf2904c-df91-40d3-9925-b20cbcf4f160'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:54.522845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36e0a78b98040598bfa5fac4fe95cf8', 'request_id': 'req-baf2904c-df91-40d3-9925-b20cbcf4f160'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:54.538493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] The token cache is being invalidate because project c36e0a78b98040598bfa5fac4fe95cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:54.538493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:54.542882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-baf2904c-df91-40d3-9925-b20cbcf4f160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:54.544873 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3368/6719] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:54 2022] DELETE /identity/v3/projects/c36e0a78b98040598bfa5fac4fe95cf8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:54.549928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f5de-dc95-4a10-8994-d4cc6a730d54 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:54.550507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f5de-dc95-4a10-8994-d4cc6a730d54 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:54.550507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f5de-dc95-4a10-8994-d4cc6a730d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:54.574598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-51d5f5de-dc95-4a10-8994-d4cc6a730d54 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:54.575982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-51d5f5de-dc95-4a10-8994-d4cc6a730d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:54.664735 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3352/6720] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:54.664884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428bfb-359f-45e3-978d-2d40ee7d38c3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:54.664884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428bfb-359f-45e3-978d-2d40ee7d38c3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:54.664884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428bfb-359f-45e3-978d-2d40ee7d38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:54.688458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8e428bfb-359f-45e3-978d-2d40ee7d38c3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:54.688458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e428bfb-359f-45e3-978d-2d40ee7d38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:54.693487 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3369/6721] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:54.698616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f5de-dc95-4a10-8994-d4cc6a730d54 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:54.708951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f5de-dc95-4a10-8994-d4cc6a730d54 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:54.715998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:54.717468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:54.717687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:54.717999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:54.718758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:54.718955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:54.720554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:54.736958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3353/6722] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:41:54.743166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428bfb-359f-45e3-978d-2d40ee7d38c3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:54.757355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428bfb-359f-45e3-978d-2d40ee7d38c3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:54.762066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:54.762957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:54.763236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:54.763921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:54.764182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:54.766169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:54.870817 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3370/6723] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:54 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:54.872452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:54.885408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ed43c-95ce-4eae-9381-aa95f0976984 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:54.910497 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:54.954464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:54.955274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:54.955562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:54.955842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:54.956843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:54.958485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:55.077277 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3354/6724] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:54 2022] POST /identity/v3/users => generated 303 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:55.081606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:55.092942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774cbfd-ecb9-4796-b301-5d60cfc65e44 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:55.098065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:55.098780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:55.099120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:55.099462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:55.100220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:55.102685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:55.116436 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3371/6725] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:55.117490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:55.136391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5558-9d1b-46ad-b8cf-581ef78598bf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:55.143164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4936d-f8a9-47a3-91bc-c0f2365925b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:55.144057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4936d-f8a9-47a3-91bc-c0f2365925b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:55.144543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4936d-f8a9-47a3-91bc-c0f2365925b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:55.145042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4936d-f8a9-47a3-91bc-c0f2365925b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:55.146189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4936d-f8a9-47a3-91bc-c0f2365925b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:55.150116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4936d-f8a9-47a3-91bc-c0f2365925b9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:55.166061 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3355/6726] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:55.168830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:55.181880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583f0a5-357c-402c-a138-4309e5e72a8b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:55.187994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:55.188730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:55.189005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:55.189276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] PATH_INFO: `/v3/projects/4459f3c837db4fcaafc0e4aaed1600e0/users/b094df884baf43a0824d210dfe6e8d26/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:55.213142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4459f3c837db4fcaafc0e4aaed1600e0, user_id=b094df884baf43a0824d210dfe6e8d26, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:55.216026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:55.290239 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3372/6727] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:55 2022] PUT /identity/v3/projects/4459f3c837db4fcaafc0e4aaed1600e0/users/b094df884baf43a0824d210dfe6e8d26/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:41:55.298041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:55.298041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:55.298262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:55.329445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:55.331547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:55.406428 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3356/6728] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:41:55.416295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:55.418070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:55.523746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36607f2d-375c-4c12-90ea-aed7fca42211 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:55.525680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e9f12-20c3-4ace-b18d-883c98611452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:55.526437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9f12-20c3-4ace-b18d-883c98611452 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:55.526782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9f12-20c3-4ace-b18d-883c98611452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:55.527126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e9f12-20c3-4ace-b18d-883c98611452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:55.537090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e9f12-20c3-4ace-b18d-883c98611452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:55.538605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e9f12-20c3-4ace-b18d-883c98611452 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:55.551365 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3373/6729] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:57.127815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:57.129557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:57.142535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5525009-6163-4c86-bd5f-0b2929ab7738 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:57.147903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:57.148586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:57.148862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:57.149324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] PATH_INFO: `/v3/users/9fde6c068f164c52924d55110721d1f8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:57.155242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fde6c068f164c52924d55110721d1f8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:57.159507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:57.359292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fde6c068f164c52924d55110721d1f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:57.373517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fde6c068f164c52924d55110721d1f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:57.374474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fde6c068f164c52924d55110721d1f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:57.488757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fde6c068f164c52924d55110721d1f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:57.489530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fde6c068f164c52924d55110721d1f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:57.534668 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3357/6730] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:41:57 2022] DELETE /identity/v3/users/9fde6c068f164c52924d55110721d1f8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:57.536472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:57.536973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:57.536973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:57.571764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:57.572986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:57.671800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3374/6731] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:57.678104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:57.679611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:57.717600 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:57.828801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ec005-52b7-49a2-9d98-7e9afb171412 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:57.833680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a70d3a-e78e-4f24-8fd4-4cdb5068d344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:57.834659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70d3a-e78e-4f24-8fd4-4cdb5068d344 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:57.835153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70d3a-e78e-4f24-8fd4-4cdb5068d344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:57.835583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70d3a-e78e-4f24-8fd4-4cdb5068d344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:57.846590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a70d3a-e78e-4f24-8fd4-4cdb5068d344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:57.848365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a70d3a-e78e-4f24-8fd4-4cdb5068d344 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:57.864899 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3358/6732] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:41:58.761765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:58.764349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:58.790565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918ce1d-d14a-42b2-975c-c7631c3c77f6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:58.796354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:58.797333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:58.797879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:58.798414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] PATH_INFO: `/v3/projects/eee206344cdd47389ecb5421cd45d85d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:58.800048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee206344cdd47389ecb5421cd45d85d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:58.802338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:58.822944 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:41:58.943419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee206344cdd47389ecb5421cd45d85d', 'request_id': 'req-d23e03ca-0559-4bf7-bb5a-ec2399499741'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:58.955140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee206344cdd47389ecb5421cd45d85d', 'request_id': 'req-d23e03ca-0559-4bf7-bb5a-ec2399499741'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:59.043343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee206344cdd47389ecb5421cd45d85d', 'request_id': 'req-d23e03ca-0559-4bf7-bb5a-ec2399499741'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:59.064372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] The token cache is being invalidate because project eee206344cdd47389ecb5421cd45d85d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:41:59.064747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:59.065511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d23e03ca-0559-4bf7-bb5a-ec2399499741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:41:59.068436 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3375/6733] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:41:58 2022] DELETE /identity/v3/projects/eee206344cdd47389ecb5421cd45d85d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:41:59.074813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061bbaf-9193-4124-b710-d3525b16c9fc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.075513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061bbaf-9193-4124-b710-d3525b16c9fc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.076067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061bbaf-9193-4124-b710-d3525b16c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.138269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e061bbaf-9193-4124-b710-d3525b16c9fc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:59.139174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e061bbaf-9193-4124-b710-d3525b16c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:59.231471 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3359/6734] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:59.245453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0fea-f811-484b-97b4-83d78c9eafc8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.245740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0fea-f811-484b-97b4-83d78c9eafc8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.246058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0fea-f811-484b-97b4-83d78c9eafc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.267789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-069e0fea-f811-484b-97b4-83d78c9eafc8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:41:59.268987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-069e0fea-f811-484b-97b4-83d78c9eafc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:41:59.277679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3376/6735] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:41:59.282300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061bbaf-9193-4124-b710-d3525b16c9fc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:59.295956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061bbaf-9193-4124-b710-d3525b16c9fc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:59.300861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:59.301622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.301892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.302216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.303061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:41:59.303353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:59.305131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:59.334715 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3360/6736] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:41:59.339671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e0fea-f811-484b-97b4-83d78c9eafc8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:59.351095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e0fea-f811-484b-97b4-83d78c9eafc8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:59.360148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:59.361162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.361597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.362836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.365480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:59.368900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:59.480156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:59.497543 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3377/6737] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:41:59 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:59.499654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd245e-7b57-4130-8966-10cf5e5d8d57 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:59.658298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:59.658795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.660513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.660789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.661456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:59.667656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:59.792870 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3361/6738] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:41:59 2022] POST /identity/v3/users => generated 287 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:41:59.797171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:59.807707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9815f-37fd-44b4-a444-ddf41086c4d5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:59.812645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:59.813256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.815007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.815007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.815007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:59.816116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:59.835321 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3378/6739] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:59.839857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:59.850163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442594a3-bafb-428d-851d-f9bbfa7d7b5a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:59.857847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703aeabd-1cff-4fbc-9879-77198eed8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:59.858575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aeabd-1cff-4fbc-9879-77198eed8e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.859223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aeabd-1cff-4fbc-9879-77198eed8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.859223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703aeabd-1cff-4fbc-9879-77198eed8e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.860040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703aeabd-1cff-4fbc-9879-77198eed8e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:59.863764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703aeabd-1cff-4fbc-9879-77198eed8e20 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:41:59.881553 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3362/6740] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:41:59.883696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:41:59.896437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277538e-4bd5-4d6b-9cee-0a523baf4af6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:41:59.902755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:41:59.904216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:41:59.904698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:41:59.905181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] PATH_INFO: `/v3/projects/6de54dca37d8453888ffde627ebcbf5f/users/4872d908935048c7ac40c896fcb6f72d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:41:59.933526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de54dca37d8453888ffde627ebcbf5f, user_id=4872d908935048c7ac40c896fcb6f72d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:41:59.939425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:00.016535 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3379/6741] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:41:59 2022] PUT /identity/v3/projects/6de54dca37d8453888ffde627ebcbf5f/users/4872d908935048c7ac40c896fcb6f72d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:00.022143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3e8a-6572-40c1-b083-c883a0fad8ff None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:00.022472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3e8a-6572-40c1-b083-c883a0fad8ff None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:00.022695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b3e8a-6572-40c1-b083-c883a0fad8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:00.094100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ff6b3e8a-6572-40c1-b083-c883a0fad8ff None None] MFA Rules not processed for user `4872d908935048c7ac40c896fcb6f72d`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:00.095455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ff6b3e8a-6572-40c1-b083-c883a0fad8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:00.109908 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:00.186868 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3363/6742] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:00.199195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:00.201575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:00.299378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3791e-aaba-4fb7-a4ce-a639df766fa3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:00.303695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:00.304383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:00.305267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:00.305835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:00.329902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:00.329902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:00.340547 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3380/6743] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:03.503717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a3cf-1bd1-4e92-a452-2bfddab7c5d2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:03.504258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a3cf-1bd1-4e92-a452-2bfddab7c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:03.504357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a3cf-1bd1-4e92-a452-2bfddab7c5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:03.534969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2d74a3cf-1bd1-4e92-a452-2bfddab7c5d2 None None] MFA Rules not processed for user `b094df884baf43a0824d210dfe6e8d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:03.536287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d74a3cf-1bd1-4e92-a452-2bfddab7c5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:03.609753 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3364/6744] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:03.614244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:03.616823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:03.707580 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:03.763983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d49d3-819c-4034-a360-1b6ddc06197f service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:03.770677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:03.771479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:03.771826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:03.772167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:03.772986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:03.775718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:03.859392 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3381/6745] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:03 2022] POST /identity/v3/projects => generated 403 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:03.863644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74a3cf-1bd1-4e92-a452-2bfddab7c5d2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:03.875924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74a3cf-1bd1-4e92-a452-2bfddab7c5d2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:03.973415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:03.974077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:03.974366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:03.974640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:03.975288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:03.977822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:04.135171 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3365/6746] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:03 2022] POST /identity/v3/users => generated 302 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:04.139274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:04.151623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f1fb-ce3c-4109-9789-e3f5ce0fd85f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:04.161280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:04.161908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:04.162227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:04.162499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:04.163173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:04.167561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:04.179786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3382/6747] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:04.187791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:04.199609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0263bc-04b2-4e86-81a7-a55d361ba744 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:04.205963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:04.212395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:04.212395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:04.212395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:04.212395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:04.212395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:04.227179 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3366/6748] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:04.228255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:04.239686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06c1f-cf73-48fb-9b09-4f7ce620748a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:04.245807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c61415-a96c-4ae0-8e52-f1985e406830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:04.246577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61415-a96c-4ae0-8e52-f1985e406830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:04.246859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61415-a96c-4ae0-8e52-f1985e406830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:04.247126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61415-a96c-4ae0-8e52-f1985e406830 admin admin] PATH_INFO: `/v3/projects/6208791d12e94925923ed1a1a75bbd42/users/10c2f508584f4c41bed50c0dd477fe02/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:04.267145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c61415-a96c-4ae0-8e52-f1985e406830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6208791d12e94925923ed1a1a75bbd42, user_id=10c2f508584f4c41bed50c0dd477fe02, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:04.270411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c61415-a96c-4ae0-8e52-f1985e406830 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:04.374982 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3383/6749] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:04 2022] PUT /identity/v3/projects/6208791d12e94925923ed1a1a75bbd42/users/10c2f508584f4c41bed50c0dd477fe02/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:09.029704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:09.065279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21334fd7-c919-4a71-a728-d3203f20b58d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:09.175785 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:09.300672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:09.301514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:09.303545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:09.305293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] PATH_INFO: `/v3/users/4872d908935048c7ac40c896fcb6f72d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:09.310721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4872d908935048c7ac40c896fcb6f72d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:09.319237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:09.712665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4872d908935048c7ac40c896fcb6f72d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:09.749325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4872d908935048c7ac40c896fcb6f72d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:09.750125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4872d908935048c7ac40c896fcb6f72d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:09.895109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4872d908935048c7ac40c896fcb6f72d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:09.895650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4872d908935048c7ac40c896fcb6f72d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:09.925814 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3367/6750] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:09 2022] DELETE /identity/v3/users/4872d908935048c7ac40c896fcb6f72d => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:09.930749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:09.932734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:09.932734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:09.968846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:09.970115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:10.117669 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3384/6751] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:10.177389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:10.179816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:10.347994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6307-a06b-41b5-ab77-02869716fdac admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:10.354771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:10.355627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:10.356209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:10.356477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:10.374387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:10.379923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:10.392548 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3368/6752] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:11.886101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:11.887603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:11.985701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e3217-e325-47ab-92f5-d8685ccc9d5b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:12.018778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:12.020721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:12.021110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:12.022694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:12.034469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:12.077120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:12.079098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:12.096558 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3385/6753] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:12.141907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:12.145836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:12.172897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00932536-297d-4854-9a89-5ac8ab501da3 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:12.194670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:12.196380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:12.196813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:12.197234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] PATH_INFO: `/v3/projects/6de54dca37d8453888ffde627ebcbf5f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:12.198712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de54dca37d8453888ffde627ebcbf5f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:12.204094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:12.331691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:12.333596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:12.348822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a9bc-f146-405e-b7c9-72f866039a74 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:12.354293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:12.355006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:12.355295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:12.355572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] PATH_INFO: `/v3/users/ca73c0dec0d84a1987dba2667d0f9c74` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:12.356732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca73c0dec0d84a1987dba2667d0f9c74)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:12.359370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:12.367842 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:12.432654 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:12.453494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de54dca37d8453888ffde627ebcbf5f', 'request_id': 'req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.460665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de54dca37d8453888ffde627ebcbf5f', 'request_id': 'req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.569307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de54dca37d8453888ffde627ebcbf5f', 'request_id': 'req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.582917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] The token cache is being invalidate because project 6de54dca37d8453888ffde627ebcbf5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:12.583304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.591836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-20dbbcc4-4a40-4f7c-917b-fc5f73204d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.592502 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3369/6754] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:12 2022] DELETE /identity/v3/projects/6de54dca37d8453888ffde627ebcbf5f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:12.597572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d456-4037-4be3-8a38-b54aef0c7dd9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:12.597851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d456-4037-4be3-8a38-b54aef0c7dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:12.598204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d456-4037-4be3-8a38-b54aef0c7dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:12.624793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1652d456-4037-4be3-8a38-b54aef0c7dd9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:12.626276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1652d456-4037-4be3-8a38-b54aef0c7dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:12.651497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca73c0dec0d84a1987dba2667d0f9c74'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.675575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca73c0dec0d84a1987dba2667d0f9c74'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.676539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca73c0dec0d84a1987dba2667d0f9c74'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.737147 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3370/6755] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:12.745682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677b26-368d-4fcb-a3ed-e3182fd4c6c1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:12.745999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677b26-368d-4fcb-a3ed-e3182fd4c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:12.746381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11677b26-368d-4fcb-a3ed-e3182fd4c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:12.807466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca73c0dec0d84a1987dba2667d0f9c74'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.808798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c047a4a8-37ed-463c-a67a-e481d8620896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca73c0dec0d84a1987dba2667d0f9c74'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:12.825844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-11677b26-368d-4fcb-a3ed-e3182fd4c6c1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:12.831690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11677b26-368d-4fcb-a3ed-e3182fd4c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:12.857339 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3371/6756] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:42:12.863936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677b26-368d-4fcb-a3ed-e3182fd4c6c1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:12.876638 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3386/6757] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:12 2022] DELETE /identity/v3/users/ca73c0dec0d84a1987dba2667d0f9c74 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:12.884376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9fdc-c231-4469-8126-906c60466047 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:12.884808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9fdc-c231-4469-8126-906c60466047 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:12.885494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9fdc-c231-4469-8126-906c60466047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:12.900311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11677b26-368d-4fcb-a3ed-e3182fd4c6c1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:12.940535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c0ed9fdc-c231-4469-8126-906c60466047 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:12.945955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0ed9fdc-c231-4469-8126-906c60466047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:13.033843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.034602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.035173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.036622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.037326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:13.037671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.041775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.055308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3372/6758] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:42:13.056300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.058363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:13.108425 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3387/6759] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:13.112705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed9fdc-c231-4469-8126-906c60466047 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.124926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed9fdc-c231-4469-8126-906c60466047 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.131087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.131087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.131395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.131666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.132536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.134679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.158744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146bc1-e579-4743-b451-024188ef86ff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.177338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.178029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.178383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.178658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.182755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:13.198204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.199667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.219225 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3373/6760] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:13.220314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.234935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89ed58-5c9f-4cc6-b011-ffb5a3d24cc6 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.239793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.242564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.242936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.248877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.258997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.260540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.280408 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3374/6761] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:13.351275 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3388/6762] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:13 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:13.357742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.370980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a9f7-2412-47a2-9a3e-36b99c8d853d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.466767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.475012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.475012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.475012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.475012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.475012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.486788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.489086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:13.567957 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3375/6763] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:13 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:13.569186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.595276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f67d72-a9ac-475a-a221-5d8b5eb59e4e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.606187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f629c-283e-4e1f-b8b5-72a69da8d25f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.615588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.616376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.617122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.617463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.617954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.618615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.618889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.619153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.619796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:13.619921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.629163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.631290 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:13.638846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.640906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.650343 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3376/6764] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:13.654048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.669188 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3389/6765] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:13.680729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97638d-da88-4740-990e-4aa95108cd7f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.693666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.693864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.695143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.696531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:13.696929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.697300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.698105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.701119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.730197 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3377/6766] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:13.731794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:13.746177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c0ef-c1bf-4082-8217-a8f93101285e service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.748193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e842e6d-2ba5-4451-ae6c-4aa8d3238e45 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:13.752571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.752798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.753173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.753525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] PATH_INFO: `/v3/projects/4c8546cf0f7a411f90a94465d6dfb7b8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.754843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8546cf0f7a411f90a94465d6dfb7b8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.754990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2071-444e-4351-af04-a22de892ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:13.755623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2071-444e-4351-af04-a22de892ff19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.755933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2071-444e-4351-af04-a22de892ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.756272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2071-444e-4351-af04-a22de892ff19 admin admin] PATH_INFO: `/v3/projects/aa2897dbcbab4a2eaa41047971dc5f72/users/b7bbde02f0454ec4acc11c0795006765/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.757154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.783143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb2071-444e-4351-af04-a22de892ff19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2897dbcbab4a2eaa41047971dc5f72, user_id=b7bbde02f0454ec4acc11c0795006765, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:13.786577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb2071-444e-4351-af04-a22de892ff19 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:13.895056 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3378/6767] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:13 2022] PUT /identity/v3/projects/aa2897dbcbab4a2eaa41047971dc5f72/users/b7bbde02f0454ec4acc11c0795006765/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:13.907630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:13.908063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:13.908518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:13.922294 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:13.939882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8546cf0f7a411f90a94465d6dfb7b8', 'request_id': 'req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:13.947687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8546cf0f7a411f90a94465d6dfb7b8', 'request_id': 'req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:13.949572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] MFA Rules not processed for user `b7bbde02f0454ec4acc11c0795006765`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:13.952276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.031842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8546cf0f7a411f90a94465d6dfb7b8', 'request_id': 'req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:14.052104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] The token cache is being invalidate because project 4c8546cf0f7a411f90a94465d6dfb7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:14.052305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:14.053625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-71b2d2bd-ec2f-4e26-a3d1-2d9a69ee66c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:14.062537 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3390/6768] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:13 2022] DELETE /identity/v3/projects/4c8546cf0f7a411f90a94465d6dfb7b8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:42:14.074652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0744d-fc99-4178-994c-a2c066fc20d3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.075838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0744d-fc99-4178-994c-a2c066fc20d3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.076547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0744d-fc99-4178-994c-a2c066fc20d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.086763 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3379/6769] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:14.095874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.099209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.115113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-15d0744d-fc99-4178-994c-a2c066fc20d3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:14.116796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-15d0744d-fc99-4178-994c-a2c066fc20d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.206922 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3391/6770] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:14.207032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439844e-66c2-49f7-8b1b-4248809f8f42 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.208104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88c6a1-c13a-4663-8645-28c5b92b2809 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.208395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88c6a1-c13a-4663-8645-28c5b92b2809 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.208731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88c6a1-c13a-4663-8645-28c5b92b2809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.218938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.223562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.223562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.223562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.223562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.229646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.239112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cc88c6a1-c13a-4663-8645-28c5b92b2809 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:14.240424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cc88c6a1-c13a-4663-8645-28c5b92b2809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.249399 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3392/6771] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:42:14.251013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.251476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.251919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.286637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] MFA Rules not processed for user `10c2f508584f4c41bed50c0dd477fe02`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:14.288987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.354010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3380/6772] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:14.354010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.391995 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3393/6773] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:14.392986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.394409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.420209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518f06-29a9-4d04-96c8-1fc15ba54e07 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.425166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.425803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.426110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.426382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.427022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:14.427321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.429505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.442422 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3381/6774] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:42:14.443229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.453218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1c873-d71b-4510-926a-1e2a115133be admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.457174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab758c8f-65cd-49a0-b0bd-fd0eec57839d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.458525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa0908-4fe5-4d6d-a98b-6c87903f8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.459126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0908-4fe5-4d6d-a98b-6c87903f8e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.459404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0908-4fe5-4d6d-a98b-6c87903f8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.459683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa0908-4fe5-4d6d-a98b-6c87903f8e6d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.460894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa0908-4fe5-4d6d-a98b-6c87903f8e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.462882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa0908-4fe5-4d6d-a98b-6c87903f8e6d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.515741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.516354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.516634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.516907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.518698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.575202 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3382/6775] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:14.584132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba3c90-f723-4674-9861-cc8292f9bd3d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.584132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba3c90-f723-4674-9861-cc8292f9bd3d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.584132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba3c90-f723-4674-9861-cc8292f9bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.601666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-79ba3c90-f723-4674-9861-cc8292f9bd3d None None] MFA Rules not processed for user `b094df884baf43a0824d210dfe6e8d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:14.603844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-79ba3c90-f723-4674-9861-cc8292f9bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.616405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.618704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.634220 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3394/6776] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:14.635120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.645868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2011-7fb7-40d1-9f7b-9947ff3ab732 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.651730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.652433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.652783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.653148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.653852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.656153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.694071 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:14.698936 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3383/6777] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:14.699770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba3c90-f723-4674-9861-cc8292f9bd3d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.724139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba3c90-f723-4674-9861-cc8292f9bd3d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.731406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.732300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.732661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.732999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.734413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.736209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.751183 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3384/6778] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:14.751183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.753146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.778049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3395/6779] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:14.779183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.781931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a086c4-719e-44c7-92e9-538299886b7a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.842265 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:14.893470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.898274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.898274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.898274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.898274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:14.902893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdaa76-090f-49db-af6f-52548028959e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.909949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.910603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.910879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.911320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.911849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.914271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.930880 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3396/6780] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:14.935897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:14.948241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad38ce6-ffdd-4e5b-8522-988b3e05ce9a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:14.953179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:14.953796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:14.954108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:14.954384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:14.955502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.957434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:14.990819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:14.993079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:15.004308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3385/6781] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:14 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:15.007020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.019245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ce38-97c6-4be7-bb37-0547a5c123c4 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.025390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f05a-95ea-4369-b8a9-f867e25debda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.026248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f05a-95ea-4369-b8a9-f867e25debda admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.034077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f05a-95ea-4369-b8a9-f867e25debda admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.034077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f05a-95ea-4369-b8a9-f867e25debda admin admin] PATH_INFO: `/v3/projects/12d99852292445299d49515150826e1f/users/7324cfd73755400280065f9b08a3fa1a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.052695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f05a-95ea-4369-b8a9-f867e25debda admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d99852292445299d49515150826e1f, user_id=7324cfd73755400280065f9b08a3fa1a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:15.056495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f05a-95ea-4369-b8a9-f867e25debda admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:15.111038 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3397/6782] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:14 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:15.114978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.126161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3f04-fd00-426a-b198-4d53abab39ce admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.133095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.133474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.143778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.143778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.143778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:15.143778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:15.152994 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3398/6783] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:42:15.154141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.174114 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3386/6784] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:15 2022] PUT /identity/v3/projects/12d99852292445299d49515150826e1f/users/7324cfd73755400280065f9b08a3fa1a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:15.174371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10e197-fa60-44b9-bfe3-edd3e7347382 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.180802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855001f-1c97-4507-923f-53c3c05110f0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.181084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855001f-1c97-4507-923f-53c3c05110f0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.181356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855001f-1c97-4507-923f-53c3c05110f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.222065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4855001f-1c97-4507-923f-53c3c05110f0 None None] MFA Rules not processed for user `7324cfd73755400280065f9b08a3fa1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:15.224084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4855001f-1c97-4507-923f-53c3c05110f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:15.306216 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:15.313715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.315217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.315499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.315780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.316433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:15.320618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:15.361427 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3399/6785] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:42:15.365449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.392880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cacbdd-b9cd-438e-b008-6ad06db0d3f5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.409267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5383-a9d6-459a-984b-dd5f3035856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.410391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5383-a9d6-459a-984b-dd5f3035856a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.414318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5383-a9d6-459a-984b-dd5f3035856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.415007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5383-a9d6-459a-984b-dd5f3035856a admin admin] PATH_INFO: `/v3/projects/36deab790e0349099efdfdfe879ba9d2/users/849d5c9d4aa54641a964553cd273f392/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.432780 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3387/6786] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:42:15.439238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd5383-a9d6-459a-984b-dd5f3035856a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36deab790e0349099efdfdfe879ba9d2, user_id=849d5c9d4aa54641a964553cd273f392, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:15.439505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855001f-1c97-4507-923f-53c3c05110f0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.443668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd5383-a9d6-459a-984b-dd5f3035856a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:15.466779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855001f-1c97-4507-923f-53c3c05110f0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.478925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.479756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.480131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.480528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.481711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:15.484002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:15.541326 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:15.618568 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3400/6787] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:15 2022] PUT /identity/v3/projects/36deab790e0349099efdfdfe879ba9d2/users/849d5c9d4aa54641a964553cd273f392/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:15.631337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63854185-70fe-42bc-b0a8-7957effe240c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.631699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63854185-70fe-42bc-b0a8-7957effe240c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.632566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63854185-70fe-42bc-b0a8-7957effe240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.658012 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3388/6788] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:15 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:15.658012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.709700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-63854185-70fe-42bc-b0a8-7957effe240c None None] MFA Rules not processed for user `849d5c9d4aa54641a964553cd273f392`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:15.711940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-63854185-70fe-42bc-b0a8-7957effe240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:15.824970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427aa51-2005-4932-99e2-177a4c5b9155 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.831447 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:15.839352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.839984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.840262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.840575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.841159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:15.843185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:15.878337 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3401/6789] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:15.890460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63854185-70fe-42bc-b0a8-7957effe240c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.896933 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:15.965519 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3389/6790] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:15 2022] POST /identity/v3/users => generated 299 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:42:15.971236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:15.980946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63854185-70fe-42bc-b0a8-7957effe240c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.986296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1a27e-bde5-4f7f-9271-70b2b918619c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:15.986852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.987394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.987660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.990779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.994957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:15.996581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:15.997077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:15.997577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:15.998505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:16.000439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:16.004243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:16.005989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:16.015460 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3390/6791] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:16.017114 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3402/6792] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:16.027602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:16.038808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b5241-3e6f-4e24-b70c-e5b22268e54e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:16.044119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:16.044873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:16.047354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:16.047354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] PATH_INFO: `/v3/projects/435b7181cb274adfae62f11d2ad54df6/users/3a2c69a0382a4c9e9483dff243438de9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:16.063769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] RBAC: Authorizing `identity:create_grant(project_id=435b7181cb274adfae62f11d2ad54df6, user_id=3a2c69a0382a4c9e9483dff243438de9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:16.066776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:16.177954 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3391/6793] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:16 2022] PUT /identity/v3/projects/435b7181cb274adfae62f11d2ad54df6/users/3a2c69a0382a4c9e9483dff243438de9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:16.182260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:16.195188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526bc8c-6a9b-46f5-9792-319b6d4019e7 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:16.266322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521a661-0a26-498f-bdb4-141e7f8cc806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:16.267026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a661-0a26-498f-bdb4-141e7f8cc806 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:16.267314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a661-0a26-498f-bdb4-141e7f8cc806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:16.267820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a661-0a26-498f-bdb4-141e7f8cc806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:16.268614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521a661-0a26-498f-bdb4-141e7f8cc806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:16.270424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521a661-0a26-498f-bdb4-141e7f8cc806 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:16.289879 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3403/6794] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:16.293436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:16.311157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d221d8-3929-4259-b5ef-3a065ecb763d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:16.316553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:16.317490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:16.318037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:16.318477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] PATH_INFO: `/v3/projects/435b7181cb274adfae62f11d2ad54df6/users/3a2c69a0382a4c9e9483dff243438de9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:16.321371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] RBAC: Authorizing `identity:create_grant(project_id=435b7181cb274adfae62f11d2ad54df6, user_id=3a2c69a0382a4c9e9483dff243438de9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:16.324225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:16.336232 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3392/6795] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:16 2022] PUT /identity/v3/projects/435b7181cb274adfae62f11d2ad54df6/users/3a2c69a0382a4c9e9483dff243438de9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:16.448222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db09eed-46b3-4620-b2ee-1b44cd3e4bac None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:16.448604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db09eed-46b3-4620-b2ee-1b44cd3e4bac None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:16.449064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db09eed-46b3-4620-b2ee-1b44cd3e4bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:16.520643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0db09eed-46b3-4620-b2ee-1b44cd3e4bac None None] MFA Rules not processed for user `3a2c69a0382a4c9e9483dff243438de9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:16.522091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0db09eed-46b3-4620-b2ee-1b44cd3e4bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:16.657634 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3404/6796] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:16.675791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:16.681753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:16.789912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcd9f3-5a77-4dab-ac69-08898779288b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:16.794826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9decf5c-6c18-47d2-a259-af68b5bc6f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:16.795238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9decf5c-6c18-47d2-a259-af68b5bc6f85 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:16.795520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9decf5c-6c18-47d2-a259-af68b5bc6f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:16.795806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9decf5c-6c18-47d2-a259-af68b5bc6f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:16.903887 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:16.919723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9decf5c-6c18-47d2-a259-af68b5bc6f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:16.921626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9decf5c-6c18-47d2-a259-af68b5bc6f85 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:16.939921 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3393/6797] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:17.184015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db09eed-46b3-4620-b2ee-1b44cd3e4bac None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:17.219485 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:17.266641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db09eed-46b3-4620-b2ee-1b44cd3e4bac None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:17.271620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:17.272439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:17.274346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:17.274896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] PATH_INFO: `/v3/users/849d5c9d4aa54641a964553cd273f392` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:17.276310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849d5c9d4aa54641a964553cd273f392)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:17.279193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:17.607705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849d5c9d4aa54641a964553cd273f392'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:17.617422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849d5c9d4aa54641a964553cd273f392'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:17.618416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849d5c9d4aa54641a964553cd273f392'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:17.734005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849d5c9d4aa54641a964553cd273f392'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:17.735255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849d5c9d4aa54641a964553cd273f392'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:17.768416 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3405/6798] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:17 2022] DELETE /identity/v3/users/849d5c9d4aa54641a964553cd273f392 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:17.773295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:17.773801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:17.774094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:17.796490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:17.797715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:17.916326 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3394/6799] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:17.926810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:17.928455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:18.018557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f12ae8-852d-494b-a257-1ebc439a8499 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:18.030094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b0a67-4cdd-4c4c-b728-ad850ba12ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:18.030094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b0a67-4cdd-4c4c-b728-ad850ba12ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:18.030094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b0a67-4cdd-4c4c-b728-ad850ba12ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:18.030094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b0a67-4cdd-4c4c-b728-ad850ba12ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:18.033500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b0a67-4cdd-4c4c-b728-ad850ba12ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:18.034961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b0a67-4cdd-4c4c-b728-ad850ba12ae1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:18.046965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3406/6800] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:18.582071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:18.584320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:18.599989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31413-bc49-4e1a-ac33-152a44782da7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:18.607745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:18.608722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:18.609218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:18.609689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] PATH_INFO: `/v3/projects/36deab790e0349099efdfdfe879ba9d2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:18.611535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36deab790e0349099efdfdfe879ba9d2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:18.614808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:18.817763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36deab790e0349099efdfdfe879ba9d2', 'request_id': 'req-40b8a04e-281a-4938-bbc2-57d223a5b634'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:18.834245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36deab790e0349099efdfdfe879ba9d2', 'request_id': 'req-40b8a04e-281a-4938-bbc2-57d223a5b634'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:18.957156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36deab790e0349099efdfdfe879ba9d2', 'request_id': 'req-40b8a04e-281a-4938-bbc2-57d223a5b634'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:18.983110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] The token cache is being invalidate because project 36deab790e0349099efdfdfe879ba9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:18.983404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:18.987523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-40b8a04e-281a-4938-bbc2-57d223a5b634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:19.001184 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3395/6801] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:18 2022] DELETE /identity/v3/projects/36deab790e0349099efdfdfe879ba9d2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:19.006297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafdd72-4c1f-428a-a65c-ee055d9b90d7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.006807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafdd72-4c1f-428a-a65c-ee055d9b90d7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.006919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafdd72-4c1f-428a-a65c-ee055d9b90d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.040659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8eafdd72-4c1f-428a-a65c-ee055d9b90d7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:19.041892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8eafdd72-4c1f-428a-a65c-ee055d9b90d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:19.101232 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:19.119542 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3407/6802] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:19.127425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ff590-93de-481d-b660-605a5b930d1e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.127826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ff590-93de-481d-b660-605a5b930d1e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.130346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ff590-93de-481d-b660-605a5b930d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.175846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b34ff590-93de-481d-b660-605a5b930d1e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:19.177111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b34ff590-93de-481d-b660-605a5b930d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:19.197164 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3396/6803] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:19.201247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafdd72-4c1f-428a-a65c-ee055d9b90d7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:19.232548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafdd72-4c1f-428a-a65c-ee055d9b90d7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:19.240297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:19.242122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.242468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.243879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.243879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:19.243879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:19.248904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:19.273259 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3408/6804] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:42:19.274401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ff590-93de-481d-b660-605a5b930d1e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:19.285630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ff590-93de-481d-b660-605a5b930d1e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:19.292310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:19.293311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.293666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.294521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.295387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:19.297800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:19.455798 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3397/6805] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:19 2022] POST /identity/v3/projects => generated 357 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:19.460951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:19.472969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb69791-1cc6-492f-9559-90a993a682ff admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:19.585640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:19.585640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.586323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.586323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.586943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:19.588702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:19.700602 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3409/6806] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:19 2022] POST /identity/v3/users => generated 279 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:19.705173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:19.716421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aa356-9f59-46bb-a833-20b40aa44ae7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:19.722449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:19.726297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.726297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.726297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.726297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:19.726297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:19.739963 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3398/6807] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:19.744986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:19.756191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fa5df-2f94-4733-9e76-3766d195d1ad admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:19.761990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d15df-0bc8-4731-a4ab-580ef3bbd15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:19.762768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d15df-0bc8-4731-a4ab-580ef3bbd15e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.763055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d15df-0bc8-4731-a4ab-580ef3bbd15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.763328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d15df-0bc8-4731-a4ab-580ef3bbd15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.764048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d15df-0bc8-4731-a4ab-580ef3bbd15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:19.765674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d15df-0bc8-4731-a4ab-580ef3bbd15e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:19.781173 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3410/6808] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:19.783858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:19.795968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbe76c-d821-449f-bd85-a8ed92c46cb1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:19.801364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:19.802428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.802791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.803282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] PATH_INFO: `/v3/projects/f1a6074982aa40d293e54cdba6cce266/users/f957e61f534947ba91c023bdf20d219a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.821449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a6074982aa40d293e54cdba6cce266, user_id=f957e61f534947ba91c023bdf20d219a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:19.824212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:19.957105 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3399/6809] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:19 2022] PUT /identity/v3/projects/f1a6074982aa40d293e54cdba6cce266/users/f957e61f534947ba91c023bdf20d219a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:42:19.959142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:19.959491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:19.960329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:19.992636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] MFA Rules not processed for user `f957e61f534947ba91c023bdf20d219a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:19.993881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:20.076109 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3411/6810] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:20.084469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:20.086951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:20.098565 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:20.151982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c8cb2-9141-49c1-969f-939b37c7354b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:20.155965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:20.156768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:20.157043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:20.157309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:20.169310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:20.171069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:20.207719 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3400/6811] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:20.548040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:20.548040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:20.642006 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:20.653561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b2f7-f193-44e8-afc3-0c362e6c5b68 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:20.666776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:20.667809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:20.668367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:20.669840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:20.672185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:20.805481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:20.807253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:20.825223 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3412/6812] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:22.778733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:22.792561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599027e1-ef43-42cf-8fea-5e4e861129ba service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:22.801226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:22.804065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:22.804065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:22.804065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:22.806358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:22.882733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:22.884206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:22.896581 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3401/6813] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:30.342221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:30.344248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:30.445618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542828-2456-48b4-b0c9-6b47fe951c2a service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:30.454122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bcc42-8f7d-45ad-b835-3d43eb21562e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:30.455135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bcc42-8f7d-45ad-b835-3d43eb21562e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:30.455416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bcc42-8f7d-45ad-b835-3d43eb21562e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:30.455899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bcc42-8f7d-45ad-b835-3d43eb21562e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:30.458684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b88bcc42-8f7d-45ad-b835-3d43eb21562e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:30.481249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bcc42-8f7d-45ad-b835-3d43eb21562e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:30.488498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bcc42-8f7d-45ad-b835-3d43eb21562e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:30.501439 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3413/6814] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:32.890789 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=52 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:33.389551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:33.392641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:33.549492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03803f2f-fdc9-45fd-a36d-897ae632c9cc service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:33.563407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:33.564091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:33.564339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:33.564613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] PATH_INFO: `/v3/users/b7bbde02f0454ec4acc11c0795006765` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:33.569895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7bbde02f0454ec4acc11c0795006765)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:33.572712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:33.788881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7bbde02f0454ec4acc11c0795006765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:33.797373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7bbde02f0454ec4acc11c0795006765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:33.798279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7bbde02f0454ec4acc11c0795006765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:33.891161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7bbde02f0454ec4acc11c0795006765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:33.895301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7bbde02f0454ec4acc11c0795006765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:33.936146 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3402/6815] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:33 2022] DELETE /identity/v3/users/b7bbde02f0454ec4acc11c0795006765 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:33.946252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:33.947524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:33.950042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:33.959658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:33.961309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:33.980855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:33.980855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:34.076529 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3414/6816] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:42:34.087550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:34.091057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:34.109803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe59c-e60d-4e14-a397-325cfca0daa9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:34.117114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:34.117880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:34.118314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:34.118666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:34.121214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:34.138325 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:34.163526 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:34.191091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:34.192736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:34.195561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dbe55-2ff7-48ab-82fa-685614fde3cf None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:34.201221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb569fe5-f985-4b75-bdec-174bacc3e56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:34.201907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569fe5-f985-4b75-bdec-174bacc3e56c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:34.202379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569fe5-f985-4b75-bdec-174bacc3e56c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:34.202746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569fe5-f985-4b75-bdec-174bacc3e56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:34.203792 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3403/6817] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:33 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:34.215304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb569fe5-f985-4b75-bdec-174bacc3e56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:34.216336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb569fe5-f985-4b75-bdec-174bacc3e56c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:34.230005 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3415/6818] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:42:34.264190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:34.264190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:34.287993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feddab7-0b8b-4fd4-9087-07a9a24eedaf service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:34.293345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:34.294289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:34.294582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:34.294846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] PATH_INFO: `/v3/users/f957e61f534947ba91c023bdf20d219a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:34.296277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f957e61f534947ba91c023bdf20d219a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:34.298273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:34.550481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f957e61f534947ba91c023bdf20d219a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:34.560876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f957e61f534947ba91c023bdf20d219a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:34.562879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f957e61f534947ba91c023bdf20d219a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:34.629278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f957e61f534947ba91c023bdf20d219a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:34.630093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f957e61f534947ba91c023bdf20d219a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:34.670081 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3404/6819] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:34 2022] DELETE /identity/v3/users/f957e61f534947ba91c023bdf20d219a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:34.674604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:34.683849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:34.683849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:34.699549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:34.700832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:34.768420 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3416/6820] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:34.778254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:34.779648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:34.837559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:34.838999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:34.859360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8cd19-f79b-443e-bd1b-8518bb579bef admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:34.860532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb984-15b9-4147-aec8-fcf4bbfea2fc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:34.864687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:34.865854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:34.866227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:34.866487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:34.866639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:34.867125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:34.867403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:34.867669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] PATH_INFO: `/v3/projects/aa2897dbcbab4a2eaa41047971dc5f72` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:34.869354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2897dbcbab4a2eaa41047971dc5f72)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:34.871587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:34.877324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:34.878822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:34.889452 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3405/6821] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:35.099558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2897dbcbab4a2eaa41047971dc5f72', 'request_id': 'req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.108010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2897dbcbab4a2eaa41047971dc5f72', 'request_id': 'req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.236508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2897dbcbab4a2eaa41047971dc5f72', 'request_id': 'req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.249583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] The token cache is being invalidate because project aa2897dbcbab4a2eaa41047971dc5f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:35.249965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.250802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.252804 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3417/6822] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:34 2022] DELETE /identity/v3/projects/aa2897dbcbab4a2eaa41047971dc5f72 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:42:35.257933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:35.258938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:35.260321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:35.276191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea4811-c32b-4834-b00d-d1d2febb8b2e service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:35.314011 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:35.338968 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:35.351205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:35.351853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:35.352040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce7b8-5af5-4415-8b9a-2152c320c5b9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:35.352157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:35.352429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] PATH_INFO: `/v3/users/7324cfd73755400280065f9b08a3fa1a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:35.354347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7324cfd73755400280065f9b08a3fa1a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:35.356497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:35.357775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:35.358490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:35.358921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:35.359234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] PATH_INFO: `/v3/projects/f1a6074982aa40d293e54cdba6cce266` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:35.360735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a6074982aa40d293e54cdba6cce266)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:35.362813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:35.558527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a6074982aa40d293e54cdba6cce266', 'request_id': 'req-5cfd70e0-dd20-402d-a566-4b323065451d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.560096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7324cfd73755400280065f9b08a3fa1a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.564858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a6074982aa40d293e54cdba6cce266', 'request_id': 'req-5cfd70e0-dd20-402d-a566-4b323065451d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.569136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7324cfd73755400280065f9b08a3fa1a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.570737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7324cfd73755400280065f9b08a3fa1a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.716385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a6074982aa40d293e54cdba6cce266', 'request_id': 'req-5cfd70e0-dd20-402d-a566-4b323065451d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.731906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] The token cache is being invalidate because project f1a6074982aa40d293e54cdba6cce266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:35.732181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.732989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5cfd70e0-dd20-402d-a566-4b323065451d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.737871 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3418/6823] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:35 2022] DELETE /identity/v3/projects/f1a6074982aa40d293e54cdba6cce266 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:42:35.739450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d9fd-6998-4c87-ad6f-dbd51c67779d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:35.739796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d9fd-6998-4c87-ad6f-dbd51c67779d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:35.740624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d9fd-6998-4c87-ad6f-dbd51c67779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:35.763014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-56f5d9fd-6998-4c87-ad6f-dbd51c67779d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:35.764259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-56f5d9fd-6998-4c87-ad6f-dbd51c67779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:35.826668 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3419/6824] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:35.834496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf257-2727-422a-9c34-d3772e724d98 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:35.834776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf257-2727-422a-9c34-d3772e724d98 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:35.835125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf257-2727-422a-9c34-d3772e724d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:35.855175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3f7bf257-2727-422a-9c34-d3772e724d98 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:35.856347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3f7bf257-2727-422a-9c34-d3772e724d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:35.864216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7324cfd73755400280065f9b08a3fa1a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.864362 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3420/6825] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:42:35.869044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7324cfd73755400280065f9b08a3fa1a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:35.872130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bf257-2727-422a-9c34-d3772e724d98 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:35.881581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bf257-2727-422a-9c34-d3772e724d98 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:35.886613 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3406/6826] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:35 2022] DELETE /identity/v3/users/7324cfd73755400280065f9b08a3fa1a => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:35.892638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:35.892638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:35.892638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:35.892638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:35.893054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:35.893054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:35.893054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:35.904041 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3421/6827] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:42:35.908131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:35.909565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:35.981486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7af35b-8d8f-4102-a254-f30ed43691f2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:35.986292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:35.986907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:35.987241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:35.987521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:35.988148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:35.990732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:36.130233 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3407/6828] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:35 2022] POST /identity/v3/projects => generated 351 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:36.134647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:36.145947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b9439-eb08-4860-8e9c-f397a97b110c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:36.217922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:36.218686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.218964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.219237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.220535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:36.222143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:36.233200 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:36.336509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3422/6829] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:36 2022] POST /identity/v3/users => generated 276 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:36.340507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:36.366410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca6863-64a9-4369-82c8-3e939ae4369e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:36.372245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:36.377219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.377219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.377219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.377219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:36.377219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:36.390502 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3408/6830] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:36.395696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:36.407808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc5dd2-d1cb-4e84-a598-8e25082dff61 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:36.414821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:36.416112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.416746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.417265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.418712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:36.424870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:36.436565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3423/6831] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:36.440951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:36.457413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706fb7-11a5-4c4d-9e7a-3c0c3fb55dfa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:36.464589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5258c-d6f7-4742-93c2-92b5c48f7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:36.465429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5258c-d6f7-4742-93c2-92b5c48f7933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.465808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5258c-d6f7-4742-93c2-92b5c48f7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.466249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5258c-d6f7-4742-93c2-92b5c48f7933 admin admin] PATH_INFO: `/v3/projects/dc5d6474babf4937b62a86b66b8a260b/users/8c63b0a47d904512ac8101457b1b03b0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.509946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5258c-d6f7-4742-93c2-92b5c48f7933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5d6474babf4937b62a86b66b8a260b, user_id=8c63b0a47d904512ac8101457b1b03b0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:36.512951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5258c-d6f7-4742-93c2-92b5c48f7933 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:36.525586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:36.529504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:36.545442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ff264-5592-4dcd-8c8c-f6d89d83c1a2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:36.553066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:36.553355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.553706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.553946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] PATH_INFO: `/v3/projects/12d99852292445299d49515150826e1f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.556121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d99852292445299d49515150826e1f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:36.557926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:36.643145 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:36.648626 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3409/6832] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:36 2022] PUT /identity/v3/projects/dc5d6474babf4937b62a86b66b8a260b/users/8c63b0a47d904512ac8101457b1b03b0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:42:36.659245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.660365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.660877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.712739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] MFA Rules not processed for user `8c63b0a47d904512ac8101457b1b03b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:36.716468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:36.730694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d99852292445299d49515150826e1f', 'request_id': 'req-64432337-e8e0-45c6-ad50-41396839e2f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:36.738599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d99852292445299d49515150826e1f', 'request_id': 'req-64432337-e8e0-45c6-ad50-41396839e2f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:36.801806 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3410/6833] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:36.812973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d99852292445299d49515150826e1f', 'request_id': 'req-64432337-e8e0-45c6-ad50-41396839e2f1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:36.819381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:36.823108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:36.828133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] The token cache is being invalidate because project 12d99852292445299d49515150826e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:36.828523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:36.829824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:36.835864 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3424/6834] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:36 2022] DELETE /identity/v3/projects/12d99852292445299d49515150826e1f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:36.838510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:36.840895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:36.931705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6b42e-d5f4-4c49-b452-b7b77cedf0b6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:36.938924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:36.939871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.940308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.940929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.943588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:36.949816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64432337-e8e0-45c6-ad50-41396839e2f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:36.955370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:36.956029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:36.956310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:36.956582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] PATH_INFO: `/v3/users/3a2c69a0382a4c9e9483dff243438de9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:36.958321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2c69a0382a4c9e9483dff243438de9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:36.976832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:37.002794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:37.002794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:37.010915 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3411/6835] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:42:37.146904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2c69a0382a4c9e9483dff243438de9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:37.155894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2c69a0382a4c9e9483dff243438de9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:37.157944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2c69a0382a4c9e9483dff243438de9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:37.269086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2c69a0382a4c9e9483dff243438de9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:37.270713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2c69a0382a4c9e9483dff243438de9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:37.277138 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=3,keystone:SELECT=82,keystone:DELETE=15 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:37.294298 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3425/6836] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:36 2022] DELETE /identity/v3/users/3a2c69a0382a4c9e9483dff243438de9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:37.498264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:37.499723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:37.619500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be893-60b9-4462-a5db-bfcf962365dc service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:37.673052 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:37.739618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59888789-9099-4abb-99d9-f27af45d232c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:37.740032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888789-9099-4abb-99d9-f27af45d232c service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:37.740594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888789-9099-4abb-99d9-f27af45d232c service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:37.740981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888789-9099-4abb-99d9-f27af45d232c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:37.751420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-59888789-9099-4abb-99d9-f27af45d232c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:37.795187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59888789-9099-4abb-99d9-f27af45d232c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:37.799049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59888789-9099-4abb-99d9-f27af45d232c service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:37.843574 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3412/6837] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:38.021936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:38.024802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:38.132597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444cda-bcdd-4a9d-8d4f-1f9b07fb7a98 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:38.145045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:38.147245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:38.148212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:38.148783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] PATH_INFO: `/v3/projects/435b7181cb274adfae62f11d2ad54df6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:38.151738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=435b7181cb274adfae62f11d2ad54df6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:38.155481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:38.270959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435b7181cb274adfae62f11d2ad54df6', 'request_id': 'req-ace5a7a6-1158-418f-bc18-55b2644df78c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:38.279388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435b7181cb274adfae62f11d2ad54df6', 'request_id': 'req-ace5a7a6-1158-418f-bc18-55b2644df78c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:38.400286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435b7181cb274adfae62f11d2ad54df6', 'request_id': 'req-ace5a7a6-1158-418f-bc18-55b2644df78c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:38.417356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] The token cache is being invalidate because project 435b7181cb274adfae62f11d2ad54df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:38.417854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:38.418916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ace5a7a6-1158-418f-bc18-55b2644df78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:38.420966 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3426/6838] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:38 2022] DELETE /identity/v3/projects/435b7181cb274adfae62f11d2ad54df6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:38.425993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1991-f471-4120-81d8-be8852580e76 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:38.426768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1991-f471-4120-81d8-be8852580e76 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:38.426768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1991-f471-4120-81d8-be8852580e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:38.455832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9eba1991-f471-4120-81d8-be8852580e76 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:38.459526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9eba1991-f471-4120-81d8-be8852580e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:38.549128 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3413/6839] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:38.558700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f96a3-584a-4735-bb16-2a46c287db4b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:38.559241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f96a3-584a-4735-bb16-2a46c287db4b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:38.559926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f96a3-584a-4735-bb16-2a46c287db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:38.611922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-469f96a3-584a-4735-bb16-2a46c287db4b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:38.613469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-469f96a3-584a-4735-bb16-2a46c287db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:38.627362 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3427/6840] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:38.632135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1991-f471-4120-81d8-be8852580e76 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:38.649797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1991-f471-4120-81d8-be8852580e76 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:38.662797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:38.663665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:38.664106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:38.664534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:38.665371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:38.665831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:38.667769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:38.692015 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3414/6841] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:42:38.697967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f96a3-584a-4735-bb16-2a46c287db4b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:38.711548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f96a3-584a-4735-bb16-2a46c287db4b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:38.718580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:38.719472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:38.720035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:38.721474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:38.722392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:38.726686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:38.870810 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3428/6842] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:38 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:38.871739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:38.885466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321d5e-fb69-4112-a339-f734eeb595d3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:38.968078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:38.968710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:38.969039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:38.969663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:38.970614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:38.972939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:39.126162 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3415/6843] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:38 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:39.127809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:39.141372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851264d-5e52-48fc-9dc8-27e037fc2d08 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:39.147957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:39.149415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:39.150215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:39.150835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:39.152837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:39.154911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:39.174253 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3429/6844] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:39.178520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:39.200322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b05c-cef9-4ba5-9f50-17919425f816 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:39.220997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d99c7c-fa5a-44d7-982a-9518cc5074e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:39.221652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99c7c-fa5a-44d7-982a-9518cc5074e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:39.221948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99c7c-fa5a-44d7-982a-9518cc5074e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:39.222248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99c7c-fa5a-44d7-982a-9518cc5074e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:39.222981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d99c7c-fa5a-44d7-982a-9518cc5074e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:39.225366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d99c7c-fa5a-44d7-982a-9518cc5074e1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:39.257007 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3416/6845] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:39.258526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:39.277951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab150f-4096-4311-8e6e-1121d8003140 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:39.284297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:39.285212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:39.285769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:39.286314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] PATH_INFO: `/v3/projects/badd5be221a846faa773780fc5cb16b6/users/d0f16cce396f42b588f2c67d06eabd67/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:39.309663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badd5be221a846faa773780fc5cb16b6, user_id=d0f16cce396f42b588f2c67d06eabd67, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:39.314555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:39.394883 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3430/6846] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:39 2022] PUT /identity/v3/projects/badd5be221a846faa773780fc5cb16b6/users/d0f16cce396f42b588f2c67d06eabd67/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:39.406038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:39.406522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:39.406900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:39.465332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] MFA Rules not processed for user `d0f16cce396f42b588f2c67d06eabd67`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:39.466580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:39.506290 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:39.598053 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3417/6847] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:39.614362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:39.617916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:39.637913 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:39.701682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dced7-3025-4e4e-a86d-39cbe1c57ad0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:39.712971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68ddff-059c-4fb0-9bd8-02c46f3467c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:39.713616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68ddff-059c-4fb0-9bd8-02c46f3467c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:39.713888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68ddff-059c-4fb0-9bd8-02c46f3467c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:39.714216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68ddff-059c-4fb0-9bd8-02c46f3467c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:39.730591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68ddff-059c-4fb0-9bd8-02c46f3467c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:39.732645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68ddff-059c-4fb0-9bd8-02c46f3467c0 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:39.745311 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3431/6848] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:40.973702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:40.976435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:41.158485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57247d26-2457-4be4-acc3-55d740031f06 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:41.169491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:41.169491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:41.169491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:41.169491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] PATH_INFO: `/v3/users/8c63b0a47d904512ac8101457b1b03b0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:41.170159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c63b0a47d904512ac8101457b1b03b0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:41.173088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:41.432133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c63b0a47d904512ac8101457b1b03b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:41.445404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c63b0a47d904512ac8101457b1b03b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:41.448206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c63b0a47d904512ac8101457b1b03b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:41.549654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c63b0a47d904512ac8101457b1b03b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:41.550333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c63b0a47d904512ac8101457b1b03b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:41.587299 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3418/6849] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:40 2022] DELETE /identity/v3/users/8c63b0a47d904512ac8101457b1b03b0 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:41.592427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382115d-3f03-4802-843d-f760468ca041 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:41.593397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382115d-3f03-4802-843d-f760468ca041 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:41.593878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382115d-3f03-4802-843d-f760468ca041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:41.658880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e382115d-3f03-4802-843d-f760468ca041 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:41.661566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e382115d-3f03-4802-843d-f760468ca041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:41.821313 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3432/6850] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:41.874755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:41.876358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:41.975806 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:42.043140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6f02-5fc3-4a36-80be-612a293f2224 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:42.057771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ccab-8b54-4d02-9572-cb6d454a92b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:42.058510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ccab-8b54-4d02-9572-cb6d454a92b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:42.058789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ccab-8b54-4d02-9572-cb6d454a92b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:42.059087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ccab-8b54-4d02-9572-cb6d454a92b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:42.093312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ccab-8b54-4d02-9572-cb6d454a92b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:42.098232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39ccab-8b54-4d02-9572-cb6d454a92b9 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:42.125111 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3419/6851] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:42.759881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382115d-3f03-4802-843d-f760468ca041 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:42.761956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e382115d-3f03-4802-843d-f760468ca041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:42.788212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382115d-3f03-4802-843d-f760468ca041 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:42.813326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:42.813781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:42.814173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:42.814447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] PATH_INFO: `/v3/projects/dc5d6474babf4937b62a86b66b8a260b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:42.816621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5d6474babf4937b62a86b66b8a260b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:42.820619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:43.054486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5d6474babf4937b62a86b66b8a260b', 'request_id': 'req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:43.061162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5d6474babf4937b62a86b66b8a260b', 'request_id': 'req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:43.173328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5d6474babf4937b62a86b66b8a260b', 'request_id': 'req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:43.188848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] The token cache is being invalidate because project dc5d6474babf4937b62a86b66b8a260b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:43.189246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:43.189807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b0c3f068-078a-4a43-bf5e-2c646f15f2ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:43.191724 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3433/6852] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:42 2022] DELETE /identity/v3/projects/dc5d6474babf4937b62a86b66b8a260b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:43.196595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62087f37-e5c2-4f35-9426-8d61016968ca None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:43.197108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62087f37-e5c2-4f35-9426-8d61016968ca None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:43.197737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62087f37-e5c2-4f35-9426-8d61016968ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:43.223679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-62087f37-e5c2-4f35-9426-8d61016968ca None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:43.225590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62087f37-e5c2-4f35-9426-8d61016968ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:43.352154 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3420/6853] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:43.363143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d814-852e-4105-a51d-702af5d90648 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:43.366403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d814-852e-4105-a51d-702af5d90648 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:43.366897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d814-852e-4105-a51d-702af5d90648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:43.398778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7ce0d814-852e-4105-a51d-702af5d90648 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:43.400221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7ce0d814-852e-4105-a51d-702af5d90648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:43.421827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62087f37-e5c2-4f35-9426-8d61016968ca None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:43.422857 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3434/6854] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:43.434480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62087f37-e5c2-4f35-9426-8d61016968ca None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:43.441699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:43.443721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:43.443721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:43.443961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:43.446808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:43.447138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:43.450836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:43.496391 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3421/6855] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:42:43.500988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d814-852e-4105-a51d-702af5d90648 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:43.515566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d814-852e-4105-a51d-702af5d90648 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:43.527281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:43.527915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:43.528195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:43.528467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:43.529167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:43.531112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:43.689669 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3435/6856] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:43 2022] POST /identity/v3/projects => generated 357 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:43.690085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:43.704698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15a0e7-c69f-46ec-9599-63b35b072f35 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:43.800081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:43.801032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:43.801720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:43.802729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:43.803552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:43.807313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:43.938324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3422/6857] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:43 2022] POST /identity/v3/users => generated 279 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:42:43.942485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:43.955800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bef90-e883-43e0-9182-c10fa9e15a1f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:43.961695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:43.962757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:43.963204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:43.963642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:43.964772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:43.967058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:43.976720 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:43.994359 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3436/6858] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:43.996012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:44.010586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9cd0-44f7-4c72-ad9c-14c6a7e45748 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:44.016458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ecd0d-625d-458d-a009-80719797b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:44.018685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ecd0d-625d-458d-a009-80719797b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:44.019159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ecd0d-625d-458d-a009-80719797b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:44.019595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ecd0d-625d-458d-a009-80719797b5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:44.020455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ecd0d-625d-458d-a009-80719797b5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:44.022183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ecd0d-625d-458d-a009-80719797b5ab admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:44.048785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3423/6859] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:44.053221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:44.069553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f38ebf-240a-4107-8f94-a81e45e5236b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:44.076704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:44.078295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:44.078684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:44.078995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] PATH_INFO: `/v3/projects/760f723e50b54f6e828819d429a45938/users/f0faf1c3ae774f29899d8c69659a8004/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:44.100623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760f723e50b54f6e828819d429a45938, user_id=f0faf1c3ae774f29899d8c69659a8004, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:44.103735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:44.223718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3437/6860] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:44 2022] PUT /identity/v3/projects/760f723e50b54f6e828819d429a45938/users/f0faf1c3ae774f29899d8c69659a8004/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:44.231040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77febe6-279c-4159-b7e9-f890b1e39c16 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:44.231040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77febe6-279c-4159-b7e9-f890b1e39c16 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:44.231040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77febe6-279c-4159-b7e9-f890b1e39c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:44.277290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a77febe6-279c-4159-b7e9-f890b1e39c16 None None] MFA Rules not processed for user `f0faf1c3ae774f29899d8c69659a8004`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:44.278684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a77febe6-279c-4159-b7e9-f890b1e39c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:44.334677 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:44.397105 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3424/6861] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:44.402747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:44.513112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d974ce4-e86e-4a23-8aa3-204a866e4010 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:44.524730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:44.524730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:44.524730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:44.524730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:44.525373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:44.525373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:44.610682 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3438/6862] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:44 2022] POST /identity/v3/projects => generated 355 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:44.617901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77febe6-279c-4159-b7e9-f890b1e39c16 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:44.638749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77febe6-279c-4159-b7e9-f890b1e39c16 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:44.768677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:44.769401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:44.769757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:44.770130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:44.772163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:44.774394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:44.878017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3425/6863] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:44 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:44.879913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:44.896984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0b42-1e76-41b6-98fe-ad010fb5c5f9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:44.908450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:44.909412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:44.914437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:44.914437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:44.914437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:44.914437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:44.929171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3439/6864] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:44.933487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:44.946617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d999b1-a100-47fa-9094-9d676752e08f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:44.953600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:44.954687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:44.955128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:44.955587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] PATH_INFO: `/v3/projects/ed9e0789328246b4b9893aa8f67c1ddd/users/eed4b0b66f5c45a19bca5fb80e988d36/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:44.975987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9e0789328246b4b9893aa8f67c1ddd, user_id=eed4b0b66f5c45a19bca5fb80e988d36, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:44.979135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:45.013958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:45.016425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:45.048976 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3426/6865] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:44 2022] PUT /identity/v3/projects/ed9e0789328246b4b9893aa8f67c1ddd/users/eed4b0b66f5c45a19bca5fb80e988d36/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:42:45.050518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:45.121357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e544c-14f2-44b5-a9cf-d8a098a029e8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:45.139670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970a8f-5dd6-4e7c-ae48-757c391dcd88 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:45.144953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:45.145636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:45.145934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:45.146241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:45.146888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:45.148482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:45.164540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3427/6866] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:45.170623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:45.183866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30a0b-d69c-48a3-8cd2-5216b016a0a4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:45.192252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72713f1f-a9a9-486d-b722-a9596d3fb255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:45.193598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713f1f-a9a9-486d-b722-a9596d3fb255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:45.194659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713f1f-a9a9-486d-b722-a9596d3fb255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:45.199724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713f1f-a9a9-486d-b722-a9596d3fb255 admin admin] PATH_INFO: `/v3/projects/ed9e0789328246b4b9893aa8f67c1ddd/users/eed4b0b66f5c45a19bca5fb80e988d36/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:45.199724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72713f1f-a9a9-486d-b722-a9596d3fb255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9e0789328246b4b9893aa8f67c1ddd, user_id=eed4b0b66f5c45a19bca5fb80e988d36, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:45.203513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72713f1f-a9a9-486d-b722-a9596d3fb255 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:45.212126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:45.212971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:45.213438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:45.213795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:45.215860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:45.222835 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3428/6867] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:45 2022] PUT /identity/v3/projects/ed9e0789328246b4b9893aa8f67c1ddd/users/eed4b0b66f5c45a19bca5fb80e988d36/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:45.234241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e4211-60f6-488f-b773-958d46568245 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:45.234900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e4211-60f6-488f-b773-958d46568245 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:45.235007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e4211-60f6-488f-b773-958d46568245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:45.274328 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:45.281225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bd3e4211-60f6-488f-b773-958d46568245 None None] MFA Rules not processed for user `eed4b0b66f5c45a19bca5fb80e988d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:45.282581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bd3e4211-60f6-488f-b773-958d46568245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:45.295412 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:45.377477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:45.379502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:45.396860 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3440/6868] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:45.407529 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3429/6869] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:42:45.416668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:45.419966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:45.443949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a739a9-8c89-4300-9a51-52cdc2f568e2 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:45.553781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:45.554480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:45.554766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:45.555119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:45.570443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:45.571911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:45.582350 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3441/6870] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:45.928641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e4211-60f6-488f-b773-958d46568245 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:45.945051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e4211-60f6-488f-b773-958d46568245 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:45.949536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5dff-9e57-4ef6-b817-2c29fb1dfc95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:45.950381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5dff-9e57-4ef6-b817-2c29fb1dfc95 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:45.956806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5dff-9e57-4ef6-b817-2c29fb1dfc95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:45.956806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5dff-9e57-4ef6-b817-2c29fb1dfc95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:46.024676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5dff-9e57-4ef6-b817-2c29fb1dfc95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:46.026200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d5dff-9e57-4ef6-b817-2c29fb1dfc95 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:46.039831 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3430/6871] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:42:46.639880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:46.641350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:46.784566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fd26-6d80-46db-9bc8-32aa8e5351b2 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:46.791096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:46.792383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:46.792743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:46.793088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] PATH_INFO: `/v3/users/d0f16cce396f42b588f2c67d06eabd67` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:46.814567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f16cce396f42b588f2c67d06eabd67)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:46.819979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:47.026241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f16cce396f42b588f2c67d06eabd67'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:47.033293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f16cce396f42b588f2c67d06eabd67'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:47.033947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f16cce396f42b588f2c67d06eabd67'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:47.037061 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:47.166701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f16cce396f42b588f2c67d06eabd67'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:47.167396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f16cce396f42b588f2c67d06eabd67'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:47.191846 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3442/6872] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:46 2022] DELETE /identity/v3/users/d0f16cce396f42b588f2c67d06eabd67 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:47.196754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:47.197255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:47.197441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:47.218222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:47.219571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:47.311124 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3431/6873] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:47.319668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:47.321620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:47.388740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738eba8-82aa-42ab-8c80-4e8ec189377a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:47.392973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e13430-3a0d-4c15-859e-2cdb53b95b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:47.393900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13430-3a0d-4c15-859e-2cdb53b95b38 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:47.394228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13430-3a0d-4c15-859e-2cdb53b95b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:47.394886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13430-3a0d-4c15-859e-2cdb53b95b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:47.406050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e13430-3a0d-4c15-859e-2cdb53b95b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:47.407618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e13430-3a0d-4c15-859e-2cdb53b95b38 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:47.430229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3443/6874] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:48.239522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:48.241100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:48.261747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c9824-d63c-4e53-92b9-e40bb0892b2a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:48.267529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:48.268493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:48.269053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:48.269622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] PATH_INFO: `/v3/projects/badd5be221a846faa773780fc5cb16b6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:48.272544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badd5be221a846faa773780fc5cb16b6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:48.274944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:48.453533 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:48.494971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badd5be221a846faa773780fc5cb16b6', 'request_id': 'req-9cdaad40-26d5-4064-bf64-d303b20171f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:48.502152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badd5be221a846faa773780fc5cb16b6', 'request_id': 'req-9cdaad40-26d5-4064-bf64-d303b20171f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:48.658638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badd5be221a846faa773780fc5cb16b6', 'request_id': 'req-9cdaad40-26d5-4064-bf64-d303b20171f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:48.678929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] The token cache is being invalidate because project badd5be221a846faa773780fc5cb16b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:48.680411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:48.682120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9cdaad40-26d5-4064-bf64-d303b20171f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:48.684233 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3432/6875] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:48 2022] DELETE /identity/v3/projects/badd5be221a846faa773780fc5cb16b6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:48.689721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445916-2bf8-4c85-9d62-c74facb61b1d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:48.691273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445916-2bf8-4c85-9d62-c74facb61b1d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:48.691748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445916-2bf8-4c85-9d62-c74facb61b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:48.718684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-63445916-2bf8-4c85-9d62-c74facb61b1d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:48.720411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-63445916-2bf8-4c85-9d62-c74facb61b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:48.800341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781abbd-71b7-4b21-ab59-2c02b45163cb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:48.800610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781abbd-71b7-4b21-ab59-2c02b45163cb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:48.810336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781abbd-71b7-4b21-ab59-2c02b45163cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:48.810483 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3444/6876] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:48.823640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9781abbd-71b7-4b21-ab59-2c02b45163cb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:48.825009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9781abbd-71b7-4b21-ab59-2c02b45163cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:48.839812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445916-2bf8-4c85-9d62-c74facb61b1d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:48.849507 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3433/6877] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:48.852699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445916-2bf8-4c85-9d62-c74facb61b1d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:48.858488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:48.859107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:48.859740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:48.860125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:48.860661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:48.860963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:48.862909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:48.881376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781abbd-71b7-4b21-ab59-2c02b45163cb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:48.887377 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3445/6878] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:42:48.891329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781abbd-71b7-4b21-ab59-2c02b45163cb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:48.896388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:48.897200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:48.897540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:48.898083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:48.898794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:48.900890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:49.045930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:49.050085 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3434/6879] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:48 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:49.058758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26aa54-f25d-49dc-85ad-b8fadf2af8aa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:49.140897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:49.141514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:49.141862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:49.142155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:49.142913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:49.144874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:49.159111 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:49.263625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3446/6880] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:49 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:49.267676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:49.278710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab24df-9fcf-4aab-89db-b953616f8725 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:49.283899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:49.284585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:49.284922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:49.285216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:49.286008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:49.288333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:49.299626 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3435/6881] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:49.303552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:49.314488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba72b24-7923-4bc7-a45c-5188ca3500ff admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:49.320466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d253ba7-5004-424e-878c-09a860622976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:49.321477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d253ba7-5004-424e-878c-09a860622976 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:49.321762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d253ba7-5004-424e-878c-09a860622976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:49.322205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d253ba7-5004-424e-878c-09a860622976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:49.322820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d253ba7-5004-424e-878c-09a860622976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:49.324746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d253ba7-5004-424e-878c-09a860622976 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:49.346481 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3447/6882] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:49.347358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:49.363562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc0fd4-3df4-4eb5-8f6d-5ba42b561177 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:49.374155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:49.374869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:49.375150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:49.375423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] PATH_INFO: `/v3/projects/bdf0b30e253d446da7503652ce9920dd/users/016101a812cd477ab62765b82fab6748/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:49.407794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf0b30e253d446da7503652ce9920dd, user_id=016101a812cd477ab62765b82fab6748, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:49.415044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:49.507056 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3436/6883] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:49 2022] PUT /identity/v3/projects/bdf0b30e253d446da7503652ce9920dd/users/016101a812cd477ab62765b82fab6748/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:49.519067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:49.519353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:49.519774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:49.575602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] MFA Rules not processed for user `016101a812cd477ab62765b82fab6748`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:49.578920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:49.677249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3448/6884] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:49.690046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:49.692967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:49.787776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2dd52-ada5-4096-b08d-b4a57746549f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:49.792199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:49.794371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:49.794371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:49.794371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:49.805086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:49.806697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:49.817576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3437/6885] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:50.945078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:50.947360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:51.072954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a668ea1-9789-457a-aba8-f014e65ceb31 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:51.078208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:51.078826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:51.079107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:51.079379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:51.081109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:51.106119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:51.107901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:51.130584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:51.132371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:51.150657 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3449/6886] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:51.211733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf50a93-5ccd-4e8c-8a42-ef4ee4dc7c09 service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:51.216407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:51.216997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:51.217275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:51.217548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] PATH_INFO: `/v3/users/b094df884baf43a0824d210dfe6e8d26` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:51.218729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b094df884baf43a0824d210dfe6e8d26)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:51.220653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:51.227436 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:51.479711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b094df884baf43a0824d210dfe6e8d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:51.499844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b094df884baf43a0824d210dfe6e8d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:51.500716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b094df884baf43a0824d210dfe6e8d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:51.560911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b094df884baf43a0824d210dfe6e8d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:51.566542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b094df884baf43a0824d210dfe6e8d26'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:51.595017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3438/6887] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:51 2022] DELETE /identity/v3/users/b094df884baf43a0824d210dfe6e8d26 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:51.940731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:51.966863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c253f-4849-4cfe-8db3-1c92cf781a1b service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:52.081234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:52.081501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:52.081613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:52.081613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:52.081613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] PATH_INFO: `/v3/projects/4459f3c837db4fcaafc0e4aaed1600e0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:52.081933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:52.083186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4459f3c837db4fcaafc0e4aaed1600e0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:52.085163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:52.093642 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:52.150484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af23d9-d5c6-4b4d-8642-82b44d8f984b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:52.154290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:52.155012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:52.155267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:52.155540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:52.157552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:52.171040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:52.172504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:52.184838 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3439/6888] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:42:52.270967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4459f3c837db4fcaafc0e4aaed1600e0', 'request_id': 'req-aa56c880-3f72-4004-868e-32f07109be6a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.278688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4459f3c837db4fcaafc0e4aaed1600e0', 'request_id': 'req-aa56c880-3f72-4004-868e-32f07109be6a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.326905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4459f3c837db4fcaafc0e4aaed1600e0', 'request_id': 'req-aa56c880-3f72-4004-868e-32f07109be6a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.342130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] The token cache is being invalidate because project 4459f3c837db4fcaafc0e4aaed1600e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:52.342652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.343478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.345364 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3450/6889] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:51 2022] DELETE /identity/v3/projects/4459f3c837db4fcaafc0e4aaed1600e0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:52.350062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:52.354272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:52.372471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3defb-82a5-4840-98a1-59b67364ee56 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:52.447269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:52.448061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:52.448442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:52.448826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] PATH_INFO: `/v3/users/10c2f508584f4c41bed50c0dd477fe02` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:52.450379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c2f508584f4c41bed50c0dd477fe02)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:52.456123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:52.575842 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:52.703251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c2f508584f4c41bed50c0dd477fe02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.711671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c2f508584f4c41bed50c0dd477fe02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.712674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c2f508584f4c41bed50c0dd477fe02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.805127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c2f508584f4c41bed50c0dd477fe02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.805127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-533b34a8-160f-4363-8049-2521003dc46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c2f508584f4c41bed50c0dd477fe02'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:52.833019 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3440/6890] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:52 2022] DELETE /identity/v3/users/10c2f508584f4c41bed50c0dd477fe02 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:53.260188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:53.261629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:53.282393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c880-3f72-4004-868e-32f07109be6a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:53.365400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:53.366354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:53.366712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:53.367057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] PATH_INFO: `/v3/projects/6208791d12e94925923ed1a1a75bbd42` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:53.368338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6208791d12e94925923ed1a1a75bbd42)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:53.370346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:53.525759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6208791d12e94925923ed1a1a75bbd42', 'request_id': 'req-81639051-910d-4f7e-b6ef-65232f1d6439'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:53.534794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6208791d12e94925923ed1a1a75bbd42', 'request_id': 'req-81639051-910d-4f7e-b6ef-65232f1d6439'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:53.646862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6208791d12e94925923ed1a1a75bbd42', 'request_id': 'req-81639051-910d-4f7e-b6ef-65232f1d6439'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:53.662761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] The token cache is being invalidate because project 6208791d12e94925923ed1a1a75bbd42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:53.663250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:53.664162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-81639051-910d-4f7e-b6ef-65232f1d6439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:53.669702 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3451/6891] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:53 2022] DELETE /identity/v3/projects/6208791d12e94925923ed1a1a75bbd42 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:53.671370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fcad1-ed00-4391-b7e6-ce90d26826b9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:53.671855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fcad1-ed00-4391-b7e6-ce90d26826b9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:53.671958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fcad1-ed00-4391-b7e6-ce90d26826b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:53.702826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bb0fcad1-ed00-4391-b7e6-ce90d26826b9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:53.704050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bb0fcad1-ed00-4391-b7e6-ce90d26826b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:53.818250 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3441/6892] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:53.824447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d505d6-086f-4bcf-8d96-3e86db453330 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:53.824809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d505d6-086f-4bcf-8d96-3e86db453330 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:53.825083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d505d6-086f-4bcf-8d96-3e86db453330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:53.859965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f0d505d6-086f-4bcf-8d96-3e86db453330 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:53.859965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f0d505d6-086f-4bcf-8d96-3e86db453330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:53.867760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3452/6893] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:53.869264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fcad1-ed00-4391-b7e6-ce90d26826b9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:53.883529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fcad1-ed00-4391-b7e6-ce90d26826b9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:53.897170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:53.897929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:53.904434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:53.904434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:53.904434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:53.904434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:53.904434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:53.914967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3442/6894] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:42:53.920039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d505d6-086f-4bcf-8d96-3e86db453330 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:53.936136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d505d6-086f-4bcf-8d96-3e86db453330 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:53.943989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:53.945209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:53.945493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:53.945770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:53.946749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:53.949576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:53.969231 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:54.068207 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3453/6895] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:53 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:54.072904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:54.090500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07f58-1eb4-4e08-813d-d478e7b7bf48 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:54.148461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:54.149485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:54.149844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:54.150353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:54.151056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:54.153047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:54.303841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3443/6896] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:54 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:54.308288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:54.323105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6136b9-4c75-406c-94c6-e5376ac30c03 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:54.328611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:54.329361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:54.329646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:54.329918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:54.330643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:54.332316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:54.345446 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3454/6897] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:54.353007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:54.366347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8ca2f-9a87-422e-b6e5-72d6f6385832 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:54.373408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57db00-a581-4c53-acca-2049aa9eb0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:54.374110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57db00-a581-4c53-acca-2049aa9eb0aa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:54.374391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57db00-a581-4c53-acca-2049aa9eb0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:54.374664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57db00-a581-4c53-acca-2049aa9eb0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:54.375321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57db00-a581-4c53-acca-2049aa9eb0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:54.377023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57db00-a581-4c53-acca-2049aa9eb0aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:54.396298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:54.401556 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3444/6898] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:54.407301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7687-7154-4c69-8967-6a7d5e09c3a0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:54.414306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:54.415475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:54.415778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:54.416098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] PATH_INFO: `/v3/projects/3a0e3ada01d343859e1e256bad602c88/users/5c1419b980e04251964862d04b08fcdc/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:54.434972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0e3ada01d343859e1e256bad602c88, user_id=5c1419b980e04251964862d04b08fcdc, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:54.437847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:54.513702 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3455/6899] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:54 2022] PUT /identity/v3/projects/3a0e3ada01d343859e1e256bad602c88/users/5c1419b980e04251964862d04b08fcdc/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:54.519095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc716cf-e389-4116-936c-bc1f721ec8a9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:54.519439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc716cf-e389-4116-936c-bc1f721ec8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:54.519706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc716cf-e389-4116-936c-bc1f721ec8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:54.547963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0bc716cf-e389-4116-936c-bc1f721ec8a9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:54.550183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0bc716cf-e389-4116-936c-bc1f721ec8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:54.560636 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:54.643094 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3445/6900] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:42:54.649854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:54.653322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:54.760491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08effc-3ba1-44a6-9397-41878fe24cca admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:54.764377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbdeda-c75e-4eaa-9c84-ee4001de18c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:54.765092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbdeda-c75e-4eaa-9c84-ee4001de18c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:54.765474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbdeda-c75e-4eaa-9c84-ee4001de18c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:54.765781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbdeda-c75e-4eaa-9c84-ee4001de18c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:54.779900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbdeda-c75e-4eaa-9c84-ee4001de18c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:54.781454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbdeda-c75e-4eaa-9c84-ee4001de18c9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:54.792506 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3456/6901] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:55.480553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:55.481074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:55.484028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:55.531509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] MFA Rules not processed for user `5c1419b980e04251964862d04b08fcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:55.532792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:55.621412 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3446/6902] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:55.633124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357643-0e54-41da-9ff0-43824351c5e7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:55.633656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357643-0e54-41da-9ff0-43824351c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:55.640466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0357643-0e54-41da-9ff0-43824351c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:55.658275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e0357643-0e54-41da-9ff0-43824351c5e7 None None] MFA Rules not processed for user `5c1419b980e04251964862d04b08fcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:55.659903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0357643-0e54-41da-9ff0-43824351c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:55.667983 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3457/6903] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:55.681218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:55.683098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:55.802410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205c98c-d467-4e88-8996-f8dd571e4f80 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:55.813920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:55.815874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:55.816416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:55.817597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:55.831088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:55.832537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:55.846737 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3447/6904] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:42:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:42:56.618495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357643-0e54-41da-9ff0-43824351c5e7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:56.641990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0357643-0e54-41da-9ff0-43824351c5e7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:56.653513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:56.654319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:56.655564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:56.656636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] PATH_INFO: `/v3/users/5c1419b980e04251964862d04b08fcdc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:56.662134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1419b980e04251964862d04b08fcdc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:56.662134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:56.840760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1419b980e04251964862d04b08fcdc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:56.850720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1419b980e04251964862d04b08fcdc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:56.851521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1419b980e04251964862d04b08fcdc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:56.927662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1419b980e04251964862d04b08fcdc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:56.927662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9bc8bca1-376f-4ec1-aa23-53fc493922f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1419b980e04251964862d04b08fcdc'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:56.948732 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3458/6905] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:42:56 2022] DELETE /identity/v3/users/5c1419b980e04251964862d04b08fcdc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:57.261099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:57.274008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c1b4-3824-4c3c-bf91-2de7dfb89ff1 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:57.307086 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:57.341520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:57.342239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:57.342622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:57.342900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] PATH_INFO: `/v3/projects/3a0e3ada01d343859e1e256bad602c88` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:57.345877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0e3ada01d343859e1e256bad602c88)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:57.347838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:57.458561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0e3ada01d343859e1e256bad602c88', 'request_id': 'req-09866a31-5e27-4638-963e-73a155373e57'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:57.473677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0e3ada01d343859e1e256bad602c88', 'request_id': 'req-09866a31-5e27-4638-963e-73a155373e57'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:57.589414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0e3ada01d343859e1e256bad602c88', 'request_id': 'req-09866a31-5e27-4638-963e-73a155373e57'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:57.611392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] The token cache is being invalidate because project 3a0e3ada01d343859e1e256bad602c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:42:57.613110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:57.618788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-09866a31-5e27-4638-963e-73a155373e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:42:57.627747 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3448/6906] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:42:57 2022] DELETE /identity/v3/projects/3a0e3ada01d343859e1e256bad602c88 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:57.635632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aba58d-098c-4571-b5c9-a5cc15c99572 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:57.636129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aba58d-098c-4571-b5c9-a5cc15c99572 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:57.636831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aba58d-098c-4571-b5c9-a5cc15c99572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:57.663189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-35aba58d-098c-4571-b5c9-a5cc15c99572 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:57.665105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35aba58d-098c-4571-b5c9-a5cc15c99572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:57.708365 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:57.792312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3459/6907] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:57.794753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698561-fc31-4b9a-b2c2-6bc74f965f3d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:57.796370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698561-fc31-4b9a-b2c2-6bc74f965f3d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:57.796370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698561-fc31-4b9a-b2c2-6bc74f965f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:57.847674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-da698561-fc31-4b9a-b2c2-6bc74f965f3d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:57.851821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-da698561-fc31-4b9a-b2c2-6bc74f965f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:57.862079 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3449/6908] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:57.866964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aba58d-098c-4571-b5c9-a5cc15c99572 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:57.883410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aba58d-098c-4571-b5c9-a5cc15c99572 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:57.899145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:57.899795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:57.900080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:57.900355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:57.901037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:42:57.901344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:57.903096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:57.939323 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3460/6909] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:42:57.939431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698561-fc31-4b9a-b2c2-6bc74f965f3d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:57.951497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698561-fc31-4b9a-b2c2-6bc74f965f3d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:57.963356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:57.963356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:57.964936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:57.965239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:57.965913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:57.973927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:58.065840 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3450/6910] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:57 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:42:58.067314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:58.077573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0311ef-008a-4b0a-b6bf-c09cfb3f7861 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:58.176944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:58.177499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:58.178609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:58.178900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:58.180374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:58.183138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:58.294462 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3461/6911] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:58 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:58.298430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:58.320813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a7234-bf0a-4106-ae51-5e10858bc723 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:58.328482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:58.329119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:58.330126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:58.330429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:58.331111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:58.333056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:58.351544 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3451/6912] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:58.355181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:58.389144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c7e82-532b-400c-812c-17171df8b297 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:58.390327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a269226-7c96-4889-8198-da06eea2c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:58.391048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a269226-7c96-4889-8198-da06eea2c8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:58.391442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a269226-7c96-4889-8198-da06eea2c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:58.391813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a269226-7c96-4889-8198-da06eea2c8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:58.392733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a269226-7c96-4889-8198-da06eea2c8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:58.394470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a269226-7c96-4889-8198-da06eea2c8c9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:58.411479 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3462/6913] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:58.415375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:58.428437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f792e63-e985-4dcd-aa7b-676c51272ec4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:58.433562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:58.434385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:58.434767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:58.435133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] PATH_INFO: `/v3/projects/f1a8506ea1e34385bfbd60adf79c5e3b/users/090c3d1ca4e24065b19a56fc78488b0c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:58.453685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a8506ea1e34385bfbd60adf79c5e3b, user_id=090c3d1ca4e24065b19a56fc78488b0c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:58.456405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:58.585112 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3452/6914] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:58 2022] PUT /identity/v3/projects/f1a8506ea1e34385bfbd60adf79c5e3b/users/090c3d1ca4e24065b19a56fc78488b0c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:58.596239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2cdfc-53ce-4076-85b7-89ae28be833c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:58.596524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2cdfc-53ce-4076-85b7-89ae28be833c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:58.596798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2cdfc-53ce-4076-85b7-89ae28be833c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:58.627812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3cf2cdfc-53ce-4076-85b7-89ae28be833c None None] MFA Rules not processed for user `090c3d1ca4e24065b19a56fc78488b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:58.629242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3cf2cdfc-53ce-4076-85b7-89ae28be833c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:58.912045 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3463/6915] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:58.922320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:58.922320 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:58.922320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f9b7e-6e4f-497e-93f7-d60e064e89fc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:58.922320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:58.923491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:58.923491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:58.923491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:58.923491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:58.923491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:58.999163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3453/6916] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:42:58 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:42:59.003288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2cdfc-53ce-4076-85b7-89ae28be833c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:59.019028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2cdfc-53ce-4076-85b7-89ae28be833c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:59.054225 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:59.103627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:59.104286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.104542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.104814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.105452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:59.107503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:59.253156 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3464/6917] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:42:59 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:42:59.257030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:59.268506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab9655-684e-4d45-b1d7-d4d4800d7a41 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:59.277243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:59.278198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.278418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.278686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.279411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:59.281273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:59.303685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:59.303850 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3454/6918] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:42:59.319734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f10de-8188-406e-8ae2-2be398905750 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:59.339987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:59.352292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.352292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.352292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] PATH_INFO: `/v3/projects/cf7befa74617469dab4291728e504358/users/bf493a86b0e24d1fa5afecc2b9a8d9f3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.359117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7befa74617469dab4291728e504358, user_id=bf493a86b0e24d1fa5afecc2b9a8d9f3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:59.361802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:59.473578 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3465/6919] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:59 2022] PUT /identity/v3/projects/cf7befa74617469dab4291728e504358/users/bf493a86b0e24d1fa5afecc2b9a8d9f3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:59.473814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:59.497216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0226f-870b-4451-8ddb-ac41d24251cf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:59.561188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0f1e3-eea7-446f-8977-7f22b3b09c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:59.561833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0f1e3-eea7-446f-8977-7f22b3b09c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.562183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0f1e3-eea7-446f-8977-7f22b3b09c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.562463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0f1e3-eea7-446f-8977-7f22b3b09c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.563109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0f1e3-eea7-446f-8977-7f22b3b09c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:59.564753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0f1e3-eea7-446f-8977-7f22b3b09c43 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:59.580394 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3455/6920] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:42:59.584492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:59.596047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70c928-2e7c-4cc1-9d55-0b5d4afdcbd5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:59.601103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:59.601766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.602104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.602382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] PATH_INFO: `/v3/projects/cf7befa74617469dab4291728e504358/users/bf493a86b0e24d1fa5afecc2b9a8d9f3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.604592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7befa74617469dab4291728e504358, user_id=bf493a86b0e24d1fa5afecc2b9a8d9f3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:59.607238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:59.620044 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3466/6921] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:42:59 2022] PUT /identity/v3/projects/cf7befa74617469dab4291728e504358/users/bf493a86b0e24d1fa5afecc2b9a8d9f3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:42:59.636675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b1685-a59e-4d60-b56d-f692462ba90f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.637503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b1685-a59e-4d60-b56d-f692462ba90f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.637884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b1685-a59e-4d60-b56d-f692462ba90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.670931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-372b1685-a59e-4d60-b56d-f692462ba90f None None] MFA Rules not processed for user `bf493a86b0e24d1fa5afecc2b9a8d9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:42:59.673142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-372b1685-a59e-4d60-b56d-f692462ba90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:42:59.752931 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3456/6922] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:42:59.757933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:59.769135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf2b39-a23f-45a2-ad69-4b21c70362d1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:59.775698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:59.776579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.777028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.780226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.784349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:59.784349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:42:59.880443 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3467/6923] 10.222.0.42 () {60 vars in 1150 bytes} [Sun Oct 23 01:42:59 2022] POST /identity/v3/domains => generated 276 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:42:59.882566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b1685-a59e-4d60-b56d-f692462ba90f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:42:59.892686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b1685-a59e-4d60-b56d-f692462ba90f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:42:59.942907 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:42:59.962122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:42:59.962751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:42:59.963030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:42:59.963303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:42:59.963969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:42:59.965836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:00.049225 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3457/6924] 10.222.0.42 () {60 vars in 1150 bytes} [Sun Oct 23 01:42:59 2022] POST /identity/v3/domains => generated 276 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:00.053700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:00.064587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f9f7-ff84-4ae4-8ffe-cb4a120f9ace tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:00.160998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:00.161915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:00.162339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:00.162630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:00.163302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:00.164981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:00.247146 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3468/6925] 10.222.0.42 () {60 vars in 1150 bytes} [Sun Oct 23 01:43:00 2022] POST /identity/v3/domains => generated 276 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:00.251708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:00.263626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adfa1c-0edb-4bae-bb46-bb181a4c8192 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:00.328081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:00.328743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:00.329015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:00.329291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:00.329959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:00.332775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:00.449203 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3458/6926] 10.222.0.42 () {60 vars in 1150 bytes} [Sun Oct 23 01:43:00 2022] POST /identity/v3/domains => generated 279 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:00.453500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:00.468795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282ce3f-877a-4721-9e1e-013f96438331 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:00.566162 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:00.573718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:00.573853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:00.575360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:00.575651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/5bf798d1363541d78e3f4b1fabf9e152` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:00.592324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5bf798d1363541d78e3f4b1fabf9e152)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:00.593961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:00.620128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.623397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.753054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152', 'request_id': 'req-08f4464e-0fea-4424-b2d8-7c52eeea2752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.766705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152', 'request_id': 'req-08f4464e-0fea-4424-b2d8-7c52eeea2752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.877895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152', 'request_id': 'req-08f4464e-0fea-4424-b2d8-7c52eeea2752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.897274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] The token cache is being invalidate because project 5bf798d1363541d78e3f4b1fabf9e152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:00.900041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.900041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.908197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152', 'request_id': 'req-08f4464e-0fea-4424-b2d8-7c52eeea2752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.909062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152', 'request_id': 'req-08f4464e-0fea-4424-b2d8-7c52eeea2752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.914047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5bf798d1363541d78e3f4b1fabf9e152', 'request_id': 'req-08f4464e-0fea-4424-b2d8-7c52eeea2752'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:00.920936 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3469/6927] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:00 2022] DELETE /identity/v3/domains/5bf798d1363541d78e3f4b1fabf9e152 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:00.925961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:00.928314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:00.941383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f674-2b25-4d7a-8da4-e5f2e1b2844f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:01.015171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:01.015795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:01.016079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:01.016473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:01.017218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:01.018847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:01.167961 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3459/6928] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:43:00 2022] POST /identity/v3/domains => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:01.168851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:01.182578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4464e-0fea-4424-b2d8-7c52eeea2752 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:01.292592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:01.293523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:01.293803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:01.294108 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/85395012fba14e2caa2351834bfe599c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:01.308822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=85395012fba14e2caa2351834bfe599c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:01.310480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:01.336539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '85395012fba14e2caa2351834bfe599c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.342306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '85395012fba14e2caa2351834bfe599c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.348806 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:01.478823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '85395012fba14e2caa2351834bfe599c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.479737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '85395012fba14e2caa2351834bfe599c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.486286 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3470/6929] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:01 2022] PATCH /identity/v3/domains/85395012fba14e2caa2351834bfe599c => generated 250 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:01.487731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:01.499472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:01.523798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85405e8-0b67-49a1-a473-14894ea81c48 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:01.601807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:01.606011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:01.606011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:01.606011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/85395012fba14e2caa2351834bfe599c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:01.617839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=85395012fba14e2caa2351834bfe599c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:01.624057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:01.630412 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:01.660673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '85395012fba14e2caa2351834bfe599c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.664889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '85395012fba14e2caa2351834bfe599c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.792155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85395012fba14e2caa2351834bfe599c', 'request_id': 'req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.803123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85395012fba14e2caa2351834bfe599c', 'request_id': 'req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.881327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85395012fba14e2caa2351834bfe599c', 'request_id': 'req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.907820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] The token cache is being invalidate because project 85395012fba14e2caa2351834bfe599c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:01.908189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.909174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.922209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '85395012fba14e2caa2351834bfe599c', 'request_id': 'req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.922209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '85395012fba14e2caa2351834bfe599c', 'request_id': 'req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.926909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '85395012fba14e2caa2351834bfe599c', 'request_id': 'req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:01.933711 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3460/6930] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:01 2022] DELETE /identity/v3/domains/85395012fba14e2caa2351834bfe599c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:01.938545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:01.949918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b2c9-5942-40d0-b89f-0da2d21cf381 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:02.036161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:02.036948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:02.037297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:02.037880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:02.038658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:02.040409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:02.160122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3471/6931] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:43:01 2022] POST /identity/v3/domains => generated 278 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:02.163501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:02.165110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:02.179517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7fe64-6cca-4a85-b6c2-2b04337d8acf tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:02.251100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:02.251747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:02.252027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:02.252302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/28273e4dc96c432d9546fdf18bd2262c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:02.273207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=28273e4dc96c432d9546fdf18bd2262c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:02.277994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:02.309673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.311562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.405745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.406419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.423778 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3461/6932] 10.222.0.42 () {60 vars in 1250 bytes} [Sun Oct 23 01:43:02 2022] PATCH /identity/v3/domains/28273e4dc96c432d9546fdf18bd2262c => generated 278 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:02.428320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:02.430580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:02.447079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f98efd-ea6c-414a-bbdc-e8cc180ffb1e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:02.523865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:02.524510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:02.524849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:02.525183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/28273e4dc96c432d9546fdf18bd2262c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:02.536090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=28273e4dc96c432d9546fdf18bd2262c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:02.538118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:02.542836 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3472/6933] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:43:02 2022] GET /identity/v3/domains/28273e4dc96c432d9546fdf18bd2262c => generated 278 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:02.544906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:02.551438 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:02.555557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328cfd-2ffc-4592-a8ed-ce9f681f1006 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:02.560956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:02.561597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:02.562050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:02.562336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/28273e4dc96c432d9546fdf18bd2262c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:02.565666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=28273e4dc96c432d9546fdf18bd2262c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:02.565666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:02.599424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.602245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.732591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c', 'request_id': 'req-f56360ed-e403-4159-8322-3e161e512a4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.744958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c', 'request_id': 'req-f56360ed-e403-4159-8322-3e161e512a4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.869712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c', 'request_id': 'req-f56360ed-e403-4159-8322-3e161e512a4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.884441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] The token cache is being invalidate because project 28273e4dc96c432d9546fdf18bd2262c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:02.884784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.885394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.894216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c', 'request_id': 'req-f56360ed-e403-4159-8322-3e161e512a4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.895036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c', 'request_id': 'req-f56360ed-e403-4159-8322-3e161e512a4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.899237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '28273e4dc96c432d9546fdf18bd2262c', 'request_id': 'req-f56360ed-e403-4159-8322-3e161e512a4a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:02.912190 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3462/6934] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:02 2022] DELETE /identity/v3/domains/28273e4dc96c432d9546fdf18bd2262c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:02.916553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:02.918792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:02.945836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aec671-fc50-4a29-a7e8-3dadf472b35d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:03.022518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:03.025670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:03.026167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:03.026643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:03.027279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:03.029398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:03.053432 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3473/6935] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:43:02 2022] GET /identity/v3/domains => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:03.057908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:03.071307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56360ed-e403-4159-8322-3e161e512a4a tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:03.076917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:03.077567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:03.077904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:03.078206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/28273e4dc96c432d9546fdf18bd2262c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:03.085588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find domain: 28273e4dc96c432d9546fdf18bd2262c.: keystone.exception.DomainNotFound: Could not find domain: 28273e4dc96c432d9546fdf18bd2262c. Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 28273e4dc96c432d9546fdf18bd2262c. Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:03.090577 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:03.091747 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 28273e4dc96c432d9546fdf18bd2262c. Oct 23 01:43:03.092802 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:03.093949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3463/6936] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:03 2022] PATCH /identity/v3/domains/28273e4dc96c432d9546fdf18bd2262c => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 23 01:43:03.096799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:03.107847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4ae04-0be9-4bf6-b9a7-9a587470fb2c tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:03.112756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:03.114034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:03.114299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:03.114576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:03.115244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:03.116843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:03.795470 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:03.802084 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3474/6937] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:43:03 2022] POST /identity/v3/domains => generated 276 bytes in 706 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:03.806222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:03.819268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7c1bf-f917-4647-ad2d-8e688bd3cc36 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:03.883950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:03.885484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:03.885867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:03.886311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:03.887014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:03.889014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:04.013592 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3464/6938] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:03 2022] POST /identity/v3/users => generated 348 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:04.023174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:04.037806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40fac-35bd-41e4-adb0-9a129de06778 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:04.042613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:04.043486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:04.043769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:04.044043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/groups` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:04.044678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:04.046886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:04.164110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3475/6939] 10.222.0.42 () {60 vars in 1147 bytes} [Sun Oct 23 01:43:04 2022] POST /identity/v3/groups => generated 325 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:04.169062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:04.196240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12499ead-89e8-4767-af48-a11b19d17fc3 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:04.200948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:04.201591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:04.201866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:04.202165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/02f11ddf618a4335a08dd76223a346bf` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:04.203402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=02f11ddf618a4335a08dd76223a346bf)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:04.205022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:04.221421 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:04.231788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '02f11ddf618a4335a08dd76223a346bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.232532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '02f11ddf618a4335a08dd76223a346bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.400555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '02f11ddf618a4335a08dd76223a346bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.401203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '02f11ddf618a4335a08dd76223a346bf'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.403950 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3465/6940] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:04 2022] PATCH /identity/v3/domains/02f11ddf618a4335a08dd76223a346bf => generated 277 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:04.408033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:04.411366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:04.444712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfce61-61a8-4914-a6ae-016c9e0654b8 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:04.523316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:04.524174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:04.524428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:04.525130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/02f11ddf618a4335a08dd76223a346bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:04.539405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=02f11ddf618a4335a08dd76223a346bf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:04.541041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:04.565771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '02f11ddf618a4335a08dd76223a346bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.573169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '02f11ddf618a4335a08dd76223a346bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.888389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0680e7c0d31e470393d6aa53d86f3915'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.895310 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=1,keystone:DELETE=11 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:04.902316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0680e7c0d31e470393d6aa53d86f3915'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:04.903688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0680e7c0d31e470393d6aa53d86f3915'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.017764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0680e7c0d31e470393d6aa53d86f3915'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.036064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0680e7c0d31e470393d6aa53d86f3915'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.153485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f11ddf618a4335a08dd76223a346bf', 'request_id': 'req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.164705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f11ddf618a4335a08dd76223a346bf', 'request_id': 'req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.268842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f11ddf618a4335a08dd76223a346bf', 'request_id': 'req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.282075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] The token cache is being invalidate because project 02f11ddf618a4335a08dd76223a346bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:05.282474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.283229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.292561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '02f11ddf618a4335a08dd76223a346bf', 'request_id': 'req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.298568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '02f11ddf618a4335a08dd76223a346bf', 'request_id': 'req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.303666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '02f11ddf618a4335a08dd76223a346bf', 'request_id': 'req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:05.311456 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3476/6941] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:04 2022] DELETE /identity/v3/domains/02f11ddf618a4335a08dd76223a346bf => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:05.319807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.333766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6c1f-c4d7-4877-98e1-f626f406758f tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.424739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.426197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.429491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.430074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/02f11ddf618a4335a08dd76223a346bf` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.443193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=02f11ddf618a4335a08dd76223a346bf)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.446734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find domain: 02f11ddf618a4335a08dd76223a346bf.: keystone.exception.DomainNotFound: Could not find domain: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:05.465374 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:05.466653 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:05.467918 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3466/6942] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:43:05 2022] GET /identity/v3/domains/02f11ddf618a4335a08dd76223a346bf => generated 112 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:05.470985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.477090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:05.503187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a163fe-2f10-4d93-b4e7-289c5b1bc8d1 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.537386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.539205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.539494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.539806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/users/0680e7c0d31e470393d6aa53d86f3915` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.559298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:get_user(user_id=0680e7c0d31e470393d6aa53d86f3915)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.562587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find user: 0680e7c0d31e470393d6aa53d86f3915.: keystone.exception.UserNotFound: Could not find user: 0680e7c0d31e470393d6aa53d86f3915. Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 01:43:05.585571 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:05.587025 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 0680e7c0d31e470393d6aa53d86f3915. Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.588417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3477/6943] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:43:05 2022] GET /identity/v3/users/0680e7c0d31e470393d6aa53d86f3915 => generated 110 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:05.591391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.603629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac83198-3599-4645-af3c-ee675a82949e tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.606781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.607419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.607698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.607966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/groups/7a322469e5224f83b44694183edcc94f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.612965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:get_group(group_id=7a322469e5224f83b44694183edcc94f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.615517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find group: 7a322469e5224f83b44694183edcc94f.: keystone.exception.GroupNotFound: Could not find group: 7a322469e5224f83b44694183edcc94f. Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 23 01:43:05.630466 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:05.631612 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 7a322469e5224f83b44694183edcc94f. Oct 23 01:43:05.632765 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:05.635510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3467/6944] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:05 2022] GET /identity/v3/groups/7a322469e5224f83b44694183edcc94f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:05.639961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.651928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f11daa-0f25-40bc-b104-5ff996fb9534 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.656863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.657503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.657806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.658111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/groups/7a322469e5224f83b44694183edcc94f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.664437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find group: 7a322469e5224f83b44694183edcc94f.: keystone.exception.GroupNotFound: Could not find group: 7a322469e5224f83b44694183edcc94f. Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 23 01:43:05.671360 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:05.672497 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 7a322469e5224f83b44694183edcc94f. Oct 23 01:43:05.673621 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.681442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.681866 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3478/6945] 10.222.0.42 () {58 vars in 1227 bytes} [Sun Oct 23 01:43:05 2022] DELETE /identity/v3/groups/7a322469e5224f83b44694183edcc94f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:05.693528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8bf0c-66fd-4bd5-9c84-3bb6f1226f98 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.699315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.700553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.700553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.700553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/users/0680e7c0d31e470393d6aa53d86f3915` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.712865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0680e7c0d31e470393d6aa53d86f3915)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.714762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find user: 0680e7c0d31e470393d6aa53d86f3915.: keystone.exception.UserNotFound: Could not find user: 0680e7c0d31e470393d6aa53d86f3915. Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 23 01:43:05.728098 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:05.729476 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 0680e7c0d31e470393d6aa53d86f3915. Oct 23 01:43:05.731002 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:05.732666 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3468/6946] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:05 2022] DELETE /identity/v3/users/0680e7c0d31e470393d6aa53d86f3915 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:05.733444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.744521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403df2a-349d-48e8-baa4-9e2018accbad tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.749431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.750088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.750373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.750690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/02f11ddf618a4335a08dd76223a346bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.758643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find domain: 02f11ddf618a4335a08dd76223a346bf.: keystone.exception.DomainNotFound: Could not find domain: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:05.764028 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.770504 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.771553 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.773043 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3479/6947] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:05 2022] PATCH /identity/v3/domains/02f11ddf618a4335a08dd76223a346bf => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:05.774347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.786352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd493-88cb-4581-9fa1-939293086942 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.791629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.792330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.792584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.792810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.793834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.795603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:05.820797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3469/6948] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:43:05 2022] GET /identity/v3/domains => generated 1346 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:05.821875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.833016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0edbca-c7cb-4556-8aa0-144dda24fb84 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.848925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.848925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.848925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.849326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.849326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:05.849326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.849326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:05.863295 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3480/6949] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:05 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:05.868071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.882102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c60c55-46b3-41e1-9a0f-f37b674b5a62 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.889824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.890215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.890438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.890719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.891587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-2057382188) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:05.891919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.893757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:05.907474 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3470/6950] 10.222.0.42 () {58 vars in 1199 bytes} [Sun Oct 23 01:43:05 2022] GET /identity/v3/domains?name=tempest-test_domain-2057382188 => generated 408 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:05.912330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.923336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6e8e-2fb2-45e9-9dda-d6cf56372cfc tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.927937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.928564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.928847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.929115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/02f11ddf618a4335a08dd76223a346bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.936510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Could not find domain: 02f11ddf618a4335a08dd76223a346bf.: keystone.exception.DomainNotFound: Could not find domain: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:05.942117 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:05.943381 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 02f11ddf618a4335a08dd76223a346bf. Oct 23 01:43:05.944448 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:05.945543 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3481/6951] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:05 2022] PATCH /identity/v3/domains/02f11ddf618a4335a08dd76223a346bf => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:05.947899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:05.959546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a443b6-d9c6-41ad-9702-6f4ad583f9ab tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:05.966610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:05.967348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:05.967688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:05.968159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/c5e8c94d951b429ab94c7588acf2e093` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:05.982866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c5e8c94d951b429ab94c7588acf2e093)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:05.984168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:06.047429 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3471/6952] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:05 2022] PATCH /identity/v3/domains/c5e8c94d951b429ab94c7588acf2e093 => generated 276 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:06.051412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:06.084702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db6195-6402-4341-8be1-ff59d75fe296 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:06.089894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:06.090569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:06.091062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:06.091339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/c5e8c94d951b429ab94c7588acf2e093` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:06.102787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c5e8c94d951b429ab94c7588acf2e093)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:06.104505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:06.133152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.137460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.154897 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:06.281914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093', 'request_id': 'req-988a72f1-edad-45e2-99cf-f41ba2a96589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.287992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093', 'request_id': 'req-988a72f1-edad-45e2-99cf-f41ba2a96589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.372156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093', 'request_id': 'req-988a72f1-edad-45e2-99cf-f41ba2a96589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.390339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] The token cache is being invalidate because project c5e8c94d951b429ab94c7588acf2e093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:06.390629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.391293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.400172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093', 'request_id': 'req-988a72f1-edad-45e2-99cf-f41ba2a96589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.400894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093', 'request_id': 'req-988a72f1-edad-45e2-99cf-f41ba2a96589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.405286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c5e8c94d951b429ab94c7588acf2e093', 'request_id': 'req-988a72f1-edad-45e2-99cf-f41ba2a96589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.411703 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3482/6953] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:06 2022] DELETE /identity/v3/domains/c5e8c94d951b429ab94c7588acf2e093 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:06.416864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:06.418885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:06.432098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac76b-aea3-4952-9acc-76e49aadc40d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:06.466395 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:06.505518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:06.506219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:06.506515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:06.506771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/4fe1d605919246d78d7c804d5bf12634` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:06.522935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4fe1d605919246d78d7c804d5bf12634)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:06.524854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:06.549944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4fe1d605919246d78d7c804d5bf12634'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.550760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4fe1d605919246d78d7c804d5bf12634'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.668546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4fe1d605919246d78d7c804d5bf12634'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.669457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4fe1d605919246d78d7c804d5bf12634'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.673576 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3472/6954] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:06 2022] PATCH /identity/v3/domains/4fe1d605919246d78d7c804d5bf12634 => generated 277 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:06.677513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:06.689032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a72f1-edad-45e2-99cf-f41ba2a96589 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:06.768616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:06.769531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:06.770012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:06.770421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/4fe1d605919246d78d7c804d5bf12634` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:06.781906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4fe1d605919246d78d7c804d5bf12634)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:06.787365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:06.811834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4fe1d605919246d78d7c804d5bf12634'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.817722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4fe1d605919246d78d7c804d5bf12634'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.943968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe1d605919246d78d7c804d5bf12634', 'request_id': 'req-b6246e26-9e6b-4508-bae7-3296af566bb6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:06.946382 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:06.952346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe1d605919246d78d7c804d5bf12634', 'request_id': 'req-b6246e26-9e6b-4508-bae7-3296af566bb6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.045919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe1d605919246d78d7c804d5bf12634', 'request_id': 'req-b6246e26-9e6b-4508-bae7-3296af566bb6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.059382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] The token cache is being invalidate because project 4fe1d605919246d78d7c804d5bf12634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:07.059671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.070116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.070116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4fe1d605919246d78d7c804d5bf12634', 'request_id': 'req-b6246e26-9e6b-4508-bae7-3296af566bb6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.070116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4fe1d605919246d78d7c804d5bf12634', 'request_id': 'req-b6246e26-9e6b-4508-bae7-3296af566bb6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.073081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4fe1d605919246d78d7c804d5bf12634', 'request_id': 'req-b6246e26-9e6b-4508-bae7-3296af566bb6'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.080483 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3483/6955] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:06 2022] DELETE /identity/v3/domains/4fe1d605919246d78d7c804d5bf12634 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:07.085223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:07.087091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:07.101197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54760585-b48d-4b01-9b3d-19db8ebf534b tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:07.165983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:07.166782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:07.167220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:07.167538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/07d76540dd9c4313a4e60d098ff36d2e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:07.179963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=07d76540dd9c4313a4e60d098ff36d2e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:07.181634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:07.205347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.206658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.334361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.335271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.340882 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3473/6956] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:07 2022] PATCH /identity/v3/domains/07d76540dd9c4313a4e60d098ff36d2e => generated 277 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:07.343173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:07.344737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:07.358643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6246e26-9e6b-4508-bae7-3296af566bb6 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:07.433740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf493a86b0e24d1fa5afecc2b9a8d9f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7befa74617469dab4291728e504358', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:07.434422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:07.434712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:07.434986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] PATH_INFO: `/v3/domains/07d76540dd9c4313a4e60d098ff36d2e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:07.446339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=07d76540dd9c4313a4e60d098ff36d2e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:07.448127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:07.474076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:07.485209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.313504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e', 'request_id': 'req-5afbc830-4dc1-4d31-b50d-deaaa702c62d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.320765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e', 'request_id': 'req-5afbc830-4dc1-4d31-b50d-deaaa702c62d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.406016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e', 'request_id': 'req-5afbc830-4dc1-4d31-b50d-deaaa702c62d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.419653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] The token cache is being invalidate because project 07d76540dd9c4313a4e60d098ff36d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:08.419904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.420668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.433949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e', 'request_id': 'req-5afbc830-4dc1-4d31-b50d-deaaa702c62d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.436738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e', 'request_id': 'req-5afbc830-4dc1-4d31-b50d-deaaa702c62d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.440619 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:08.442750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5afbc830-4dc1-4d31-b50d-deaaa702c62d tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '07d76540dd9c4313a4e60d098ff36d2e', 'request_id': 'req-5afbc830-4dc1-4d31-b50d-deaaa702c62d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.452268 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3484/6957] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:07 2022] DELETE /identity/v3/domains/07d76540dd9c4313a4e60d098ff36d2e => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:08.457448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:08.460128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:08.521878 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:08.547586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99a87-bfd0-4468-982b-7834af84c943 tempest-DomainsTestJSON-652701708 tempest-DomainsTestJSON-652701708-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:08.615906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:08.616557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:08.616836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:08.617107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] PATH_INFO: `/v3/users/090c3d1ca4e24065b19a56fc78488b0c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:08.618314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090c3d1ca4e24065b19a56fc78488b0c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:08.620229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:08.864352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090c3d1ca4e24065b19a56fc78488b0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.871491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090c3d1ca4e24065b19a56fc78488b0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.872161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090c3d1ca4e24065b19a56fc78488b0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.936396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090c3d1ca4e24065b19a56fc78488b0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.937117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090c3d1ca4e24065b19a56fc78488b0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:08.962140 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3474/6958] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:08 2022] DELETE /identity/v3/users/090c3d1ca4e24065b19a56fc78488b0c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:08.966552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:08.966864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:08.967208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:08.990109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:08.991339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:09.062023 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3485/6959] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:09.070665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:09.072115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:09.148512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6be679-5367-4086-b6f9-23739214f026 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:09.165271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:09.166009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:09.166682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:09.166823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:09.184282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:09.185806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:09.198945 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3475/6960] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:09.810782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:09.813314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:09.840853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eed293-07f7-4103-9809-dba47ac2b92a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:09.869994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:09.870652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:09.870931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:09.871200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] PATH_INFO: `/v3/projects/f1a8506ea1e34385bfbd60adf79c5e3b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:09.872363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a8506ea1e34385bfbd60adf79c5e3b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:09.874466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:10.041929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a8506ea1e34385bfbd60adf79c5e3b', 'request_id': 'req-14804061-4fdd-4f84-bf1d-029d6b9c91b1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.048324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a8506ea1e34385bfbd60adf79c5e3b', 'request_id': 'req-14804061-4fdd-4f84-bf1d-029d6b9c91b1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.193443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a8506ea1e34385bfbd60adf79c5e3b', 'request_id': 'req-14804061-4fdd-4f84-bf1d-029d6b9c91b1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.210362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] The token cache is being invalidate because project f1a8506ea1e34385bfbd60adf79c5e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:10.210970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.211875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.218385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:10.229911 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3486/6961] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:09 2022] DELETE /identity/v3/projects/f1a8506ea1e34385bfbd60adf79c5e3b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:10.232239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d18b53-4c1b-4d2c-8409-b6e6f12ab041 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:10.240573 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:10.351817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:10.352547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:10.352902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:10.353302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] PATH_INFO: `/v3/users/bf493a86b0e24d1fa5afecc2b9a8d9f3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:10.354499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf493a86b0e24d1fa5afecc2b9a8d9f3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:10.356470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:10.622823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf493a86b0e24d1fa5afecc2b9a8d9f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.631795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf493a86b0e24d1fa5afecc2b9a8d9f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.632833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf493a86b0e24d1fa5afecc2b9a8d9f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.692271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf493a86b0e24d1fa5afecc2b9a8d9f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.699044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-57afd957-2475-48ed-a20a-e9b4ed84250e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf493a86b0e24d1fa5afecc2b9a8d9f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:10.731673 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3476/6962] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:10 2022] DELETE /identity/v3/users/bf493a86b0e24d1fa5afecc2b9a8d9f3 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:11.281304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:11.282959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:11.306587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14804061-4fdd-4f84-bf1d-029d6b9c91b1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:11.428550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:11.428550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:11.428550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:11.428550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] PATH_INFO: `/v3/projects/cf7befa74617469dab4291728e504358` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:11.430112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7befa74617469dab4291728e504358)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:11.433244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:11.473918 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:11.574543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7befa74617469dab4291728e504358', 'request_id': 'req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:11.584610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7befa74617469dab4291728e504358', 'request_id': 'req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:11.674830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7befa74617469dab4291728e504358', 'request_id': 'req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:11.696120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] The token cache is being invalidate because project cf7befa74617469dab4291728e504358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:11.697436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:11.698716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40613cfc-f6ba-4c08-ac50-d9cc5e8be85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:11.701660 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3487/6963] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:11 2022] DELETE /identity/v3/projects/cf7befa74617469dab4291728e504358 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:11.707658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc102e6-f563-49a1-a6c9-dd38eb81b47f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:11.710145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc102e6-f563-49a1-a6c9-dd38eb81b47f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:11.711039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc102e6-f563-49a1-a6c9-dd38eb81b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:11.755612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7cc102e6-f563-49a1-a6c9-dd38eb81b47f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:11.758400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7cc102e6-f563-49a1-a6c9-dd38eb81b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:11.849381 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3477/6964] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:11.856176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28d15-bdcd-4d25-af7d-b184c3628a7c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:11.856594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28d15-bdcd-4d25-af7d-b184c3628a7c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:11.857041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28d15-bdcd-4d25-af7d-b184c3628a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:11.907330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2cc28d15-bdcd-4d25-af7d-b184c3628a7c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:11.908966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2cc28d15-bdcd-4d25-af7d-b184c3628a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:11.919629 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3488/6965] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:11.923930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc102e6-f563-49a1-a6c9-dd38eb81b47f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:11.950613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc102e6-f563-49a1-a6c9-dd38eb81b47f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:11.976543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:11.977182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:11.977462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:11.977731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:11.978439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:11.978739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:11.980323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:12.001271 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3478/6966] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:12.010691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc28d15-bdcd-4d25-af7d-b184c3628a7c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:12.021587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc28d15-bdcd-4d25-af7d-b184c3628a7c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:12.026336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:12.026951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:12.027226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:12.027495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:12.028123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:12.030380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:12.156596 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3489/6967] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:12 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:12.158257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:12.170417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a8e36-7b3f-43c2-80c9-921f9b8cc2a7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:12.184373 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:12.258081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:12.271882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:12.271882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:12.271882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:12.271882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:12.271882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:12.364620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:12.376627 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3479/6968] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:12 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:12.380538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e5cc6-2939-4b0b-b708-0b5cf1061839 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:12.387335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:12.387922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:12.390035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:12.390286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:12.391035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:12.393245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:12.419473 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3490/6969] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:12.423220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:12.435942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a3e6-c855-4ce9-b9bf-b161b5a1d283 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:12.442953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c86a5c-9e64-49c2-9d70-702c4a163ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:12.443950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86a5c-9e64-49c2-9d70-702c4a163ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:12.444309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86a5c-9e64-49c2-9d70-702c4a163ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:12.444578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86a5c-9e64-49c2-9d70-702c4a163ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:12.445303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c86a5c-9e64-49c2-9d70-702c4a163ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:12.446931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c86a5c-9e64-49c2-9d70-702c4a163ffe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:12.500563 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3480/6970] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:12.502164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:12.524729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ff96-1854-4eb1-a0e5-2b5ed024c38e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:12.541876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:12.542883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:12.548839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:12.548839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] PATH_INFO: `/v3/projects/0e91d72aceb64edd81d9621634bc724c/users/b0ce74d1ae9440dab4aeece94f8eecf9/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:12.580088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e91d72aceb64edd81d9621634bc724c, user_id=b0ce74d1ae9440dab4aeece94f8eecf9, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:12.583284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:12.717597 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3491/6971] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:12 2022] PUT /identity/v3/projects/0e91d72aceb64edd81d9621634bc724c/users/b0ce74d1ae9440dab4aeece94f8eecf9/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:12.729074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b80bec-963a-4e27-8682-0e152208dba0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:12.742131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b80bec-963a-4e27-8682-0e152208dba0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:12.742131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b80bec-963a-4e27-8682-0e152208dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:12.776084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-55b80bec-963a-4e27-8682-0e152208dba0 None None] MFA Rules not processed for user `b0ce74d1ae9440dab4aeece94f8eecf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:12.777357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-55b80bec-963a-4e27-8682-0e152208dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:12.864248 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3481/6972] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:12.868004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:12.955985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d45e-9ac9-4d06-ba50-88274bdf80d9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:12.962060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:12.962725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:12.963007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:12.963284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:12.963919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:12.966032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:13.069458 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3492/6973] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:12 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:13.070656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b80bec-963a-4e27-8682-0e152208dba0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:13.089374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b80bec-963a-4e27-8682-0e152208dba0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:13.201923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:13.202526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:13.202814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:13.203090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:13.203754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:13.205785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:13.309643 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3482/6974] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:13 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:13.322083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:13.332958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da32194-e751-47f4-8f1d-4d377d0a08a7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:13.337764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:13.338372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:13.338651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:13.338929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:13.339570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:13.341218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:13.354532 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3493/6975] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:13.358319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:13.377865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52822bf-0ecd-400c-93dd-fc0f0631c971 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:13.388683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:13.388683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:13.388683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:13.388683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] PATH_INFO: `/v3/projects/375212fab9c041ddafa929ac2b2b612e/users/6167c5d8fe19402284f4401679e34c9f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:13.403537 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:13.408195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=375212fab9c041ddafa929ac2b2b612e, user_id=6167c5d8fe19402284f4401679e34c9f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:13.411214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:13.499302 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3483/6976] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:13 2022] PUT /identity/v3/projects/375212fab9c041ddafa929ac2b2b612e/users/6167c5d8fe19402284f4401679e34c9f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:13.507324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:13.518205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb09e6-32f7-4975-a1c4-e35844074814 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:13.551125 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:13.606945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4ef8a-720c-4923-ab72-0cf1c4022d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:13.607565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4ef8a-720c-4923-ab72-0cf1c4022d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:13.607872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4ef8a-720c-4923-ab72-0cf1c4022d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:13.608110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4ef8a-720c-4923-ab72-0cf1c4022d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:13.608785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4ef8a-720c-4923-ab72-0cf1c4022d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:13.610492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4ef8a-720c-4923-ab72-0cf1c4022d5a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:13.629009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3494/6977] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:13.633340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:13.663629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52d47f-5850-43da-99f3-43a99988eccd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:13.670780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:13.671128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:13.671128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:13.673745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] PATH_INFO: `/v3/projects/375212fab9c041ddafa929ac2b2b612e/users/6167c5d8fe19402284f4401679e34c9f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:13.678852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375212fab9c041ddafa929ac2b2b612e, user_id=6167c5d8fe19402284f4401679e34c9f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:13.681504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:13.711941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3484/6978] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:13 2022] PUT /identity/v3/projects/375212fab9c041ddafa929ac2b2b612e/users/6167c5d8fe19402284f4401679e34c9f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:13.718020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b78c3-4c40-41ff-be0d-a42ccc7bc517 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:13.718379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b78c3-4c40-41ff-be0d-a42ccc7bc517 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:13.718596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b78c3-4c40-41ff-be0d-a42ccc7bc517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:13.768342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2c0b78c3-4c40-41ff-be0d-a42ccc7bc517 None None] MFA Rules not processed for user `6167c5d8fe19402284f4401679e34c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:13.770735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c0b78c3-4c40-41ff-be0d-a42ccc7bc517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:13.856215 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3495/6979] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:13.860868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:13.872313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a23f-228a-4c43-b5f3-e23ade808845 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:13.877159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:13.877773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:13.878142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:13.878450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/services` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:13.879112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:13.880823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:13.991567 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3485/6980] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:13 2022] POST /identity/v3/services => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:13.995398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b78c3-4c40-41ff-be0d-a42ccc7bc517 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:14.005777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b78c3-4c40-41ff-be0d-a42ccc7bc517 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:14.024416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:14.025043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:14.025319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:14.025589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:14.026285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:14.028527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:14.192260 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1720986950. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:14.192260 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:14.192260 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:14.340941 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3496/6981] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:43:13 2022] POST /identity/v3/endpoints => generated 361 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:14.345099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:14.356685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb3d14-97f3-4d89-a25c-79517bc41a46 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:14.388705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:14.389365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:14.389671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:14.390156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-1720986950` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:14.392991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1720986950)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:14.392991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:14.393631 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3486/6982] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:43:14 2022] GET /identity/v3/regions/tempest-region-1720986950 => generated 180 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:14.398199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:14.408760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06310f78-9fd2-41bd-8390-ef5ad9b786b7 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:14.413603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:14.414227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:14.414508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:14.414780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:14.415446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:14.417008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:14.556012 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3497/6983] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:14 2022] POST /identity/v3/services => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:14.560259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:14.571361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e892f21-532d-4a68-a8f7-7582e7a5df0d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:14.586963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:14.587543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:14.587950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:14.588232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:14.588910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:14.589920 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:14.589920 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:43:14.589920 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:14.590849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:14.742430 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-794661571. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:14.742430 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:14.742430 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:14.943212 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3487/6984] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:43:14 2022] POST /identity/v3/endpoints => generated 360 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:14.946874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:14.958811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691121-d0cf-4701-9bdc-752edaaeefc4 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:14.974311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:14.974936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:14.975213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:14.975480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-794661571` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:14.976051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-794661571)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:14.977231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:14.979116 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3498/6985] 10.222.0.42 () {58 vars in 1203 bytes} [Sun Oct 23 01:43:14 2022] GET /identity/v3/regions/tempest-region-794661571 => generated 178 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:14.983730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:14.996054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971198-3eda-42c3-a6bc-ddf1719b918b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.000728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.001342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.001629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.001902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.002621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:15.004219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:15.158572 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2070652432. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:15.158572 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:15.158572 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:15.316070 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3488/6986] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:43:14 2022] POST /identity/v3/endpoints => generated 360 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:15.320189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:15.330910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b260-e289-443a-9261-ebe9d121a88a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.374938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.375706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.376057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.376463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-2070652432` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.377162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2070652432)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:15.378508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:15.383473 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3499/6987] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:43:15 2022] GET /identity/v3/regions/tempest-region-2070652432 => generated 180 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:15.384510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:15.396097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3539a3-54eb-4dbf-9e39-eb2693fc6622 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.400938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.401549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.401827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.402148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.402760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:15.403765 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:15.403765 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:43:15.403765 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:15.404643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:15.414091 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3489/6988] 10.222.0.42 () {58 vars in 1134 bytes} [Sun Oct 23 01:43:15 2022] GET /identity/v3/endpoints => generated 4395 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:15.418423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:15.429039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d502b-3907-47c0-8a66-16f0f776ba6a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.434513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.435246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.435603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.435954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints/8b4047732d7446269a82560465d3d086` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.442142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=8b4047732d7446269a82560465d3d086)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:15.443659 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:15.443659 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:43:15.443659 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:15.445733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:15.446533 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3500/6989] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:15 2022] GET /identity/v3/endpoints/8b4047732d7446269a82560465d3d086 => generated 360 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:15.450848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:15.463295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f54b-92f4-42ac-8901-204b8fc71a11 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.468171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.468799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.469076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.469344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints/8b4047732d7446269a82560465d3d086` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.470580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8b4047732d7446269a82560465d3d086)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:15.471800 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:15.471800 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:43:15.471800 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:15.473727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:15.695148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8b4047732d7446269a82560465d3d086', 'request_id': 'req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:15.707587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3490/6990] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:15 2022] DELETE /identity/v3/endpoints/8b4047732d7446269a82560465d3d086 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:15.711357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:15.719081 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:15.723089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614935d5-756a-472b-9f4a-63dfe552e181 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.739427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.740647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.741080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.741498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.776530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:15.776530 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:15.776530 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:43:15.776530 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:15.776530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:15.776530 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3501/6991] 10.222.0.42 () {58 vars in 1134 bytes} [Sun Oct 23 01:43:15 2022] GET /identity/v3/endpoints => generated 4048 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:15.779941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:15.810656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00ca9-b2fb-4a53-b99d-57be47ff2b60 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.837806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.838731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.842278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.842784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints/8b4047732d7446269a82560465d3d086` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.857704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Could not find endpoint: 8b4047732d7446269a82560465d3d086.: keystone.exception.EndpointNotFound: Could not find endpoint: 8b4047732d7446269a82560465d3d086. Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._iter().one() Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._only_one_row( Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:15.879985 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 8b4047732d7446269a82560465d3d086. Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:15.881212 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:15.882491 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 8b4047732d7446269a82560465d3d086. Oct 23 01:43:15.883536 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:15.884631 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3491/6992] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:15 2022] DELETE /identity/v3/endpoints/8b4047732d7446269a82560465d3d086 => generated 114 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:15.888514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:15.904739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a7a4-0c40-49ba-b788-673aa33f1c34 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:15.915662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:15.916723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:15.916723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:15.916917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-2070652432` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:15.917383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2070652432)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:15.923997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.063235 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2070652432. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:16.063235 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:16.063235 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:16.077587 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3502/6993] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:43:15 2022] DELETE /identity/v3/regions/tempest-region-2070652432 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:16.085676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.101049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2585b-1508-4d28-8ff0-808d70f5adc9 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.127948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.128877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.129369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.130545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.131415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.137619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.149909 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3492/6994] 10.222.0.42 () {58 vars in 1134 bytes} [Sun Oct 23 01:43:16 2022] GET /identity/v3/endpoints => generated 4048 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:16.157570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.169798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aa918-aaff-4aa4-8b23-d6f2ac1b23d5 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.174508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.175147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.175452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.175731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.176378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Adding query filter params (service_id=b80539b4a7374594a3956c3889e5ab83) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:16.176683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.178461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.185293 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3503/6995] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:43:16 2022] GET /identity/v3/endpoints?service_id=b80539b4a7374594a3956c3889e5ab83 => generated 503 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:16.196186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.206977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846260a-a50d-447d-8b55-669e9aa7524c tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.211719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.212316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.212596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.212864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.213513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Adding query filter params (service_id=cd91bfb4f5824eb1b8cc38d29f3c08f9) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:16.213814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.215728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.223169 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3493/6996] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:43:16 2022] GET /identity/v3/endpoints?service_id=cd91bfb4f5824eb1b8cc38d29f3c08f9 => generated 502 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:16.227411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.238443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10bb12-3485-44e1-9744-5488fb4cf117 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.245290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.245915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.246288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.246712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.247379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:16.247755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.249532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.262827 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3504/6997] 10.222.0.42 () {58 vars in 1167 bytes} [Sun Oct 23 01:43:16 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:16.264036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.275192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29274f18-1567-41de-858f-e4df71093b47 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.280276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.280895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.281182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.281459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.282153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:16.282463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.284048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.291461 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3494/6998] 10.222.0.42 () {58 vars in 1171 bytes} [Sun Oct 23 01:43:16 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:16.314438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.328161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cd313-3b3a-4777-882f-76a8c2012c7b tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.334861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.335550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.340350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.340350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/services` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.340350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.340350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.531173 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3505/6999] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:16 2022] POST /identity/v3/services => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:16.532903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.548839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdfc8f-ba4a-4e9c-8e3a-0382764615a6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.568680 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:16.569703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.570595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.571100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.571473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.572398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.574286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.715074 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1890356137. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:16.715074 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:16.715074 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:16.885162 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3495/7000] 10.222.0.42 () {60 vars in 1156 bytes} [Sun Oct 23 01:43:16 2022] POST /identity/v3/endpoints => generated 361 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:16.886449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.898620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b03ea-4c9f-47db-8855-983196476352 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.915782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.916662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.917109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.917730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-1890356137` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.918476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1890356137)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.919561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:16.921453 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3506/7001] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:43:16 2022] GET /identity/v3/regions/tempest-region-1890356137 => generated 180 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:16.926346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:16.951311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7231a-c6f2-43c5-b86b-4cd4070aba18 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:16.960933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:16.963386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:16.965806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:16.966175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints/6dfa28a28b4a42ad8bf8b5d510965540` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:16.976534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=6dfa28a28b4a42ad8bf8b5d510965540)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:16.977637 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:16.977637 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:43:16.977637 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:16.982963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:17.248374 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-304630624. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:17.248374 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:17.248374 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:17.470398 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3496/7002] 10.222.0.42 () {60 vars in 1256 bytes} [Sun Oct 23 01:43:16 2022] PATCH /identity/v3/endpoints/6dfa28a28b4a42ad8bf8b5d510965540 => generated 362 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:17.480578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:17.496928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7040c8-ada5-4c49-8d5c-8b6aa1075aec tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:17.534000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:17.536490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:17.536813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:17.537097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-304630624` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:17.539340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-304630624)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:17.540693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:17.545401 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3507/7003] 10.222.0.42 () {58 vars in 1203 bytes} [Sun Oct 23 01:43:17 2022] GET /identity/v3/regions/tempest-region-304630624 => generated 178 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:17.555254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:17.582417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c30b3-40e9-48ca-891e-9148a19277b6 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:17.594372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:17.595841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:17.598047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:17.598047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints/6dfa28a28b4a42ad8bf8b5d510965540` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:17.606285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6dfa28a28b4a42ad8bf8b5d510965540)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:17.608463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:17.748416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6dfa28a28b4a42ad8bf8b5d510965540', 'request_id': 'req-be535f38-f232-43b2-8413-9131d62f0f58'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:17.771824 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3497/7004] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:17 2022] DELETE /identity/v3/endpoints/6dfa28a28b4a42ad8bf8b5d510965540 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:17.776200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:17.789769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a3a9b-e287-4e6b-a3aa-87b27b5e9abe tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:17.816147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:17.817012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:17.817448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:17.818212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-304630624` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:17.819468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-304630624)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:17.820242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:17.821942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:17.827571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:17.955036 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-304630624. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:17.955036 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:17.955036 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:17.955706 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3508/7005] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:43:17 2022] DELETE /identity/v3/regions/tempest-region-304630624 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:17.960005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:18.005787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7156a-b2e8-425b-8cb4-7d9c3d22dcfc tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:18.016022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:18.016831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.018361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.018788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-1890356137` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.019851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1890356137)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:18.023222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:18.151211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be535f38-f232-43b2-8413-9131d62f0f58 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:18.170489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:18.171172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.171548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.171919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] PATH_INFO: `/v3/users/f0faf1c3ae774f29899d8c69659a8004` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.173386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0faf1c3ae774f29899d8c69659a8004)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:18.176552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:18.193749 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1890356137. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:18.193749 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:18.193749 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:18.207782 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3509/7006] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:43:17 2022] DELETE /identity/v3/regions/tempest-region-1890356137 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:18.212986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:18.258799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061faf4-5ac0-4cd3-9941-d1bbd3073b2f tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:18.265343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:18.266034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.266480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.266874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/services/152dd25cb0be47d1966a73414dac09dd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.267466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_service(service_id=152dd25cb0be47d1966a73414dac09dd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:18.270430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:18.397944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3510/7007] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:18 2022] DELETE /identity/v3/services/152dd25cb0be47d1966a73414dac09dd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:18.399017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:18.421225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acda0e8-397b-4baf-97e7-0d8f1215d38d tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:18.426570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:18.427225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.427506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.427780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints/5fc41c1f914e4219946d29945319ae8f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.433529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5fc41c1f914e4219946d29945319ae8f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:18.436019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:18.508949 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:18.511571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0faf1c3ae774f29899d8c69659a8004'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:18.519277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0faf1c3ae774f29899d8c69659a8004'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:18.519971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0faf1c3ae774f29899d8c69659a8004'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:18.553739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5fc41c1f914e4219946d29945319ae8f', 'request_id': 'req-4cf719f2-2c67-40e3-973f-467cad423515'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:18.558990 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:18.564685 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3511/7008] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:18 2022] DELETE /identity/v3/endpoints/5fc41c1f914e4219946d29945319ae8f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:18.569241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:18.592228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf719f2-2c67-40e3-973f-467cad423515 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:18.598917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:18.599574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.599856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.600131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-794661571` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.600710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-794661571)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:18.602324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:18.708777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0faf1c3ae774f29899d8c69659a8004'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:18.709401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba7c4f7a-b454-4a2b-856c-d85e931ebf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0faf1c3ae774f29899d8c69659a8004'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:18.727701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3498/7009] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:17 2022] DELETE /identity/v3/users/f0faf1c3ae774f29899d8c69659a8004 => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:18.732067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.732351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.732623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.737819 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-794661571. To ensure interoperability, identifiers should be a valid uuid. Oct 23 01:43:18.737819 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 23 01:43:18.737819 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:18.746897 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3512/7010] 10.222.0.42 () {58 vars in 1206 bytes} [Sun Oct 23 01:43:18 2022] DELETE /identity/v3/regions/tempest-region-794661571 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:18.754757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:18.758675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:18.761573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:18.763372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:18.787472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b1c8-9fa0-4add-9548-8201f1c1e956 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:18.838916 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3499/7011] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:18 2022] POST /identity/v3/auth/tokens => generated 3689 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:18.851750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:18.853712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:18.857557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:18.859071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.859449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.859841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/services/cd91bfb4f5824eb1b8cc38d29f3c08f9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.860533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cd91bfb4f5824eb1b8cc38d29f3c08f9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:18.862382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:18.933595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3d00c-ef9c-4024-8b78-4ff116c4de65 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:18.937850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:18.938785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:18.939164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:18.939536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:18.950237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:18.951861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:18.965251 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3500/7012] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:18 2022] GET /identity/v3/auth/tokens => generated 3689 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:19.048573 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3513/7013] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:18 2022] DELETE /identity/v3/services/cd91bfb4f5824eb1b8cc38d29f3c08f9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:19.052626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:19.068911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a754a-d8c1-4a23-b362-1a5508a1eae2 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:19.103080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:19.104403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:19.104933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:19.105681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/endpoints/7d292fb1fcdd4f5782ca5bf20b72924d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:19.116417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7d292fb1fcdd4f5782ca5bf20b72924d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:19.119329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:19.273920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7d292fb1fcdd4f5782ca5bf20b72924d', 'request_id': 'req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:19.288358 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3501/7014] 10.222.0.42 () {58 vars in 1236 bytes} [Sun Oct 23 01:43:19 2022] DELETE /identity/v3/endpoints/7d292fb1fcdd4f5782ca5bf20b72924d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:19.289798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:19.301333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccfddb-daed-421b-b4b6-46b3ec5426ca tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:19.319232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:19.320141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:19.320656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:19.320993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/regions/tempest-region-1720986950` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:19.321709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1720986950)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:19.323571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:19.449808 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3514/7015] 10.222.0.42 () {58 vars in 1209 bytes} [Sun Oct 23 01:43:19 2022] DELETE /identity/v3/regions/tempest-region-1720986950 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:19.453773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:19.470062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d67ae7-da25-4b2d-94d8-ff53a1aaf919 tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:19.501723 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:19.506710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6167c5d8fe19402284f4401679e34c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '375212fab9c041ddafa929ac2b2b612e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:19.507633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:19.508930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:19.509217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] PATH_INFO: `/v3/services/b80539b4a7374594a3956c3889e5ab83` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:19.509819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b80539b4a7374594a3956c3889e5ab83)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:19.512718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:19.672040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:19.674654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:19.718370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3502/7016] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:19 2022] DELETE /identity/v3/services/b80539b4a7374594a3956c3889e5ab83 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:19.719966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:19.724350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:19.728058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66ece2-fb26-461a-944d-1afeeab1e36a tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:19.756007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f742f-8c9d-44b1-9d69-c475d1939b2e tempest-EndPointsTestJSON-723299102 tempest-EndPointsTestJSON-723299102-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:19.758782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:19.759432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:19.759688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:19.759968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] PATH_INFO: `/v3/projects/760f723e50b54f6e828819d429a45938` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:19.761090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760f723e50b54f6e828819d429a45938)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:19.762393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:19.763321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:19.763616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:19.764012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:19.764374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] PATH_INFO: `/v3/users/b0ce74d1ae9440dab4aeece94f8eecf9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:19.766055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ce74d1ae9440dab4aeece94f8eecf9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:19.768247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:20.209638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ce74d1ae9440dab4aeece94f8eecf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.224557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ce74d1ae9440dab4aeece94f8eecf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.227837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ce74d1ae9440dab4aeece94f8eecf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.232150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760f723e50b54f6e828819d429a45938', 'request_id': 'req-14fc65de-372d-47f3-a6b0-a58f0a17fa49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.234670 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:20.243590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760f723e50b54f6e828819d429a45938', 'request_id': 'req-14fc65de-372d-47f3-a6b0-a58f0a17fa49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.400100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ce74d1ae9440dab4aeece94f8eecf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.400875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ce74d1ae9440dab4aeece94f8eecf9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.425255 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3503/7017] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:19 2022] DELETE /identity/v3/users/b0ce74d1ae9440dab4aeece94f8eecf9 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:20.426116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:20.427465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:20.468193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760f723e50b54f6e828819d429a45938', 'request_id': 'req-14fc65de-372d-47f3-a6b0-a58f0a17fa49'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.485520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] The token cache is being invalidate because project 760f723e50b54f6e828819d429a45938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:20.485825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.486510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-14fc65de-372d-47f3-a6b0-a58f0a17fa49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:20.492450 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3515/7018] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:19 2022] DELETE /identity/v3/projects/760f723e50b54f6e828819d429a45938 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:20.493911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:20.494216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:20.494491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:20.514730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:20.515980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:20.537233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c730bb-20c8-49e4-98e1-d9c55bbec83b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:20.543773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:20.544513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:20.545045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:20.545268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:20.547222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:20.580125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3516/7019] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:20.583463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:20.583463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:20.585147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:20.587068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:20.600256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34770e-0924-4aa5-95b7-61144719e1fc None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:20.605108 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3504/7020] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:20.606134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:20.607402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:20.607684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:20.609031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:20.609493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:20.609943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] PATH_INFO: `/v3/users/eed4b0b66f5c45a19bca5fb80e988d36` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:20.617032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed4b0b66f5c45a19bca5fb80e988d36)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:20.617032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:20.648875 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:20.698635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97eb81-53bc-407b-b348-bf9eba4e1576 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:20.702533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:20.703191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:20.703475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:20.703746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:20.713272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:20.714794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:20.724440 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3505/7021] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:21.027464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed4b0b66f5c45a19bca5fb80e988d36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.036339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed4b0b66f5c45a19bca5fb80e988d36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.037123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed4b0b66f5c45a19bca5fb80e988d36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.143574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed4b0b66f5c45a19bca5fb80e988d36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.147313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed4b0b66f5c45a19bca5fb80e988d36'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.174324 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3517/7022] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:20 2022] DELETE /identity/v3/users/eed4b0b66f5c45a19bca5fb80e988d36 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:21.296181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:21.298106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:21.322597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188ff3-b984-4e13-878e-66ec42561041 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:21.410431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:21.411217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:21.411554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:21.422208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] PATH_INFO: `/v3/projects/0e91d72aceb64edd81d9621634bc724c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:21.422208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e91d72aceb64edd81d9621634bc724c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:21.422208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:21.595357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e91d72aceb64edd81d9621634bc724c', 'request_id': 'req-2a9b2bbe-2a10-48d3-84b7-a728249cb864'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.623925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e91d72aceb64edd81d9621634bc724c', 'request_id': 'req-2a9b2bbe-2a10-48d3-84b7-a728249cb864'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.721852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e91d72aceb64edd81d9621634bc724c', 'request_id': 'req-2a9b2bbe-2a10-48d3-84b7-a728249cb864'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.738632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] The token cache is being invalidate because project 0e91d72aceb64edd81d9621634bc724c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:21.738926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.739997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:21.741549 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3506/7023] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:21 2022] DELETE /identity/v3/projects/0e91d72aceb64edd81d9621634bc724c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:21.745701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:21.747404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:21.762451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bbbe-f2f5-4a7b-9012-c8dd84309c1e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:21.814887 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:21.827750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:21.828399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:21.828684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:21.828956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] PATH_INFO: `/v3/users/6167c5d8fe19402284f4401679e34c9f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:21.830155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6167c5d8fe19402284f4401679e34c9f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:21.833170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:22.020815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:22.022497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:22.039699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2bbe-2a10-48d3-84b7-a728249cb864 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:22.045882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:22.051143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:22.051143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:22.051143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] PATH_INFO: `/v3/projects/ed9e0789328246b4b9893aa8f67c1ddd` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:22.051143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9e0789328246b4b9893aa8f67c1ddd)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:22.051982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:22.157731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6167c5d8fe19402284f4401679e34c9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.166238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6167c5d8fe19402284f4401679e34c9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.167298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6167c5d8fe19402284f4401679e34c9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.256219 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:22.263386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9e0789328246b4b9893aa8f67c1ddd', 'request_id': 'req-5fe5481f-eb85-4244-a196-b97161cfe8d5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.270129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9e0789328246b4b9893aa8f67c1ddd', 'request_id': 'req-5fe5481f-eb85-4244-a196-b97161cfe8d5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.287114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6167c5d8fe19402284f4401679e34c9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.287725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0fdb1fa3-415c-44dc-9590-586603a3eaa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6167c5d8fe19402284f4401679e34c9f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.305763 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3518/7024] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:21 2022] DELETE /identity/v3/users/6167c5d8fe19402284f4401679e34c9f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:22.461544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9e0789328246b4b9893aa8f67c1ddd', 'request_id': 'req-5fe5481f-eb85-4244-a196-b97161cfe8d5'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.481736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] The token cache is being invalidate because project ed9e0789328246b4b9893aa8f67c1ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:22.482602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.484299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5fe5481f-eb85-4244-a196-b97161cfe8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:22.487901 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3507/7025] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:22 2022] DELETE /identity/v3/projects/ed9e0789328246b4b9893aa8f67c1ddd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:22.496572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68be013-7055-4efc-94c6-5e0a43405b6a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:22.496862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68be013-7055-4efc-94c6-5e0a43405b6a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:22.497134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68be013-7055-4efc-94c6-5e0a43405b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:22.523620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c68be013-7055-4efc-94c6-5e0a43405b6a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:22.524962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c68be013-7055-4efc-94c6-5e0a43405b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:22.602222 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3519/7026] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:22.606610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd14bd-d549-488a-bac0-838a21500fc7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:22.607130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd14bd-d549-488a-bac0-838a21500fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:22.607130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd14bd-d549-488a-bac0-838a21500fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:22.648592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b2cd14bd-d549-488a-bac0-838a21500fc7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:22.651993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b2cd14bd-d549-488a-bac0-838a21500fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:22.669436 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3508/7027] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:22.669927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68be013-7055-4efc-94c6-5e0a43405b6a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:22.681713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68be013-7055-4efc-94c6-5e0a43405b6a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:22.689721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:22.689721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:22.689721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:22.689721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:22.690327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:22.690608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:22.692465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:22.707405 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3520/7028] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:22.711445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd14bd-d549-488a-bac0-838a21500fc7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:22.721372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd14bd-d549-488a-bac0-838a21500fc7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:22.727634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:22.728264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:22.728539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:22.729317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:22.729601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:22.731484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:22.895819 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3509/7029] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:22 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:22.896807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:22.911986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbace9f-6d00-4c2f-9e0c-d09b42304ee2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:22.942315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:22.947211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:23.032282 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:23.040540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.041155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.041434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.041752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.042468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.043608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113ce80-b721-4639-bb50-0f91cd853051 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.045471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.050566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.052467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.053216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.053216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] PATH_INFO: `/v3/projects/375212fab9c041ddafa929ac2b2b612e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.055341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375212fab9c041ddafa929ac2b2b612e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.058554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.165077 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3521/7030] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:22 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:23.167407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.177157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad3324-2f39-4a1b-91ea-aab4241f63b3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.181949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.182574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.182852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.183145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.183835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.185893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.197110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3522/7031] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:23.204813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.209683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375212fab9c041ddafa929ac2b2b612e', 'request_id': 'req-1159f91d-d545-4118-b710-bf4b43ff8a34'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:23.216019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375212fab9c041ddafa929ac2b2b612e', 'request_id': 'req-1159f91d-d545-4118-b710-bf4b43ff8a34'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:23.218711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e194f-d44c-4a1d-a618-0e09586a0416 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.278699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.279222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.279501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.279768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.280405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.282025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.293537 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3523/7032] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:23.297739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.308427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d6f2-9ae7-4a66-aba5-3ea73a1e7896 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.313585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47768657-c79d-4dfb-8bba-343f86cffdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.314346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768657-c79d-4dfb-8bba-343f86cffdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.314623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768657-c79d-4dfb-8bba-343f86cffdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.314893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768657-c79d-4dfb-8bba-343f86cffdb9 admin admin] PATH_INFO: `/v3/projects/2f0242e43bf84628835bb978e367a26a/users/0c21a240070e46478f7e8bda47b02a37/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.318341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375212fab9c041ddafa929ac2b2b612e', 'request_id': 'req-1159f91d-d545-4118-b710-bf4b43ff8a34'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:23.333222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] The token cache is being invalidate because project 375212fab9c041ddafa929ac2b2b612e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:23.333222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:23.333222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1159f91d-d545-4118-b710-bf4b43ff8a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:23.335155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47768657-c79d-4dfb-8bba-343f86cffdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0242e43bf84628835bb978e367a26a, user_id=0c21a240070e46478f7e8bda47b02a37, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.335478 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3510/7033] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:22 2022] DELETE /identity/v3/projects/375212fab9c041ddafa929ac2b2b612e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:23.340237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c4872-1dc4-4400-8b8b-cc188a01a3c7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.340586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c4872-1dc4-4400-8b8b-cc188a01a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.341244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c4872-1dc4-4400-8b8b-cc188a01a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.341392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47768657-c79d-4dfb-8bba-343f86cffdb9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.361621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a96c4872-1dc4-4400-8b8b-cc188a01a3c7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:23.363405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a96c4872-1dc4-4400-8b8b-cc188a01a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:23.371688 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3511/7034] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:23.379488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d698-99cb-4ed5-b79a-0c8a4481d43b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.379770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d698-99cb-4ed5-b79a-0c8a4481d43b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.380042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d698-99cb-4ed5-b79a-0c8a4481d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.400238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7fa3d698-99cb-4ed5-b79a-0c8a4481d43b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:23.401487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7fa3d698-99cb-4ed5-b79a-0c8a4481d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:23.410464 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3512/7035] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:23.414487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3d698-99cb-4ed5-b79a-0c8a4481d43b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.424245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3d698-99cb-4ed5-b79a-0c8a4481d43b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.429653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.430310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.430589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.430857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.431518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:23.431819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.433428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.451688 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3513/7036] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:23.453131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.458911 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:23.464759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cffcd-206f-46b5-a69d-bf597545ad98 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.477439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.478175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.478392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.478664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.479457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.481499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.494841 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3524/7037] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:23 2022] PUT /identity/v3/projects/2f0242e43bf84628835bb978e367a26a/users/0c21a240070e46478f7e8bda47b02a37/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:23.506357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.506903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.507690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.537931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] MFA Rules not processed for user `0c21a240070e46478f7e8bda47b02a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:23.539226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:23.607084 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3525/7038] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:23.611571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.613529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:23.634222 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3514/7039] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:23 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:23.636320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.687806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879db61a-c94f-4787-969a-c2a43bde3da4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.731756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebf81e-ae94-47ed-a0c5-f865261c2d6e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.731756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.732142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.732490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.732777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.733582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.735671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.753943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88766284-d347-401a-861d-cf82549b260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.754600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88766284-d347-401a-861d-cf82549b260e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.754879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88766284-d347-401a-861d-cf82549b260e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.755147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88766284-d347-401a-861d-cf82549b260e admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.755774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88766284-d347-401a-861d-cf82549b260e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.757784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88766284-d347-401a-861d-cf82549b260e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.883452 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3515/7040] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:23 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:23.884490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.894716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc76243-090f-42fc-b298-ba2d5135410c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:23.899238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:23.899825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:23.900100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:23.900368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:23.900995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:23.902598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:23.914276 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3516/7041] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:23.917379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.921576 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3526/7042] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:23 2022] POST /identity/v3/projects => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:23.925484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88766284-d347-401a-861d-cf82549b260e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:23.929055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630295-c5fc-4184-8b4a-db5043f3b629 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.003867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88766284-d347-401a-861d-cf82549b260e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.007672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.008298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.008778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.009068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.010211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.014681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.016167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.017047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.018137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.018659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.019468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.022595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.033692 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3517/7043] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:24.043916 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:24.048323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.059623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676cd1-f92f-4b5c-b6b3-b5c70aaf360a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.064815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bd3ef-2696-4b24-b066-03e53252308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.065673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd3ef-2696-4b24-b066-03e53252308c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.065952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd3ef-2696-4b24-b066-03e53252308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.066306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd3ef-2696-4b24-b066-03e53252308c admin admin] PATH_INFO: `/v3/projects/31403fc84297466790ca1c26ee425cf8/users/1e8a61a687d0462f8495328807763680/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.086725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bd3ef-2696-4b24-b066-03e53252308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31403fc84297466790ca1c26ee425cf8, user_id=1e8a61a687d0462f8495328807763680, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.089570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bd3ef-2696-4b24-b066-03e53252308c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.180009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3527/7044] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:23 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:24.188134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.202509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207936e1-1a93-4b7b-a727-3cf586961673 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.207826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.208494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.208921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.209039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.209671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.211320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.226175 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3528/7045] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:24.227621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.239925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14469-0402-4754-8379-088bc78a8fd8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.248710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.249574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.250103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.250442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] PATH_INFO: `/v3/projects/215b9bb422f4449da14228ebd07e6930/users/9c41222b7aeb4b37adb8a3f420e7687f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.267549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215b9bb422f4449da14228ebd07e6930, user_id=9c41222b7aeb4b37adb8a3f420e7687f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.270767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.280774 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3518/7046] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:24 2022] PUT /identity/v3/projects/31403fc84297466790ca1c26ee425cf8/users/1e8a61a687d0462f8495328807763680/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:24.292435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5f1c-d81f-4b69-be0b-c7e58077efc3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.293588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5f1c-d81f-4b69-be0b-c7e58077efc3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.296954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5f1c-d81f-4b69-be0b-c7e58077efc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.326724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-966e5f1c-d81f-4b69-be0b-c7e58077efc3 None None] MFA Rules not processed for user `1e8a61a687d0462f8495328807763680`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:24.328081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-966e5f1c-d81f-4b69-be0b-c7e58077efc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:24.384883 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3529/7047] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:24 2022] PUT /identity/v3/projects/215b9bb422f4449da14228ebd07e6930/users/9c41222b7aeb4b37adb8a3f420e7687f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:24.385641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.390824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:24.403106 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:24.454677 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3519/7048] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:24.463801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5f1c-d81f-4b69-be0b-c7e58077efc3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.569130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21e4b4-7dc5-4fec-90ff-23ecb0c98429 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.581939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.583198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.586972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.587369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.591093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:24.602315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5f1c-d81f-4b69-be0b-c7e58077efc3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.737703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.739142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.739142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.739142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.740030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.741859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.762128 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3520/7049] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:24.764141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.779895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e426da0-ead6-4583-9fa2-8dd5d9c29a81 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.782090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.783708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.786667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.787484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.787918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.788339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.789122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.791251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.803147 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3530/7050] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:43:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:43:24.803984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.826939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5f6fb-013f-4781-aadb-055ca9a7eac1 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:24.837646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f484fc-f76e-44aa-85c6-80c8b7d62954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:24.838371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f484fc-f76e-44aa-85c6-80c8b7d62954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.838659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f484fc-f76e-44aa-85c6-80c8b7d62954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.838931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f484fc-f76e-44aa-85c6-80c8b7d62954 admin admin] PATH_INFO: `/v3/projects/215b9bb422f4449da14228ebd07e6930/users/9c41222b7aeb4b37adb8a3f420e7687f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.845088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f484fc-f76e-44aa-85c6-80c8b7d62954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215b9bb422f4449da14228ebd07e6930, user_id=9c41222b7aeb4b37adb8a3f420e7687f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:24.846237 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:24.857234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f484fc-f76e-44aa-85c6-80c8b7d62954 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:24.884011 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3531/7051] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:24 2022] PUT /identity/v3/projects/215b9bb422f4449da14228ebd07e6930/users/9c41222b7aeb4b37adb8a3f420e7687f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:24.885762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:24.889226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:24.889226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:24.937196 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3521/7052] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:24 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:24.938647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:24.952304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] MFA Rules not processed for user `9c41222b7aeb4b37adb8a3f420e7687f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:24.953551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:25.076684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b99c7-7151-4d30-99f4-ed8817b95fad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:25.092952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:25.114810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:25.114810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:25.114810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:25.114810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:25.114810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:25.119642 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3532/7053] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:25.125269 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:25.131129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:25.133295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:25.228643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e246a9a-4c4a-473e-8e40-77ae9fdf337d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:25.231983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:25.232718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:25.233102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:25.233494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:25.246988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:25.250296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:25.261122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3533/7054] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:43:25.370744 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3522/7055] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:24 2022] POST /identity/v3/users => generated 301 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:25.374536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:25.390723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f23b-7495-4612-8e5b-f7cb6add47b5 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:25.399632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:25.400634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:25.401139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:25.401836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:25.402743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:25.404605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:25.422920 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3534/7056] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:25.432174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:25.444167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3792-d730-4d86-bd5c-401aa13ee35e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:25.449106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:25.449785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:25.450092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:25.450858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] PATH_INFO: `/v3/projects/6ff8f92912714343ba450c8eec8a7d35/users/0e202f24f2444e198cbc991b180788bf/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:25.512328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff8f92912714343ba450c8eec8a7d35, user_id=0e202f24f2444e198cbc991b180788bf, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:25.515230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:25.670592 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3523/7057] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:25 2022] PUT /identity/v3/projects/6ff8f92912714343ba450c8eec8a7d35/users/0e202f24f2444e198cbc991b180788bf/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:25.671296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:25.686731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2c2f-dda3-48dd-9401-b054b58b3657 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:25.817468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e2c35-3dba-4190-80ca-f40a0d33344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:25.817468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e2c35-3dba-4190-80ca-f40a0d33344b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:25.817468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e2c35-3dba-4190-80ca-f40a0d33344b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:25.817468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e2c35-3dba-4190-80ca-f40a0d33344b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:25.818392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e2c35-3dba-4190-80ca-f40a0d33344b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:25.818392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e2c35-3dba-4190-80ca-f40a0d33344b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:25.832386 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3535/7058] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:25.836841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:25.857909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f563e9-de51-4575-8c8c-f7450e54145f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:25.870451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:25.872837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:25.873138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:25.873505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] PATH_INFO: `/v3/projects/6ff8f92912714343ba450c8eec8a7d35/users/0e202f24f2444e198cbc991b180788bf/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:25.880737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff8f92912714343ba450c8eec8a7d35, user_id=0e202f24f2444e198cbc991b180788bf, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:25.894033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:25.918703 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3524/7059] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:25 2022] PUT /identity/v3/projects/6ff8f92912714343ba450c8eec8a7d35/users/0e202f24f2444e198cbc991b180788bf/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:25.920951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296ab31-e840-4646-99fc-0de335ab4b69 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:25.921269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296ab31-e840-4646-99fc-0de335ab4b69 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:25.921523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296ab31-e840-4646-99fc-0de335ab4b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:25.959440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3296ab31-e840-4646-99fc-0de335ab4b69 None None] MFA Rules not processed for user `0e202f24f2444e198cbc991b180788bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:25.960878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3296ab31-e840-4646-99fc-0de335ab4b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:26.056548 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3536/7060] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:26.061183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.073309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9846-a6d8-4c39-9a09-c51cfaf867c2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.078835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.079727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.080078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.080423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects/31403fc84297466790ca1c26ee425cf8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.084715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:get_project(project_id=31403fc84297466790ca1c26ee425cf8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.100034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.100034 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3525/7061] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects/31403fc84297466790ca1c26ee425cf8 => generated 387 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:26.102836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296ab31-e840-4646-99fc-0de335ab4b69 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.115347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296ab31-e840-4646-99fc-0de335ab4b69 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.120162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.120883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.121165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.121439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.122300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.124228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.305526 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:26.320312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3537/7062] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:43:26 2022] POST /identity/v3/projects => generated 339 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:26.325578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.338732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4b891-465f-4f67-b9d0-60f91860d42a tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.466720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.474314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.475789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.476391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.477315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.479851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.519759 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3526/7063] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects => generated 6959 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:26.521118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.537292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c322b-a9b8-4ac1-8cf5-69692f43bb6c tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.547889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.548782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.549231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.550231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects/31403fc84297466790ca1c26ee425cf8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.552515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:get_project(project_id=31403fc84297466790ca1c26ee425cf8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.558087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.560641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.567831 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3538/7064] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects/31403fc84297466790ca1c26ee425cf8 => generated 387 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:26.574750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a30ca-4f96-4fcb-8d09-55d20efac7f5 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.580175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.581078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.581513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.588198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects/ac2a6ad768ea44349d65b711730c265d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.591693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac2a6ad768ea44349d65b711730c265d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.593824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.598917 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3527/7065] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects/ac2a6ad768ea44349d65b711730c265d => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:26.603720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.621633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3cd76-9934-40fa-9dd9-3050d527f699 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.635873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.638622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.644260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.644260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.644260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.644260 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:26.644260 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:43:26.644260 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:26.644898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.697008 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3539/7066] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects => generated 6959 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:26.699003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.713048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b34655-a25a-42ef-ae4b-482b45fa9361 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.722625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.723325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.723739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.724115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.724899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:26.725323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.727490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.767222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.771839 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3528/7067] 10.222.0.42 () {58 vars in 1166 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects?domain_id=default => generated 6628 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:26.782469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fc0f9-7129-47f6-b097-9c6f13d7e68e tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.796067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.796837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.797125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.797900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.798123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.800693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.842065 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3540/7068] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects => generated 6959 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:26.847737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.864966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd14db-45ce-42ac-9d2d-8335f5fc4c25 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.876310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:26.877744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:26.880018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:26.880505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:26.882076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:26.885180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:26.886358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:26.975155 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3529/7069] 10.222.0.42 () {58 vars in 1166 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects?domain_id=default => generated 6628 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:26.976478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:26.991329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aebbd-416f-47e2-bb34-b84209e1a9cf tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:26.999475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.000462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.001439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.002552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.003483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.006222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.012170 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:27.016255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:27.097652 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3541/7070] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:43:26 2022] GET /identity/v3/projects => generated 6959 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:27.102982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:27.115083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195589a-d09e-47ff-bb61-ff1c93835545 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:27.119660 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:27.120737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.121777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.122294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.122799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.123683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-429175597) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:27.124215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.126475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.133942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4f12-1d4d-42cf-a7bd-a0ffbd255efe tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:27.154038 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3542/7071] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:27 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-429175597 => generated 534 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:27.155410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:27.160103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c41222b7aeb4b37adb8a3f420e7687f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '215b9bb422f4449da14228ebd07e6930', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.160918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.161078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.161408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.162441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:27.162755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.166380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.172740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68a11-7baa-4d77-b4e7-6ae8a9e6e114 tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:27.179006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e202f24f2444e198cbc991b180788bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ff8f92912714343ba450c8eec8a7d35', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.180331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.181299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.181748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] PATH_INFO: `/v3/projects/ac2a6ad768ea44349d65b711730c265d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.183427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac2a6ad768ea44349d65b711730c265d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.185881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.196004 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3530/7072] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:27.204114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:27.229963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12cf99-0b7e-4797-a9d9-1aba5005daff tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:27.247005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c41222b7aeb4b37adb8a3f420e7687f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '215b9bb422f4449da14228ebd07e6930', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.247005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.247005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.249514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.250994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.257578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.363846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2a6ad768ea44349d65b711730c265d', 'request_id': 'req-b07dbee5-6426-4c82-afec-c8206484473d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.372155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2a6ad768ea44349d65b711730c265d', 'request_id': 'req-b07dbee5-6426-4c82-afec-c8206484473d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.421036 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3531/7073] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:27 2022] POST /identity/v3/projects => generated 354 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:27.435725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:27.447705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2a6ad768ea44349d65b711730c265d', 'request_id': 'req-b07dbee5-6426-4c82-afec-c8206484473d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.473580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] The token cache is being invalidate because project ac2a6ad768ea44349d65b711730c265d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:27.473901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.475803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.479054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3543/7074] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:27 2022] DELETE /identity/v3/projects/ac2a6ad768ea44349d65b711730c265d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:27.486835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:27.489084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:27.542318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ac92d-3931-4c44-b64b-d892f1d70408 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:27.551784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c41222b7aeb4b37adb8a3f420e7687f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '215b9bb422f4449da14228ebd07e6930', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.552618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.553017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.553927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.554780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:27.555429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.558272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.582020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3532/7075] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:27.609165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dbee5-6426-4c82-afec-c8206484473d tempest-ListProjectsStaticTestJSON-1761027705 tempest-ListProjectsStaticTestJSON-1761027705-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:27.661449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:27.664231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:27.706359 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:27.711770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1034-1e13-4f26-873f-3d857b63fec4 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:27.715008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c41222b7aeb4b37adb8a3f420e7687f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '215b9bb422f4449da14228ebd07e6930', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.715658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.715944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.716222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] PATH_INFO: `/v3/projects/dc72c7a6b4f74d86a09d850dbbfdd0a4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.717404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc72c7a6b4f74d86a09d850dbbfdd0a4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.719722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.738325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:27.739355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:27.739893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:27.740391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] PATH_INFO: `/v3/users/1e8a61a687d0462f8495328807763680` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:27.743947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8a61a687d0462f8495328807763680)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:27.751418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:27.874348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc72c7a6b4f74d86a09d850dbbfdd0a4', 'request_id': 'req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.882442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc72c7a6b4f74d86a09d850dbbfdd0a4', 'request_id': 'req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.966170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc72c7a6b4f74d86a09d850dbbfdd0a4', 'request_id': 'req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.985494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] The token cache is being invalidate because project dc72c7a6b4f74d86a09d850dbbfdd0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:27.986112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.988903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c4e0da77-7d77-42a6-aa7d-6a0da636bac1 tempest-VolumeQuotaClassesTest-1193857038 tempest-VolumeQuotaClassesTest-1193857038-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:27.992244 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3533/7076] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:27 2022] DELETE /identity/v3/projects/dc72c7a6b4f74d86a09d850dbbfdd0a4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:28.021036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8a61a687d0462f8495328807763680'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:28.030077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8a61a687d0462f8495328807763680'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:28.030926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8a61a687d0462f8495328807763680'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:28.135794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8a61a687d0462f8495328807763680'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:28.140232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8a61a687d0462f8495328807763680'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:28.173547 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3544/7077] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:27 2022] DELETE /identity/v3/users/1e8a61a687d0462f8495328807763680 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:28.175130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:28.175374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:28.175652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:28.194556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:28.195740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:28.233558 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:28.255887 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3534/7078] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:28.265852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:28.267311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:28.349806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e185c99-fa0a-4dd3-b244-ae6f1431390f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:28.354250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:28.354923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:28.355203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:28.355471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:28.370015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:28.371484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:28.382612 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3545/7079] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:28.914677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:28.921677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:28.935352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe28380-4a24-48ce-b189-0633fff20c77 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:28.944718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:28.945920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:28.946529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:28.947103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] PATH_INFO: `/v3/users/0c21a240070e46478f7e8bda47b02a37` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:28.948625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c21a240070e46478f7e8bda47b02a37)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:28.951624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:29.001360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:29.001360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:29.012330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66711d0d-c4b5-454d-9644-eae7e5040039 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:29.027472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:29.029442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:29.030945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:29.031406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] PATH_INFO: `/v3/projects/31403fc84297466790ca1c26ee425cf8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:29.040899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31403fc84297466790ca1c26ee425cf8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:29.044752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:29.222595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c21a240070e46478f7e8bda47b02a37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.227476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31403fc84297466790ca1c26ee425cf8', 'request_id': 'req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.242413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31403fc84297466790ca1c26ee425cf8', 'request_id': 'req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.243468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c21a240070e46478f7e8bda47b02a37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.244409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c21a240070e46478f7e8bda47b02a37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.353174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31403fc84297466790ca1c26ee425cf8', 'request_id': 'req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.366608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] The token cache is being invalidate because project 31403fc84297466790ca1c26ee425cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:29.367598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.367732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.369255 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3546/7080] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:28 2022] DELETE /identity/v3/projects/31403fc84297466790ca1c26ee425cf8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:29.373198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:29.374731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:29.422843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c21a240070e46478f7e8bda47b02a37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.425817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-17007e6e-1759-49a1-9136-c77f7167bf5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c21a240070e46478f7e8bda47b02a37'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.466905 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3535/7081] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:28 2022] DELETE /identity/v3/users/0c21a240070e46478f7e8bda47b02a37 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:29.471454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:29.472225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:29.472601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:29.476038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ea367-ed1b-4b2e-9ae5-c5fb87537638 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:29.499212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:29.500910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:29.576684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:29.589773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:29.590381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:29.590990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] PATH_INFO: `/v3/users/0e202f24f2444e198cbc991b180788bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:29.596826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e202f24f2444e198cbc991b180788bf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:29.596826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:29.615056 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3536/7082] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:29.625924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:29.628608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:29.691365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb749-8dc3-49b9-b9d5-51f049638b32 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:29.700851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:29.701593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:29.702311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:29.702419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:29.723897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:29.726283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:29.740575 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3537/7083] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:43:29.862897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e202f24f2444e198cbc991b180788bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.883472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e202f24f2444e198cbc991b180788bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:29.884681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e202f24f2444e198cbc991b180788bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.017563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e202f24f2444e198cbc991b180788bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.018457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e202f24f2444e198cbc991b180788bf'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.050523 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3547/7084] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:29 2022] DELETE /identity/v3/users/0e202f24f2444e198cbc991b180788bf => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:30.257496 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:30.385019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:30.387699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:30.404975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b868c-6ead-44b6-ba29-67e284ec96ee service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:30.484257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:30.485121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:30.485456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:30.485835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] PATH_INFO: `/v3/projects/2f0242e43bf84628835bb978e367a26a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:30.487813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0242e43bf84628835bb978e367a26a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:30.490050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:30.635954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:30.638902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:30.654203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c2ead-b370-4639-8ae3-f48ae8f7a3ab admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:30.665319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0242e43bf84628835bb978e367a26a', 'request_id': 'req-37a9568d-c29d-4b5c-8e05-f26371a45fe6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.680701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0242e43bf84628835bb978e367a26a', 'request_id': 'req-37a9568d-c29d-4b5c-8e05-f26371a45fe6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.713661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:30.714426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:30.714775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:30.715131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] PATH_INFO: `/v3/projects/6ff8f92912714343ba450c8eec8a7d35` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:30.716319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff8f92912714343ba450c8eec8a7d35)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:30.718477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:30.742902 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:30.770458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0242e43bf84628835bb978e367a26a', 'request_id': 'req-37a9568d-c29d-4b5c-8e05-f26371a45fe6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.783264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] The token cache is being invalidate because project 2f0242e43bf84628835bb978e367a26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:30.784102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.784759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.786311 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3538/7085] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:30 2022] DELETE /identity/v3/projects/2f0242e43bf84628835bb978e367a26a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:30.790215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:30.791551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:30.805502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9568d-c29d-4b5c-8e05-f26371a45fe6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:30.813515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:30.813515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:30.813515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:30.813515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] PATH_INFO: `/v3/users/9c41222b7aeb4b37adb8a3f420e7687f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:30.814163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c41222b7aeb4b37adb8a3f420e7687f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:30.814677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:30.850958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff8f92912714343ba450c8eec8a7d35', 'request_id': 'req-fe8ce894-c184-4f97-a319-549d4b8df697'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.856216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff8f92912714343ba450c8eec8a7d35', 'request_id': 'req-fe8ce894-c184-4f97-a319-549d4b8df697'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.955112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff8f92912714343ba450c8eec8a7d35', 'request_id': 'req-fe8ce894-c184-4f97-a319-549d4b8df697'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.969431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] The token cache is being invalidate because project 6ff8f92912714343ba450c8eec8a7d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:30.969876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.970985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fe8ce894-c184-4f97-a319-549d4b8df697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:30.979030 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3548/7086] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:30 2022] DELETE /identity/v3/projects/6ff8f92912714343ba450c8eec8a7d35 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:30.981179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7bb0c-8411-4afb-81fc-5a68c5674f9d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:30.981565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7bb0c-8411-4afb-81fc-5a68c5674f9d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:30.981942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7bb0c-8411-4afb-81fc-5a68c5674f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.025276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c41222b7aeb4b37adb8a3f420e7687f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:31.029340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1eb7bb0c-8411-4afb-81fc-5a68c5674f9d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:31.030797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1eb7bb0c-8411-4afb-81fc-5a68c5674f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:31.034414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c41222b7aeb4b37adb8a3f420e7687f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:31.035188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c41222b7aeb4b37adb8a3f420e7687f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:31.106806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3549/7087] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:31.108919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3df04f-7ae7-4cc9-8a62-b46e94060b55 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.109265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3df04f-7ae7-4cc9-8a62-b46e94060b55 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.109390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c41222b7aeb4b37adb8a3f420e7687f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:31.109617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3df04f-7ae7-4cc9-8a62-b46e94060b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.110306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c41222b7aeb4b37adb8a3f420e7687f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:31.135526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ac3df04f-7ae7-4cc9-8a62-b46e94060b55 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:31.137465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ac3df04f-7ae7-4cc9-8a62-b46e94060b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:31.145310 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3539/7088] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:30 2022] DELETE /identity/v3/users/9c41222b7aeb4b37adb8a3f420e7687f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:31.151672 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3550/7089] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:31.156836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:31.241827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc9500-703b-4410-b6eb-e72637bc4b88 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:31.247176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:31.247821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.248214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.248357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.249445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:31.249950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:31.253488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:31.265969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3540/7090] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:31.270308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3df04f-7ae7-4cc9-8a62-b46e94060b55 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:31.281632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3df04f-7ae7-4cc9-8a62-b46e94060b55 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:31.286823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:31.287628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.288166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.288704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.289382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:31.291313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:31.399150 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3551/7091] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:31 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:31.400416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:31.411745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff6a2-ac45-4dab-9ec2-6d63c94e18aa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:31.489815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:31.493170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.493170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.493170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.493170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:31.494065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:31.637040 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3541/7092] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:31 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:31.639372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:31.653806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598d55-c92c-47b7-a839-4a66fe36f8d7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:31.661555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:31.665280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.665280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.665280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.665280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:31.665280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:31.678837 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3552/7093] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:31.680008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:31.690481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17424067-3932-43c5-94f6-fc7b721820db admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:31.692551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:31.694847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:31.697773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:31.698618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.698898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.699170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.699848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:31.701399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:31.714346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca81a28-b7a1-4ca7-8fca-0a9d948378dd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:31.717432 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3542/7094] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:31.734181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:31.734181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.734181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.734181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] PATH_INFO: `/v3/projects/215b9bb422f4449da14228ebd07e6930` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.736379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=215b9bb422f4449da14228ebd07e6930)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:31.736379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:31.738339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:31.749913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec60cc-0db5-488d-b628-f9f0eca0c45e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:31.755263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f5cee-f95f-4b3d-987d-18be6525ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:31.756340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5cee-f95f-4b3d-987d-18be6525ce0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:31.756781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5cee-f95f-4b3d-987d-18be6525ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:31.757256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5cee-f95f-4b3d-987d-18be6525ce0d admin admin] PATH_INFO: `/v3/projects/c6deffb6eb88487e98c43d76a2facc24/users/5e25fac2b59c4466a24526969b07cf95/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:31.793185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f5cee-f95f-4b3d-987d-18be6525ce0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6deffb6eb88487e98c43d76a2facc24, user_id=5e25fac2b59c4466a24526969b07cf95, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:31.800748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f5cee-f95f-4b3d-987d-18be6525ce0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:31.935898 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3543/7095] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:31 2022] PUT /identity/v3/projects/c6deffb6eb88487e98c43d76a2facc24/users/5e25fac2b59c4466a24526969b07cf95/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:32.016537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215b9bb422f4449da14228ebd07e6930', 'request_id': 'req-b9645570-246d-4b5d-91f7-eae8aa3b2a37'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:32.027637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf6238-379c-4935-a7a8-34ca9db3c46c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.027926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf6238-379c-4935-a7a8-34ca9db3c46c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.028156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215b9bb422f4449da14228ebd07e6930', 'request_id': 'req-b9645570-246d-4b5d-91f7-eae8aa3b2a37'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:32.028554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf6238-379c-4935-a7a8-34ca9db3c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.039725 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:32.061000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0bdf6238-379c-4935-a7a8-34ca9db3c46c None None] MFA Rules not processed for user `5e25fac2b59c4466a24526969b07cf95`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:32.062277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0bdf6238-379c-4935-a7a8-34ca9db3c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:32.125257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215b9bb422f4449da14228ebd07e6930', 'request_id': 'req-b9645570-246d-4b5d-91f7-eae8aa3b2a37'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:32.130799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3544/7096] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:32.135319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf6238-379c-4935-a7a8-34ca9db3c46c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.141011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] The token cache is being invalidate because project 215b9bb422f4449da14228ebd07e6930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:32.141371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:32.142359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9645570-246d-4b5d-91f7-eae8aa3b2a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:32.144861 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3553/7097] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:31 2022] DELETE /identity/v3/projects/215b9bb422f4449da14228ebd07e6930 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:32.149715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a5903-d616-45bd-89d2-179a65874c58 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.150130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a5903-d616-45bd-89d2-179a65874c58 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.150523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a5903-d616-45bd-89d2-179a65874c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.170594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-573a5903-d616-45bd-89d2-179a65874c58 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:32.171849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-573a5903-d616-45bd-89d2-179a65874c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:32.224572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf6238-379c-4935-a7a8-34ca9db3c46c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.229655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.230419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.230766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.231105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.231808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.233750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.283115 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3554/7098] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:32.290991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72528-13ab-4012-8fcd-bd30af609bf1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.291279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72528-13ab-4012-8fcd-bd30af609bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.291558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72528-13ab-4012-8fcd-bd30af609bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.311526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cba72528-13ab-4012-8fcd-bd30af609bf1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:32.313074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cba72528-13ab-4012-8fcd-bd30af609bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:32.325455 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3555/7099] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:32.326399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba72528-13ab-4012-8fcd-bd30af609bf1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.343978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba72528-13ab-4012-8fcd-bd30af609bf1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.348747 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3545/7100] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:32.349912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.352247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:32.446213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457bb99-edfc-4517-973c-454dee1e601e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.448155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.448975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.449308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.451442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.456330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:32.456330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.456604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.456604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.456604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.456919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.457031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.457031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.458293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.470023 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3556/7101] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:32.475071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.486345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ec650-c9de-45b9-8d68-4dfd7ab152e8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.492040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.492795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.493078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.493347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.494006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.495966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.525559 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:32.559065 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3546/7102] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:32.562355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.573081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c72f0-004e-48ae-b78e-60f2aa269580 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.578170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.578772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.579731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.579731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.580156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.581788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.592021 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3547/7103] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:32.595966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.606004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ddfb5-0e7f-4be8-ae29-423deda09d7c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.610686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.611327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.611601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.611870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] PATH_INFO: `/v3/projects/b0181a6fc2d84b2c9f7f23b842304997/users/95b86feb76ae46d1be045c9c67fc236c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.626743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0181a6fc2d84b2c9f7f23b842304997, user_id=95b86feb76ae46d1be045c9c67fc236c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.629953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.665086 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3557/7104] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:32.669435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.732889 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3548/7105] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:32 2022] PUT /identity/v3/projects/b0181a6fc2d84b2c9f7f23b842304997/users/95b86feb76ae46d1be045c9c67fc236c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:32.737170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.762115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea9114-0cc6-457c-a3d3-205aac0f725e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.825202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284b787-9aa6-46bc-8280-ced180d077a3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.830087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.830697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.830979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.831453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.832096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.833670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.846029 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3549/7106] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:32.850863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.852775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.853396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.853677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.853949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.854640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.856719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.860980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18498cf1-bcf0-44e0-8bd9-e249ed6eb3d6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:32.866853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf07f1-9c2f-4628-99a1-3c59fbed0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:32.867517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf07f1-9c2f-4628-99a1-3c59fbed0c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.867801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf07f1-9c2f-4628-99a1-3c59fbed0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.868075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf07f1-9c2f-4628-99a1-3c59fbed0c58 admin admin] PATH_INFO: `/v3/projects/b0181a6fc2d84b2c9f7f23b842304997/users/95b86feb76ae46d1be045c9c67fc236c/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.870109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf07f1-9c2f-4628-99a1-3c59fbed0c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0181a6fc2d84b2c9f7f23b842304997, user_id=95b86feb76ae46d1be045c9c67fc236c, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:32.872723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf07f1-9c2f-4628-99a1-3c59fbed0c58 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:32.885294 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3550/7107] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:32 2022] PUT /identity/v3/projects/b0181a6fc2d84b2c9f7f23b842304997/users/95b86feb76ae46d1be045c9c67fc236c/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:32.896050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d16a92-214b-4715-90b6-927fc2c6442b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:32.896326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d16a92-214b-4715-90b6-927fc2c6442b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:32.896597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d16a92-214b-4715-90b6-927fc2c6442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:32.935513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-56d16a92-214b-4715-90b6-927fc2c6442b None None] MFA Rules not processed for user `95b86feb76ae46d1be045c9c67fc236c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:32.937474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56d16a92-214b-4715-90b6-927fc2c6442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:32.949637 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3558/7108] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:32.953533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:32.966687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d116d-5f57-4f2e-95d2-edf7bfcc54d7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.070119 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3551/7109] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:33.071312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.072435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.072717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.073001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.073634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.075038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d16a92-214b-4715-90b6-927fc2c6442b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.081599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.087146 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3559/7110] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:33.087517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d16a92-214b-4715-90b6-927fc2c6442b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.091273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.092852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.093497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.093836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.094582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.095299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.097798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.106408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e3ce6-dc38-4530-ada9-e34b74449256 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.117438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.118113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.118814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.119262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.120239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.122727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.154514 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3560/7111] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:33.158316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.170240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf86b-7f2a-4ad8-b413-0a5026f8aee1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.176536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990014ff-4317-4c0c-8fbd-fa208d841db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.177312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990014ff-4317-4c0c-8fbd-fa208d841db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.177715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990014ff-4317-4c0c-8fbd-fa208d841db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.178876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990014ff-4317-4c0c-8fbd-fa208d841db2 admin admin] PATH_INFO: `/v3/projects/e03db7d9c6f649d3b5fb8e1f7c3ddbfc/users/468b055808364c6fa78c231857d97c39/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.195708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990014ff-4317-4c0c-8fbd-fa208d841db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03db7d9c6f649d3b5fb8e1f7c3ddbfc, user_id=468b055808364c6fa78c231857d97c39, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.198575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990014ff-4317-4c0c-8fbd-fa208d841db2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.258095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3552/7112] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:33 2022] POST /identity/v3/projects => generated 333 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:33.262046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.308240 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3561/7113] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:33 2022] PUT /identity/v3/projects/e03db7d9c6f649d3b5fb8e1f7c3ddbfc/users/468b055808364c6fa78c231857d97c39/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:33.319007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab5795-328b-4923-bcf8-64efb15987f5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.319596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab5795-328b-4923-bcf8-64efb15987f5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.320050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab5795-328b-4923-bcf8-64efb15987f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.339817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f31b04-197c-426e-93d1-32cad8086017 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.354053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c8ab5795-328b-4923-bcf8-64efb15987f5 None None] MFA Rules not processed for user `468b055808364c6fa78c231857d97c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:33.355744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c8ab5795-328b-4923-bcf8-64efb15987f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:33.412065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.412982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.413390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.413837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.414713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.416795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.434036 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3562/7114] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:33.438805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab5795-328b-4923-bcf8-64efb15987f5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.507245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab5795-328b-4923-bcf8-64efb15987f5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.511776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.514791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.514791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.514791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.514791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.515661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.580972 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3553/7115] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:43:33 2022] POST /identity/v3/projects => generated 332 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:33.584924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.600872 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:33.610141 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3563/7116] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:33 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:33.614648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.668749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a00ad-c1a7-45b4-9767-6dec40aac3b7 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.689692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dcddf-bd98-4009-9406-5388408c48f0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.697460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.697460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.697460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.697460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.698252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.698848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.736708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.737376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.738208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.738481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.739097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.741201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.864810 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3564/7117] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:33 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:33.867530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.877406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f62ba2-a9e7-4744-ad47-620bbfdf9dec admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.882174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.882786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.883057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.883327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.884095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.885673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.888891 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:33.897864 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3565/7118] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:43:33.901672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.903986 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3554/7119] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:33 2022] POST /identity/v3/projects => generated 357 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:33.910559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:33.914238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ab0f2-2b4f-40e9-82d2-513424f2523a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.987667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.988406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:33.988688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:33.989395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:33.989596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:33.991276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:33.993836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5ba3-d914-42a7-a58a-4296d36788db tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:33.998954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:33.999785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.000111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.000451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.001180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.003503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.009666 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3566/7120] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:34.010911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.025189 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3555/7121] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:43:33 2022] GET /identity/v3/projects => generated 7584 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:34.026252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5710-6e19-4060-8754-b49890e249e0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.032774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22bb4a-abad-4714-8d30-0bb2e16bfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:34.034030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22bb4a-abad-4714-8d30-0bb2e16bfbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.035454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22bb4a-abad-4714-8d30-0bb2e16bfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.035609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.036273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22bb4a-abad-4714-8d30-0bb2e16bfbf4 admin admin] PATH_INFO: `/v3/projects/84c6a942d32c43099187077716ac0218/users/518fa132652e4158b3253f73b935377b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.046970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9620-595e-459c-8edf-044f2125e9b2 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.054049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:34.060610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.060610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.060610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.060610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:34.060610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.061114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22bb4a-abad-4714-8d30-0bb2e16bfbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c6a942d32c43099187077716ac0218, user_id=518fa132652e4158b3253f73b935377b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.061114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22bb4a-abad-4714-8d30-0bb2e16bfbf4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.066380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.086028 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3556/7122] 10.222.0.42 () {58 vars in 1158 bytes} [Sun Oct 23 01:43:34 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:34.094971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.105811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0dabd-dbdd-4233-8660-29589d227367 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.117561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:34.123325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.123325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.123325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.123325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Adding query filter params (parent_id=1e2dbd12d95b4b34974befb6f00caead) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:34.123325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.123773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.138920 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3557/7123] 10.222.0.42 () {58 vars in 1216 bytes} [Sun Oct 23 01:43:34 2022] GET /identity/v3/projects?parent_id=1e2dbd12d95b4b34974befb6f00caead => generated 497 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:34.144930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.157098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3567/7124] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:34 2022] PUT /identity/v3/projects/84c6a942d32c43099187077716ac0218/users/518fa132652e4158b3253f73b935377b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:34.157582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cf479-e806-4e0a-9967-a13ed59f267f tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.161484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cbe5-45c0-4b40-8a80-02276f9ae7b6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.161774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cbe5-45c0-4b40-8a80-02276f9ae7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.162087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cbe5-45c0-4b40-8a80-02276f9ae7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.194376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4a49cbe5-45c0-4b40-8a80-02276f9ae7b6 None None] MFA Rules not processed for user `518fa132652e4158b3253f73b935377b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:34.195733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a49cbe5-45c0-4b40-8a80-02276f9ae7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:34.228870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:34.229683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.230105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.230441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects/7fe61a5702414b1b8ef683a5db986d0e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.231807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7fe61a5702414b1b8ef683a5db986d0e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.236571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.271237 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3568/7125] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:34.275680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49cbe5-45c0-4b40-8a80-02276f9ae7b6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.339798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49cbe5-45c0-4b40-8a80-02276f9ae7b6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.344580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:34.345239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.345518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.345774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.346429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.348336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.474959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe61a5702414b1b8ef683a5db986d0e', 'request_id': 'req-2c93e09b-f203-4a01-a650-400141b63035'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:34.480488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe61a5702414b1b8ef683a5db986d0e', 'request_id': 'req-2c93e09b-f203-4a01-a650-400141b63035'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:34.681197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3569/7126] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:34 2022] POST /identity/v3/projects => generated 377 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:34.685101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.757243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cda72-4d22-44e5-bcf0-5f0979a72357 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.763894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:34.764504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.765516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.765788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.766445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.768379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.856847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe61a5702414b1b8ef683a5db986d0e', 'request_id': 'req-2c93e09b-f203-4a01-a650-400141b63035'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:34.874983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] The token cache is being invalidate because project 7fe61a5702414b1b8ef683a5db986d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:34.875491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:34.876522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:34.879085 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3558/7127] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:34 2022] DELETE /identity/v3/projects/7fe61a5702414b1b8ef683a5db986d0e => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:34.883283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.884886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:34.933389 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3570/7128] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:34 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:34.936403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.939375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:34.953316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9c3b-37f4-438b-b785-9642f27a7fad admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.959073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:34.962257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:34.962257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:34.962257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:34.962257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:34.962714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:34.966326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e09b-f203-4a01-a650-400141b63035 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:34.973450 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3571/7129] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:34.978455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:34.991515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1f32-af0b-490f-a947-5eb5ccb4711f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:35.012370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:35.012370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:35.012751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:35.013055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] PATH_INFO: `/v3/projects/a6a7b6343bd44b2fb0becc81abbbb91c/users/c00f2c22c3464d34b6b5b1bc1daad9c8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:35.035070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a7b6343bd44b2fb0becc81abbbb91c, user_id=c00f2c22c3464d34b6b5b1bc1daad9c8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:35.039246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:35.061503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:35.065601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:35.065601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:35.065601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects/1e2dbd12d95b4b34974befb6f00caead` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:35.065601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e2dbd12d95b4b34974befb6f00caead)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:35.066691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:35.146525 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3572/7130] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:34 2022] PUT /identity/v3/projects/a6a7b6343bd44b2fb0becc81abbbb91c/users/c00f2c22c3464d34b6b5b1bc1daad9c8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:35.151315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:35.231407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4d80-8f0b-46cc-b4bb-cd639bc87bd9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:35.234250 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:35.257410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2dbd12d95b4b34974befb6f00caead', 'request_id': 'req-f5ce2e21-3699-44e7-8a11-bac721275085'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:35.269902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2dbd12d95b4b34974befb6f00caead', 'request_id': 'req-f5ce2e21-3699-44e7-8a11-bac721275085'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:35.346037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:35.347201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:35.347623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:35.347894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:35.348529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2dbd12d95b4b34974befb6f00caead', 'request_id': 'req-f5ce2e21-3699-44e7-8a11-bac721275085'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:35.348685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:35.350292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:35.361160 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3573/7131] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:35.372714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:35.375914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] The token cache is being invalidate because project 1e2dbd12d95b4b34974befb6f00caead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:35.379937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:35.382232 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:35.383157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:35.385419 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3559/7132] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:34 2022] DELETE /identity/v3/projects/1e2dbd12d95b4b34974befb6f00caead => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:35.389845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:35.392102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:35.394198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c46f9b-d81b-4ef2-9bc8-53ce0fbf5933 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:35.403327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1592e-9706-4d0b-800e-46e7bf0009bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:35.403327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1592e-9706-4d0b-800e-46e7bf0009bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:35.403327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1592e-9706-4d0b-800e-46e7bf0009bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:35.405301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1592e-9706-4d0b-800e-46e7bf0009bc admin admin] PATH_INFO: `/v3/projects/a6a7b6343bd44b2fb0becc81abbbb91c/users/c00f2c22c3464d34b6b5b1bc1daad9c8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:35.407586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1592e-9706-4d0b-800e-46e7bf0009bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a7b6343bd44b2fb0becc81abbbb91c, user_id=c00f2c22c3464d34b6b5b1bc1daad9c8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:35.411466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1592e-9706-4d0b-800e-46e7bf0009bc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:35.430545 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3574/7133] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:35 2022] PUT /identity/v3/projects/a6a7b6343bd44b2fb0becc81abbbb91c/users/c00f2c22c3464d34b6b5b1bc1daad9c8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:35.441015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:35.441406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:35.441644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:35.488364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] MFA Rules not processed for user `c00f2c22c3464d34b6b5b1bc1daad9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:35.488364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:35.541183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce2e21-3699-44e7-8a11-bac721275085 tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:35.624569 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3575/7134] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:43:35.639057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:35.639885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:35.648189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95b86feb76ae46d1be045c9c67fc236c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0181a6fc2d84b2c9f7f23b842304997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:35.648877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:35.649429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:35.649713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] PATH_INFO: `/v3/projects/66b905be13284cab90dfa878e7be3040` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:35.653393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66b905be13284cab90dfa878e7be3040)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:35.659445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:35.734311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6d066-d6d6-4bb3-af6f-df44be2a7796 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:35.739260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:35.739816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:35.740090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:35.740360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:35.742403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:35.845313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:35.845313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:35.857598 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3576/7135] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:43:35.864360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b905be13284cab90dfa878e7be3040', 'request_id': 'req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:35.870943 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:35.872405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b905be13284cab90dfa878e7be3040', 'request_id': 'req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.027222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b905be13284cab90dfa878e7be3040', 'request_id': 'req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.047832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] The token cache is being invalidate because project 66b905be13284cab90dfa878e7be3040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:36.048238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.050852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4dc3ec6f-cb0f-49d7-9a84-ff0acf72998d tempest-ListProjectsTestJSON-241341732 tempest-ListProjectsTestJSON-241341732-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.053876 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3560/7136] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:35 2022] DELETE /identity/v3/projects/66b905be13284cab90dfa878e7be3040 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:36.058157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:36.059780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:36.168696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9fea5-513d-460d-b615-f70ca5381550 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:36.244442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:36.244442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:36.244442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:36.244442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] PATH_INFO: `/v3/users/5e25fac2b59c4466a24526969b07cf95` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:36.245331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e25fac2b59c4466a24526969b07cf95)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:36.246900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:36.464271 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:36.512805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e25fac2b59c4466a24526969b07cf95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.523316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e25fac2b59c4466a24526969b07cf95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.524144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e25fac2b59c4466a24526969b07cf95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.609535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e25fac2b59c4466a24526969b07cf95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.612724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e25fac2b59c4466a24526969b07cf95'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:36.651329 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3577/7137] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:36 2022] DELETE /identity/v3/users/5e25fac2b59c4466a24526969b07cf95 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:36.655012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:36.655527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:36.655978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:36.703790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:36.705294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:36.871150 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3561/7138] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:36.883898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:36.885578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:36.948042 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:37.011967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd2425-110b-45a5-9ce5-53bf3fda7388 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:37.032302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:37.035117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:37.035367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:37.035636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:37.055074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:37.056520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:37.070833 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3578/7139] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:37.495984 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:37.821966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:37.823684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:37.863700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2bc6e-0d00-4906-8c54-9cb11d7318af None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:37.875537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:37.877312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:37.879631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:37.880224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] PATH_INFO: `/v3/projects/c6deffb6eb88487e98c43d76a2facc24` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:37.882134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6deffb6eb88487e98c43d76a2facc24)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:37.884386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:37.926619 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:38.072668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6deffb6eb88487e98c43d76a2facc24', 'request_id': 'req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.084948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6deffb6eb88487e98c43d76a2facc24', 'request_id': 'req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.199348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6deffb6eb88487e98c43d76a2facc24', 'request_id': 'req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.253728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] The token cache is being invalidate because project c6deffb6eb88487e98c43d76a2facc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:38.254950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.256013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.257847 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3562/7140] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:37 2022] DELETE /identity/v3/projects/c6deffb6eb88487e98c43d76a2facc24 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:38.262243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:38.282317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7106b2-a42e-415e-9a2e-95ae30ccdd2a service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:38.428705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:38.429484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:38.434364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:38.434364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] PATH_INFO: `/v3/users/95b86feb76ae46d1be045c9c67fc236c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:38.434364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b86feb76ae46d1be045c9c67fc236c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:38.434364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:38.716146 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:38.741175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b86feb76ae46d1be045c9c67fc236c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.783204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b86feb76ae46d1be045c9c67fc236c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.788971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b86feb76ae46d1be045c9c67fc236c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.873925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b86feb76ae46d1be045c9c67fc236c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.874603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b86feb76ae46d1be045c9c67fc236c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:38.908142 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3579/7141] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:38 2022] DELETE /identity/v3/users/95b86feb76ae46d1be045c9c67fc236c => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:39.432888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:39.435210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:39.495951 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:39.559451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bbbd6-d475-4e8e-9fd1-ab404f2441bc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:39.567107 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:39.632909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf4812-b4e8-452c-a38f-509ec726e573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:39.634140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4812-b4e8-452c-a38f-509ec726e573 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:39.634140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4812-b4e8-452c-a38f-509ec726e573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:39.634469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4812-b4e8-452c-a38f-509ec726e573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:39.636643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0edf4812-b4e8-452c-a38f-509ec726e573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:39.710009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:39.711584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:39.720358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf4812-b4e8-452c-a38f-509ec726e573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:39.722400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf4812-b4e8-452c-a38f-509ec726e573 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:39.768958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3563/7142] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:39.864094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d795b-214f-4e3c-bce0-2903722611cc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:39.870312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:39.871205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:39.871671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:39.872349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] PATH_INFO: `/v3/projects/b0181a6fc2d84b2c9f7f23b842304997` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:39.873905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0181a6fc2d84b2c9f7f23b842304997)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:39.875904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:40.038512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0181a6fc2d84b2c9f7f23b842304997', 'request_id': 'req-946a3e34-69d2-4cf5-94c2-5e091d335101'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:40.059996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0181a6fc2d84b2c9f7f23b842304997', 'request_id': 'req-946a3e34-69d2-4cf5-94c2-5e091d335101'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:40.153340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0181a6fc2d84b2c9f7f23b842304997', 'request_id': 'req-946a3e34-69d2-4cf5-94c2-5e091d335101'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:40.173913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] The token cache is being invalidate because project b0181a6fc2d84b2c9f7f23b842304997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:40.174229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:40.178561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-946a3e34-69d2-4cf5-94c2-5e091d335101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:40.185661 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3580/7143] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:39 2022] DELETE /identity/v3/projects/b0181a6fc2d84b2c9f7f23b842304997 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:40.191789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66747d9-260c-4148-b1c0-2b6b5eebd804 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:40.192036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66747d9-260c-4148-b1c0-2b6b5eebd804 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:40.192287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66747d9-260c-4148-b1c0-2b6b5eebd804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:40.230637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e66747d9-260c-4148-b1c0-2b6b5eebd804 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:40.232621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e66747d9-260c-4148-b1c0-2b6b5eebd804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:40.368404 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3564/7144] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:40.376329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05ff2-9c41-4aaf-970d-ae7a98e6d5e2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:40.376769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05ff2-9c41-4aaf-970d-ae7a98e6d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:40.377030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05ff2-9c41-4aaf-970d-ae7a98e6d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:40.406459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fbc05ff2-9c41-4aaf-970d-ae7a98e6d5e2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:40.408139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fbc05ff2-9c41-4aaf-970d-ae7a98e6d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:40.432990 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3581/7145] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:40.433623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66747d9-260c-4148-b1c0-2b6b5eebd804 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:40.457141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66747d9-260c-4148-b1c0-2b6b5eebd804 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:40.479485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:40.496592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:40.496592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:40.496592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:40.496592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:40.496592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:40.502301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:40.535656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977dcd1-daf3-4110-9570-279b38b252ab None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:40.535956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977dcd1-daf3-4110-9570-279b38b252ab None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:40.536234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977dcd1-daf3-4110-9570-279b38b252ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:40.551224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3565/7146] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:40.556707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:40.575994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca441b2-512b-44de-8f29-432fd87cbdcd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:40.581564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:40.588045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:40.588045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:40.588045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:40.588616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6977dcd1-daf3-4110-9570-279b38b252ab None None] MFA Rules not processed for user `037ed342980a4de9a2dfc8d576293aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:40.588727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:40.588842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6977dcd1-daf3-4110-9570-279b38b252ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:40.588942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:40.775958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3566/7147] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:40 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:40.778688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:40.803399 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:40.836911 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3582/7148] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:40.986373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbff704-13e3-494e-9d76-ee444be4f080 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:40.997226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:40.998111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:41.000771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:41.001318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:41.002095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:41.004187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:41.122058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3567/7149] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:40 2022] POST /identity/v3/users => generated 285 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:41.127455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977dcd1-daf3-4110-9570-279b38b252ab None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:41.151032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977dcd1-daf3-4110-9570-279b38b252ab None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:41.166971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:41.168414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:41.168944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:41.169462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:41.170685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:41.175517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:41.206874 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3583/7150] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:41.209946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:41.251161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881b015-1788-4acd-b10b-b76057291e2a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:41.264203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca610bd-9cf2-4e1f-a4c5-769955eeea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:41.265227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca610bd-9cf2-4e1f-a4c5-769955eeea26 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:41.265876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca610bd-9cf2-4e1f-a4c5-769955eeea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:41.266407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca610bd-9cf2-4e1f-a4c5-769955eeea26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:41.267418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca610bd-9cf2-4e1f-a4c5-769955eeea26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:41.273104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca610bd-9cf2-4e1f-a4c5-769955eeea26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:41.306469 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3568/7151] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:41.308901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:41.324777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380e27-b689-4272-b9cd-cc8e7e5ac83a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:41.333298 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:41.339444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:41.340469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:41.341041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:41.341473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] PATH_INFO: `/v3/projects/e2bfb3800037437cb7353ff304ae0307/users/013a4b7947a94a2488a7f391b498340b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:41.382514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bfb3800037437cb7353ff304ae0307, user_id=013a4b7947a94a2488a7f391b498340b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:41.391245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:41.529233 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3584/7152] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:41 2022] PUT /identity/v3/projects/e2bfb3800037437cb7353ff304ae0307/users/013a4b7947a94a2488a7f391b498340b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:41.531089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5add84-020a-4327-a480-723632857739 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:41.531571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5add84-020a-4327-a480-723632857739 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:41.531844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5add84-020a-4327-a480-723632857739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:41.598770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0e5add84-020a-4327-a480-723632857739 None None] MFA Rules not processed for user `013a4b7947a94a2488a7f391b498340b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:41.600194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e5add84-020a-4327-a480-723632857739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:41.816647 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3569/7153] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:41.817240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:41.945078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c96f5c-1476-4e81-85b9-8e036ef50412 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:41.950886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5add84-020a-4327-a480-723632857739 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:41.952789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e5add84-020a-4327-a480-723632857739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:41.957483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:41.958199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:41.958585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:41.958953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:41.959714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:41.961834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:42.053386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5add84-020a-4327-a480-723632857739 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:42.072003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:42.072657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:42.072934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:42.073203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:42.075063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:42.135233 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3585/7154] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:41 2022] POST /identity/v3/projects => generated 367 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:42.139578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:42.170939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:42.172487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:42.183971 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3570/7155] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:43:42.227854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed860003-6487-4404-89fc-9939ad382756 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:42.232572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:42.233182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:42.233461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:42.233732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:42.234423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:42.236393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:42.341018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3586/7156] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:42 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:42.342621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:42.362395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76e329-2f4a-4513-953c-4d784ce81a15 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:42.378629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:42.379288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:42.379575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:42.380036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:42.381005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:42.382521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:42.399053 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3571/7157] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:42.402997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:42.419074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8f780-604a-4851-be3e-7b1fb67488ab admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:42.435180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:42.435870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:42.436155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:42.436664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] PATH_INFO: `/v3/projects/a2a549776dbb4e508d087abfd6538cf7/users/7d259a58eb754dbba2e5682ac85bcc41/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:42.473760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a549776dbb4e508d087abfd6538cf7, user_id=7d259a58eb754dbba2e5682ac85bcc41, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:42.482432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:42.513837 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:42.601094 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3587/7158] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:42 2022] PUT /identity/v3/projects/a2a549776dbb4e508d087abfd6538cf7/users/7d259a58eb754dbba2e5682ac85bcc41/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:42.604857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:42.620941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26bca8-ec08-460b-a5de-648a8d0697f0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:42.731742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92fe51-4587-4e56-bb24-dac318fc3066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:42.732366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92fe51-4587-4e56-bb24-dac318fc3066 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:42.732695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92fe51-4587-4e56-bb24-dac318fc3066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:42.733006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92fe51-4587-4e56-bb24-dac318fc3066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:42.733708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92fe51-4587-4e56-bb24-dac318fc3066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:42.735707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92fe51-4587-4e56-bb24-dac318fc3066 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:42.750828 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3572/7159] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:42.752349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:42.764288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330b88-5555-4be7-ad8e-6697cebebade admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:42.772002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:42.772682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:42.772962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:42.773238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] PATH_INFO: `/v3/projects/a2a549776dbb4e508d087abfd6538cf7/users/7d259a58eb754dbba2e5682ac85bcc41/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:42.775806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a549776dbb4e508d087abfd6538cf7, user_id=7d259a58eb754dbba2e5682ac85bcc41, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:42.778694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:42.801188 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3588/7160] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:42 2022] PUT /identity/v3/projects/a2a549776dbb4e508d087abfd6538cf7/users/7d259a58eb754dbba2e5682ac85bcc41/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:42.803947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539d396-a6f1-42e1-b4af-fa5be95467c5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:42.804454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539d396-a6f1-42e1-b4af-fa5be95467c5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:42.804920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539d396-a6f1-42e1-b4af-fa5be95467c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:42.875177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2539d396-a6f1-42e1-b4af-fa5be95467c5 None None] MFA Rules not processed for user `7d259a58eb754dbba2e5682ac85bcc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:42.876882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2539d396-a6f1-42e1-b4af-fa5be95467c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:42.996017 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3573/7161] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:43.001069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:43.028066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ac684-a645-47dc-baec-3a7c81c238a6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:43.044054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:43.044881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:43.045447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:43.045907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:43.046717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:43.048874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:43.207643 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3589/7162] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:43 2022] POST /identity/v3/projects => generated 359 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:43.213298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539d396-a6f1-42e1-b4af-fa5be95467c5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:43.228422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539d396-a6f1-42e1-b4af-fa5be95467c5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:43.368795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:43.374158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:43.374158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:43.374158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:43.374158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:43.376727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:43.506148 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3574/7163] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:43 2022] POST /identity/v3/users => generated 413 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:43.510065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:43.521523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf552a-ee89-493d-b2c5-5d4a22b26e90 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:43.526469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:43.527368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:43.528674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:43.528674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/users/9e3ad6fffb8a404ebedb3a12a67b454f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:43.557014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_user(user_id=9e3ad6fffb8a404ebedb3a12a67b454f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:43.559983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:43.567050 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3590/7164] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:43:43 2022] GET /identity/v3/users/9e3ad6fffb8a404ebedb3a12a67b454f => generated 413 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:43.568019 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:43.578200 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:43.585212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0e2e-5602-4638-85fd-73aff1daeb70 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:43.598813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:43.600301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:43.600301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:43.600498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/users/9e3ad6fffb8a404ebedb3a12a67b454f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:43.601867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9e3ad6fffb8a404ebedb3a12a67b454f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:43.604738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:43.876852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3ad6fffb8a404ebedb3a12a67b454f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:43.887721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3ad6fffb8a404ebedb3a12a67b454f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:43.888623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3ad6fffb8a404ebedb3a12a67b454f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:43.978462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3ad6fffb8a404ebedb3a12a67b454f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:43.980134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3ad6fffb8a404ebedb3a12a67b454f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:44.001683 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3575/7165] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:43 2022] DELETE /identity/v3/users/9e3ad6fffb8a404ebedb3a12a67b454f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:44.006520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:44.008667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:44.048627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505278ee-d99b-4826-8450-f132d239fa11 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:44.189611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:44.191615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:44.192391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:44.193073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/b87d63faea4046e887debfabddf96739` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:44.196269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b87d63faea4046e887debfabddf96739)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:44.199149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:44.342700 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:44.345052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87d63faea4046e887debfabddf96739', 'request_id': 'req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:44.355350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87d63faea4046e887debfabddf96739', 'request_id': 'req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:44.433741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87d63faea4046e887debfabddf96739', 'request_id': 'req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:44.450276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project b87d63faea4046e887debfabddf96739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:44.451270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:44.452507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:44.462762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:44.491006 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3591/7166] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:44 2022] DELETE /identity/v3/projects/b87d63faea4046e887debfabddf96739 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:44.493706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e6df-3392-41ca-9bd3-5ac0fff37c1c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:44.587705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:44.588337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:44.588622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:44.588893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:44.589534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:44.591392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:44.693839 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3576/7167] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:44 2022] POST /identity/v3/projects => generated 348 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:44.697756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:44.699320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:44.725551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1a3d-7ef9-4645-9e12-b37dfc8df2b8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:44.826564 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:44.872718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:44.873555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:44.874086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:44.881936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:44.881936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:44.881936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:44.881936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:44.897385 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3592/7168] 10.222.0.42 () {58 vars in 1160 bytes} [Sun Oct 23 01:43:44 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:44.902631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:44.914849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c223-85f1-4597-bdb6-e80147d12c2c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:44.920511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:44.921738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:44.922232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:44.922752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:44.923655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:44.925498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:44.952571 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3577/7169] 10.222.0.42 () {58 vars in 1128 bytes} [Sun Oct 23 01:43:44 2022] GET /identity/v3/domains => generated 829 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:44.956502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:44.974032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7960c0b-8f04-4754-8b51-1ed5a6332ca3 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:44.991413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:44.994485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:44.994903 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:44.995685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:44.996072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/3775b18468934b7a94ac26bec1ce6aa2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:44.997651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:update_project(project_id=3775b18468934b7a94ac26bec1ce6aa2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:44.998832 n-d-master-1 devstack@keystone.service[81936]: WARNING py.warnings [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:44.998832 n-d-master-1 devstack@keystone.service[81936]: warnings.warn(msg) Oct 23 01:43:44.998832 n-d-master-1 devstack@keystone.service[81936]: Oct 23 01:43:45.000098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:45.027321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.028350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.033907 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:45.151801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.154229 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:45.154797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.157447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3593/7170] 10.222.0.42 () {60 vars in 1252 bytes} [Sun Oct 23 01:43:44 2022] PATCH /identity/v3/projects/3775b18468934b7a94ac26bec1ce6aa2 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:45.161830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:45.163863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:45.179349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca137d7-ba5d-4db7-b9d4-c5dc50b1cbc0 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:45.257366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:45.259155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:45.259680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:45.260209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/3775b18468934b7a94ac26bec1ce6aa2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:45.295559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3775b18468934b7a94ac26bec1ce6aa2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:45.300080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:45.357454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.367458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.399443 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:45.550329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2', 'request_id': 'req-bf45ab35-b7ef-417f-8235-f37e7caf87d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.556425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2', 'request_id': 'req-bf45ab35-b7ef-417f-8235-f37e7caf87d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.631658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2', 'request_id': 'req-bf45ab35-b7ef-417f-8235-f37e7caf87d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.658589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 3775b18468934b7a94ac26bec1ce6aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:45.658898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.660063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.671850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2', 'request_id': 'req-bf45ab35-b7ef-417f-8235-f37e7caf87d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.672690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2', 'request_id': 'req-bf45ab35-b7ef-417f-8235-f37e7caf87d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.676714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3775b18468934b7a94ac26bec1ce6aa2', 'request_id': 'req-bf45ab35-b7ef-417f-8235-f37e7caf87d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:45.687259 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3578/7171] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:45 2022] DELETE /identity/v3/projects/3775b18468934b7a94ac26bec1ce6aa2 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:45.692815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:45.704150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44683aff-5440-4b97-a68d-6b84b0e4abde tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:45.720931 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:45.771157 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:45.794911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:45.795747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:45.796093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:45.797743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:45.797743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:45.800909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:45.979760 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3594/7172] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:45 2022] POST /identity/v3/projects => generated 359 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:45.984399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:45.987552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:46.012663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ab35-b7ef-417f-8235-f37e7caf87d7 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:46.093327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:46.094042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:46.094331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:46.094640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/1ed862a1a3d44b0f8dff24279eec9f95` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:46.095823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ed862a1a3d44b0f8dff24279eec9f95)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:46.098590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:46.103385 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3579/7173] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:45 2022] GET /identity/v3/projects/1ed862a1a3d44b0f8dff24279eec9f95 => generated 359 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:46.105431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:46.141079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9874-c344-4d6d-8512-2dd0d8a17f93 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:46.160760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:46.161445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:46.167239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:46.175317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/1ed862a1a3d44b0f8dff24279eec9f95` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:46.175317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ed862a1a3d44b0f8dff24279eec9f95)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:46.175317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:46.328089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed862a1a3d44b0f8dff24279eec9f95', 'request_id': 'req-f4df6baf-b148-40d7-894d-3dfff7ffc8db'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:46.333648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed862a1a3d44b0f8dff24279eec9f95', 'request_id': 'req-f4df6baf-b148-40d7-894d-3dfff7ffc8db'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:46.423931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed862a1a3d44b0f8dff24279eec9f95', 'request_id': 'req-f4df6baf-b148-40d7-894d-3dfff7ffc8db'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:46.441653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 1ed862a1a3d44b0f8dff24279eec9f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:46.442192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:46.444645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:46.446950 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3595/7174] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:46 2022] DELETE /identity/v3/projects/1ed862a1a3d44b0f8dff24279eec9f95 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:46.451662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:46.453404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:46.466333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31cc4-8989-4a73-bdd2-5dc4ef8a3b19 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:46.569584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:46.570236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:46.570517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:46.570803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:46.571441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:46.573323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:46.765852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3580/7175] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:46 2022] POST /identity/v3/projects => generated 360 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:46.770830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:46.788392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df6baf-b148-40d7-894d-3dfff7ffc8db tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:46.885237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:46.886053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:46.886413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:46.886751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/9a8313b2e70b4219bc26cd165709d4bf` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:46.888059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=9a8313b2e70b4219bc26cd165709d4bf)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:46.890317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:46.892285 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3596/7176] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:46 2022] GET /identity/v3/projects/9a8313b2e70b4219bc26cd165709d4bf => generated 360 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:46.896473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:46.912535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bdc02-954e-4150-b8c5-db31fa8aec23 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:46.918776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:46.919768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:46.923366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:46.924574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/9a8313b2e70b4219bc26cd165709d4bf` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:46.926136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a8313b2e70b4219bc26cd165709d4bf)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:46.928464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:47.083493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8313b2e70b4219bc26cd165709d4bf', 'request_id': 'req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:47.092102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8313b2e70b4219bc26cd165709d4bf', 'request_id': 'req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:47.164799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8313b2e70b4219bc26cd165709d4bf', 'request_id': 'req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:47.166221 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:47.206746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 9a8313b2e70b4219bc26cd165709d4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:47.210081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:47.210081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:47.218030 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3581/7177] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:46 2022] DELETE /identity/v3/projects/9a8313b2e70b4219bc26cd165709d4bf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:47.218696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:47.227828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:47.259540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e8919-5aeb-4da2-817e-bb318b4f9570 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:47.307660 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:47.380344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:47.380344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:47.380344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:47.380674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:47.381316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:47.383476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:47.534665 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3597/7178] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:43:47 2022] POST /identity/v3/projects => generated 348 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:47.538703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:47.563593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7729a1-971b-4e2c-ad6f-36f6c259fa0b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:47.691636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:47.692619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:47.693073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:47.693534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/efbec54907d74f7683f16ad77a5f6cec` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:47.696218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=efbec54907d74f7683f16ad77a5f6cec)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:47.700884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:47.706588 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3582/7179] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:47 2022] GET /identity/v3/projects/efbec54907d74f7683f16ad77a5f6cec => generated 348 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:47.708924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:47.738291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2ac3-554c-487e-906d-ae83cf7438ab tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:47.745830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:47.746760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:47.747217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:47.747643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/efbec54907d74f7683f16ad77a5f6cec` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:47.748981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=efbec54907d74f7683f16ad77a5f6cec)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:47.751874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:47.929355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbec54907d74f7683f16ad77a5f6cec', 'request_id': 'req-8010678e-a01c-4bf5-b571-09fc3d391d2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:47.940486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbec54907d74f7683f16ad77a5f6cec', 'request_id': 'req-8010678e-a01c-4bf5-b571-09fc3d391d2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:48.010309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbec54907d74f7683f16ad77a5f6cec', 'request_id': 'req-8010678e-a01c-4bf5-b571-09fc3d391d2b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:48.040704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project efbec54907d74f7683f16ad77a5f6cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:48.041082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:48.043227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:48.051122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3598/7180] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:47 2022] DELETE /identity/v3/projects/efbec54907d74f7683f16ad77a5f6cec => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:48.051340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:48.053353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:48.075791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22aa93-9930-4a02-861e-1b2a911fd0ce tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:48.172556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:48.173210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:48.174361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:48.174663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:48.175383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:48.177260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:48.281448 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3583/7181] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:43:48 2022] POST /identity/v3/domains => generated 276 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:48.285818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:48.297775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010678e-a01c-4bf5-b571-09fc3d391d2b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:48.373737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:48.374528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:48.374834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:48.375168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:48.375886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:48.379346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:48.507433 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3599/7182] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:48 2022] POST /identity/v3/projects => generated 404 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:48.511653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:48.543064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358c89-be2b-4275-9ae4-bd56226e6f61 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:48.697918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:48.698690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:48.698980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:48.699255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/2e52e695b11349d6a59225da896aad40` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:48.700415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=2e52e695b11349d6a59225da896aad40)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:48.702639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:48.704328 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3584/7183] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:48 2022] GET /identity/v3/projects/2e52e695b11349d6a59225da896aad40 => generated 404 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:48.710022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:48.726019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f493e5-bb15-4e1f-930f-c96220019c2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:48.739104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:48.739757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:48.740038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:48.740317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/2e52e695b11349d6a59225da896aad40` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:48.741449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e52e695b11349d6a59225da896aad40)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:48.747674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:48.760989 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:48.914293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e52e695b11349d6a59225da896aad40', 'request_id': 'req-04e208a7-c5ac-4a4d-b781-d48e3f93830b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:48.925305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e52e695b11349d6a59225da896aad40', 'request_id': 'req-04e208a7-c5ac-4a4d-b781-d48e3f93830b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:48.998886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e52e695b11349d6a59225da896aad40', 'request_id': 'req-04e208a7-c5ac-4a4d-b781-d48e3f93830b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.015993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 2e52e695b11349d6a59225da896aad40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:49.018439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.019343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.025009 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3600/7184] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:48 2022] DELETE /identity/v3/projects/2e52e695b11349d6a59225da896aad40 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:49.028891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:49.030672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:49.050678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feedb4-9651-4b7e-9d19-67caff3e47b6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:49.090422 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:49.126005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:49.126677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:49.126963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:49.127408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains/b4911dc0b59f419c86b897b67feb1784` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:49.128747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b4911dc0b59f419c86b897b67feb1784)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:49.130478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:49.165563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.167256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.278191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.279317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.287236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3585/7185] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:49 2022] PATCH /identity/v3/domains/b4911dc0b59f419c86b897b67feb1784 => generated 277 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:49.291321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:49.313145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e208a7-c5ac-4a4d-b781-d48e3f93830b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:49.403397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:49.404631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:49.404983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:49.405334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains/b4911dc0b59f419c86b897b67feb1784` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:49.422109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b4911dc0b59f419c86b897b67feb1784)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:49.424656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:49.458570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.462980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.633298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784', 'request_id': 'req-0df918f6-e66f-4a66-a09a-4dc35f62525e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.648215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784', 'request_id': 'req-0df918f6-e66f-4a66-a09a-4dc35f62525e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.726652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784', 'request_id': 'req-0df918f6-e66f-4a66-a09a-4dc35f62525e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.729539 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:49.750812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project b4911dc0b59f419c86b897b67feb1784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:49.751501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.755061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.773952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784', 'request_id': 'req-0df918f6-e66f-4a66-a09a-4dc35f62525e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.775282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784', 'request_id': 'req-0df918f6-e66f-4a66-a09a-4dc35f62525e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.786124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b4911dc0b59f419c86b897b67feb1784', 'request_id': 'req-0df918f6-e66f-4a66-a09a-4dc35f62525e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:49.793865 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3601/7186] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:49 2022] DELETE /identity/v3/domains/b4911dc0b59f419c86b897b67feb1784 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:49.798915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:49.800454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:49.816581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405cd9-a1dc-447b-9294-2e7b3be686f8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:49.905093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:49.906442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:49.906790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:49.907399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:49.908148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:49.910103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:50.017324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3586/7187] 10.222.0.42 () {60 vars in 1149 bytes} [Sun Oct 23 01:43:49 2022] POST /identity/v3/domains => generated 277 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:50.021521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:50.023182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:50.045338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df918f6-e66f-4a66-a09a-4dc35f62525e tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:50.110772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:50.111658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:50.112213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:50.114305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:50.116425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:50.118448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:50.257014 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3602/7188] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:50 2022] POST /identity/v3/projects => generated 409 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:50.258181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:50.269784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce66e-6718-4e56-b530-b8b3856cfd12 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:50.342753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:50.344365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:50.344965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:50.345524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:50.346864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:50.349453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:50.466912 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3587/7189] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:50 2022] POST /identity/v3/projects => generated 405 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:50.468381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:50.481288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd809c-7412-4e54-83e9-bd1602ecc270 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:50.546998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:50.547649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:50.547932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:50.548206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/1a52bcc617dd4c9c8aaefa3207ebe2d4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:50.549578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a52bcc617dd4c9c8aaefa3207ebe2d4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:50.551565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:50.701582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a52bcc617dd4c9c8aaefa3207ebe2d4', 'request_id': 'req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:50.704121 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:50.713755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a52bcc617dd4c9c8aaefa3207ebe2d4', 'request_id': 'req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:50.787903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a52bcc617dd4c9c8aaefa3207ebe2d4', 'request_id': 'req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:50.800706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 1a52bcc617dd4c9c8aaefa3207ebe2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:50.801026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:50.801653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:50.803174 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3603/7190] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:50 2022] DELETE /identity/v3/projects/1a52bcc617dd4c9c8aaefa3207ebe2d4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:50.807826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:50.810026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:50.825142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df755-0ec9-430f-803f-b57200b5931a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:50.834580 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:50.885397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:50.886214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:50.886562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:50.886793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/e73db6cb7e5147bc90b01a6ddaa035f4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:50.888129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e73db6cb7e5147bc90b01a6ddaa035f4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:50.894671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:51.040237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73db6cb7e5147bc90b01a6ddaa035f4', 'request_id': 'req-8c5eff3a-3430-447c-8601-a983e6a2d84c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.047644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73db6cb7e5147bc90b01a6ddaa035f4', 'request_id': 'req-8c5eff3a-3430-447c-8601-a983e6a2d84c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.155142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73db6cb7e5147bc90b01a6ddaa035f4', 'request_id': 'req-8c5eff3a-3430-447c-8601-a983e6a2d84c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.203281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project e73db6cb7e5147bc90b01a6ddaa035f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:51.203718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.205512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.211438 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3588/7191] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:50 2022] DELETE /identity/v3/projects/e73db6cb7e5147bc90b01a6ddaa035f4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:51.219541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:51.227389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87699f-5fc6-4959-8f9f-c7dd4fdc2713 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:51.290990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:51.291637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:51.291943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:51.292194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains/0d212d5224814edcb2031f97879146c9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:51.294012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0d212d5224814edcb2031f97879146c9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:51.295418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:51.322458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0d212d5224814edcb2031f97879146c9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.323245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0d212d5224814edcb2031f97879146c9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.431829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0d212d5224814edcb2031f97879146c9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.433647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0d212d5224814edcb2031f97879146c9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.437013 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3604/7192] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:51 2022] PATCH /identity/v3/domains/0d212d5224814edcb2031f97879146c9 => generated 278 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:51.441371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:51.442843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:51.465158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5eff3a-3430-447c-8601-a983e6a2d84c tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:51.550960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:51.557145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:51.557145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:51.557145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains/0d212d5224814edcb2031f97879146c9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:51.567426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0d212d5224814edcb2031f97879146c9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:51.569849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:51.601036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0d212d5224814edcb2031f97879146c9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.606173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0d212d5224814edcb2031f97879146c9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.631316 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:51.764203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d212d5224814edcb2031f97879146c9', 'request_id': 'req-6ff82842-2ffe-4e4e-b88d-be01ccb24543'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.778901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d212d5224814edcb2031f97879146c9', 'request_id': 'req-6ff82842-2ffe-4e4e-b88d-be01ccb24543'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.846449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d212d5224814edcb2031f97879146c9', 'request_id': 'req-6ff82842-2ffe-4e4e-b88d-be01ccb24543'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.865905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 0d212d5224814edcb2031f97879146c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:51.866362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.868422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.889816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0d212d5224814edcb2031f97879146c9', 'request_id': 'req-6ff82842-2ffe-4e4e-b88d-be01ccb24543'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.891177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0d212d5224814edcb2031f97879146c9', 'request_id': 'req-6ff82842-2ffe-4e4e-b88d-be01ccb24543'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.899377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0d212d5224814edcb2031f97879146c9', 'request_id': 'req-6ff82842-2ffe-4e4e-b88d-be01ccb24543'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:51.906933 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3589/7193] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:51 2022] DELETE /identity/v3/domains/0d212d5224814edcb2031f97879146c9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:51.911935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:51.913518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:51.943940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02503-d4b7-4118-aa7f-38715b9d03e2 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:52.012470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:52.013214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:52.013759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:52.014074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:52.014745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:52.016646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:52.157622 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3605/7194] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:51 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:52.162219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:52.164258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:52.181187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff82842-2ffe-4e4e-b88d-be01ccb24543 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:52.278861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:52.280044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:52.280334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:52.280613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/be92efa4adde4d969b94371ff2a125a4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:52.287069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=be92efa4adde4d969b94371ff2a125a4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:52.290052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:52.294959 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3590/7195] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:52 2022] GET /identity/v3/projects/be92efa4adde4d969b94371ff2a125a4 => generated 377 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:52.296853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:52.313422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30f8c-6796-49aa-9af2-9473d288b022 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:52.332560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:52.337794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:52.340583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:52.342975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:52.343884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:52.352716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:52.397096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3606/7196] 10.222.0.42 () {58 vars in 1131 bytes} [Sun Oct 23 01:43:52 2022] GET /identity/v3/projects => generated 7312 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:52.415789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:52.435554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a1506-ccea-4321-8e62-cd92844c6325 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:52.453630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:52.454364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:52.454643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:52.454945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/be92efa4adde4d969b94371ff2a125a4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:52.456143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=be92efa4adde4d969b94371ff2a125a4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:52.458222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:52.597595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be92efa4adde4d969b94371ff2a125a4', 'request_id': 'req-b6ff9f1d-2273-447e-a815-9a04fdba67dc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:52.612264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be92efa4adde4d969b94371ff2a125a4', 'request_id': 'req-b6ff9f1d-2273-447e-a815-9a04fdba67dc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:52.679682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be92efa4adde4d969b94371ff2a125a4', 'request_id': 'req-b6ff9f1d-2273-447e-a815-9a04fdba67dc'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:52.695435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project be92efa4adde4d969b94371ff2a125a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:52.695978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:52.696861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:52.698957 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3591/7197] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:52 2022] DELETE /identity/v3/projects/be92efa4adde4d969b94371ff2a125a4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:52.704491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:52.706892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:52.722412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb3163-1786-4d77-a016-c8622040039b tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:52.741025 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:52.793009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:52.793627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:52.793907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:52.794334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:52.794974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:52.797121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:52.924462 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3607/7198] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Oct 23 01:43:52 2022] POST /identity/v3/projects => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:52.928499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:52.933806 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:52.941051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff9f1d-2273-447e-a815-9a04fdba67dc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:53.011000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:53.011766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:53.012125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:53.012476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/fe0061ddfa8246b68b364e8907744873` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:53.013957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:update_project(project_id=fe0061ddfa8246b68b364e8907744873)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:53.015792 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:43:53.015792 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:43:53.015792 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:43:53.018221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:53.147230 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3592/7199] 10.222.0.42 () {60 vars in 1252 bytes} [Sun Oct 23 01:43:52 2022] PATCH /identity/v3/projects/fe0061ddfa8246b68b364e8907744873 => generated 362 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:53.148714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:53.160824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe66058-3ca9-4b7a-888e-273c9498eab6 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:53.165749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:53.166517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:53.167631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:53.167631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/fe0061ddfa8246b68b364e8907744873` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:53.181685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe0061ddfa8246b68b364e8907744873)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:53.185258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:53.191062 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3608/7200] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:53 2022] GET /identity/v3/projects/fe0061ddfa8246b68b364e8907744873 => generated 349 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:53.192764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:53.206789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4865-b105-48f7-aeae-24405f27d27a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:53.212711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:53.214651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:53.215157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:53.215717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/fe0061ddfa8246b68b364e8907744873` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:53.217215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe0061ddfa8246b68b364e8907744873)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:53.219690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:53.358507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0061ddfa8246b68b364e8907744873', 'request_id': 'req-a3039581-e3fe-4ca1-b055-09d1c4897719'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:53.366414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0061ddfa8246b68b364e8907744873', 'request_id': 'req-a3039581-e3fe-4ca1-b055-09d1c4897719'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:53.478534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0061ddfa8246b68b364e8907744873', 'request_id': 'req-a3039581-e3fe-4ca1-b055-09d1c4897719'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:53.519392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project fe0061ddfa8246b68b364e8907744873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:53.519746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:53.520533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:53.524998 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3593/7201] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:53 2022] DELETE /identity/v3/projects/fe0061ddfa8246b68b364e8907744873 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:53.529791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:53.531926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:53.560304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdca39-7f46-4483-949e-b17fd5ae5802 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:53.620777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:53.621313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:53.621596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:53.621877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:53.622542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:53.624604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:53.738296 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3609/7202] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:53 2022] POST /identity/v3/projects => generated 360 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:53.754005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:53.762781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039581-e3fe-4ca1-b055-09d1c4897719 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:53.835375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:53.836308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:53.836714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:53.836995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/0befe20823c442feb5ecc180723323bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:53.838359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:update_project(project_id=0befe20823c442feb5ecc180723323bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:53.840261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:53.851448 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:53.958220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:53.962646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:54.030957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1d2b6-960d-4dce-b042-8f4c4cd44455 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:54.037315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:54.038344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:54.038601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:54.038872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] PATH_INFO: `/v3/users/468b055808364c6fa78c231857d97c39` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:54.040112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468b055808364c6fa78c231857d97c39)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:54.043030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:54.045565 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3594/7203] 10.222.0.42 () {60 vars in 1252 bytes} [Sun Oct 23 01:43:53 2022] PATCH /identity/v3/projects/0befe20823c442feb5ecc180723323bc => generated 372 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:54.049911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:54.062716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc5041-f3c3-4ae8-af55-7ae9f1db42a5 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:54.063740 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:54.067980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:54.068742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:54.069050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:54.069301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/0befe20823c442feb5ecc180723323bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:54.088263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=0befe20823c442feb5ecc180723323bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:54.090407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:54.092350 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3595/7204] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:54 2022] GET /identity/v3/projects/0befe20823c442feb5ecc180723323bc => generated 359 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:43:54.096856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:54.107329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ada52-0816-4968-bd69-3ea3cfaf2b6a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:54.112494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:54.113120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:54.113400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:54.113669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/0befe20823c442feb5ecc180723323bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:54.114875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0befe20823c442feb5ecc180723323bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:54.116757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:54.268316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468b055808364c6fa78c231857d97c39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.279411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468b055808364c6fa78c231857d97c39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.280574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468b055808364c6fa78c231857d97c39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.284600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0befe20823c442feb5ecc180723323bc', 'request_id': 'req-ded71e75-42a3-42d6-abbb-ad158fe6de2a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.294366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0befe20823c442feb5ecc180723323bc', 'request_id': 'req-ded71e75-42a3-42d6-abbb-ad158fe6de2a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.363456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468b055808364c6fa78c231857d97c39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.364155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-51c7d12e-b5a1-405b-ba83-01dbd77051e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468b055808364c6fa78c231857d97c39'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.400630 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3610/7205] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:53 2022] DELETE /identity/v3/users/468b055808364c6fa78c231857d97c39 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:54.403635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:54.404209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:54.404773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:54.427941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:54.438937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:54.461955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0befe20823c442feb5ecc180723323bc', 'request_id': 'req-ded71e75-42a3-42d6-abbb-ad158fe6de2a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.489528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 0befe20823c442feb5ecc180723323bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:54.505441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.509255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.514590 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3611/7206] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:54.518016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:54.525256 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3596/7207] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:54 2022] DELETE /identity/v3/projects/0befe20823c442feb5ecc180723323bc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:54.526893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:54.527043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:54.534308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:54.553281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425281-420a-4dfe-be34-5d5a3a70eea6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:54.559600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:54.560723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:54.561170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:54.561540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] PATH_INFO: `/v3/users/016101a812cd477ab62765b82fab6748` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:54.566411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=016101a812cd477ab62765b82fab6748)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:54.569587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:54.667149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded71e75-42a3-42d6-abbb-ad158fe6de2a tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:54.767260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:54.768030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:54.768840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:54.769332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:54.770231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:54.777009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:54.799879 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:54.802814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016101a812cd477ab62765b82fab6748'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.820179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016101a812cd477ab62765b82fab6748'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.822290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016101a812cd477ab62765b82fab6748'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.906774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016101a812cd477ab62765b82fab6748'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.907557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016101a812cd477ab62765b82fab6748'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:54.924656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3597/7208] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:54 2022] POST /identity/v3/projects => generated 354 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:54.924656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:54.932198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:54.941718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3612/7209] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:54 2022] DELETE /identity/v3/users/016101a812cd477ab62765b82fab6748 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:54.942638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:54.944564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:54.952466 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:55.081719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b7d7-5de0-4af9-b92f-f2070229f844 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:55.097948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977869c-1fe6-46b5-ad89-cf4c2bc36dba admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:55.122671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa414c1-e453-4d97-9f8e-488d92312adc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:55.123888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa414c1-e453-4d97-9f8e-488d92312adc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.124341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa414c1-e453-4d97-9f8e-488d92312adc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.124796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa414c1-e453-4d97-9f8e-488d92312adc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/434bac88769143119b4fdc2c26eadf3f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.128972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa414c1-e453-4d97-9f8e-488d92312adc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:update_project(project_id=434bac88769143119b4fdc2c26eadf3f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:55.131316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa414c1-e453-4d97-9f8e-488d92312adc tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:55.199424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:55.200148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.200496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.200854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.208446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:55.293855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:55.297391 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3613/7210] 10.222.0.42 () {60 vars in 1252 bytes} [Sun Oct 23 01:43:54 2022] PATCH /identity/v3/projects/434bac88769143119b4fdc2c26eadf3f => generated 368 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:55.299919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:55.302043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.302528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.302892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.314016 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3598/7211] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:55.323880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:55.325904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:55.327652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:55.329674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00093a-6bfc-4656-a0ae-ab7fdb8d057f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:55.339623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:55.342327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.342849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.343064 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3614/7212] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:55.343580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/434bac88769143119b4fdc2c26eadf3f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.353337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:55.355318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:55.363835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:get_project(project_id=434bac88769143119b4fdc2c26eadf3f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:55.366184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:55.367965 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3599/7213] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:43:55 2022] GET /identity/v3/projects/434bac88769143119b4fdc2c26eadf3f => generated 355 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:55.372138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:55.379109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fcd2-79e6-40c6-be20-0185ac05d639 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:55.384224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:55.385141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.385534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.386068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.386533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9a119-627c-4c86-8bc2-12e789fb92ec tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:55.391898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:55.393290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.394368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.394368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/projects/434bac88769143119b4fdc2c26eadf3f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.395246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorizing `identity:delete_project(project_id=434bac88769143119b4fdc2c26eadf3f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:55.397351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:55.400517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:55.402672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:55.416800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3615/7214] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:43:55.421573 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:55.553746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434bac88769143119b4fdc2c26eadf3f', 'request_id': 'req-694320a7-4807-4d8e-8b26-bb0c2edcf106'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:55.556415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434bac88769143119b4fdc2c26eadf3f', 'request_id': 'req-694320a7-4807-4d8e-8b26-bb0c2edcf106'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:55.702345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434bac88769143119b4fdc2c26eadf3f', 'request_id': 'req-694320a7-4807-4d8e-8b26-bb0c2edcf106'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:55.725040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] The token cache is being invalidate because project 434bac88769143119b4fdc2c26eadf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:55.725955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:55.726849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:55.728505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3600/7215] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:55 2022] DELETE /identity/v3/projects/434bac88769143119b4fdc2c26eadf3f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:55.735531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:55.751667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e67a8-96f3-47f3-b61b-97f6c0061657 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:55.826858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:55.827667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.828389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.828389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains/0d212d5224814edcb2031f97879146c9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.841897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Could not find domain: 0d212d5224814edcb2031f97879146c9.: keystone.exception.DomainNotFound: Could not find domain: 0d212d5224814edcb2031f97879146c9. Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0d212d5224814edcb2031f97879146c9. Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:55.846715 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:55.848032 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0d212d5224814edcb2031f97879146c9. Oct 23 01:43:55.849502 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:43:55.852342 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3616/7216] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:55 2022] PATCH /identity/v3/domains/0d212d5224814edcb2031f97879146c9 => generated 112 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:55.852514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:55.853579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:55.882398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694320a7-4807-4d8e-8b26-bb0c2edcf106 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:55.888079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d259a58eb754dbba2e5682ac85bcc41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2a549776dbb4e508d087abfd6538cf7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:55.889102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:55.889749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:55.890061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] PATH_INFO: `/v3/domains/b4911dc0b59f419c86b897b67feb1784` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:55.899169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Could not find domain: b4911dc0b59f419c86b897b67feb1784.: keystone.exception.DomainNotFound: Could not find domain: b4911dc0b59f419c86b897b67feb1784. Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b4911dc0b59f419c86b897b67feb1784. Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:43:55.905807 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:43:55.907288 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application with Lock( Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self._enter() Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.creator() Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application created_value = creator( Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b4911dc0b59f419c86b897b67feb1784. Oct 23 01:43:55.908508 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:43:55.909772 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3601/7217] 10.222.0.42 () {60 vars in 1249 bytes} [Sun Oct 23 01:43:55 2022] PATCH /identity/v3/domains/b4911dc0b59f419c86b897b67feb1784 => generated 112 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 23 01:43:55.911836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:55.913811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:55.993014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f324e-6a45-4ae9-a2ab-c21fb44c8df8 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:56.002947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:56.002947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:56.002947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:56.002947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] PATH_INFO: `/v3/users/013a4b7947a94a2488a7f391b498340b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:56.004703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:56.006043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013a4b7947a94a2488a7f391b498340b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:56.006710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:56.008064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:56.011212 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:56.026205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5efd0a-3ff5-4432-8f53-20458c117c95 tempest-ProjectsTestJSON-587738771 tempest-ProjectsTestJSON-587738771-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:56.031393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:56.034414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:56.034414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:56.034414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] PATH_INFO: `/v3/projects/e03db7d9c6f649d3b5fb8e1f7c3ddbfc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:56.043624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03db7d9c6f649d3b5fb8e1f7c3ddbfc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:56.046115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:56.258744 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013a4b7947a94a2488a7f391b498340b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.260650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03db7d9c6f649d3b5fb8e1f7c3ddbfc', 'request_id': 'req-6e6a00a7-606f-4f19-815a-369a1c7781f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.265743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013a4b7947a94a2488a7f391b498340b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.266436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013a4b7947a94a2488a7f391b498340b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.268096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03db7d9c6f649d3b5fb8e1f7c3ddbfc', 'request_id': 'req-6e6a00a7-606f-4f19-815a-369a1c7781f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.357087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013a4b7947a94a2488a7f391b498340b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.357715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013a4b7947a94a2488a7f391b498340b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.377901 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3617/7218] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:55 2022] DELETE /identity/v3/users/013a4b7947a94a2488a7f391b498340b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:56.388752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:56.393699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:56.449680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03db7d9c6f649d3b5fb8e1f7c3ddbfc', 'request_id': 'req-6e6a00a7-606f-4f19-815a-369a1c7781f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.463490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] The token cache is being invalidate because project e03db7d9c6f649d3b5fb8e1f7c3ddbfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:56.464135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.464961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6e6a00a7-606f-4f19-815a-369a1c7781f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.467577 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3602/7219] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:56 2022] DELETE /identity/v3/projects/e03db7d9c6f649d3b5fb8e1f7c3ddbfc => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:56.469105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:56.469559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:56.470136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:56.484068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d9a3c-7c7c-40b2-ad4b-1aff6e76f116 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:56.492951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:56.493647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:56.493922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:56.494221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] PATH_INFO: `/v3/projects/bdf0b30e253d446da7503652ce9920dd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:56.495421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf0b30e253d446da7503652ce9920dd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:56.497318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:56.521897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:56.523599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:56.539793 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3603/7220] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:56.550970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:56.552454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:56.566225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efaa1e-ee59-43a9-849f-d93aca45b486 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:56.571434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:56.577861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:56.577861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:56.577861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] PATH_INFO: `/v3/users/518fa132652e4158b3253f73b935377b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:56.577861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518fa132652e4158b3253f73b935377b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:56.577861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:56.651768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf0b30e253d446da7503652ce9920dd', 'request_id': 'req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.657483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf0b30e253d446da7503652ce9920dd', 'request_id': 'req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.768379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf0b30e253d446da7503652ce9920dd', 'request_id': 'req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.784579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] The token cache is being invalidate because project bdf0b30e253d446da7503652ce9920dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:56.784865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.786573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.788861 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3618/7221] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:56 2022] DELETE /identity/v3/projects/bdf0b30e253d446da7503652ce9920dd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:56.789753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:56.791642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:56.809462 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:56.844139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518fa132652e4158b3253f73b935377b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.852043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518fa132652e4158b3253f73b935377b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.852781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518fa132652e4158b3253f73b935377b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.892944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e5e6-1015-4556-86d7-23aa7e9fe42b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:56.897315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0ca2f-9eb2-4d8f-a139-0fffd48ec97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:56.897938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ca2f-9eb2-4d8f-a139-0fffd48ec97b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:56.898251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ca2f-9eb2-4d8f-a139-0fffd48ec97b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:56.898519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ca2f-9eb2-4d8f-a139-0fffd48ec97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:56.900392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-47c0ca2f-9eb2-4d8f-a139-0fffd48ec97b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:56.928377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518fa132652e4158b3253f73b935377b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.929082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-06a27fdc-a61e-48d6-9579-23c313516f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518fa132652e4158b3253f73b935377b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:56.935483 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=75,keystone:DELETE=22,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:56.960797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3604/7222] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:56 2022] DELETE /identity/v3/users/518fa132652e4158b3253f73b935377b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:56.972043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe152af-c937-45a3-aa34-58b95a74d70e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:56.972389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe152af-c937-45a3-aa34-58b95a74d70e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:56.972671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe152af-c937-45a3-aa34-58b95a74d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:56.978947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ca2f-9eb2-4d8f-a139-0fffd48ec97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:56.980611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ca2f-9eb2-4d8f-a139-0fffd48ec97b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:56.995333 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3619/7223] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:57.009797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fbe152af-c937-45a3-aa34-58b95a74d70e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:57.011374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fbe152af-c937-45a3-aa34-58b95a74d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:57.091457 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3605/7224] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:57.103256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8f98-d424-4cb3-86ce-b7ad8040dc0d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.103256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8f98-d424-4cb3-86ce-b7ad8040dc0d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.103256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8f98-d424-4cb3-86ce-b7ad8040dc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.124841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bfcb8f98-d424-4cb3-86ce-b7ad8040dc0d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:57.126091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bfcb8f98-d424-4cb3-86ce-b7ad8040dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:57.134923 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3620/7225] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:57.139353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe152af-c937-45a3-aa34-58b95a74d70e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.149740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe152af-c937-45a3-aa34-58b95a74d70e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:57.155788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:57.156170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.156444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.156772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.157429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:43:57.157727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:57.160059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:57.178783 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3606/7226] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:43:57.180984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8f98-d424-4cb3-86ce-b7ad8040dc0d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.194771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8f98-d424-4cb3-86ce-b7ad8040dc0d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:57.200563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:57.201494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.202328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.202527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.203260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:57.205830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:57.397874 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3621/7227] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:43:57 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:43:57.403098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.426475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e94322-ce0b-46be-8e82-c593d75021dc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:57.535129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:57.535936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.536293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.536864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.537589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:57.540912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:57.681060 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3607/7228] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:43:57 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:43:57.685147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.696983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a64b6-b5db-44d1-846d-2551afdbbc30 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:57.704671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:57.705996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.706298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.706726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.707383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:57.709088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:57.723010 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3622/7229] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:57.726958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.740033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf080e0-3da8-47a9-8107-6c38787d7429 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:57.759876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.761530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:57.762309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.762765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.763188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.763948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:57.765283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:57.765807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:57.780837 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3608/7230] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:43:57.794465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6fd7-75d6-42a6-9fb4-3b1a9ab9e15c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:57.809210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.831288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fcabd-bbbf-480e-91fc-0d7f08ef7b3e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:57.836787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:57.837446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.837724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.837854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:57.838598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:57.838949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:57.839294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] PATH_INFO: `/v3/projects/7e64fd5446d541da9d10af97a24ea037/users/2630e3eda1df4f698cad1eda511ad76a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.840667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] PATH_INFO: `/v3/projects/e2bfb3800037437cb7353ff304ae0307` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:57.843580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bfb3800037437cb7353ff304ae0307)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:57.849414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:57.873825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e64fd5446d541da9d10af97a24ea037, user_id=2630e3eda1df4f698cad1eda511ad76a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:57.885569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:57.988532 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3609/7231] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:43:57 2022] PUT /identity/v3/projects/7e64fd5446d541da9d10af97a24ea037/users/2630e3eda1df4f698cad1eda511ad76a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:57.989728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:57.991522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:58.037496 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:58.067533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bfb3800037437cb7353ff304ae0307', 'request_id': 'req-7864e4b4-4106-42bb-be1c-6e36b2540bad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.081735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bfb3800037437cb7353ff304ae0307', 'request_id': 'req-7864e4b4-4106-42bb-be1c-6e36b2540bad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.104802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f11d5b-20de-400b-aca8-bcc025f26e52 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:58.169186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:58.170562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:58.170846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:58.171122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] PATH_INFO: `/v3/projects/84c6a942d32c43099187077716ac0218` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:58.173103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c6a942d32c43099187077716ac0218)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:58.176093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bfb3800037437cb7353ff304ae0307', 'request_id': 'req-7864e4b4-4106-42bb-be1c-6e36b2540bad'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.176250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:58.189287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] The token cache is being invalidate because project e2bfb3800037437cb7353ff304ae0307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:58.189722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.190707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7864e4b4-4106-42bb-be1c-6e36b2540bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.192623 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3623/7232] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:57 2022] DELETE /identity/v3/projects/e2bfb3800037437cb7353ff304ae0307 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:43:58.193863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:58.194175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:58.194496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:58.209326 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:58.222618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:43:58.224251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:58.236525 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3624/7233] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:43:58.237639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:58.239168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:58.259668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760fd4-3146-49b6-9b67-70ec9239c7bd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:58.274562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:58.275276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:58.275611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:58.276025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] PATH_INFO: `/v3/users/7d259a58eb754dbba2e5682ac85bcc41` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:58.280567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d259a58eb754dbba2e5682ac85bcc41)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:58.280567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:58.356492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c6a942d32c43099187077716ac0218', 'request_id': 'req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.363690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c6a942d32c43099187077716ac0218', 'request_id': 'req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.445179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c6a942d32c43099187077716ac0218', 'request_id': 'req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.460543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] The token cache is being invalidate because project 84c6a942d32c43099187077716ac0218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:43:58.460871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.477314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.484437 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3610/7234] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:43:57 2022] DELETE /identity/v3/projects/84c6a942d32c43099187077716ac0218 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:58.491132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:58.494836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:58.557229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d259a58eb754dbba2e5682ac85bcc41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.570336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d259a58eb754dbba2e5682ac85bcc41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.572484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d259a58eb754dbba2e5682ac85bcc41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.578907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9680d-87f3-4e5a-91ee-0f379cb9dff4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:58.584416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:58.585293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:58.585638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:58.586012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:58.588396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:58.660673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:58.661838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:58.674812 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3611/7235] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:43:58.675763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:43:58.677318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:43:58.691415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d259a58eb754dbba2e5682ac85bcc41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.691606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ecb2-99b4-4c69-a494-df541e185833 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:43:58.692919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d259a58eb754dbba2e5682ac85bcc41'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.701800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:43:58.701800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:43:58.701800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:43:58.701800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] PATH_INFO: `/v3/users/c00f2c22c3464d34b6b5b1bc1daad9c8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:43:58.702323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00f2c22c3464d34b6b5b1bc1daad9c8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:43:58.702323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:43:58.714630 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:43:58.731093 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3625/7236] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:58 2022] DELETE /identity/v3/users/7d259a58eb754dbba2e5682ac85bcc41 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:43:58.947189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00f2c22c3464d34b6b5b1bc1daad9c8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.968272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00f2c22c3464d34b6b5b1bc1daad9c8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:58.969475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00f2c22c3464d34b6b5b1bc1daad9c8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:59.074339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00f2c22c3464d34b6b5b1bc1daad9c8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:59.075092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00f2c22c3464d34b6b5b1bc1daad9c8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:43:59.095679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3612/7237] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:43:58 2022] DELETE /identity/v3/users/c00f2c22c3464d34b6b5b1bc1daad9c8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:00.074333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:00.076156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:00.161406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:00.163240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:00.164103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee3816-d70f-44b0-8557-43d778f5f111 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:00.250952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:00.252489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.252917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.253337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] PATH_INFO: `/v3/projects/a2a549776dbb4e508d087abfd6538cf7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.256546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a549776dbb4e508d087abfd6538cf7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:00.260422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:00.301952 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:00.317804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48534509-803d-407a-808d-1964eb1f76b2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:00.324642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:00.325545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.326133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.326411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] PATH_INFO: `/v3/projects/a6a7b6343bd44b2fb0becc81abbbb91c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.327659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a7b6343bd44b2fb0becc81abbbb91c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:00.329594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:00.433318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a549776dbb4e508d087abfd6538cf7', 'request_id': 'req-c90e3d61-7208-402e-9168-cd28b2d68bc1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.443344 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:00.443917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a549776dbb4e508d087abfd6538cf7', 'request_id': 'req-c90e3d61-7208-402e-9168-cd28b2d68bc1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.461351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a7b6343bd44b2fb0becc81abbbb91c', 'request_id': 'req-a2f6beec-6c84-4bd2-b543-b78615f41640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.467168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a7b6343bd44b2fb0becc81abbbb91c', 'request_id': 'req-a2f6beec-6c84-4bd2-b543-b78615f41640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.559570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a549776dbb4e508d087abfd6538cf7', 'request_id': 'req-c90e3d61-7208-402e-9168-cd28b2d68bc1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.572701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] The token cache is being invalidate because project a2a549776dbb4e508d087abfd6538cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:00.573000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.574749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c90e3d61-7208-402e-9168-cd28b2d68bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.580022 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3626/7238] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:00 2022] DELETE /identity/v3/projects/a2a549776dbb4e508d087abfd6538cf7 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:00.581459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf835e8b-74ce-49a8-a612-ca8c7859638a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.581841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf835e8b-74ce-49a8-a612-ca8c7859638a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.582240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf835e8b-74ce-49a8-a612-ca8c7859638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.608028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bf835e8b-74ce-49a8-a612-ca8c7859638a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:00.620671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bf835e8b-74ce-49a8-a612-ca8c7859638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:00.626947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a7b6343bd44b2fb0becc81abbbb91c', 'request_id': 'req-a2f6beec-6c84-4bd2-b543-b78615f41640'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.639238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] The token cache is being invalidate because project a6a7b6343bd44b2fb0becc81abbbb91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:00.639578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.640418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2f6beec-6c84-4bd2-b543-b78615f41640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:00.641883 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3613/7239] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:00 2022] DELETE /identity/v3/projects/a6a7b6343bd44b2fb0becc81abbbb91c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:00.646892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927e73-3604-4459-aa0e-433ad8e98948 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.646892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927e73-3604-4459-aa0e-433ad8e98948 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.647340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927e73-3604-4459-aa0e-433ad8e98948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.673137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6f927e73-3604-4459-aa0e-433ad8e98948 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:00.675332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6f927e73-3604-4459-aa0e-433ad8e98948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:00.711239 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3627/7240] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:00.721128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8b09-45eb-4933-a53a-ac8aa7b6d128 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.721434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8b09-45eb-4933-a53a-ac8aa7b6d128 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.721706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8b09-45eb-4933-a53a-ac8aa7b6d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.758041 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3614/7241] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:00.768439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f9ae8b09-45eb-4933-a53a-ac8aa7b6d128 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:00.768439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f9ae8b09-45eb-4933-a53a-ac8aa7b6d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:00.785303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3628/7242] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:00.790443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f927e73-3604-4459-aa0e-433ad8e98948 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:00.807132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f927e73-3604-4459-aa0e-433ad8e98948 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:00.822415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a7b5-c3c3-46b8-8047-2a3d88f4c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:00.822748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a7b5-c3c3-46b8-8047-2a3d88f4c8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.823097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a7b5-c3c3-46b8-8047-2a3d88f4c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.823776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a7b5-c3c3-46b8-8047-2a3d88f4c8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.824764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a7b5-c3c3-46b8-8047-2a3d88f4c8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:44:00.826625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a7b5-c3c3-46b8-8047-2a3d88f4c8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:00.828435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a7b5-c3c3-46b8-8047-2a3d88f4c8ac admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:00.845691 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3615/7243] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:00.850350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8b09-45eb-4933-a53a-ac8aa7b6d128 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:00.863179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8b09-45eb-4933-a53a-ac8aa7b6d128 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:00.864783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f1587-378e-4e5b-883c-00e4d5b69671 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.865152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f1587-378e-4e5b-883c-00e4d5b69671 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.865524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f1587-378e-4e5b-883c-00e4d5b69671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.871693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:00.872592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.872963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.873338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.874101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:00.876250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:00.886461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6b2f1587-378e-4e5b-883c-00e4d5b69671 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:00.887696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6b2f1587-378e-4e5b-883c-00e4d5b69671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:00.900454 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3616/7244] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:00.904405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f1587-378e-4e5b-883c-00e4d5b69671 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:00.914992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f1587-378e-4e5b-883c-00e4d5b69671 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:00.922118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:00.922118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.922118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.922118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.922526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:44:00.922748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:00.924424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:00.941161 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3617/7245] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:44:00.942152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:00.955290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107f46b-9d29-4be0-a22a-14cc9518aae6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:00.960653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:00.961374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:00.961877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:00.962208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:00.962953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:00.964923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.015077 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3629/7246] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:00 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:01.019930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.086676 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3618/7247] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:00 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:01.091249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.100750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294b934-f23a-407f-be65-e057f432b85a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.216769 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:01.228898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f737fb-baea-429d-8be0-b11ee914b204 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.242657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.244273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.244802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.245910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.247729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.249162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec2037-cb2a-48b5-a720-159afb7c045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.249853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2037-cb2a-48b5-a720-159afb7c045d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.250187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2037-cb2a-48b5-a720-159afb7c045d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.250462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2037-cb2a-48b5-a720-159afb7c045d admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.251102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec2037-cb2a-48b5-a720-159afb7c045d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.252570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.254229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec2037-cb2a-48b5-a720-159afb7c045d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.356618 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3630/7248] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:01 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:01.356618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421763f-5e59-4d22-8928-f844a2cd8375 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.356618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421763f-5e59-4d22-8928-f844a2cd8375 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.356618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421763f-5e59-4d22-8928-f844a2cd8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.399573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1421763f-5e59-4d22-8928-f844a2cd8375 None None] MFA Rules not processed for user `2630e3eda1df4f698cad1eda511ad76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:01.399942 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3619/7249] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:01 2022] POST /identity/v3/users => generated 291 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:01.400821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1421763f-5e59-4d22-8928-f844a2cd8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:01.402328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.454628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3bf13-09a3-4bad-bb9a-3382033f3eae admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.470734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.471518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.472414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.472778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.473490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.475288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.489595 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3620/7250] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:01.490836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.504705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297965a5-2530-4875-81a9-38c01f6821d6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.510962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.511587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.512186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.512458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.513396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.515009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.530120 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3621/7251] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:01.530120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.547652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eef97-17b7-4ae3-aaae-93f2f8129b5d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.568166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.568816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.569316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.569597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.570348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.572008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.591670 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3631/7252] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:01.592355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421763f-5e59-4d22-8928-f844a2cd8375 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.609055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3622/7253] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:01.609055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.609419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421763f-5e59-4d22-8928-f844a2cd8375 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.611435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:01.613534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.614483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.615100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.615494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.616253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.618268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.648486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3632/7254] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:01.649622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.663770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcf4c8-20fc-44e5-99f4-1f15ffdc3f78 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.671984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2f3c-ebab-48c2-8428-88a1c9ce8be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.674107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2f3c-ebab-48c2-8428-88a1c9ce8be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.674504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2f3c-ebab-48c2-8428-88a1c9ce8be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.674929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2f3c-ebab-48c2-8428-88a1c9ce8be4 admin admin] PATH_INFO: `/v3/projects/d5c1fbe7e53c465db49951482b2e9206/users/4c3578eda7ab468da06a5fea9776fb8f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.701019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2f3c-ebab-48c2-8428-88a1c9ce8be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c1fbe7e53c465db49951482b2e9206, user_id=4c3578eda7ab468da06a5fea9776fb8f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.705811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2f3c-ebab-48c2-8428-88a1c9ce8be4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.710934 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:01.716899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838fda2-d456-4221-8d52-18a459a0b9da admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.722105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.723054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.723404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.723673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.734205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.735973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.758917 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3623/7255] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:01.759947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.788961 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3633/7256] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:01 2022] PUT /identity/v3/projects/d5c1fbe7e53c465db49951482b2e9206/users/4c3578eda7ab468da06a5fea9776fb8f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:01.798611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1405-e18c-49b5-b282-22e7f599389e service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.800837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0835a-3948-42ea-8beb-5fb3bc061365 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.801595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0835a-3948-42ea-8beb-5fb3bc061365 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.802151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0835a-3948-42ea-8beb-5fb3bc061365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.878323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8bb0835a-3948-42ea-8beb-5fb3bc061365 None None] MFA Rules not processed for user `4c3578eda7ab468da06a5fea9776fb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:01.879853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8bb0835a-3948-42ea-8beb-5fb3bc061365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:01.905487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4d80a-cf1d-4022-9ae0-9ea06376a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:01.906980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4d80a-cf1d-4022-9ae0-9ea06376a0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:01.907517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4d80a-cf1d-4022-9ae0-9ea06376a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:01.908542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4d80a-cf1d-4022-9ae0-9ea06376a0fb admin admin] PATH_INFO: `/v3/projects/c41bb459f91144968c180ed331a3424e/users/754bc2a882e54a3483b10dff7a9fb291/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:01.931595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4d80a-cf1d-4022-9ae0-9ea06376a0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41bb459f91144968c180ed331a3424e, user_id=754bc2a882e54a3483b10dff7a9fb291, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:01.935327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4d80a-cf1d-4022-9ae0-9ea06376a0fb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:01.978647 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3634/7257] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:01.979755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0835a-3948-42ea-8beb-5fb3bc061365 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:01.992926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0835a-3948-42ea-8beb-5fb3bc061365 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:01.999724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.000432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.000727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.000980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.001738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.003919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.052946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3624/7258] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:01 2022] PUT /identity/v3/projects/c41bb459f91144968c180ed331a3424e/users/754bc2a882e54a3483b10dff7a9fb291/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:02.054676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78145c8a-44be-4135-88de-167aa87493db None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.054963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78145c8a-44be-4135-88de-167aa87493db None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.055240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78145c8a-44be-4135-88de-167aa87493db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.093484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-78145c8a-44be-4135-88de-167aa87493db None None] MFA Rules not processed for user `754bc2a882e54a3483b10dff7a9fb291`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:02.095147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-78145c8a-44be-4135-88de-167aa87493db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:02.177001 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3635/7259] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:01 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:02.188248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.238849 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3625/7260] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:02.243973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78145c8a-44be-4135-88de-167aa87493db None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.323454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686abe4-8c24-468c-8435-f8781ffeab34 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.333495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.343680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.343680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.343680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.343680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.343680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.361355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78145c8a-44be-4135-88de-167aa87493db None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.366427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.367425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.367854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.368141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.368979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.370946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.442688 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3636/7261] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:02 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:02.446717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.457624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8a1a8-08f5-41c8-a4de-1d9ac781bf78 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.462518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.463132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.463407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.463677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.464314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.465897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.483720 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3637/7262] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:44:02.485315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.496886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11a2c1-beaa-46b5-b68b-8619eaa18e82 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.504386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.505153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.505423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.505709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] PATH_INFO: `/v3/projects/ae0d0a310d614456a9910b85ecb4f6e9/users/110c92fdb1474349bda2c330f979be46/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.511909 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3626/7263] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:02 2022] POST /identity/v3/projects => generated 383 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:02.515460 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.524188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0d0a310d614456a9910b85ecb4f6e9, user_id=110c92fdb1474349bda2c330f979be46, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.527719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.594276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081e3d-733a-4b97-872c-6ad48a5f7e0f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.600205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.600858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.601141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.601414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.602090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.604658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.628364 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3638/7264] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:02 2022] PUT /identity/v3/projects/ae0d0a310d614456a9910b85ecb4f6e9/users/110c92fdb1474349bda2c330f979be46/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:02.629319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.632952 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:02.707101 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3627/7265] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:02 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:02.722048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.728355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59841463-1aab-44cb-8cac-01fe545e09fd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.746799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.747510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.747845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.748125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.748782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.753667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.755663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f42c-f675-4822-a49e-9165b9cc6e65 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.767259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.768227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.768510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.768917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.769665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.771309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.774306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3628/7266] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:02.778696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.805939 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3639/7267] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:02.810939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e94d4-e4aa-45da-999f-e6b857d14554 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.811136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.817213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.823593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.823593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.823593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.823593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.823593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.834669 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3629/7268] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:02.838687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:02.839790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1cc5-e53a-4c93-a0d3-169585a415dd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.846415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29c593-27a8-407f-bdb3-af2c7b7aa94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.848320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c593-27a8-407f-bdb3-af2c7b7aa94c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.848807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c593-27a8-407f-bdb3-af2c7b7aa94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.849579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c593-27a8-407f-bdb3-af2c7b7aa94c admin admin] PATH_INFO: `/v3/projects/ae0d0a310d614456a9910b85ecb4f6e9/users/110c92fdb1474349bda2c330f979be46/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.851966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0f31-19a9-4082-9b90-dbf406897eb1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:02.852372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29c593-27a8-407f-bdb3-af2c7b7aa94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0d0a310d614456a9910b85ecb4f6e9, user_id=110c92fdb1474349bda2c330f979be46, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.857090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29c593-27a8-407f-bdb3-af2c7b7aa94c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.857597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f22b9-046f-4509-8337-9cd4adcbbf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:02.858608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f22b9-046f-4509-8337-9cd4adcbbf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.858735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f22b9-046f-4509-8337-9cd4adcbbf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.859071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f22b9-046f-4509-8337-9cd4adcbbf76 admin admin] PATH_INFO: `/v3/projects/bf3c3fde12e543839c91b5b6ab840c15/users/2a46e17411c348678a7d86b4c0c92993/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.874547 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3640/7269] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:02 2022] PUT /identity/v3/projects/ae0d0a310d614456a9910b85ecb4f6e9/users/110c92fdb1474349bda2c330f979be46/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:02.876546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f22b9-046f-4509-8337-9cd4adcbbf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3c3fde12e543839c91b5b6ab840c15, user_id=2a46e17411c348678a7d86b4c0c92993, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:02.879292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f22b9-046f-4509-8337-9cd4adcbbf76 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:02.885099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eea14-6529-4f42-89c1-e90e413e032c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:02.885459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eea14-6529-4f42-89c1-e90e413e032c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:02.885736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eea14-6529-4f42-89c1-e90e413e032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:02.914215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-554eea14-6529-4f42-89c1-e90e413e032c None None] MFA Rules not processed for user `110c92fdb1474349bda2c330f979be46`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:02.915419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-554eea14-6529-4f42-89c1-e90e413e032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:02.994095 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3630/7270] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:02 2022] PUT /identity/v3/projects/bf3c3fde12e543839c91b5b6ab840c15/users/2a46e17411c348678a7d86b4c0c92993/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:03.001312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3641/7271] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:03.006489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d514ff-1cd1-48c6-afa1-029c91f5948f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.006774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d514ff-1cd1-48c6-afa1-029c91f5948f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.007048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d514ff-1cd1-48c6-afa1-029c91f5948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.010655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eea14-6529-4f42-89c1-e90e413e032c None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.020605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eea14-6529-4f42-89c1-e90e413e032c None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.037732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d2d514ff-1cd1-48c6-afa1-029c91f5948f None None] MFA Rules not processed for user `2a46e17411c348678a7d86b4c0c92993`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:03.039083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d2d514ff-1cd1-48c6-afa1-029c91f5948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:03.085125 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:03.093473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.094052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.094340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.094851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.095768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.097752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.131349 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3631/7272] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:03.135871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d514ff-1cd1-48c6-afa1-029c91f5948f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.204030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d514ff-1cd1-48c6-afa1-029c91f5948f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.209679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.210328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.211879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.211879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.211879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.213421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.226717 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3642/7273] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:03 2022] POST /identity/v3/projects => generated 358 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:03.228510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.310544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975f0f1-2b07-4dca-8c1f-dc3a8d616998 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.315877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.323142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.323142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.323142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.323142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.323142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.323631 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3632/7274] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:03 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:03.325548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.345649 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:03.390646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a7cb-06de-489e-a957-07279e9e5926 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.395489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.396099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.396376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.396649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.397271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.399234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.422057 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3643/7275] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:03 2022] POST /identity/v3/users => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:03.424024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.434897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe565d-c05e-4ce4-8633-1c636131e823 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.480907 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3633/7276] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:03 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:03.485268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.506026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aff0d-05ee-434a-a68e-bd99ea4ad5d4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.518250 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:03.519574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.520449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.520803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.521301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.522122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.525221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.530892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.531546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.531828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.532105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/adb6046b690e463b84d5490ea5fe9cfb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.536650 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:03.538085 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3634/7277] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:03.542030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.551820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:get_user(user_id=adb6046b690e463b84d5490ea5fe9cfb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.564716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.564851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf855358-6932-4938-9d0b-e1b64a76883f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.564949 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3644/7278] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:44:03 2022] GET /identity/v3/users/adb6046b690e463b84d5490ea5fe9cfb => generated 373 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:03.565035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.565035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.565035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.565035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] PATH_INFO: `/v3/projects/395648e6788d437d8c6f9cde82d29b9e/users/23905374cd974003bc78d9f3dbdc2439/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.565678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.576141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0a82-73e2-453d-8371-38975302af89 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.581658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.582308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.584941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.584941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/adb6046b690e463b84d5490ea5fe9cfb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.584941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=adb6046b690e463b84d5490ea5fe9cfb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.586306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.592475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] RBAC: Authorizing `identity:create_grant(project_id=395648e6788d437d8c6f9cde82d29b9e, user_id=23905374cd974003bc78d9f3dbdc2439, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.595592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.679278 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3635/7279] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:03 2022] PUT /identity/v3/projects/395648e6788d437d8c6f9cde82d29b9e/users/23905374cd974003bc78d9f3dbdc2439/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:03.683774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.724391 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:03.743475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb6046b690e463b84d5490ea5fe9cfb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:03.752957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb6046b690e463b84d5490ea5fe9cfb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:03.753824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb6046b690e463b84d5490ea5fe9cfb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:03.758074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f595da-145c-45d2-ac6d-07efdb48281b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.763281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.774363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.774363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.774363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.774363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.774363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.778799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3636/7280] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:03.782839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.792647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84166-964a-4cbc-90ff-df6decc246d6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:03.797279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59927a6d-ef66-46f7-be2f-de1ad1684d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:03.797946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59927a6d-ef66-46f7-be2f-de1ad1684d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.798254 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59927a6d-ef66-46f7-be2f-de1ad1684d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.798526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59927a6d-ef66-46f7-be2f-de1ad1684d44 admin admin] PATH_INFO: `/v3/projects/395648e6788d437d8c6f9cde82d29b9e/users/23905374cd974003bc78d9f3dbdc2439/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.800426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59927a6d-ef66-46f7-be2f-de1ad1684d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395648e6788d437d8c6f9cde82d29b9e, user_id=23905374cd974003bc78d9f3dbdc2439, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:03.803107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59927a6d-ef66-46f7-be2f-de1ad1684d44 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:03.813035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3637/7281] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:03 2022] PUT /identity/v3/projects/395648e6788d437d8c6f9cde82d29b9e/users/23905374cd974003bc78d9f3dbdc2439/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:03.825091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:03.825373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:03.825718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:03.858225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] MFA Rules not processed for user `23905374cd974003bc78d9f3dbdc2439`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:03.859871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:03.861229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb6046b690e463b84d5490ea5fe9cfb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:03.862203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb6046b690e463b84d5490ea5fe9cfb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:03.899447 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3645/7282] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:03 2022] DELETE /identity/v3/users/adb6046b690e463b84d5490ea5fe9cfb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:03.916363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:03.916363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:04.008871 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3638/7283] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:04.017944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298032de-c38f-4fdd-ae6a-938e00ccb05a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:04.020922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:04.022800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:04.033081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:04.033957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:04.034418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:04.034695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/5cb83f973acb4b53bac28c0b30135bba` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:04.036142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5cb83f973acb4b53bac28c0b30135bba)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:04.038172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:04.068985 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:04.096505 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:04.115453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319ce28-4b32-4c76-af16-9e772529727b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:04.164447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:04.165142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:04.165344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:04.165602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:04.167725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:04.183209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb83f973acb4b53bac28c0b30135bba', 'request_id': 'req-44c45346-5a20-44c1-ac19-990c717c6c53'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:04.190016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb83f973acb4b53bac28c0b30135bba', 'request_id': 'req-44c45346-5a20-44c1-ac19-990c717c6c53'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:04.232566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:04.234047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:04.243670 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3639/7284] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:04.278424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb83f973acb4b53bac28c0b30135bba', 'request_id': 'req-44c45346-5a20-44c1-ac19-990c717c6c53'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:04.291746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] The token cache is being invalidate because project 5cb83f973acb4b53bac28c0b30135bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:04.292074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:04.293082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:04.294948 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3646/7285] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:03 2022] DELETE /identity/v3/projects/5cb83f973acb4b53bac28c0b30135bba => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:04.300475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:04.311455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e821f-c7d3-4dc6-9651-0557848da3ad service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:04.389100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:04.390749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:04.391038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:04.391339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:04.392025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:04.394810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:04.542529 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3640/7286] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:04 2022] POST /identity/v3/projects => generated 360 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:04.546519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:04.548100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:04.561346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c45346-5a20-44c1-ac19-990c717c6c53 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:04.621369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:04.621928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:04.622234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:04.622567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:04.623159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:04.624994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:04.768303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3647/7287] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:04 2022] POST /identity/v3/users => generated 417 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:04.772132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:04.783856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398db99-be19-432d-9480-c817d3529ecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:04.795615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:04.798584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:04.798863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:04.800834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:04.800834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:04.804097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:04.954779 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3641/7288] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:44:04 2022] POST /identity/v3/roles => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:04.961114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:04.977061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f9be-9522-434c-b81f-77c5e7194a9a tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:04.982342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:04.982976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:04.983236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:04.983517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/d86e4c06ebaa49c69f57664991f7e508` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.000400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:get_user(user_id=d86e4c06ebaa49c69f57664991f7e508)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.003490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:05.005435 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3648/7289] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:44:04 2022] GET /identity/v3/users/d86e4c06ebaa49c69f57664991f7e508 => generated 417 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:05.009286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:05.020328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2649808-2da2-48ec-99fa-aae3f20527e4 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:05.025510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:05.026196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:05.028549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:05.028549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/roles/00912cf38de44864a9a0d9e4777c27e8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.028549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:get_role(role_id=00912cf38de44864a9a0d9e4777c27e8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.030036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:05.031558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3642/7290] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:44:05 2022] GET /identity/v3/roles/00912cf38de44864a9a0d9e4777c27e8 => generated 240 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:05.035560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:05.045882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32efa0-0285-45ae-9108-879195e11488 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:05.050900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:05.051489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:05.051769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:05.052050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.052790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.054916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:05.181171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3649/7291] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:05 2022] POST /identity/v3/projects => generated 360 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:05.185237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:05.197003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8261-12ae-4c83-9f9c-2180aaf2561d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:05.216905 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:05.266003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:05.266759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:05.267107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:05.267451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/7b6278ae855c41948238e17723be33a1` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.269337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:get_project(project_id=7b6278ae855c41948238e17723be33a1)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.271494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:05.276251 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3643/7292] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:44:05 2022] GET /identity/v3/projects/7b6278ae855c41948238e17723be33a1 => generated 360 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:05.284616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:05.288660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205fa0d-8673-41ad-a002-716747929e8e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:05.293915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:05.294668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:05.294952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:05.295255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/7b6278ae855c41948238e17723be33a1/users/d86e4c06ebaa49c69f57664991f7e508/roles/00912cf38de44864a9a0d9e4777c27e8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.297480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7b6278ae855c41948238e17723be33a1, user_id=d86e4c06ebaa49c69f57664991f7e508, role_id=00912cf38de44864a9a0d9e4777c27e8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.301342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:05.418813 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3650/7293] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:05 2022] PUT /identity/v3/projects/7b6278ae855c41948238e17723be33a1/users/d86e4c06ebaa49c69f57664991f7e508/roles/00912cf38de44864a9a0d9e4777c27e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:05.422482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:05.434120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0b6db-0b2f-4e03-a18a-e3eeae06ac11 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:05.499619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:05.500263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:05.500540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:05.500812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.501432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.503929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:05.763090 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3644/7294] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:05 2022] POST /identity/v3/projects => generated 360 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:05.763235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:05.777948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da7dd5-af14-49fa-9a92-598ef824be54 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:05.867053 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:05.883893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:05.884619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:05.884971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:05.885311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/1a28b4fccbcd45a6a51b11e6ba10a4d5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.886557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:get_project(project_id=1a28b4fccbcd45a6a51b11e6ba10a4d5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.888671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:05.890685 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3651/7295] 10.222.0.42 () {58 vars in 1230 bytes} [Sun Oct 23 01:44:05 2022] GET /identity/v3/projects/1a28b4fccbcd45a6a51b11e6ba10a4d5 => generated 360 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:05.895194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:05.906385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de482e3d-f8d7-4b2d-8cf5-5a1cd0f86b6c tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:05.911629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:05.912282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:05.912561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:05.912834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/1a28b4fccbcd45a6a51b11e6ba10a4d5/users/d86e4c06ebaa49c69f57664991f7e508/roles/00912cf38de44864a9a0d9e4777c27e8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:05.915054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1a28b4fccbcd45a6a51b11e6ba10a4d5, user_id=d86e4c06ebaa49c69f57664991f7e508, role_id=00912cf38de44864a9a0d9e4777c27e8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:05.918500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:06.115248 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3645/7296] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:05 2022] PUT /identity/v3/projects/1a28b4fccbcd45a6a51b11e6ba10a4d5/users/d86e4c06ebaa49c69f57664991f7e508/roles/00912cf38de44864a9a0d9e4777c27e8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:06.119472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:06.134430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c100c-42f0-4399-94b8-0f02ef868792 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:06.238530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:06.238530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:06.238530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:06.239001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/d86e4c06ebaa49c69f57664991f7e508/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:06.239001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=d86e4c06ebaa49c69f57664991f7e508)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:06.239001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:06.287360 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3652/7297] 10.222.0.42 () {58 vars in 1248 bytes} [Sun Oct 23 01:44:06 2022] GET /identity/v3/users/d86e4c06ebaa49c69f57664991f7e508/projects => generated 844 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:06.291482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:06.322550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0b12-de79-4326-b331-1dc8ae8471fd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:06.328380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:06.329271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:06.329798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:06.330777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/1a28b4fccbcd45a6a51b11e6ba10a4d5` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:06.332473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a28b4fccbcd45a6a51b11e6ba10a4d5)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:06.334543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:06.636456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a28b4fccbcd45a6a51b11e6ba10a4d5', 'request_id': 'req-af09242c-997b-4ae6-81db-7a37779f0068'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:06.643118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a28b4fccbcd45a6a51b11e6ba10a4d5', 'request_id': 'req-af09242c-997b-4ae6-81db-7a37779f0068'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:06.723175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a28b4fccbcd45a6a51b11e6ba10a4d5', 'request_id': 'req-af09242c-997b-4ae6-81db-7a37779f0068'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:06.741201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] The token cache is being invalidate because project 1a28b4fccbcd45a6a51b11e6ba10a4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:06.741529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:06.742496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:06.744173 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3646/7298] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:06 2022] DELETE /identity/v3/projects/1a28b4fccbcd45a6a51b11e6ba10a4d5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:06.749225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:06.754512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:06.779236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23073-389a-45ad-84ef-ec51363fa751 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:06.847949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:06.848674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:06.849049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:06.849440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/7b6278ae855c41948238e17723be33a1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:06.850803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b6278ae855c41948238e17723be33a1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:06.852786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:07.141869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6278ae855c41948238e17723be33a1', 'request_id': 'req-de639756-4287-47ba-a909-4c2c760efcb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.149936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6278ae855c41948238e17723be33a1', 'request_id': 'req-de639756-4287-47ba-a909-4c2c760efcb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.155478 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:07.249472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6278ae855c41948238e17723be33a1', 'request_id': 'req-de639756-4287-47ba-a909-4c2c760efcb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.262412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] The token cache is being invalidate because project 7b6278ae855c41948238e17723be33a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:07.262800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.263541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.265110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3653/7299] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:06 2022] DELETE /identity/v3/projects/7b6278ae855c41948238e17723be33a1 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:07.269168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:07.285594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09242c-997b-4ae6-81db-7a37779f0068 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:07.294747 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:07.346938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:07.347831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:07.348182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:07.348520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/roles/00912cf38de44864a9a0d9e4777c27e8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:07.350054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_role(role_id=00912cf38de44864a9a0d9e4777c27e8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:07.351793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:07.403849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:07.405272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:07.477400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639756-4287-47ba-a909-4c2c760efcb9 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:07.480278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invalidating the token cache because role 00912cf38de44864a9a0d9e4777c27e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:07.480862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.482610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.489871 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3647/7300] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:07 2022] DELETE /identity/v3/roles/00912cf38de44864a9a0d9e4777c27e8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:07.495045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:07.496836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:07.507119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:07.507119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:07.507119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:07.507119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:07.507620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:07.577196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:07.578941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:07.581998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a40b3-3368-4e0d-96fe-2435cc3fb91d tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:07.611007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:07.611317 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3654/7301] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:07.611624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:07.612425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:07.612703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/d86e4c06ebaa49c69f57664991f7e508` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:07.618236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d86e4c06ebaa49c69f57664991f7e508)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:07.620930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:07.791885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86e4c06ebaa49c69f57664991f7e508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.800466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86e4c06ebaa49c69f57664991f7e508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.803165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86e4c06ebaa49c69f57664991f7e508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.912934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86e4c06ebaa49c69f57664991f7e508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.913659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86e4c06ebaa49c69f57664991f7e508'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:07.935825 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3648/7302] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:07 2022] DELETE /identity/v3/users/d86e4c06ebaa49c69f57664991f7e508 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:07.940841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:07.952920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f52b-6e07-46fd-bf24-cca7fb0ffa8b service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:08.013016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:08.013691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:08.013959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:08.023667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/e571deac3d3b49e595eff1ac262a0dc0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:08.023667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e571deac3d3b49e595eff1ac262a0dc0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:08.023667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:08.181753 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:08.183140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e571deac3d3b49e595eff1ac262a0dc0', 'request_id': 'req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.189173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e571deac3d3b49e595eff1ac262a0dc0', 'request_id': 'req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.282146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e571deac3d3b49e595eff1ac262a0dc0', 'request_id': 'req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.295044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] The token cache is being invalidate because project e571deac3d3b49e595eff1ac262a0dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:08.295395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.296141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce174cd0-dee0-4ac4-a28b-94b35f1a90a0 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.297833 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3655/7303] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:07 2022] DELETE /identity/v3/projects/e571deac3d3b49e595eff1ac262a0dc0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:08.302898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:08.304520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:08.318530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cbf04-d6b4-4584-900a-c7e72f1deb07 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:08.376557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:08.377193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:08.378196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:08.378473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/4c3578eda7ab468da06a5fea9776fb8f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:08.379719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:update_user(user_id=4c3578eda7ab468da06a5fea9776fb8f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:08.380758 n-d-master-1 devstack@keystone.service[81937]: WARNING py.warnings [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 01:44:08.380758 n-d-master-1 devstack@keystone.service[81937]: warnings.warn(msg) Oct 23 01:44:08.380758 n-d-master-1 devstack@keystone.service[81937]: Oct 23 01:44:08.381949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:08.415593 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:08.475911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.563769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invalidating the token cache because user 4c3578eda7ab468da06a5fea9776fb8f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:08.564074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.567582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.568448 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3649/7304] 10.222.0.42 () {60 vars in 1243 bytes} [Sun Oct 23 01:44:08 2022] PATCH /identity/v3/users/4c3578eda7ab468da06a5fea9776fb8f => generated 296 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:08.573116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048510cd-2363-40ff-b181-d2c43bc6bfdd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:08.573622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048510cd-2363-40ff-b181-d2c43bc6bfdd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:08.573899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048510cd-2363-40ff-b181-d2c43bc6bfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:08.613335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-048510cd-2363-40ff-b181-d2c43bc6bfdd None None] MFA Rules not processed for user `4c3578eda7ab468da06a5fea9776fb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:08.614945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-048510cd-2363-40ff-b181-d2c43bc6bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:08.622235 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3656/7305] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:08 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:08.624056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:08.625463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:08.638306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5386-d756-4a5e-8c95-00091f41b560 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:08.643016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:08.643644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:08.643924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:08.644196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/4c3578eda7ab468da06a5fea9776fb8f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:08.645388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:update_user(user_id=4c3578eda7ab468da06a5fea9776fb8f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:08.647419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:08.812068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.992465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invalidating the token cache because user 4c3578eda7ab468da06a5fea9776fb8f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:08.992765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.998964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ce51c55d-37b2-4bff-b045-2f08ffd7961e tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:08.998964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3650/7306] 10.222.0.42 () {60 vars in 1243 bytes} [Sun Oct 23 01:44:08 2022] PATCH /identity/v3/users/4c3578eda7ab468da06a5fea9776fb8f => generated 296 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:08.999750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048510cd-2363-40ff-b181-d2c43bc6bfdd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:09.019539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048510cd-2363-40ff-b181-d2c43bc6bfdd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:09.034086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:09.034086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:09.034086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:09.034502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/4c3578eda7ab468da06a5fea9776fb8f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:09.051481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:update_user(user_id=4c3578eda7ab468da06a5fea9776fb8f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:09.053500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:09.132152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:09.261221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invalidating the token cache because user 4c3578eda7ab468da06a5fea9776fb8f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:09.261221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:09.264954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:09.264954 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3657/7307] 10.222.0.42 () {60 vars in 1243 bytes} [Sun Oct 23 01:44:08 2022] PATCH /identity/v3/users/4c3578eda7ab468da06a5fea9776fb8f => generated 296 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:44:09.268469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a326180-2b31-4dd9-8203-dced4ab79893 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:09.268757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a326180-2b31-4dd9-8203-dced4ab79893 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:09.269028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a326180-2b31-4dd9-8203-dced4ab79893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:09.303636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0a326180-2b31-4dd9-8203-dced4ab79893 None None] MFA Rules not processed for user `4c3578eda7ab468da06a5fea9776fb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:09.304950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0a326180-2b31-4dd9-8203-dced4ab79893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:09.308192 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3651/7308] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:09 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:09.312468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:09.313961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:09.327297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318a8a-86f7-46e6-8cf6-7b9707e173ed tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:09.332511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:09.333260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:09.333607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:09.334086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/4c3578eda7ab468da06a5fea9776fb8f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:09.335315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:update_user(user_id=4c3578eda7ab468da06a5fea9776fb8f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:09.337234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:09.502990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:09.632237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invalidating the token cache because user 4c3578eda7ab468da06a5fea9776fb8f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:09.636410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:09.636410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:09.636410 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3658/7309] 10.222.0.42 () {60 vars in 1243 bytes} [Sun Oct 23 01:44:09 2022] PATCH /identity/v3/users/4c3578eda7ab468da06a5fea9776fb8f => generated 296 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:09.642517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a326180-2b31-4dd9-8203-dced4ab79893 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:09.659833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a326180-2b31-4dd9-8203-dced4ab79893 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:09.669551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:09.670208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:09.670498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:09.670854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:09.671424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:09.673375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:09.699900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:09.701541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:09.772541 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3652/7310] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Oct 23 01:44:09 2022] POST /identity/v3/users => generated 265 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:09.779168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:09.783936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:09.785197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0156af-df88-4a54-83ca-aacac2c74412 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:09.789563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999c206-8159-4f80-bbbe-4902bb94bf41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:09.790634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999c206-8159-4f80-bbbe-4902bb94bf41 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:09.791144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999c206-8159-4f80-bbbe-4902bb94bf41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:09.792030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999c206-8159-4f80-bbbe-4902bb94bf41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:09.794386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3999c206-8159-4f80-bbbe-4902bb94bf41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:09.798887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6efa0-8182-4ea9-afd1-1edf425e79d1 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:09.808457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390c660-318e-4e23-babc-c289a58370ea tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:09.808457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390c660-318e-4e23-babc-c289a58370ea tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:09.808457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390c660-318e-4e23-babc-c289a58370ea tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:09.809069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390c660-318e-4e23-babc-c289a58370ea tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/058b42a8b2cd4e5399e8ed5f546d81da/password` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:09.865117 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:09.880676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999c206-8159-4f80-bbbe-4902bb94bf41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:09.882366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999c206-8159-4f80-bbbe-4902bb94bf41 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:09.898114 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3659/7311] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:44:09.974659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2390c660-318e-4e23-babc-c289a58370ea tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '058b42a8b2cd4e5399e8ed5f546d81da'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:10.142320 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3653/7312] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:09 2022] POST /identity/v3/users/058b42a8b2cd4e5399e8ed5f546d81da/password => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:11.148490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75af1-f165-44de-9abe-c7f6fd108eea None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:11.149009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75af1-f165-44de-9abe-c7f6fd108eea None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:11.149009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75af1-f165-44de-9abe-c7f6fd108eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:11.171068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d0e75af1-f165-44de-9abe-c7f6fd108eea None None] MFA Rules not processed for user `058b42a8b2cd4e5399e8ed5f546d81da`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:11.172279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d0e75af1-f165-44de-9abe-c7f6fd108eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:11.175584 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3660/7313] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:11 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:11.179675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390c660-318e-4e23-babc-c289a58370ea tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:11.190671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390c660-318e-4e23-babc-c289a58370ea tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:11.195356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:11.195968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:11.196275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:11.196749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:11.203284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:11.206394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:11.220259 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3654/7314] 10.222.0.42 () {56 vars in 1263 bytes} [Sun Oct 23 01:44:11 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:44:11.224856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e75af1-f165-44de-9abe-c7f6fd108eea None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:11.240206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e75af1-f165-44de-9abe-c7f6fd108eea None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:11.245676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:11.246367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:11.246700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:11.246973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/058b42a8b2cd4e5399e8ed5f546d81da` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:11.249083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=058b42a8b2cd4e5399e8ed5f546d81da)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:11.250538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:11.422998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058b42a8b2cd4e5399e8ed5f546d81da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:11.435342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058b42a8b2cd4e5399e8ed5f546d81da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:11.436487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058b42a8b2cd4e5399e8ed5f546d81da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:11.506644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058b42a8b2cd4e5399e8ed5f546d81da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:11.507312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058b42a8b2cd4e5399e8ed5f546d81da'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:11.529518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3661/7315] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:11 2022] DELETE /identity/v3/users/058b42a8b2cd4e5399e8ed5f546d81da => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:11.534909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:11.547273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e08214-f50b-43a9-a8fc-b58bd392b648 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:11.558173 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:UPDATE=3,keystone:INSERT=9,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:11.621782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:11.622732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:11.623225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:11.623727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:11.624648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:11.628474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:11.793075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:11.794511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:11.796633 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3655/7316] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:11 2022] POST /identity/v3/users => generated 367 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:11.809458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a7225-9085-4d37-a847-d533379f7432 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:11.814166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:11.814820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:11.815097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:11.815367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:11.816017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:11.818027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:11.950218 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3662/7317] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:11 2022] POST /identity/v3/projects => generated 360 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:11.952804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:11.969755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b69de1-892e-4a22-8354-483a9474a6df tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:12.043565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:12.044208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:12.044489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:12.046717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/91aa15b511e847dd830a927a9ae88f5d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:12.059549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:update_user(user_id=91aa15b511e847dd830a927a9ae88f5d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:12.061617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:12.183416 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3656/7318] 10.222.0.42 () {60 vars in 1244 bytes} [Sun Oct 23 01:44:11 2022] PATCH /identity/v3/users/91aa15b511e847dd830a927a9ae88f5d => generated 517 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:12.187545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:12.201320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0dc6-5f77-4636-bcdb-492b324d9c02 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:12.210876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:12.211603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:12.211949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:12.212237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/91aa15b511e847dd830a927a9ae88f5d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:12.258339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:get_user(user_id=91aa15b511e847dd830a927a9ae88f5d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:12.262185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:12.264479 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3663/7319] 10.222.0.42 () {58 vars in 1221 bytes} [Sun Oct 23 01:44:12 2022] GET /identity/v3/users/91aa15b511e847dd830a927a9ae88f5d => generated 386 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:12.269025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:12.279495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adab27-fb46-4cda-9c59-a87aae30e786 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:12.285479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:12.286215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:12.286507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:12.287248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/projects/8dd47468ba914475a4bd88b7f05bf376` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:12.288433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8dd47468ba914475a4bd88b7f05bf376)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:12.290551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:12.452789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd47468ba914475a4bd88b7f05bf376', 'request_id': 'req-150427b0-b30b-4d9f-aa4f-be4984a1cecd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.461842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd47468ba914475a4bd88b7f05bf376', 'request_id': 'req-150427b0-b30b-4d9f-aa4f-be4984a1cecd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.503155 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:12.614537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd47468ba914475a4bd88b7f05bf376', 'request_id': 'req-150427b0-b30b-4d9f-aa4f-be4984a1cecd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.634516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] The token cache is being invalidate because project 8dd47468ba914475a4bd88b7f05bf376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:12.634808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.635573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.640745 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3657/7320] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:12 2022] DELETE /identity/v3/projects/8dd47468ba914475a4bd88b7f05bf376 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:12.641810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:12.645165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:12.661208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11fc28-421f-4dc1-bfe9-1b251b159785 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:12.729962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '110c92fdb1474349bda2c330f979be46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0d0a310d614456a9910b85ecb4f6e9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:12.730652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:12.730931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:12.731207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] PATH_INFO: `/v3/users/91aa15b511e847dd830a927a9ae88f5d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:12.732766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91aa15b511e847dd830a927a9ae88f5d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:12.734875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:12.761960 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:12.879774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91aa15b511e847dd830a927a9ae88f5d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.887119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91aa15b511e847dd830a927a9ae88f5d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.888004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91aa15b511e847dd830a927a9ae88f5d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.976660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91aa15b511e847dd830a927a9ae88f5d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:12.977586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bb42fb32-f424-4c91-a5bd-8e0cfca07d36 tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91aa15b511e847dd830a927a9ae88f5d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:13.005111 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3664/7321] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:12 2022] DELETE /identity/v3/users/91aa15b511e847dd830a927a9ae88f5d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:13.005432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:13.007620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:13.081372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150427b0-b30b-4d9f-aa4f-be4984a1cecd tempest-UsersV3TestJSON-722580926 tempest-UsersV3TestJSON-722580926-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:13.146418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:13.147115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:13.147394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:13.147664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] PATH_INFO: `/v3/users/4c3578eda7ab468da06a5fea9776fb8f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:13.162804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3578eda7ab468da06a5fea9776fb8f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:13.164740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:13.430447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:13.450505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:13.450852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:13.562558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:13.564343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3578eda7ab468da06a5fea9776fb8f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:13.603681 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3658/7322] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:13 2022] DELETE /identity/v3/users/4c3578eda7ab468da06a5fea9776fb8f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:13.609178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:13.609728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:13.609728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:13.638465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:13.645995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:13.728358 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3665/7323] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:13.749050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:13.750704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:13.761386 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:13.839306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600d9ba-fe37-467c-8b1f-0bad472aca5f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:13.843168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:13.843868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:13.844211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:13.844489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:13.854984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:13.861217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:13.866426 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3659/7324] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:44:14.378596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:14.383961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:14.395736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5e2a-cd95-4c1c-abdc-257663d84672 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:14.400638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:14.415373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:14.415583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:14.415811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] PATH_INFO: `/v3/projects/d5c1fbe7e53c465db49951482b2e9206` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:14.418485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c1fbe7e53c465db49951482b2e9206)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:14.431321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:14.613044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c1fbe7e53c465db49951482b2e9206', 'request_id': 'req-1cc6f761-1d45-4f68-883c-1608557c7f81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:14.625750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c1fbe7e53c465db49951482b2e9206', 'request_id': 'req-1cc6f761-1d45-4f68-883c-1608557c7f81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:14.718119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c1fbe7e53c465db49951482b2e9206', 'request_id': 'req-1cc6f761-1d45-4f68-883c-1608557c7f81'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:14.731454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] The token cache is being invalidate because project d5c1fbe7e53c465db49951482b2e9206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:14.731872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:14.732637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:14.734327 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3666/7325] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:14 2022] DELETE /identity/v3/projects/d5c1fbe7e53c465db49951482b2e9206 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:14.738830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:14.749655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e729b8-bdb4-4327-82c3-0d2e492daed3 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:14.810575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:14.811214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:14.811487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:14.811748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] PATH_INFO: `/v3/users/110c92fdb1474349bda2c330f979be46` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:14.813074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110c92fdb1474349bda2c330f979be46)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:14.815945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:15.175974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110c92fdb1474349bda2c330f979be46'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:15.183033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110c92fdb1474349bda2c330f979be46'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:15.183793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110c92fdb1474349bda2c330f979be46'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:15.302133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110c92fdb1474349bda2c330f979be46'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:15.302379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ec9ae5f1-d041-42ee-b4bb-38176f573f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110c92fdb1474349bda2c330f979be46'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:15.335090 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3660/7326] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:14 2022] DELETE /identity/v3/users/110c92fdb1474349bda2c330f979be46 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:15.839314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:15.842809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:15.860822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6f761-1d45-4f68-883c-1608557c7f81 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:15.886439 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:15.928406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:15.929348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:15.929780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:15.930238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] PATH_INFO: `/v3/projects/ae0d0a310d614456a9910b85ecb4f6e9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:15.931719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0d0a310d614456a9910b85ecb4f6e9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:15.933914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:16.096171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0d0a310d614456a9910b85ecb4f6e9', 'request_id': 'req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:16.102418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0d0a310d614456a9910b85ecb4f6e9', 'request_id': 'req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:16.261185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0d0a310d614456a9910b85ecb4f6e9', 'request_id': 'req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:16.284090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] The token cache is being invalidate because project ae0d0a310d614456a9910b85ecb4f6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:16.284701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:16.287358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d9971f9e-59b0-4f3b-8e88-3a0fcb817589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:16.287941 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3667/7327] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:15 2022] DELETE /identity/v3/projects/ae0d0a310d614456a9910b85ecb4f6e9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:16.294580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6cdf7-4c69-4229-a557-237d38d4323e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:16.295204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6cdf7-4c69-4229-a557-237d38d4323e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:16.295346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6cdf7-4c69-4229-a557-237d38d4323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:16.328954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7fe6cdf7-4c69-4229-a557-237d38d4323e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:16.332782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7fe6cdf7-4c69-4229-a557-237d38d4323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:16.406569 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:16.480286 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3661/7328] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:16.494322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4682-f8e6-4e7a-87ae-a294df72bc5e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:16.495473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4682-f8e6-4e7a-87ae-a294df72bc5e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:16.496655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4682-f8e6-4e7a-87ae-a294df72bc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:16.538633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-70ee4682-f8e6-4e7a-87ae-a294df72bc5e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:16.545304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-70ee4682-f8e6-4e7a-87ae-a294df72bc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:16.548682 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3668/7329] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:16.552834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6cdf7-4c69-4229-a557-237d38d4323e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:16.562868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6cdf7-4c69-4229-a557-237d38d4323e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:16.573639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:16.579645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:16.579645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:16.579645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:16.579645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:44:16.579645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:16.579645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:16.595983 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3662/7330] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:16.600100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4682-f8e6-4e7a-87ae-a294df72bc5e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:16.611053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4682-f8e6-4e7a-87ae-a294df72bc5e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:16.616647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:16.617257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:16.617533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:16.617801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:16.618524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:16.620389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:16.763699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3669/7331] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:16 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:16.765144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:16.775956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a693af-be3b-44b3-832e-3ef603af731b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:16.850140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:16.850140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:16.850140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:16.850140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:16.850595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:16.850595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:17.003347 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3663/7332] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:16 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:17.007598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:17.022215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0530e-0ea6-4b6f-b6aa-399e75f9d716 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:17.023733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:17.024356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:17.024636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:17.024906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:17.025542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:17.027163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:17.038083 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3670/7333] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:17.042248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:17.055459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82614f61-69ee-4e8a-9898-50c77542bf78 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:17.061874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084fa1f-8f05-4e84-abb6-e92ff8d5bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:17.062653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fa1f-8f05-4e84-abb6-e92ff8d5bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:17.062927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fa1f-8f05-4e84-abb6-e92ff8d5bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:17.063193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fa1f-8f05-4e84-abb6-e92ff8d5bb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:17.063833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084fa1f-8f05-4e84-abb6-e92ff8d5bb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:17.065629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084fa1f-8f05-4e84-abb6-e92ff8d5bb84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:17.078127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3664/7334] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:17.082533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:17.092759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45476817-b52b-4e18-95dc-2f176b93e0c8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:17.102622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:17.103327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:17.103658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:17.103940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] PATH_INFO: `/v3/projects/d791e8ac421949cb85d649ddf28bdbe3/users/29468dad0e6248faa99e6b9af9c81bee/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:17.134632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d791e8ac421949cb85d649ddf28bdbe3, user_id=29468dad0e6248faa99e6b9af9c81bee, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:17.137322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:17.226417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3671/7335] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:17 2022] PUT /identity/v3/projects/d791e8ac421949cb85d649ddf28bdbe3/users/29468dad0e6248faa99e6b9af9c81bee/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:17.237551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4e8d2-9642-406d-9c44-20560229c6ae None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:17.237833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4e8d2-9642-406d-9c44-20560229c6ae None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:17.238132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4e8d2-9642-406d-9c44-20560229c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:17.272322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0ce4e8d2-9642-406d-9c44-20560229c6ae None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:17.273563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ce4e8d2-9642-406d-9c44-20560229c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:17.343272 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3665/7336] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:17.349071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:17.361843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cadd3-4352-41f3-bf9d-1022532cf65a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:17.365714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f368ba-1b69-4369-9e00-8745f755145d tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:17.366495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f368ba-1b69-4369-9e00-8745f755145d tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:17.366776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f368ba-1b69-4369-9e00-8745f755145d tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:17.367046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f368ba-1b69-4369-9e00-8745f755145d tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:17.490866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e7f368ba-1b69-4369-9e00-8745f755145d tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:17.587932 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3672/7337] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:17 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:18.593687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2052c-8c4e-423a-92cf-ac4cdc23203e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:18.593687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2052c-8c4e-423a-92cf-ac4cdc23203e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:18.594220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2052c-8c4e-423a-92cf-ac4cdc23203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:18.613789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b1f2052c-8c4e-423a-92cf-ac4cdc23203e None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:18.615090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1f2052c-8c4e-423a-92cf-ac4cdc23203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:18.619351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3666/7338] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:18 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:18.624717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad1f1-95ad-493b-99dd-2c2b590c1437 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:18.626107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad1f1-95ad-493b-99dd-2c2b590c1437 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:18.627489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad1f1-95ad-493b-99dd-2c2b590c1437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:18.659520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-592ad1f1-95ad-493b-99dd-2c2b590c1437 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:18.673836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-592ad1f1-95ad-493b-99dd-2c2b590c1437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:18.673836 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3673/7339] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:18.676864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2052c-8c4e-423a-92cf-ac4cdc23203e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:18.688480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2052c-8c4e-423a-92cf-ac4cdc23203e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:18.693360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0c20-44d3-4434-a528-9a37e881810f tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:18.694391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0c20-44d3-4434-a528-9a37e881810f tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:18.698822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0c20-44d3-4434-a528-9a37e881810f tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:18.698822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0c20-44d3-4434-a528-9a37e881810f tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:18.731154 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-7edd0c20-44d3-4434-a528-9a37e881810f tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:44:18.769935 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 23 01:44:18.774609 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:44:18.775963 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3667/7340] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:18 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 188 bytes in 95 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 23 01:44:18.776065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ad1f1-95ad-493b-99dd-2c2b590c1437 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:18.785165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ad1f1-95ad-493b-99dd-2c2b590c1437 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:18.789839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6df47-3f3f-4e6e-8c1f-f4e892179cea tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:18.790631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6df47-3f3f-4e6e-8c1f-f4e892179cea tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:18.792537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6df47-3f3f-4e6e-8c1f-f4e892179cea tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:18.792537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6df47-3f3f-4e6e-8c1f-f4e892179cea tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:18.797451 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-f2c6df47-3f3f-4e6e-8c1f-f4e892179cea tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:44:18.831487 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 23 01:44:18.832920 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:44:18.834344 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3674/7341] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:18 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 188 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 23 01:44:18.840542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0c20-44d3-4434-a528-9a37e881810f tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:18.854734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0c20-44d3-4434-a528-9a37e881810f tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:18.859810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc6778-48d9-4aad-b876-f2e44fc6020e tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:18.860817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6778-48d9-4aad-b876-f2e44fc6020e tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:18.861739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6778-48d9-4aad-b876-f2e44fc6020e tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:18.862067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6778-48d9-4aad-b876-f2e44fc6020e tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:19.019705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5fdc6778-48d9-4aad-b876-f2e44fc6020e tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:19.227567 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3668/7342] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:18 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:20.233412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017515d5-23dd-455f-9146-40a547e82a10 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:20.236219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017515d5-23dd-455f-9146-40a547e82a10 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:20.236813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017515d5-23dd-455f-9146-40a547e82a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:20.265705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-017515d5-23dd-455f-9146-40a547e82a10 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:20.266960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-017515d5-23dd-455f-9146-40a547e82a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:20.271187 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3675/7343] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:20 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:20.276809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:20.277372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:20.277614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:20.300490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:20.302000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:20.309615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3669/7344] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:20.313604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017515d5-23dd-455f-9146-40a547e82a10 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:20.329015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017515d5-23dd-455f-9146-40a547e82a10 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:20.333630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43693e26-e903-4a3b-8cd7-5a065287d4bf tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:20.338174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693e26-e903-4a3b-8cd7-5a065287d4bf tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:20.338174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693e26-e903-4a3b-8cd7-5a065287d4bf tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:20.338174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693e26-e903-4a3b-8cd7-5a065287d4bf tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:20.396977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:20.407322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:20.480860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d358686-fa20-4220-b662-aaaffc40effa None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:20.492745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:20.500166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-43693e26-e903-4a3b-8cd7-5a065287d4bf tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:20.500850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:20.500850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:20.500850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] PATH_INFO: `/v3/users/754bc2a882e54a3483b10dff7a9fb291` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:20.502263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754bc2a882e54a3483b10dff7a9fb291)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:20.504610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:20.597911 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3676/7345] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:20 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:20.736758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754bc2a882e54a3483b10dff7a9fb291'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:20.748567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754bc2a882e54a3483b10dff7a9fb291'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:20.749408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754bc2a882e54a3483b10dff7a9fb291'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:20.883595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754bc2a882e54a3483b10dff7a9fb291'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:20.884364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754bc2a882e54a3483b10dff7a9fb291'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:20.906730 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3670/7346] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:20 2022] DELETE /identity/v3/users/754bc2a882e54a3483b10dff7a9fb291 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:20.912002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c4b2-0b81-4115-9f2b-02366e0aae50 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:20.912350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c4b2-0b81-4115-9f2b-02366e0aae50 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:20.912563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c4b2-0b81-4115-9f2b-02366e0aae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:20.940055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2591c4b2-0b81-4115-9f2b-02366e0aae50 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:20.941893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2591c4b2-0b81-4115-9f2b-02366e0aae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:21.013257 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3677/7347] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:21.024267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:21.025768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:21.072743 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:21.094007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8542-db6e-4915-a1e0-9fb46b874e29 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:21.097624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe9019-a85d-4e29-b92c-82796030d06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:21.098336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe9019-a85d-4e29-b92c-82796030d06b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:21.098614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe9019-a85d-4e29-b92c-82796030d06b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:21.098915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe9019-a85d-4e29-b92c-82796030d06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:21.108824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe9019-a85d-4e29-b92c-82796030d06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:21.110354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe9019-a85d-4e29-b92c-82796030d06b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:21.120594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3671/7348] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:21.603597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:21.604183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:21.604305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:21.632790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:21.633997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:21.640528 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3678/7349] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:21 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:21.642875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f658d7-c932-4b96-9f03-eb34ffc5f643 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:21.647937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f658d7-c932-4b96-9f03-eb34ffc5f643 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:21.647937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f658d7-c932-4b96-9f03-eb34ffc5f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:21.664713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-66f658d7-c932-4b96-9f03-eb34ffc5f643 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:21.666055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-66f658d7-c932-4b96-9f03-eb34ffc5f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:21.682639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:21.684651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:21.718733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47ad20-b254-4223-abd6-41f91e7c0d2f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:21.727023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:21.727770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:21.728098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:21.728374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] PATH_INFO: `/v3/projects/c41bb459f91144968c180ed331a3424e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:21.729739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41bb459f91144968c180ed331a3424e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:21.731694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:21.765874 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3672/7350] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:21.767906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f658d7-c932-4b96-9f03-eb34ffc5f643 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:21.782732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f658d7-c932-4b96-9f03-eb34ffc5f643 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:21.787211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:21.788851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:21.788851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:21.792568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:21.898920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41bb459f91144968c180ed331a3424e', 'request_id': 'req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:21.905317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41bb459f91144968c180ed331a3424e', 'request_id': 'req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:21.953291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.007584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41bb459f91144968c180ed331a3424e', 'request_id': 'req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.021893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] The token cache is being invalidate because project c41bb459f91144968c180ed331a3424e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:22.029352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.030102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.031627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3679/7351] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:21 2022] DELETE /identity/v3/projects/c41bb459f91144968c180ed331a3424e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:22.036237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:22.037723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:22.064819 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:22.106902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3673/7352] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:21 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:22.108707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce306126-2ad8-4ba6-9cad-19c0e36f1f89 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:22.113858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:22.114562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:22.114865 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:22.115133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] PATH_INFO: `/v3/users/2a46e17411c348678a7d86b4c0c92993` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:22.116274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a46e17411c348678a7d86b4c0c92993)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:22.118236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:22.344211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a46e17411c348678a7d86b4c0c92993'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.351710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a46e17411c348678a7d86b4c0c92993'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.352397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a46e17411c348678a7d86b4c0c92993'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.426095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a46e17411c348678a7d86b4c0c92993'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.426723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cc16004d-225d-4953-af40-9f8be68721bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a46e17411c348678a7d86b4c0c92993'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:22.448754 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3680/7353] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:22 2022] DELETE /identity/v3/users/2a46e17411c348678a7d86b4c0c92993 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:22.975549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:22.977607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:23.001064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b88a-ff9c-4f0b-8ed3-44c73738d734 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:23.066996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:23.067634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:23.067913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:23.068211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] PATH_INFO: `/v3/projects/bf3c3fde12e543839c91b5b6ab840c15` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:23.069366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3c3fde12e543839c91b5b6ab840c15)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:23.071306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:23.113488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127f2c8-5b00-4a02-8718-e4aa0594a654 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:23.114414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127f2c8-5b00-4a02-8718-e4aa0594a654 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:23.114697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127f2c8-5b00-4a02-8718-e4aa0594a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:23.135093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2127f2c8-5b00-4a02-8718-e4aa0594a654 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:23.136531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2127f2c8-5b00-4a02-8718-e4aa0594a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:23.139770 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3681/7354] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:23 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:44:23.144252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc414b-213b-4aac-ab6b-c48f85e9138b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:23.144543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc414b-213b-4aac-ab6b-c48f85e9138b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:23.144810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc414b-213b-4aac-ab6b-c48f85e9138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:23.164757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6fcc414b-213b-4aac-ab6b-c48f85e9138b None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:23.166208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6fcc414b-213b-4aac-ab6b-c48f85e9138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:23.230444 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3682/7355] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:23.231811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc414b-213b-4aac-ab6b-c48f85e9138b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:23.242891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc414b-213b-4aac-ab6b-c48f85e9138b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:23.250394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3c3fde12e543839c91b5b6ab840c15', 'request_id': 'req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.251812 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:23.260581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3c3fde12e543839c91b5b6ab840c15', 'request_id': 'req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.299159 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:23.313453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:23.314132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:23.314424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:23.314681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:23.363553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3c3fde12e543839c91b5b6ab840c15', 'request_id': 'req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.380260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] The token cache is being invalidate because project bf3c3fde12e543839c91b5b6ab840c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:23.380554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.381203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.382769 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3674/7356] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:22 2022] DELETE /identity/v3/projects/bf3c3fde12e543839c91b5b6ab840c15 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:23.386695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:23.388086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:23.462986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4bd0-d52f-45e8-a5de-f7db9f99db3e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:23.465057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.471425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:23.471425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:23.471425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:23.471425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] PATH_INFO: `/v3/users/23905374cd974003bc78d9f3dbdc2439` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:23.474825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23905374cd974003bc78d9f3dbdc2439)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:23.474825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:23.598397 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3683/7357] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:23 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:23.722719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23905374cd974003bc78d9f3dbdc2439'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.729754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23905374cd974003bc78d9f3dbdc2439'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.730467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23905374cd974003bc78d9f3dbdc2439'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.831737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23905374cd974003bc78d9f3dbdc2439'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.832393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77aac48c-8d7d-4a7f-a7a7-3917e4b4ff47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23905374cd974003bc78d9f3dbdc2439'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:23.862423 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3675/7358] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:23 2022] DELETE /identity/v3/users/23905374cd974003bc78d9f3dbdc2439 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:24.382320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:24.384373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:24.406713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8768-7515-4a48-87c8-313cf2a3dade tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:24.469158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:24.469794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:24.470919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:24.471213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] PATH_INFO: `/v3/projects/395648e6788d437d8c6f9cde82d29b9e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:24.472366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=395648e6788d437d8c6f9cde82d29b9e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:24.474289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:24.604131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d86b3e-5a05-4e36-ab7a-6a7eeb002126 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:24.604702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d86b3e-5a05-4e36-ab7a-6a7eeb002126 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:24.604702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d86b3e-5a05-4e36-ab7a-6a7eeb002126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:24.630349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-67d86b3e-5a05-4e36-ab7a-6a7eeb002126 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:24.631545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-67d86b3e-5a05-4e36-ab7a-6a7eeb002126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:24.635949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395648e6788d437d8c6f9cde82d29b9e', 'request_id': 'req-c8d1c485-3e52-4082-a284-c1053c9048ea'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:24.638335 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3676/7359] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:24 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 01:44:24.644602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395648e6788d437d8c6f9cde82d29b9e', 'request_id': 'req-c8d1c485-3e52-4082-a284-c1053c9048ea'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:24.728963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395648e6788d437d8c6f9cde82d29b9e', 'request_id': 'req-c8d1c485-3e52-4082-a284-c1053c9048ea'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:24.742253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] The token cache is being invalidate because project 395648e6788d437d8c6f9cde82d29b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:24.743445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:24.743445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c8d1c485-3e52-4082-a284-c1053c9048ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:24.748396 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3684/7360] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:24 2022] DELETE /identity/v3/projects/395648e6788d437d8c6f9cde82d29b9e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:24.750342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0751d-c040-4c40-9cdb-e4e511577d98 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:24.750630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0751d-c040-4c40-9cdb-e4e511577d98 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:24.751092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0751d-c040-4c40-9cdb-e4e511577d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:24.774013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-43d0751d-c040-4c40-9cdb-e4e511577d98 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:24.775046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-43d0751d-c040-4c40-9cdb-e4e511577d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:24.822529 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:24.837856 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3677/7361] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:24.845784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47be58-c146-4f16-8c7c-ef2bad24d043 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:24.846091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47be58-c146-4f16-8c7c-ef2bad24d043 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:24.846371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47be58-c146-4f16-8c7c-ef2bad24d043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:24.868398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bc47be58-c146-4f16-8c7c-ef2bad24d043 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:24.869628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bc47be58-c146-4f16-8c7c-ef2bad24d043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:24.884983 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3685/7362] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:24.889500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0751d-c040-4c40-9cdb-e4e511577d98 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:24.899593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0751d-c040-4c40-9cdb-e4e511577d98 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:24.904380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:24.904985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:24.905260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:24.905532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:24.906207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:44:24.906508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:24.908141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:24.921604 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3678/7363] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:44:24.927028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47be58-c146-4f16-8c7c-ef2bad24d043 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:24.941227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47be58-c146-4f16-8c7c-ef2bad24d043 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:24.946225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:24.946843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:24.947119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:24.947404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:24.948031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:24.950008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:25.043781 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3686/7364] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:24 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:25.045020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:25.055835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd858-1a27-4f3c-a64d-83b59aee1fed admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:25.115944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:25.116866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.116866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.117270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.117969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:25.119990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:25.236022 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3679/7365] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:25 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:25.237259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:25.248330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5b77-bf93-4e1a-9601-89426897d5ec admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:25.253995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:25.254633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.255005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.255289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.255932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:25.257543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:25.268430 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3687/7366] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:25.272611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:25.282895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc459128-a076-4408-9f6e-d16e8902e8b7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:25.288176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfc419-64ec-48fa-aae4-eed59f995edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:25.288831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc419-64ec-48fa-aae4-eed59f995edc admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.289110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc419-64ec-48fa-aae4-eed59f995edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.289503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc419-64ec-48fa-aae4-eed59f995edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.290166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfc419-64ec-48fa-aae4-eed59f995edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:25.291808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfc419-64ec-48fa-aae4-eed59f995edc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:25.304260 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3680/7367] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:25.317724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:25.330131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c1809-1103-42a4-83f0-e26ff9ac9ed3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:25.335177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:25.336366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.336366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.336366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] PATH_INFO: `/v3/projects/3c6377f05e21462b8a374170ec06a211/users/b2985f6e7b7c4e91ac80db47d1f2dff4/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.339456 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:25.355841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6377f05e21462b8a374170ec06a211, user_id=b2985f6e7b7c4e91ac80db47d1f2dff4, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:25.358601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:25.463946 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3688/7368] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:25 2022] PUT /identity/v3/projects/3c6377f05e21462b8a374170ec06a211/users/b2985f6e7b7c4e91ac80db47d1f2dff4/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:25.469355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bab6-ff46-4512-aa58-26170af05491 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.469820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bab6-ff46-4512-aa58-26170af05491 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.470290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bab6-ff46-4512-aa58-26170af05491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.500717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4189bab6-ff46-4512-aa58-26170af05491 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:25.502784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4189bab6-ff46-4512-aa58-26170af05491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:25.606615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3681/7369] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:25.612912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:25.614738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:25.642507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669d42a-a43c-4e80-a273-28acac85b75c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.645023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669d42a-a43c-4e80-a273-28acac85b75c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.645023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669d42a-a43c-4e80-a273-28acac85b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.663337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d669d42a-a43c-4e80-a273-28acac85b75c None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:25.664557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d669d42a-a43c-4e80-a273-28acac85b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:25.688555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ebc7-7184-48b6-adf9-f0cea15773d8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:25.695964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09995e-e2f7-467d-b64a-835a1a27330b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:25.696887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09995e-e2f7-467d-b64a-835a1a27330b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.697676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09995e-e2f7-467d-b64a-835a1a27330b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.698258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09995e-e2f7-467d-b64a-835a1a27330b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.711081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09995e-e2f7-467d-b64a-835a1a27330b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:25.712743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09995e-e2f7-467d-b64a-835a1a27330b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:25.741442 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3689/7370] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:25.742168 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3682/7371] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:25.749458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5be41-b620-403a-847c-91fd5d0f9a7c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.750339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5be41-b620-403a-847c-91fd5d0f9a7c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.750339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5be41-b620-403a-847c-91fd5d0f9a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.780374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0ca5be41-b620-403a-847c-91fd5d0f9a7c None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:25.782419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0ca5be41-b620-403a-847c-91fd5d0f9a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:25.792430 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3690/7372] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:25 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:25.797064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac22a-adc9-42fc-b99b-ccd93523854b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.797338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac22a-adc9-42fc-b99b-ccd93523854b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.797790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac22a-adc9-42fc-b99b-ccd93523854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:25.804518 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:25.960348 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.server.flask.application [None req-855ac22a-adc9-42fc-b99b-ccd93523854b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.42: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 23 01:44:25.962191 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3683/7373] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:25 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 166 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 23 01:44:25.966998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dfc5d-580e-44a7-9161-f104aca01858 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:25.968855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dfc5d-580e-44a7-9161-f104aca01858 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:25.968855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dfc5d-580e-44a7-9161-f104aca01858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:26.095218 n-d-master-1 devstack@keystone.service[81936]: WARNING keystone.server.flask.application [None req-346dfc5d-580e-44a7-9161-f104aca01858 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.42: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 23 01:44:26.096919 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3691/7374] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:25 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 131 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 23 01:44:26.101536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e051e-4f48-4d3a-ad76-9f349b5c7861 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:26.102195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e051e-4f48-4d3a-ad76-9f349b5c7861 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:26.102767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e051e-4f48-4d3a-ad76-9f349b5c7861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:26.131204 n-d-master-1 devstack@keystone.service[81937]: WARNING keystone.server.flask.application [None req-231e051e-4f48-4d3a-ad76-9f349b5c7861 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.42: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 23 01:44:26.132902 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3684/7375] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:26 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 32 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 23 01:44:27.120684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de28f-3432-4b27-a7d9-3586e1f55ed4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:27.121157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de28f-3432-4b27-a7d9-3586e1f55ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:27.121266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de28f-3432-4b27-a7d9-3586e1f55ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:27.174194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5f9de28f-3432-4b27-a7d9-3586e1f55ed4 None None] MFA Rules not processed for user `b2985f6e7b7c4e91ac80db47d1f2dff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:27.175788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f9de28f-3432-4b27-a7d9-3586e1f55ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:27.254363 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3692/7376] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:27.264930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e051e-4f48-4d3a-ad76-9f349b5c7861 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:27.267768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-231e051e-4f48-4d3a-ad76-9f349b5c7861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:27.338336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e051e-4f48-4d3a-ad76-9f349b5c7861 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:27.341848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:27.342491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:27.342771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:27.343044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:27.352148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:27.353579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:27.363760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3685/7377] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:30.269266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0044d7b-40cc-44fd-847f-f23d97d23698 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:30.270053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0044d7b-40cc-44fd-847f-f23d97d23698 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:30.270053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0044d7b-40cc-44fd-847f-f23d97d23698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:30.289471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c0044d7b-40cc-44fd-847f-f23d97d23698 None None] MFA Rules not processed for user `b2985f6e7b7c4e91ac80db47d1f2dff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:30.290699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c0044d7b-40cc-44fd-847f-f23d97d23698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:30.298174 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3693/7378] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:30.555364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:30.569578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acffde-cf7a-4864-9727-695fb399aedd service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:30.574508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:30.575300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:30.575642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:30.575975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:30.578753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:30.592589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:30.594146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:30.604617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3686/7379] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:33.972996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0044d7b-40cc-44fd-847f-f23d97d23698 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:33.984593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0044d7b-40cc-44fd-847f-f23d97d23698 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:33.990943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:33.994457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:33.994738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:33.995139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:33.997334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:34.007002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:34.008931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:34.012308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:34.014033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:34.026040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3694/7380] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:34.057794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:34.059863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:34.093444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce0fd0-4b82-4360-91f0-b4266b166819 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:34.099025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:34.099859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:34.100280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:34.100400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:34.102194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:34.104257 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:34.156926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc679e5-b3b6-4acc-bcff-78fc2afb67f5 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:34.162837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dec95-283a-4ad8-96de-b784793cf96b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:34.163359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dec95-283a-4ad8-96de-b784793cf96b service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:34.163635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dec95-283a-4ad8-96de-b784793cf96b service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:34.164565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dec95-283a-4ad8-96de-b784793cf96b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:34.166401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9b8dec95-283a-4ad8-96de-b784793cf96b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:34.167268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:34.168654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:34.179543 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3687/7381] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:44:34.182577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dec95-283a-4ad8-96de-b784793cf96b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:34.184175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dec95-283a-4ad8-96de-b784793cf96b service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:34.198429 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3695/7382] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:44:34.943522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:34.949795 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:34.973211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e82a-ac5b-48dc-86a5-226009e7e5b3 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:34.979504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:34.981376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:34.981734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:34.982090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:34.984178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:35.003758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:35.006490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:35.026271 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3688/7383] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:37.149183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566194-9ec7-4480-9b34-5aed2428da2a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:37.149782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566194-9ec7-4480-9b34-5aed2428da2a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:37.149782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566194-9ec7-4480-9b34-5aed2428da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:37.312562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-49566194-9ec7-4480-9b34-5aed2428da2a None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:37.314518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-49566194-9ec7-4480-9b34-5aed2428da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:37.319867 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3696/7384] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:37.325154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:37.340412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb151a79-5f50-4099-86d7-62da60c59bfb service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:37.346996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71a0e-9e55-4393-9930-a4c67d131f37 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:37.347923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71a0e-9e55-4393-9930-a4c67d131f37 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:37.348936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71a0e-9e55-4393-9930-a4c67d131f37 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:37.350328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71a0e-9e55-4393-9930-a4c67d131f37 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:37.499777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b7b71a0e-9e55-4393-9930-a4c67d131f37 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:37.632630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3689/7385] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:37 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:38.638128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56945ee4-e527-4a07-b301-4c9c33bf1b72 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:38.639039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56945ee4-e527-4a07-b301-4c9c33bf1b72 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:38.639495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56945ee4-e527-4a07-b301-4c9c33bf1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:38.675238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-56945ee4-e527-4a07-b301-4c9c33bf1b72 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:38.676730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-56945ee4-e527-4a07-b301-4c9c33bf1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:38.681118 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3697/7386] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:38.685382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ca6f-bb3a-45b1-9f29-efe7b8bac6e4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:38.686287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ca6f-bb3a-45b1-9f29-efe7b8bac6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:38.686753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492ca6f-bb3a-45b1-9f29-efe7b8bac6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application [None req-b492ca6f-bb3a-45b1-9f29-efe7b8bac6e4 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 23 01:44:38.744622 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:44:38.745875 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: ERROR keystone.server.flask.application Oct 23 01:44:38.752943 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3690/7387] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:38 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:44:38.754306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de095-626a-4f7d-8e59-613f7f965caa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:38.754306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de095-626a-4f7d-8e59-613f7f965caa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:38.754306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de095-626a-4f7d-8e59-613f7f965caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:38.857110 n-d-master-1 devstack@keystone.service[81936]: WARNING keystone.server.flask.application [None req-944de095-626a-4f7d-8e59-613f7f965caa None None] Authorization failed. The request you have made requires authentication. from 10.222.0.42: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 23 01:44:38.859207 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3698/7388] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 107 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 23 01:44:38.864194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0926d33-386f-4331-9ed4-342975f57a59 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:38.864482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0926d33-386f-4331-9ed4-342975f57a59 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:38.864756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0926d33-386f-4331-9ed4-342975f57a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:39.078167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f0926d33-386f-4331-9ed4-342975f57a59 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:39.081180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f0926d33-386f-4331-9ed4-342975f57a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:39.093599 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3691/7389] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:39.098509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944de095-626a-4f7d-8e59-613f7f965caa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:39.126137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944de095-626a-4f7d-8e59-613f7f965caa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:39.147260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bede78-e43a-4fae-9778-5f806921acc1 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:39.149832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bede78-e43a-4fae-9778-5f806921acc1 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:39.150162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bede78-e43a-4fae-9778-5f806921acc1 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:39.150442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bede78-e43a-4fae-9778-5f806921acc1 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:39.304584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-94bede78-e43a-4fae-9778-5f806921acc1 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:39.380870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3699/7390] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:39 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:40.386499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff50b-ff80-4b68-b98d-e7af68a7e5f2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:40.386958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff50b-ff80-4b68-b98d-e7af68a7e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:40.387074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff50b-ff80-4b68-b98d-e7af68a7e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:40.411033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6fcff50b-ff80-4b68-b98d-e7af68a7e5f2 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:40.412293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6fcff50b-ff80-4b68-b98d-e7af68a7e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:40.419967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3692/7391] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:40 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:40.424699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91ff3-d561-4830-9ecd-494a82296d3f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:40.425264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91ff3-d561-4830-9ecd-494a82296d3f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:40.425264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91ff3-d561-4830-9ecd-494a82296d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:40.447032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fba91ff3-d561-4830-9ecd-494a82296d3f None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:40.448324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fba91ff3-d561-4830-9ecd-494a82296d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:40.456633 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3700/7392] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:40.460997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff50b-ff80-4b68-b98d-e7af68a7e5f2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:40.478923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff50b-ff80-4b68-b98d-e7af68a7e5f2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:40.485180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2c21-0f42-49f7-9e4e-57d9bab1ff36 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:40.485882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2c21-0f42-49f7-9e4e-57d9bab1ff36 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:40.486209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2c21-0f42-49f7-9e4e-57d9bab1ff36 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:40.486482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2c21-0f42-49f7-9e4e-57d9bab1ff36 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:40.601963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-88cc2c21-0f42-49f7-9e4e-57d9bab1ff36 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:40.687323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3693/7393] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:40 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:41.693043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d3804-7758-4373-a871-e97611212608 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:41.694118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d3804-7758-4373-a871-e97611212608 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:41.694615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d3804-7758-4373-a871-e97611212608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:41.724758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0a7d3804-7758-4373-a871-e97611212608 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:41.727529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0a7d3804-7758-4373-a871-e97611212608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:41.732047 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3701/7394] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:41 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:41.736839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e916b-e3f4-4570-801e-b5363b18cc37 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:41.740487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e916b-e3f4-4570-801e-b5363b18cc37 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:41.740487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e916b-e3f4-4570-801e-b5363b18cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:41.760840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7b0e916b-e3f4-4570-801e-b5363b18cc37 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:41.762239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7b0e916b-e3f4-4570-801e-b5363b18cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:41.769634 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3694/7395] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:41.773776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d3804-7758-4373-a871-e97611212608 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:41.786318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d3804-7758-4373-a871-e97611212608 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:41.790963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed112b-7b02-4fce-aec5-a4f949b56e93 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29468dad0e6248faa99e6b9af9c81bee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd791e8ac421949cb85d649ddf28bdbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:41.791867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed112b-7b02-4fce-aec5-a4f949b56e93 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:41.792136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed112b-7b02-4fce-aec5-a4f949b56e93 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:41.792411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed112b-7b02-4fce-aec5-a4f949b56e93 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee/password` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:41.914706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-67ed112b-7b02-4fce-aec5-a4f949b56e93 tempest-IdentityV3UsersTest-2087375058 tempest-IdentityV3UsersTest-2087375058-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:42.007480 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3702/7396] 10.222.0.42 () {60 vars in 1269 bytes} [Sun Oct 23 01:44:41 2022] POST /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee/password => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:43.012937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:43.013509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:43.014045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:43.034389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:43.035715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:43.040807 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3695/7397] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:43 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:44:44.044457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0c1ca-05b6-4f4a-b714-28c1dfa68a95 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:44.044967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0c1ca-05b6-4f4a-b714-28c1dfa68a95 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:44.045100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0c1ca-05b6-4f4a-b714-28c1dfa68a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:44.067087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-68c0c1ca-05b6-4f4a-b714-28c1dfa68a95 None None] MFA Rules not processed for user `29468dad0e6248faa99e6b9af9c81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:44.068292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-68c0c1ca-05b6-4f4a-b714-28c1dfa68a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:44.076698 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3703/7398] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:44.082476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:44.084008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:44.100687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2f928-442c-46b6-8bbb-f24cd08b8a94 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:44.105451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:44.109501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:44.109501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:44.109501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] PATH_INFO: `/v3/users/29468dad0e6248faa99e6b9af9c81bee` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:44.109501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29468dad0e6248faa99e6b9af9c81bee)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:44.110579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:44.296887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:44.305385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:44.306124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:44.379709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:44.380385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29468dad0e6248faa99e6b9af9c81bee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:44.399947 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3696/7399] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:44 2022] DELETE /identity/v3/users/29468dad0e6248faa99e6b9af9c81bee => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:44.404469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:44.404749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:44.405018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:44.431335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:44.432730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:44.461462 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:44.499280 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3704/7400] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:44.510574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:44.512568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:44.535386 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=78,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=14 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:44.602603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b59d-0227-42ff-b50b-24d0d00e27c2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:44.607368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07589-ead1-4752-97a8-dc7e34946d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:44.608057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07589-ead1-4752-97a8-dc7e34946d88 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:44.608344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07589-ead1-4752-97a8-dc7e34946d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:44.608832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07589-ead1-4752-97a8-dc7e34946d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:44.619072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f07589-ead1-4752-97a8-dc7e34946d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:44.620801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f07589-ead1-4752-97a8-dc7e34946d88 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:44.643828 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3697/7401] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:45.106561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:45.108097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:45.122439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75de8-217e-4c99-9e8c-77de4ddaf726 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:45.128182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:45.132102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.132102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.132102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] PATH_INFO: `/v3/projects/d791e8ac421949cb85d649ddf28bdbe3` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.132102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d791e8ac421949cb85d649ddf28bdbe3)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:45.132543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:45.289016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd791e8ac421949cb85d649ddf28bdbe3', 'request_id': 'req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:45.296389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd791e8ac421949cb85d649ddf28bdbe3', 'request_id': 'req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:45.361484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd791e8ac421949cb85d649ddf28bdbe3', 'request_id': 'req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:45.373486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] The token cache is being invalidate because project d791e8ac421949cb85d649ddf28bdbe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:45.373801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:45.374530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-6a221156-9cd0-4bbf-9e4d-0e8cb6fa7fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:45.376598 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3705/7402] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:45 2022] DELETE /identity/v3/projects/d791e8ac421949cb85d649ddf28bdbe3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:45.382433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278796-43dd-43e7-8d3d-409422782a49 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.382946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278796-43dd-43e7-8d3d-409422782a49 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.383134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278796-43dd-43e7-8d3d-409422782a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.403065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-68278796-43dd-43e7-8d3d-409422782a49 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:45.404351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-68278796-43dd-43e7-8d3d-409422782a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:45.471008 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3698/7403] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:45.479843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ead21-bd84-4f59-9040-070d230aeb29 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.480156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ead21-bd84-4f59-9040-070d230aeb29 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.480400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ead21-bd84-4f59-9040-070d230aeb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.515755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b57ead21-bd84-4f59-9040-070d230aeb29 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:45.517261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b57ead21-bd84-4f59-9040-070d230aeb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:45.525780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3706/7404] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:45.530139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278796-43dd-43e7-8d3d-409422782a49 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:45.542757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278796-43dd-43e7-8d3d-409422782a49 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:45.548995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:45.548995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.549291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.549397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.550053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:44:45.550354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:45.551941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:45.564216 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3699/7405] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:45.568612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ead21-bd84-4f59-9040-070d230aeb29 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:45.578798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ead21-bd84-4f59-9040-070d230aeb29 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:45.583426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:45.584073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.584354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.584626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.585249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:45.587163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:45.677074 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3707/7406] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:45 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:45.681338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:45.688813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c092d-f6eb-47be-bfbe-9dfb41441c85 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:45.756766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:45.757410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.757686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.757953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.758606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:45.760625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:45.852904 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3700/7407] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:45 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:44:45.856519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:45.871990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370b090-7b35-450f-b818-be2bd17ffe56 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:45.878641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:45.879596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.880085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.881035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.881321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:45.883327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:45.896623 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3708/7408] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:45.900834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:45.914290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffac8b-c68a-4621-9300-fcee3689ecd0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:45.931403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402ea80-402f-473d-9d1e-5d728cdf3717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:45.932586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ea80-402f-473d-9d1e-5d728cdf3717 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.932586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ea80-402f-473d-9d1e-5d728cdf3717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.932586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ea80-402f-473d-9d1e-5d728cdf3717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.933205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402ea80-402f-473d-9d1e-5d728cdf3717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:45.934927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402ea80-402f-473d-9d1e-5d728cdf3717 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:45.949111 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3701/7409] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:45.950430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:45.962228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dc42c-85f7-4224-ad5f-a632f05a6ed5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:45.966922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:45.967582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:45.967861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:45.968140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] PATH_INFO: `/v3/projects/3ba0a0916a5041889cbcc5b12fe189c9/users/b4a2be4ed6b94a49ae2d25639082e7dd/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:45.988421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba0a0916a5041889cbcc5b12fe189c9, user_id=b4a2be4ed6b94a49ae2d25639082e7dd, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:45.991835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:46.096167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3709/7410] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:45 2022] PUT /identity/v3/projects/3ba0a0916a5041889cbcc5b12fe189c9/users/b4a2be4ed6b94a49ae2d25639082e7dd/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:46.107196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620eba-9acf-4b8a-8acd-956e97b103a6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:46.111038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620eba-9acf-4b8a-8acd-956e97b103a6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:46.111038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620eba-9acf-4b8a-8acd-956e97b103a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:46.142294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f7620eba-9acf-4b8a-8acd-956e97b103a6 None None] MFA Rules not processed for user `b4a2be4ed6b94a49ae2d25639082e7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:46.143720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f7620eba-9acf-4b8a-8acd-956e97b103a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:46.154200 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:46.227963 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3702/7411] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:46.239339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:46.241742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:46.327647 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:46.341607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671280d-687f-4f97-9980-c0866b6ce374 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:46.346120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:46.347274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:46.347274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:46.347274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:46.356976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:46.358509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:46.370161 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3710/7412] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:46.685489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006d08-36f6-4a26-b9af-3cd4b3385c4e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:46.686365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006d08-36f6-4a26-b9af-3cd4b3385c4e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:46.686646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006d08-36f6-4a26-b9af-3cd4b3385c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:46.742363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a3006d08-36f6-4a26-b9af-3cd4b3385c4e None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:46.743687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a3006d08-36f6-4a26-b9af-3cd4b3385c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:46.824236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3703/7413] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:44:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:47.007276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:47.008763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:47.093942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434a5a-193b-4820-9d49-972e0811e203 service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:47.099595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:47.100216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:47.100493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:47.100771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:47.110243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:47.111843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:47.120129 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3711/7414] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:44:47.856078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867437a-7b1c-471a-981c-d7117787286a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:47.856556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867437a-7b1c-471a-981c-d7117787286a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:47.856758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867437a-7b1c-471a-981c-d7117787286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:47.878751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c867437a-7b1c-471a-981c-d7117787286a None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:47.880396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c867437a-7b1c-471a-981c-d7117787286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:47.890068 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3704/7415] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:44:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:47.904714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:47.918763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c62d-179d-4432-8c26-910a411dc97e service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:47.931628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:47.931628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:47.931628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:47.931628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:47.944232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:47.946232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:47.955983 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3712/7416] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:44:48.894332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5245-c9c7-41a6-86f0-38d939e1d328 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:48.894809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5245-c9c7-41a6-86f0-38d939e1d328 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:48.894809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5245-c9c7-41a6-86f0-38d939e1d328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:48.916368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6c2b5245-c9c7-41a6-86f0-38d939e1d328 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:48.917905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6c2b5245-c9c7-41a6-86f0-38d939e1d328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:48.926511 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3705/7417] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:44:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:48.941497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:48.957183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc34ebc-d0c1-4622-82e8-964487667afa service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:48.965888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:48.966779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:48.967182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:48.967567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:48.983049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:48.984769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:48.993785 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3713/7418] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:44:49.520621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8f151-2786-4c4e-9541-00eb9ad868b9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:49.520904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8f151-2786-4c4e-9541-00eb9ad868b9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:49.521174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8f151-2786-4c4e-9541-00eb9ad868b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:49.540623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f6b8f151-2786-4c4e-9541-00eb9ad868b9 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:49.542117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6b8f151-2786-4c4e-9541-00eb9ad868b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:49.549522 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3706/7419] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:49.561827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:49.581528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082b626-a89a-4a5a-9856-6156fd4b739a service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:49.597059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:49.597059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:49.597059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:49.597059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:49.597592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:49.599021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:49.608412 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3714/7420] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:44:50.405559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b15a2c-ad24-4ea9-99b8-a4b6038626a0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:50.406075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b15a2c-ad24-4ea9-99b8-a4b6038626a0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:50.411122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b15a2c-ad24-4ea9-99b8-a4b6038626a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:50.442453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-40b15a2c-ad24-4ea9-99b8-a4b6038626a0 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:50.443807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-40b15a2c-ad24-4ea9-99b8-a4b6038626a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:50.458018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3707/7421] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:50.465289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:50.490882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8cbc7-7e82-473f-b2a6-5ab72b40c5e5 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:50.504730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:50.505481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:50.505766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:50.506071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:50.516296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:50.517892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:50.534405 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3715/7422] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:44:51.170864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed8c7-da78-47fc-a890-18c7cb3701ff None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:51.171148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed8c7-da78-47fc-a890-18c7cb3701ff None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:51.171495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed8c7-da78-47fc-a890-18c7cb3701ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:51.191673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-220ed8c7-da78-47fc-a890-18c7cb3701ff None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:51.192892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-220ed8c7-da78-47fc-a890-18c7cb3701ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:51.201004 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3708/7423] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:44:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:51.215050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:51.229101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc90257-c1b6-45d0-b216-072e2fef51ae service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:51.236000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df37856-dc07-4dda-b3d3-6320663b3255 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:51.236620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37856-dc07-4dda-b3d3-6320663b3255 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:51.236901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37856-dc07-4dda-b3d3-6320663b3255 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:51.237175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37856-dc07-4dda-b3d3-6320663b3255 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:51.246136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df37856-dc07-4dda-b3d3-6320663b3255 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:51.248800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df37856-dc07-4dda-b3d3-6320663b3255 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:51.257216 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3716/7424] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:44:51.813595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ed8c7-da78-47fc-a890-18c7cb3701ff None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:51.872508 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:51.887795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ed8c7-da78-47fc-a890-18c7cb3701ff None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:51.892818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:51.893577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:51.896108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:51.896108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] PATH_INFO: `/v3/users/b4a2be4ed6b94a49ae2d25639082e7dd` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:51.896108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a2be4ed6b94a49ae2d25639082e7dd)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:51.897354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:52.090506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a2be4ed6b94a49ae2d25639082e7dd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:52.099066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a2be4ed6b94a49ae2d25639082e7dd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:52.099766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a2be4ed6b94a49ae2d25639082e7dd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:52.177455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a2be4ed6b94a49ae2d25639082e7dd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:52.178213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a2be4ed6b94a49ae2d25639082e7dd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:52.200339 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3709/7425] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:51 2022] DELETE /identity/v3/users/b4a2be4ed6b94a49ae2d25639082e7dd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:52.205155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:52.205646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:52.205755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:52.225132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:52.226351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:52.290259 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3717/7426] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:52.301133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:52.311221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:52.382879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383960eb-08bf-4685-ae43-326937ddcab5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:52.384229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3ffa2-e0b6-41cd-9349-025672b541e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:52.384853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3ffa2-e0b6-41cd-9349-025672b541e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:52.385279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3ffa2-e0b6-41cd-9349-025672b541e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:52.385569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3ffa2-e0b6-41cd-9349-025672b541e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:52.395508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3ffa2-e0b6-41cd-9349-025672b541e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:52.396928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3ffa2-e0b6-41cd-9349-025672b541e8 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:52.418074 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3710/7427] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:53.167148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:53.167609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:53.184475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaa86a-4987-40cd-b203-9414199879f1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:53.190177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:53.190894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:53.191242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:53.191580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] PATH_INFO: `/v3/projects/3ba0a0916a5041889cbcc5b12fe189c9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:53.192850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba0a0916a5041889cbcc5b12fe189c9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:53.195093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:53.197613 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:53.304016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba0a0916a5041889cbcc5b12fe189c9', 'request_id': 'req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:53.309898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba0a0916a5041889cbcc5b12fe189c9', 'request_id': 'req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:53.396807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba0a0916a5041889cbcc5b12fe189c9', 'request_id': 'req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:53.422461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] The token cache is being invalidate because project 3ba0a0916a5041889cbcc5b12fe189c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:53.422754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:53.423468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b2f1ce40-ebd2-4bb9-abc0-98734a48bcce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:53.424984 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3718/7428] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:53 2022] DELETE /identity/v3/projects/3ba0a0916a5041889cbcc5b12fe189c9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:53.433339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c870-b9f5-4e13-9d49-415a86432631 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:53.434032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c870-b9f5-4e13-9d49-415a86432631 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:53.434032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c870-b9f5-4e13-9d49-415a86432631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:53.457432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-94b3c870-b9f5-4e13-9d49-415a86432631 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:53.458728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94b3c870-b9f5-4e13-9d49-415a86432631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:53.527447 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3711/7429] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:53.535392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d525e2-6278-47df-8c9e-32a787d8fb8b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:53.535969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d525e2-6278-47df-8c9e-32a787d8fb8b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:53.536598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d525e2-6278-47df-8c9e-32a787d8fb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:53.561949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-72d525e2-6278-47df-8c9e-32a787d8fb8b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:53.564003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-72d525e2-6278-47df-8c9e-32a787d8fb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:53.572962 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3719/7430] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:53.577322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3c870-b9f5-4e13-9d49-415a86432631 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:53.587229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3c870-b9f5-4e13-9d49-415a86432631 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:53.592082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:53.592690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:53.592968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:53.593261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:53.594133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:44:53.594436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:53.596188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:53.603282 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:53.612726 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3712/7431] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:44:53.613906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d525e2-6278-47df-8c9e-32a787d8fb8b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:53.629765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d525e2-6278-47df-8c9e-32a787d8fb8b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:53.635451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:53.636373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:53.636815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:53.637272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:53.638223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:53.642020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:53.729521 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3720/7432] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:53 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:53.733770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:53.754756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e870d8-363b-4d93-936f-7615dd20865b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:53.814177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:53.814788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:53.815068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:53.815341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:53.815968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:53.817869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:53.928259 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3713/7433] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:53 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:53.939210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:53.954350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d12c27-13f8-4023-a4e4-02ca769813f8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:53.963323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:53.964465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:53.965082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:53.965556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:53.966888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:53.976133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.000393 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3721/7434] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:54.001907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.013249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93aec9-6a72-4b61-b2fc-deef203c34e7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.018319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.018941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.019222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.019490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.020216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.021787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.033966 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3714/7435] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:54.041875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.054786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bb163-da2c-47a4-bc77-8965e19e7c52 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.059771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6160b5-cd90-4aa8-8b82-efea901ff7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.060522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6160b5-cd90-4aa8-8b82-efea901ff7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.061005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6160b5-cd90-4aa8-8b82-efea901ff7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.061285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6160b5-cd90-4aa8-8b82-efea901ff7b5 admin admin] PATH_INFO: `/v3/projects/43fa02b9fb984e3f8c288636d25da3c0/users/29d0bcbd6e8b46f384c14dff236dbabb/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.080866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6160b5-cd90-4aa8-8b82-efea901ff7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fa02b9fb984e3f8c288636d25da3c0, user_id=29d0bcbd6e8b46f384c14dff236dbabb, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.085741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6160b5-cd90-4aa8-8b82-efea901ff7b5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.154293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.156829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:54.163171 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3722/7436] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:54 2022] PUT /identity/v3/projects/43fa02b9fb984e3f8c288636d25da3c0/users/29d0bcbd6e8b46f384c14dff236dbabb/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:44:54.174348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc421ed2-49a5-4939-8411-fecfef8ca233 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.174631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc421ed2-49a5-4939-8411-fecfef8ca233 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.174902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc421ed2-49a5-4939-8411-fecfef8ca233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.203707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dc421ed2-49a5-4939-8411-fecfef8ca233 None None] MFA Rules not processed for user `29d0bcbd6e8b46f384c14dff236dbabb`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:54.204917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dc421ed2-49a5-4939-8411-fecfef8ca233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:54.239897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3e7ec-191d-4308-9440-75921b4cab94 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.277005 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3723/7437] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:54.291214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc421ed2-49a5-4939-8411-fecfef8ca233 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.315347 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:54.320962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.321589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.321864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.322907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.324670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:54.357440 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:54.391301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc421ed2-49a5-4939-8411-fecfef8ca233 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.396529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.397390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.397869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.398493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.405145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.414834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.417726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.424868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.446935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3715/7438] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:44:54.541791 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3724/7439] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:44:54 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:54.545700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.557480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7207e24-4c7e-475d-97a3-b52562da6b0e service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.620759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.621369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.621644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.621913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.622645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.625123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.746471 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3716/7440] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:44:54 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:44:54.750959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.766080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59d2bb-34c1-4685-8064-6744a9fdd598 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.768848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.769541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.769895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.770259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.771045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.772712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.788277 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3725/7441] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:54.792694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.810000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04037b8-8820-4aeb-9686-48f6c3599a86 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.810783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e2eca-0009-4962-9533-8e32386e747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.810783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2eca-0009-4962-9533-8e32386e747d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.811093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2eca-0009-4962-9533-8e32386e747d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.811322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2eca-0009-4962-9533-8e32386e747d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.811910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2eca-0009-4962-9533-8e32386e747d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.814070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2eca-0009-4962-9533-8e32386e747d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.826846 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3717/7442] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:44:54.831881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:54.838518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dc947-0215-4ebe-ac9b-4be92f8b204b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.838861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dc947-0215-4ebe-ac9b-4be92f8b204b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.839143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dc947-0215-4ebe-ac9b-4be92f8b204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.846894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01261bb6-16e4-460e-bd96-bc28e616e82e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:54.853407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:54.861619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.861619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.861619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] PATH_INFO: `/v3/projects/9eccd46985a444049179632f72f04375/users/6c09ab3c4e9e4a2c99f2273a51928854/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.865629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-766dc947-0215-4ebe-ac9b-4be92f8b204b None None] MFA Rules not processed for user `b2985f6e7b7c4e91ac80db47d1f2dff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:54.866947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-766dc947-0215-4ebe-ac9b-4be92f8b204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:54.871182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eccd46985a444049179632f72f04375, user_id=6c09ab3c4e9e4a2c99f2273a51928854, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:54.873914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:54.933460 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3718/7443] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:54.957452 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3726/7444] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:44:54 2022] PUT /identity/v3/projects/9eccd46985a444049179632f72f04375/users/6c09ab3c4e9e4a2c99f2273a51928854/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:54.960662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e67a-06fa-4e23-b48d-b8ae56b5233f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:54.961220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e67a-06fa-4e23-b48d-b8ae56b5233f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:54.961547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e67a-06fa-4e23-b48d-b8ae56b5233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:54.993130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b085e67a-06fa-4e23-b48d-b8ae56b5233f None None] MFA Rules not processed for user `6c09ab3c4e9e4a2c99f2273a51928854`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:54.994385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b085e67a-06fa-4e23-b48d-b8ae56b5233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:55.026177 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:55.101775 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3719/7445] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:44:55.118208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:55.119905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:55.183071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2986db-e9d3-443e-a0db-4bf58587e4cb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:55.186781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:55.187738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:55.187877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:55.188109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:55.248470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:55.250613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:55.260054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3727/7446] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:55.604225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:55.604783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:55.604783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:55.629160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:55.630398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:55.693468 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3720/7447] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:44:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:55.706522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:55.707915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:55.735036 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:55.780387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0b3ff-5808-4525-ae07-2513f881c7dd service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:55.786408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82969b2-11ba-47e4-80ab-7ebb57568830 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:55.787010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82969b2-11ba-47e4-80ab-7ebb57568830 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:55.787286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82969b2-11ba-47e4-80ab-7ebb57568830 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:55.787555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82969b2-11ba-47e4-80ab-7ebb57568830 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:55.796276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82969b2-11ba-47e4-80ab-7ebb57568830 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:55.797859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82969b2-11ba-47e4-80ab-7ebb57568830 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:55.805943 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3728/7448] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:44:56.542600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:56.542600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:56.581130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90499e44-4a5b-4c2d-b234-c63a8352d9b0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:56.584869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:56.585495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:56.585774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:56.586082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:56.596800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:56.599060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:56.622606 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3721/7449] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:56.707745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480245b-f5c8-4913-902f-8f4cc7b6c39a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:56.708741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480245b-f5c8-4913-902f-8f4cc7b6c39a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:56.709381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480245b-f5c8-4913-902f-8f4cc7b6c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:56.731122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2480245b-f5c8-4913-902f-8f4cc7b6c39a None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:56.732755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2480245b-f5c8-4913-902f-8f4cc7b6c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:56.740929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3729/7450] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:44:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:56.755071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:56.770119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19cf3-d226-47bf-8d0b-7f917663d07f service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:56.779279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:56.781120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:56.781638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:56.781912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:56.791042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:56.794805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:56.810908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3722/7451] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:44:57.356037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480245b-f5c8-4913-902f-8f4cc7b6c39a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:57.514216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480245b-f5c8-4913-902f-8f4cc7b6c39a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:57.518871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:57.519504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:57.519866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:57.520140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] PATH_INFO: `/v3/users/29d0bcbd6e8b46f384c14dff236dbabb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:57.521324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d0bcbd6e8b46f384c14dff236dbabb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:57.523868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:57.549104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:57.551437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:57.629930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6cb89-f69d-4f7c-813f-201136ea7a3a service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:57.635599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705e58-fd72-4dd0-b9f5-b735b4a7186d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:57.636219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705e58-fd72-4dd0-b9f5-b735b4a7186d service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:57.636554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705e58-fd72-4dd0-b9f5-b735b4a7186d service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:57.636765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705e58-fd72-4dd0-b9f5-b735b4a7186d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:57.638621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd705e58-fd72-4dd0-b9f5-b735b4a7186d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:57.653753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705e58-fd72-4dd0-b9f5-b735b4a7186d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:57.655458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705e58-fd72-4dd0-b9f5-b735b4a7186d service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:57.670104 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3723/7452] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:57.766750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d0bcbd6e8b46f384c14dff236dbabb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:57.778895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d0bcbd6e8b46f384c14dff236dbabb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:57.782451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d0bcbd6e8b46f384c14dff236dbabb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:57.897935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d0bcbd6e8b46f384c14dff236dbabb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:57.898971 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d0bcbd6e8b46f384c14dff236dbabb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:57.930568 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3730/7453] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:57 2022] DELETE /identity/v3/users/29d0bcbd6e8b46f384c14dff236dbabb => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:57.934850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:57.935464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:57.939508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:57.981806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:44:57.983072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:58.005812 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:58.091385 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3724/7454] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:44:58.115886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:58.119661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:58.168563 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:44:58.206994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056356-3dee-4e08-84d6-80566289ff42 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:58.210919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:58.211706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:58.211987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:58.212260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:58.225548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:58.227134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:58.238509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3731/7455] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:44:59.167168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:59.169208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:44:59.197299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee789b-69d8-4e9e-8fc2-6b48d253c0d5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:59.206301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:59.207213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:59.207736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:59.208175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] PATH_INFO: `/v3/projects/43fa02b9fb984e3f8c288636d25da3c0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:59.209705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fa02b9fb984e3f8c288636d25da3c0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:59.212933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:59.370762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fa02b9fb984e3f8c288636d25da3c0', 'request_id': 'req-6ace9ce7-12fc-417b-aa96-480a2d3e542e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.399137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fa02b9fb984e3f8c288636d25da3c0', 'request_id': 'req-6ace9ce7-12fc-417b-aa96-480a2d3e542e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.505923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fa02b9fb984e3f8c288636d25da3c0', 'request_id': 'req-6ace9ce7-12fc-417b-aa96-480a2d3e542e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.531196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] The token cache is being invalidate because project 43fa02b9fb984e3f8c288636d25da3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:44:59.531488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.532151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.533733 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3725/7456] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:44:59 2022] DELETE /identity/v3/projects/43fa02b9fb984e3f8c288636d25da3c0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:44:59.543304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:44:59.550588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30272de9-8b44-4757-b58a-d1be6d21ca6b service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:44:59.628103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:44:59.628938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:44:59.629620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:44:59.629899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] PATH_INFO: `/v3/users/6c09ab3c4e9e4a2c99f2273a51928854` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:44:59.635313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c09ab3c4e9e4a2c99f2273a51928854)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:44:59.635313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:44:59.892898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c09ab3c4e9e4a2c99f2273a51928854'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.907362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c09ab3c4e9e4a2c99f2273a51928854'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.909495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c09ab3c4e9e4a2c99f2273a51928854'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.981998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c09ab3c4e9e4a2c99f2273a51928854'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:44:59.982768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-bba6b255-a366-496c-9da0-dde784d39740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c09ab3c4e9e4a2c99f2273a51928854'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:00.006074 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3732/7457] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:44:59 2022] DELETE /identity/v3/users/6c09ab3c4e9e4a2c99f2273a51928854 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:00.879909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:00.884477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:00.931512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace9ce7-12fc-417b-aa96-480a2d3e542e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:01.008413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:01.009821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:01.010330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:01.011301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] PATH_INFO: `/v3/projects/9eccd46985a444049179632f72f04375` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:01.013029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eccd46985a444049179632f72f04375)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:01.016236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:01.140192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eccd46985a444049179632f72f04375', 'request_id': 'req-1fac705e-ed56-4979-ba65-a2be3b82d7e0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:01.144001 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:01.149241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eccd46985a444049179632f72f04375', 'request_id': 'req-1fac705e-ed56-4979-ba65-a2be3b82d7e0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:01.241319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eccd46985a444049179632f72f04375', 'request_id': 'req-1fac705e-ed56-4979-ba65-a2be3b82d7e0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:01.265065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] The token cache is being invalidate because project 9eccd46985a444049179632f72f04375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:01.265643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:01.266673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1fac705e-ed56-4979-ba65-a2be3b82d7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:01.270344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3726/7458] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:00 2022] DELETE /identity/v3/projects/9eccd46985a444049179632f72f04375 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:01.276398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dd59-9d00-4de4-b220-ea499c500656 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:01.277280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dd59-9d00-4de4-b220-ea499c500656 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:01.283097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dd59-9d00-4de4-b220-ea499c500656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:01.316214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4c17dd59-9d00-4de4-b220-ea499c500656 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:01.317559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c17dd59-9d00-4de4-b220-ea499c500656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:01.385026 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:01.407718 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3733/7459] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:01.416317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05349dd-0dbe-450e-b876-a7a5b46edc69 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:01.417230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05349dd-0dbe-450e-b876-a7a5b46edc69 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:01.417816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05349dd-0dbe-450e-b876-a7a5b46edc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:01.443317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e05349dd-0dbe-450e-b876-a7a5b46edc69 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:01.444848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e05349dd-0dbe-450e-b876-a7a5b46edc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:01.456824 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3727/7460] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:01.460694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17dd59-9d00-4de4-b220-ea499c500656 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:01.473142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17dd59-9d00-4de4-b220-ea499c500656 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:01.479704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:01.481281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:01.482431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:01.482890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:01.484353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:45:01.485187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:01.487071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:01.505586 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3734/7461] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:45:01.509642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05349dd-0dbe-450e-b876-a7a5b46edc69 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:01.522798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05349dd-0dbe-450e-b876-a7a5b46edc69 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:01.531359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:01.532371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:01.533350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:01.533817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:01.534685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:01.536904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:01.674018 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3728/7462] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:45:01 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:01.678511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:01.692627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a19e-dae7-41fc-a152-40d3237d6534 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:01.789175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:01.789175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:01.789175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:01.789175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:01.790054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:01.792827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:01.925494 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3735/7463] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:45:01 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:01.929347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:01.960982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af605052-b9c7-47b9-ad55-f1c33ccd0853 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:01.973489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:01.974413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:01.974889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:01.978931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:01.980027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:01.983151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:01.996858 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3729/7464] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:45:02.001501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:02.013676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d44ea-a30b-4ae7-966d-d53e958aff96 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:02.019648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32f01-2de1-4357-a631-6f58ead18d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:02.020234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32f01-2de1-4357-a631-6f58ead18d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:02.020545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32f01-2de1-4357-a631-6f58ead18d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:02.021037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32f01-2de1-4357-a631-6f58ead18d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:02.021738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32f01-2de1-4357-a631-6f58ead18d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:02.024185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32f01-2de1-4357-a631-6f58ead18d0a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:02.040857 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3736/7465] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:02.046177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:02.069718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f850-cdb8-432e-b5b2-9dc7be26fee7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:02.079975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:02.081256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:02.081736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:02.082315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] PATH_INFO: `/v3/projects/dc0fd9926a0e4d07b06d3df033c06480/users/3b743528809246eb975f6313df8816bd/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:02.106773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0fd9926a0e4d07b06d3df033c06480, user_id=3b743528809246eb975f6313df8816bd, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:02.111518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:02.203163 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3730/7466] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:02 2022] PUT /identity/v3/projects/dc0fd9926a0e4d07b06d3df033c06480/users/3b743528809246eb975f6313df8816bd/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:02.215486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16d27-608a-4f70-b7eb-734d6ab249d8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:02.215783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16d27-608a-4f70-b7eb-734d6ab249d8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:02.216236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16d27-608a-4f70-b7eb-734d6ab249d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:02.281837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b1a16d27-608a-4f70-b7eb-734d6ab249d8 None None] MFA Rules not processed for user `3b743528809246eb975f6313df8816bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:02.284224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b1a16d27-608a-4f70-b7eb-734d6ab249d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:02.452383 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3737/7467] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:02.498915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:02.510322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:02.581470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78a4f8-0777-4037-a85b-a98c713e3295 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:02.586060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:02.586729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:02.587007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:02.587277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:02.601154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:02.602707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:02.615425 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3731/7468] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:03.231560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea3bb-2fc3-4b78-a544-cb95c153c405 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:03.232129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea3bb-2fc3-4b78-a544-cb95c153c405 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:03.232542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea3bb-2fc3-4b78-a544-cb95c153c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:03.268378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b92ea3bb-2fc3-4b78-a544-cb95c153c405 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:03.269879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b92ea3bb-2fc3-4b78-a544-cb95c153c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:03.383646 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:03.443049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3738/7469] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:45:03.458090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:03.459431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:03.637128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36bc68-4007-4d00-bc2f-14e435ae7da1 service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:03.650761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:03.651401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:03.651685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:03.651956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:03.684286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:03.685891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:03.714570 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3732/7470] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:04.749681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb916-d0c3-4556-a7cd-57c2f8d9806c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:04.750551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb916-d0c3-4556-a7cd-57c2f8d9806c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:04.751041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb916-d0c3-4556-a7cd-57c2f8d9806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:04.787453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a13cb916-d0c3-4556-a7cd-57c2f8d9806c None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:04.792203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a13cb916-d0c3-4556-a7cd-57c2f8d9806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:04.814077 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3739/7471] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:04.829526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:04.851976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c980fa0-3564-4571-a755-0e87cfda5b42 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:04.882086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:04.882086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:04.882086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:04.882086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:04.895978 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:04.900829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:04.921926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:04.946058 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3733/7472] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:45:06.094265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a492-e291-4467-a686-0cfb9ab90925 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:06.094758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a492-e291-4467-a686-0cfb9ab90925 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:06.094758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a492-e291-4467-a686-0cfb9ab90925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:06.135727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-35a0a492-e291-4467-a686-0cfb9ab90925 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:06.145635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-35a0a492-e291-4467-a686-0cfb9ab90925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:06.158166 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3740/7473] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:45:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:06.181405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:06.225361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ec2e-a2d2-4f57-b3fa-118ac42005cc service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:06.242149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:06.242873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:06.244419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:06.245069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:06.259926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:06.260854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:06.271657 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3734/7474] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:07.577094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97668173-2bdf-4cdb-82e0-286c8c8e62c0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:07.578012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97668173-2bdf-4cdb-82e0-286c8c8e62c0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:07.578753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97668173-2bdf-4cdb-82e0-286c8c8e62c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:07.612970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-97668173-2bdf-4cdb-82e0-286c8c8e62c0 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:07.616582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-97668173-2bdf-4cdb-82e0-286c8c8e62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:07.627390 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3741/7475] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:07.641372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:07.691394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750ac9-c84b-4efe-be4e-b8dcc75fb382 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:07.758186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:07.758186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:07.758186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:07.758186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:07.767552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:07.769761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:07.799035 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3735/7476] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:09.097159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1ad0-f1c2-42fb-a45e-efc6857df01b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:09.097988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1ad0-f1c2-42fb-a45e-efc6857df01b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:09.098445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1ad0-f1c2-42fb-a45e-efc6857df01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:09.121778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9bbe1ad0-f1c2-42fb-a45e-efc6857df01b None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:09.123472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9bbe1ad0-f1c2-42fb-a45e-efc6857df01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:09.142501 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3742/7477] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:09.155563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:09.182649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f98928-dc90-4c2c-9995-6fe4375f8074 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:09.197352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:09.198657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:09.199115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:09.199575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:09.211278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:09.213377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:09.239617 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3736/7478] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:45:10.386850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:10.387818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:10.388263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:10.430686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:10.435443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:10.445122 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3743/7479] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:10.460553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:10.517431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbae0dd-3473-4869-9ad2-b9da5beb53d4 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:10.537441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66981-535a-41f7-8997-182830480379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:10.538367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66981-535a-41f7-8997-182830480379 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:10.538821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66981-535a-41f7-8997-182830480379 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:10.539269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66981-535a-41f7-8997-182830480379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:10.555095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d66981-535a-41f7-8997-182830480379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:10.556686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d66981-535a-41f7-8997-182830480379 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:10.578404 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3737/7480] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:12.299114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:12.302180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:12.499920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f108cbc-1bcc-4195-a14d-bebf8a450301 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:12.523678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:12.524528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:12.524911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:12.525284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] PATH_INFO: `/v3/users/d2c2d14de3694c4c976121f601614270` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:12.526738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c2d14de3694c4c976121f601614270)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:12.539016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464cea5-0927-46a1-af8f-9d9a4475ed8e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:12.539566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464cea5-0927-46a1-af8f-9d9a4475ed8e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:12.539819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464cea5-0927-46a1-af8f-9d9a4475ed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:12.546959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:12.602461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a464cea5-0927-46a1-af8f-9d9a4475ed8e None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:12.603909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a464cea5-0927-46a1-af8f-9d9a4475ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:12.640846 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3738/7481] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:45:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:45:12.657274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464cea5-0927-46a1-af8f-9d9a4475ed8e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:12.675880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464cea5-0927-46a1-af8f-9d9a4475ed8e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:12.682227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb2913-e287-42ba-8e47-36ec1d9b5a60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:12.683083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2913-e287-42ba-8e47-36ec1d9b5a60 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:12.683657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2913-e287-42ba-8e47-36ec1d9b5a60 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:12.684107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2913-e287-42ba-8e47-36ec1d9b5a60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:12.697662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb2913-e287-42ba-8e47-36ec1d9b5a60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:12.699703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb2913-e287-42ba-8e47-36ec1d9b5a60 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:12.712284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3739/7482] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:45:12.874195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c2d14de3694c4c976121f601614270'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:12.884530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c2d14de3694c4c976121f601614270'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:12.885653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c2d14de3694c4c976121f601614270'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:13.034224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c2d14de3694c4c976121f601614270'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:13.035771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c2d14de3694c4c976121f601614270'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:13.072351 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3744/7483] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:45:12 2022] DELETE /identity/v3/users/d2c2d14de3694c4c976121f601614270 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:45:13.075779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16bb44-7f4d-44a9-a540-0d5c393aca3e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:13.076189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16bb44-7f4d-44a9-a540-0d5c393aca3e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:13.077307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16bb44-7f4d-44a9-a540-0d5c393aca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:13.100315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0a16bb44-7f4d-44a9-a540-0d5c393aca3e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:13.101817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0a16bb44-7f4d-44a9-a540-0d5c393aca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:13.208497 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3740/7484] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:13.218431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:13.220579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:13.367231 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:13.387937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b11b9-f7f4-4d95-b4e8-26e68c3c7cb4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:13.388355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b11b9-f7f4-4d95-b4e8-26e68c3c7cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:13.388737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b11b9-f7f4-4d95-b4e8-26e68c3c7cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:13.424830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f708-8899-4fcc-92d8-49468a4fae9e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:13.427846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-896b11b9-f7f4-4d95-b4e8-26e68c3c7cb4 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:13.431203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-896b11b9-f7f4-4d95-b4e8-26e68c3c7cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:13.447239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:13.447877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:13.448215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:13.448491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:13.469658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:13.471241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:13.491820 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3745/7485] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:13.604553 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3741/7486] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:45:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:13.625356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:13.626911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:13.823338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bac34e-7c32-4636-a021-1c4c13e6c72c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:13.839885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:13.841312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:13.842586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:13.845894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:13.858848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:13.862987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:13.873949 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3746/7487] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:14.450954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:14.452057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:14.452589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:14.475541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:14.477216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:14.493678 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3742/7488] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:45:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:14.511426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:14.526375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:14.527083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:14.549378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ec198-1e1b-45fd-88ad-f5cc7839b621 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:14.554025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b27738-a187-4b4a-8233-91c87cd137f8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:14.563744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:14.564826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:14.565311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:14.565794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] PATH_INFO: `/v3/projects/26c5e08c6e524aa381e028f910ba63fc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:14.566110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:14.566735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:14.567009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:14.567471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:14.567879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c5e08c6e524aa381e028f910ba63fc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:14.570030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:14.585612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:14.588051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:14.600729 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3747/7489] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:14.601249 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:14.739841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c5e08c6e524aa381e028f910ba63fc', 'request_id': 'req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:14.745922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c5e08c6e524aa381e028f910ba63fc', 'request_id': 'req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:14.841592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c5e08c6e524aa381e028f910ba63fc', 'request_id': 'req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:14.866177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] The token cache is being invalidate because project 26c5e08c6e524aa381e028f910ba63fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:14.866636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:14.867570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cea06e0-09ff-4ad6-bdb6-b3e03efd8c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:14.869328 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3743/7490] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:14 2022] DELETE /identity/v3/projects/26c5e08c6e524aa381e028f910ba63fc => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:14.874506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:14.891753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089856-3db0-4967-ba7a-a2e12198f43b service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:14.981639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:14.982651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:14.983692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:14.984196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] PATH_INFO: `/v3/users/a54961ca03c1416f8dd1dea1e1531be2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:14.985584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54961ca03c1416f8dd1dea1e1531be2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:14.988034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:15.063198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:15.063703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:15.064171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:15.088814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:15.090086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:15.157090 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3744/7491] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:15.171898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:15.173303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:15.175718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54961ca03c1416f8dd1dea1e1531be2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:15.182850 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:15.185275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54961ca03c1416f8dd1dea1e1531be2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:15.187415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54961ca03c1416f8dd1dea1e1531be2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:15.256550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddf72-2d9f-4113-a491-1b253210875e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:15.262466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:15.263341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:15.263668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:15.264499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:15.265062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54961ca03c1416f8dd1dea1e1531be2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:15.266516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-404229f2-6a06-4cb1-883f-48a36c7d72c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54961ca03c1416f8dd1dea1e1531be2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:15.283053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:15.284696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:15.292834 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3748/7492] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:45:14 2022] DELETE /identity/v3/users/a54961ca03c1416f8dd1dea1e1531be2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:15.298026 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3745/7493] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:15.918124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:15.918695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:15.918695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:15.953482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:15.954639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:16.008807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:16.011309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:16.036442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740312c0-4ac9-46bc-be20-a1a36a9740b2 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:16.062408 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3749/7494] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:16.070273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:16.074988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:16.136985 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:16.169424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:16.171427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:16.172790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:16.174274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] PATH_INFO: `/v3/projects/c11aaf5795364b599dff27b44b491e56` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:16.177030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11aaf5795364b599dff27b44b491e56)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:16.183168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:16.222361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097bb27-ea33-4d93-b84c-647dd8c7b999 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:16.231035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8116f0-6eb6-4fec-94b0-ec6418f3d9d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:16.232017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8116f0-6eb6-4fec-94b0-ec6418f3d9d3 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:16.232735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8116f0-6eb6-4fec-94b0-ec6418f3d9d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:16.233196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8116f0-6eb6-4fec-94b0-ec6418f3d9d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:16.244811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8116f0-6eb6-4fec-94b0-ec6418f3d9d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:16.246817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8116f0-6eb6-4fec-94b0-ec6418f3d9d3 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:16.256482 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3750/7495] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:45:16.323730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11aaf5795364b599dff27b44b491e56', 'request_id': 'req-d3be48c9-cc86-4247-a19f-1b2766629113'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:16.330812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11aaf5795364b599dff27b44b491e56', 'request_id': 'req-d3be48c9-cc86-4247-a19f-1b2766629113'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:16.398736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11aaf5795364b599dff27b44b491e56', 'request_id': 'req-d3be48c9-cc86-4247-a19f-1b2766629113'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:16.433706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] The token cache is being invalidate because project c11aaf5795364b599dff27b44b491e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:16.438407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:16.438407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-d3be48c9-cc86-4247-a19f-1b2766629113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:16.439402 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3746/7496] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:16 2022] DELETE /identity/v3/projects/c11aaf5795364b599dff27b44b491e56 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:16.444295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299cba-0cdc-475d-90d4-c41dae0e89b9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:16.445041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299cba-0cdc-475d-90d4-c41dae0e89b9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:16.445562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299cba-0cdc-475d-90d4-c41dae0e89b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:16.475360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b5299cba-0cdc-475d-90d4-c41dae0e89b9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:16.477623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b5299cba-0cdc-475d-90d4-c41dae0e89b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:16.617409 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3751/7497] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:16.620548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c059d68-6f8f-4a9b-8714-c9cd7fc177bc None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:16.621251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c059d68-6f8f-4a9b-8714-c9cd7fc177bc None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:16.621251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c059d68-6f8f-4a9b-8714-c9cd7fc177bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:16.670941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7c059d68-6f8f-4a9b-8714-c9cd7fc177bc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:16.688311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7c059d68-6f8f-4a9b-8714-c9cd7fc177bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:16.698532 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3747/7498] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:16.702808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299cba-0cdc-475d-90d4-c41dae0e89b9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:16.716142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299cba-0cdc-475d-90d4-c41dae0e89b9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:16.730843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41186a28-ed54-4d56-a3ab-6c21718623d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:16.731477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41186a28-ed54-4d56-a3ab-6c21718623d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:16.731758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41186a28-ed54-4d56-a3ab-6c21718623d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:16.732027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41186a28-ed54-4d56-a3ab-6c21718623d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:16.732726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41186a28-ed54-4d56-a3ab-6c21718623d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:45:16.733025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41186a28-ed54-4d56-a3ab-6c21718623d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:16.736357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41186a28-ed54-4d56-a3ab-6c21718623d2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:16.738112 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:16.774473 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3752/7499] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:45:16.779445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c059d68-6f8f-4a9b-8714-c9cd7fc177bc None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:16.812381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c059d68-6f8f-4a9b-8714-c9cd7fc177bc None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:16.827873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:16.830657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:16.836701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:16.836701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:16.836701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:16.836701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:16.869747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:16.876800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:16.876800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:16.895688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:16.896778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:16.994103 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3748/7500] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:45:16 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:16.997098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:17.065358 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3753/7501] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:45:17.073251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:17.074881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:17.197382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16031f5-f944-48c0-976d-0fc442d3784d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:17.244619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99382efd-a030-4cbd-8d61-466d39c3e45d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:17.250140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:17.251976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:17.252447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:17.252919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:17.253876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:17.256022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:17.329025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:17.329876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:17.330348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:17.330828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:17.333208 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3749/7502] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:45:16 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:45:17.338076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:17.348165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f749885-6f5d-47bc-9a2d-9e1f78baf78f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:17.353811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:17.354529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:17.354808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:17.355081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:17.355765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:17.358205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:17.377762 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3750/7503] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:45:17.384043 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:17.414263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:17.418085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:17.432485 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3754/7504] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:45:17.441993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:17.500795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f44f1f-930f-4d6a-9a29-7792e822d258 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:17.507693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed6427-1e2d-4b1b-a74f-dce98c8dd9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:17.508429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6427-1e2d-4b1b-a74f-dce98c8dd9fa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:17.510253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6427-1e2d-4b1b-a74f-dce98c8dd9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:17.510253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6427-1e2d-4b1b-a74f-dce98c8dd9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:17.510253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed6427-1e2d-4b1b-a74f-dce98c8dd9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:17.511609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed6427-1e2d-4b1b-a74f-dce98c8dd9fa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:17.529006 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3751/7505] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:17.530297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:17.547443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fefa6-c2ac-43f8-8ef1-2d3ca6e8cd68 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:17.552899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:17.553792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:17.554168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:17.554506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] PATH_INFO: `/v3/projects/8c7042f2d01c4556bb6486f55cb86da6/users/b5a712b35af040e68f7e57011c2bf4a2/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:17.622162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7042f2d01c4556bb6486f55cb86da6, user_id=b5a712b35af040e68f7e57011c2bf4a2, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:17.630025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:17.804862 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3755/7506] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:17 2022] PUT /identity/v3/projects/8c7042f2d01c4556bb6486f55cb86da6/users/b5a712b35af040e68f7e57011c2bf4a2/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:17.816738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:17.817188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:17.817578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:17.850398 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:17.887901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] MFA Rules not processed for user `b5a712b35af040e68f7e57011c2bf4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:17.891197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:17.978091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:17.987345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:17.998946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3752/7507] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:18.074906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5be91-52a6-47c9-8334-c08dfb7a4cca admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:18.080072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:18.080805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:18.081186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:18.081559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] PATH_INFO: `/v3/users/3b743528809246eb975f6313df8816bd` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:18.082866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b743528809246eb975f6313df8816bd)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:18.084900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:18.109044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:18.110744 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:18.187536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c1ce2-c04a-4649-80ed-1785d9d27e84 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:18.191560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2438bf1-aff2-42c8-ba2d-c89b7f54935f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:18.192170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2438bf1-aff2-42c8-ba2d-c89b7f54935f service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:18.192449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2438bf1-aff2-42c8-ba2d-c89b7f54935f service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:18.192727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2438bf1-aff2-42c8-ba2d-c89b7f54935f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:18.201778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2438bf1-aff2-42c8-ba2d-c89b7f54935f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:18.203237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2438bf1-aff2-42c8-ba2d-c89b7f54935f service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:18.218188 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3753/7508] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:18.325086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b743528809246eb975f6313df8816bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:18.341025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b743528809246eb975f6313df8816bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:18.358393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b743528809246eb975f6313df8816bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:18.464922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b743528809246eb975f6313df8816bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:18.465869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b743528809246eb975f6313df8816bd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:18.533454 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3756/7509] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:45:17 2022] DELETE /identity/v3/users/3b743528809246eb975f6313df8816bd => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:18.540601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:18.541408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:18.541522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:18.562457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:18.570160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:18.633969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3754/7510] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:18.643186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:18.644591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:18.688210 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:18.707117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151be47-a0cb-45c3-8b29-1ed51fc9e174 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:18.711046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae728eb3-2e12-4518-a759-0c826e4ac1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:18.711654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae728eb3-2e12-4518-a759-0c826e4ac1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:18.711948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae728eb3-2e12-4518-a759-0c826e4ac1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:18.712334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae728eb3-2e12-4518-a759-0c826e4ac1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:18.722401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae728eb3-2e12-4518-a759-0c826e4ac1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:18.723848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae728eb3-2e12-4518-a759-0c826e4ac1a1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:18.734468 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3757/7511] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:19.447022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:19.448687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:19.480746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb24248-7d08-4c19-9419-e38ba8f4ab80 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:19.482333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:19.482995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:19.483275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:19.483549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] PATH_INFO: `/v3/projects/dc0fd9926a0e4d07b06d3df033c06480` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:19.484709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0fd9926a0e4d07b06d3df033c06480)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:19.492630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:19.651308 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:19.673415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0fd9926a0e4d07b06d3df033c06480', 'request_id': 'req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:19.680587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0fd9926a0e4d07b06d3df033c06480', 'request_id': 'req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:19.804959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0fd9926a0e4d07b06d3df033c06480', 'request_id': 'req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:19.834145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] The token cache is being invalidate because project dc0fd9926a0e4d07b06d3df033c06480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:19.834520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:19.835567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-82eb7a02-38b2-4a7b-afee-0f80d60e53f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:19.838066 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3755/7512] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:19 2022] DELETE /identity/v3/projects/dc0fd9926a0e4d07b06d3df033c06480 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:19.844344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c403-8232-4d40-821c-65be87633cdb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:19.844886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c403-8232-4d40-821c-65be87633cdb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:19.844886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c403-8232-4d40-821c-65be87633cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:19.872979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4ad5c403-8232-4d40-821c-65be87633cdb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:19.875937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ad5c403-8232-4d40-821c-65be87633cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:19.955736 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3758/7513] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:19.957437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce364600-2a45-4780-87ed-ccd9c633a909 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:19.957726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce364600-2a45-4780-87ed-ccd9c633a909 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:19.958021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce364600-2a45-4780-87ed-ccd9c633a909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:19.979323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ce364600-2a45-4780-87ed-ccd9c633a909 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:19.985264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ce364600-2a45-4780-87ed-ccd9c633a909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:19.989241 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3756/7514] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:19.993589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c403-8232-4d40-821c-65be87633cdb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.005331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c403-8232-4d40-821c-65be87633cdb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:20.010013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:20.014317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.014317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.014317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.014317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:45:20.014317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:20.014317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:20.026671 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3759/7515] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:45:20.031055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce364600-2a45-4780-87ed-ccd9c633a909 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.043984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce364600-2a45-4780-87ed-ccd9c633a909 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:20.049654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:20.050482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.050861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.051233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.051963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:20.054070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:20.148256 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3757/7516] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:45:20 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:20.152397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.163271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b55c7c-e0d9-4a2b-8082-9a02c860ed70 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:20.236232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:20.237104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.237760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.238140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.239386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:20.242261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:20.332219 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3760/7517] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:45:20 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:20.336367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.348898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040af4-ddfc-4b4c-91c0-c69290b87f8f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:20.354363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:20.364026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.364026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.364026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.364026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:20.364026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:20.374678 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3758/7518] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:20.379569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.396450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25028dd-8732-4ee4-b2cc-dd40623ba236 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:20.403579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69239ab7-5908-43f6-aaa5-a66cd87d629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:20.405198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239ab7-5908-43f6-aaa5-a66cd87d629e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.405689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239ab7-5908-43f6-aaa5-a66cd87d629e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.406322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239ab7-5908-43f6-aaa5-a66cd87d629e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.407166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69239ab7-5908-43f6-aaa5-a66cd87d629e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:20.409842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69239ab7-5908-43f6-aaa5-a66cd87d629e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:20.429155 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3761/7519] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:45:20.433837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.446604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e59f5-6ae6-4b28-a428-310ed3192adb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:20.453700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:20.454707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.455173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.455609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] PATH_INFO: `/v3/projects/b8cf28763bb343d28a4293ad0f2f254d/users/6a51bfdd150b49d5a5ae4c2244ad19d7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.474349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cf28763bb343d28a4293ad0f2f254d, user_id=6a51bfdd150b49d5a5ae4c2244ad19d7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:20.477234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:20.608571 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3759/7520] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:20 2022] PUT /identity/v3/projects/b8cf28763bb343d28a4293ad0f2f254d/users/6a51bfdd150b49d5a5ae4c2244ad19d7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:20.619708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051526-0218-47c8-acf7-f11a31070196 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.620183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051526-0218-47c8-acf7-f11a31070196 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.620715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051526-0218-47c8-acf7-f11a31070196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.657604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-51051526-0218-47c8-acf7-f11a31070196 None None] MFA Rules not processed for user `6a51bfdd150b49d5a5ae4c2244ad19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:20.659013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-51051526-0218-47c8-acf7-f11a31070196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:20.725367 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:20.754659 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3762/7521] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:20.759197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.839638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8da7-6bec-4209-aeb8-62363dbc29d4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:20.845243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:20.846085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:20.846370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:20.846644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:20.847300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:20.849593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:20.950979 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3760/7522] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:45:20 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:45:20.952366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051526-0218-47c8-acf7-f11a31070196 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:20.967739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51051526-0218-47c8-acf7-f11a31070196 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:21.062349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:21.063145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:21.063596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:21.063984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:21.064850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:21.066905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:21.208336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3763/7523] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:45:20 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:21.213747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:21.228601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae477f-8382-4c3f-866f-1ca8db32fad3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:21.234282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:21.235122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:21.242561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:21.242561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:21.242561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:21.242561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:21.255517 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3761/7524] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:21.259626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:21.270658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979464c-4379-49d8-8327-a274350cf35e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:21.277814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:21.277814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:21.277814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:21.277814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] PATH_INFO: `/v3/projects/85aace8481d0455686f3d5b8c088b807/users/c750e4af90924a189a6b1acd726953fe/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:21.300321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85aace8481d0455686f3d5b8c088b807, user_id=c750e4af90924a189a6b1acd726953fe, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:21.304619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:21.410476 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3764/7525] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:21 2022] PUT /identity/v3/projects/85aace8481d0455686f3d5b8c088b807/users/c750e4af90924a189a6b1acd726953fe/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:21.411503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:21.427776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93760611-2d11-46d6-aaaa-af2e710ef5ae admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:21.532957 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:21.563674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d96f2c-a333-4028-b6a3-630f393f70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:21.564280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d96f2c-a333-4028-b6a3-630f393f70f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:21.564555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d96f2c-a333-4028-b6a3-630f393f70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:21.564817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d96f2c-a333-4028-b6a3-630f393f70f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:21.565661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d96f2c-a333-4028-b6a3-630f393f70f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:21.567270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d96f2c-a333-4028-b6a3-630f393f70f7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:21.583043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:21.598908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3762/7526] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:45:21.603606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b3356-6150-4aa9-9f57-afaddc6af7d8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:21.610193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:21.614813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:21.614813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:21.614813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] PATH_INFO: `/v3/projects/85aace8481d0455686f3d5b8c088b807/users/c750e4af90924a189a6b1acd726953fe/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:21.614813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85aace8481d0455686f3d5b8c088b807, user_id=c750e4af90924a189a6b1acd726953fe, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:21.623278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:21.639527 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3765/7527] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:21 2022] PUT /identity/v3/projects/85aace8481d0455686f3d5b8c088b807/users/c750e4af90924a189a6b1acd726953fe/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:21.652616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5446-d6f2-4201-96d6-66b03c73956b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:21.652914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5446-d6f2-4201-96d6-66b03c73956b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:21.653474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f5446-d6f2-4201-96d6-66b03c73956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:21.683186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8b1f5446-d6f2-4201-96d6-66b03c73956b None None] MFA Rules not processed for user `c750e4af90924a189a6b1acd726953fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:21.684526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8b1f5446-d6f2-4201-96d6-66b03c73956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:21.776721 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3763/7528] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:45:21.787272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:21.789001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:21.863264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eebb0-7739-4e75-806c-eb903eb8fc10 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:21.868911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae1cca-d50f-4b6f-bc0b-a08b40db8d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:21.868911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1cca-d50f-4b6f-bc0b-a08b40db8d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:21.868911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1cca-d50f-4b6f-bc0b-a08b40db8d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:21.869339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1cca-d50f-4b6f-bc0b-a08b40db8d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:21.893561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae1cca-d50f-4b6f-bc0b-a08b40db8d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:21.896101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae1cca-d50f-4b6f-bc0b-a08b40db8d01 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:21.915722 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3766/7529] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:25.325084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f5446-d6f2-4201-96d6-66b03c73956b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:25.426284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f5446-d6f2-4201-96d6-66b03c73956b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:25.431891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:25.432719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:25.433060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:25.433405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] PATH_INFO: `/v3/users/6a51bfdd150b49d5a5ae4c2244ad19d7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:25.436302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a51bfdd150b49d5a5ae4c2244ad19d7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:25.438742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:25.666944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a51bfdd150b49d5a5ae4c2244ad19d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:25.677427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a51bfdd150b49d5a5ae4c2244ad19d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:25.677598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a51bfdd150b49d5a5ae4c2244ad19d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:25.679735 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:25.774371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:25.774859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:25.775109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:25.779428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a51bfdd150b49d5a5ae4c2244ad19d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:25.780225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33e123f8-061e-4e85-be09-ddaaa4cc2a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a51bfdd150b49d5a5ae4c2244ad19d7'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:25.805126 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3764/7530] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:45:25 2022] DELETE /identity/v3/users/6a51bfdd150b49d5a5ae4c2244ad19d7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:25.808721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:25.809203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:25.809566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:25.809915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:25.810299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:25.848211 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:25.849075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:25.850342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:25.879868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3767/7531] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:25.894956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:25.896530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:25.921752 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3765/7532] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:25.931853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:25.933349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:25.987370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33cd90-208c-4de6-a807-2caf4db22a19 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:26.014755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:26.015393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:26.015697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:26.015969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:26.026836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:26.028480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:26.037312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3768/7533] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:45:26.041489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0fd10-cd3f-4415-bc1b-2cf7ee1a6508 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:26.045444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:26.046239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:26.046590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:26.046965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:26.057192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:26.058728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:26.069351 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3766/7534] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:45:26.747101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:26.749572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:26.805308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaf106-aeee-4742-99a5-456f7ef7f94d service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:26.819097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:26.820354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:26.820818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:26.821261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] PATH_INFO: `/v3/projects/b8cf28763bb343d28a4293ad0f2f254d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:26.823151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cf28763bb343d28a4293ad0f2f254d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:26.825300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:26.966085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cf28763bb343d28a4293ad0f2f254d', 'request_id': 'req-1154b03f-b7f2-4c36-8749-05d91ee2a572'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:26.974523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cf28763bb343d28a4293ad0f2f254d', 'request_id': 'req-1154b03f-b7f2-4c36-8749-05d91ee2a572'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.066964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cf28763bb343d28a4293ad0f2f254d', 'request_id': 'req-1154b03f-b7f2-4c36-8749-05d91ee2a572'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.084805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] The token cache is being invalidate because project b8cf28763bb343d28a4293ad0f2f254d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:27.085138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.087746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.099944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3769/7535] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:26 2022] DELETE /identity/v3/projects/b8cf28763bb343d28a4293ad0f2f254d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:27.104663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:27.121317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993467d-c853-43ab-bc94-2ad06de72bc5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:27.227767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:27.228533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:27.228913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:27.229286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] PATH_INFO: `/v3/users/c750e4af90924a189a6b1acd726953fe` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:27.230557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c750e4af90924a189a6b1acd726953fe)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:27.232970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:27.272595 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=1,keystone:DELETE=5,keystone:SELECT=94 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:27.475563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c750e4af90924a189a6b1acd726953fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.487836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c750e4af90924a189a6b1acd726953fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.489706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c750e4af90924a189a6b1acd726953fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.606973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c750e4af90924a189a6b1acd726953fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.608260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5e6b714-4259-47c4-8084-8248d4fac7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c750e4af90924a189a6b1acd726953fe'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:27.645517 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3767/7536] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:45:27 2022] DELETE /identity/v3/users/c750e4af90924a189a6b1acd726953fe => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:28.340773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:28.343402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:28.390750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b03f-b7f2-4c36-8749-05d91ee2a572 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:28.496939 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:28.534228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:28.535216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:28.535637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:28.536602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] PATH_INFO: `/v3/projects/85aace8481d0455686f3d5b8c088b807` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:28.542924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85aace8481d0455686f3d5b8c088b807)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:28.549362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:28.729568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85aace8481d0455686f3d5b8c088b807', 'request_id': 'req-5399e6a4-b75b-4baa-a84c-cea377eee75e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:28.735962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85aace8481d0455686f3d5b8c088b807', 'request_id': 'req-5399e6a4-b75b-4baa-a84c-cea377eee75e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:28.808329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85aace8481d0455686f3d5b8c088b807', 'request_id': 'req-5399e6a4-b75b-4baa-a84c-cea377eee75e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:28.835808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] The token cache is being invalidate because project 85aace8481d0455686f3d5b8c088b807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:28.836274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:28.837909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5399e6a4-b75b-4baa-a84c-cea377eee75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:28.839902 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3770/7537] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:28 2022] DELETE /identity/v3/projects/85aace8481d0455686f3d5b8c088b807 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:28.845257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95e887-91e3-4d23-8f5f-e60c957bec7c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:28.845771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95e887-91e3-4d23-8f5f-e60c957bec7c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:28.845771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95e887-91e3-4d23-8f5f-e60c957bec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:28.885025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9b95e887-91e3-4d23-8f5f-e60c957bec7c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:28.886358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b95e887-91e3-4d23-8f5f-e60c957bec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:28.990406 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3768/7538] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:28.998040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a82d1-80fd-46a3-8ec3-4894bfc3d4b9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:28.998333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a82d1-80fd-46a3-8ec3-4894bfc3d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:28.998609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a82d1-80fd-46a3-8ec3-4894bfc3d4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.041814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2c0a82d1-80fd-46a3-8ec3-4894bfc3d4b9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:29.043714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2c0a82d1-80fd-46a3-8ec3-4894bfc3d4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:29.062482 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3771/7539] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:29.066669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95e887-91e3-4d23-8f5f-e60c957bec7c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:29.081260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95e887-91e3-4d23-8f5f-e60c957bec7c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:29.098107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:29.098107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:29.098107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:29.098107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.098606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:45:29.098606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:29.098606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:29.117581 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3769/7540] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:45:29.121646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a82d1-80fd-46a3-8ec3-4894bfc3d4b9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:29.133333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a82d1-80fd-46a3-8ec3-4894bfc3d4b9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:29.146393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:29.147017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:29.147348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:29.147560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.148199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:29.150142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:29.251518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3772/7541] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:45:29 2022] POST /identity/v3/projects => generated 407 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:29.255955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:29.267617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1911e0a-0ce9-47f6-9219-7a10b51bfc7e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:29.352232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:29.353189 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:29.353694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:29.353963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.354641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:29.357235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:29.470397 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3770/7542] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:45:29 2022] POST /identity/v3/users => generated 304 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:29.473486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:29.488833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70842b33-2d72-452f-ad89-16d005039564 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:29.503575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:29.504231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:29.504512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:29.504785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.505468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:29.507734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:29.539486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3773/7543] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:29.542582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:29.555943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10fb1b-6a35-4e8f-a670-29bb88e3c140 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:29.573426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bcdae-d3e5-42c8-a06a-7c772fb11dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:29.575087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bcdae-d3e5-42c8-a06a-7c772fb11dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:29.576163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bcdae-d3e5-42c8-a06a-7c772fb11dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:29.579602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bcdae-d3e5-42c8-a06a-7c772fb11dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.580662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bcdae-d3e5-42c8-a06a-7c772fb11dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:29.585404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bcdae-d3e5-42c8-a06a-7c772fb11dc6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:29.621431 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3771/7544] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:29.623618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:29.638253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229a93d-a0ff-4fad-a018-3ca5fecfd3da admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:29.651513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:29.652349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:29.652768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:29.653123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] PATH_INFO: `/v3/projects/b57b4601201b449e99fc7984df94246e/users/7bd53065c49747239dfc1ca0662bb159/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.680391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57b4601201b449e99fc7984df94246e, user_id=7bd53065c49747239dfc1ca0662bb159, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:29.684904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:29.772625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3774/7545] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:29 2022] PUT /identity/v3/projects/b57b4601201b449e99fc7984df94246e/users/7bd53065c49747239dfc1ca0662bb159/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:29.784470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4883e-4fb5-4f83-bf8f-05b412be4bf3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:29.784709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4883e-4fb5-4f83-bf8f-05b412be4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:29.785074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4883e-4fb5-4f83-bf8f-05b412be4bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:29.793117 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:29.822484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-96a4883e-4fb5-4f83-bf8f-05b412be4bf3 None None] MFA Rules not processed for user `7bd53065c49747239dfc1ca0662bb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:29.823993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96a4883e-4fb5-4f83-bf8f-05b412be4bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:29.934239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:29.947086 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3772/7546] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:30.064592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70f02-33c1-4a5f-a860-1da533008b14 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:30.077767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:30.078841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:30.079698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:30.081753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:30.082620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:30.086338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:30.255596 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:30.269036 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3775/7547] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:45:29 2022] POST /identity/v3/projects => generated 407 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:30.273005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4883e-4fb5-4f83-bf8f-05b412be4bf3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:30.286272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4883e-4fb5-4f83-bf8f-05b412be4bf3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:30.362221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:30.362869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:30.363144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:30.363435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:30.364074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:30.366270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:30.463370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3773/7548] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:45:30 2022] POST /identity/v3/users => generated 310 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:45:30.464502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:30.479233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92982-1273-4d61-9499-af8c865a7b22 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:30.486994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:30.488023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:30.488502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:30.488937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:30.489802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:30.502147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:30.513506 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3776/7549] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:30.514233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:30.533723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac3d70-2c11-441a-a09e-0a5402a4358d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:30.540130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:30.540810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:30.541342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:30.541613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] PATH_INFO: `/v3/projects/63454b6fffc54658b56927f0655a2eb9/users/371bf9844ea7450fa7f1f18fd046027e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:30.576905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=63454b6fffc54658b56927f0655a2eb9, user_id=371bf9844ea7450fa7f1f18fd046027e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:30.579639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:30.678802 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3774/7550] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:30 2022] PUT /identity/v3/projects/63454b6fffc54658b56927f0655a2eb9/users/371bf9844ea7450fa7f1f18fd046027e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:45:30.682829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:30.702373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45896e-c8fb-4f4c-b8ad-25cca7823166 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:30.834975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16bbf1-4491-4852-8f68-ff14dea140b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:30.835962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16bbf1-4491-4852-8f68-ff14dea140b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:30.850087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16bbf1-4491-4852-8f68-ff14dea140b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:30.851766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16bbf1-4491-4852-8f68-ff14dea140b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:30.855311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16bbf1-4491-4852-8f68-ff14dea140b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:30.858252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16bbf1-4491-4852-8f68-ff14dea140b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:30.884806 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3777/7551] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:30.902267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:30.922707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cc4f-2841-45d2-9e0e-26e6879c08ff admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:30.927884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:30.928575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:30.928911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:30.929147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] PATH_INFO: `/v3/projects/63454b6fffc54658b56927f0655a2eb9/users/371bf9844ea7450fa7f1f18fd046027e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:30.932919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63454b6fffc54658b56927f0655a2eb9, user_id=371bf9844ea7450fa7f1f18fd046027e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:30.940106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:30.953510 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3775/7552] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:30 2022] PUT /identity/v3/projects/63454b6fffc54658b56927f0655a2eb9/users/371bf9844ea7450fa7f1f18fd046027e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:30.963840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:30.964125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:30.964415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:30.996120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] MFA Rules not processed for user `371bf9844ea7450fa7f1f18fd046027e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:30.997455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:31.080777 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3778/7553] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:30 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:31.092359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:31.094784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:31.151523 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:31.169787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d99eb-2527-48b2-98d1-087afe306c40 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:31.176032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:31.176966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:31.177415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:31.178022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:31.240386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:31.242394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:31.266507 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3776/7554] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:31 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:32.132585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:32.134468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:32.312326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8301aa-c9ed-4496-b9b0-666220cd40f3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:32.319374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb475cd-0be5-4189-96eb-39a5313700d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:32.320063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb475cd-0be5-4189-96eb-39a5313700d9 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:32.320415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb475cd-0be5-4189-96eb-39a5313700d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:32.320600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb475cd-0be5-4189-96eb-39a5313700d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:32.331633 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:32.334389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb475cd-0be5-4189-96eb-39a5313700d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:32.336295 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb475cd-0be5-4189-96eb-39a5313700d9 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:32.348711 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3779/7555] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:32 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:41.474919 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=28 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:42.376153 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:45.726897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:45.848877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7e6d2-7bac-4e6f-917d-20cbac5280ce service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:45.864021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:45.865027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:45.865694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:45.866130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] PATH_INFO: `/v3/users/7bd53065c49747239dfc1ca0662bb159` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:45.868143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd53065c49747239dfc1ca0662bb159)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:45.872448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:46.093535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd53065c49747239dfc1ca0662bb159'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:46.141506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd53065c49747239dfc1ca0662bb159'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:46.146174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd53065c49747239dfc1ca0662bb159'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:46.280612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd53065c49747239dfc1ca0662bb159'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:46.281935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd53065c49747239dfc1ca0662bb159'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:46.331893 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3777/7556] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:45:45 2022] DELETE /identity/v3/users/7bd53065c49747239dfc1ca0662bb159 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:46.336216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:46.336666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:46.336735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:46.370013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:46.371587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:46.488868 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3780/7557] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:45:46.506473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:46.509279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:46.642641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bb5ec-222d-4ea1-a68a-729a278aa177 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:46.648211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:46.649256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:46.649754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:46.650122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:46.670299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:46.676057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:46.712235 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3778/7558] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:47.155677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:47.157527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:47.277246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf540-f578-4323-b3ed-24761585f80b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:47.296230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:47.297133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:47.298032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:47.298519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] PATH_INFO: `/v3/projects/b57b4601201b449e99fc7984df94246e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:47.299909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b57b4601201b449e99fc7984df94246e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:47.304953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:47.499347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57b4601201b449e99fc7984df94246e', 'request_id': 'req-4985f7a5-788a-48e6-b114-f7d259cb6be4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:47.515680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57b4601201b449e99fc7984df94246e', 'request_id': 'req-4985f7a5-788a-48e6-b114-f7d259cb6be4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:47.611803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57b4601201b449e99fc7984df94246e', 'request_id': 'req-4985f7a5-788a-48e6-b114-f7d259cb6be4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:47.627695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] The token cache is being invalidate because project b57b4601201b449e99fc7984df94246e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:47.627995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:47.628803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:47.635836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:47.645748 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3781/7559] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:47 2022] DELETE /identity/v3/projects/b57b4601201b449e99fc7984df94246e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:47.656719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46090657-abc9-43d8-96e5-af178d03c58a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:47.706016 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:47.819497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:47.820148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:47.820427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:47.820701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] PATH_INFO: `/v3/users/371bf9844ea7450fa7f1f18fd046027e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:47.821861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371bf9844ea7450fa7f1f18fd046027e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:47.825871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:48.071878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371bf9844ea7450fa7f1f18fd046027e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:48.092716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371bf9844ea7450fa7f1f18fd046027e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:48.093521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371bf9844ea7450fa7f1f18fd046027e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:48.183169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371bf9844ea7450fa7f1f18fd046027e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:48.183902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2386f64c-239b-417c-ab0f-987f8a5a9236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371bf9844ea7450fa7f1f18fd046027e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:48.217254 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3779/7560] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:45:47 2022] DELETE /identity/v3/users/371bf9844ea7450fa7f1f18fd046027e => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:48.547086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:48.548536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:48.569095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f7a5-788a-48e6-b114-f7d259cb6be4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:48.651167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:48.652790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:48.653364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:48.654587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] PATH_INFO: `/v3/projects/63454b6fffc54658b56927f0655a2eb9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:48.656728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=63454b6fffc54658b56927f0655a2eb9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:48.664980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:48.802555 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:48.828301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63454b6fffc54658b56927f0655a2eb9', 'request_id': 'req-0b4b823b-557a-44a7-a8a0-0c499844c57e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:48.836098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63454b6fffc54658b56927f0655a2eb9', 'request_id': 'req-0b4b823b-557a-44a7-a8a0-0c499844c57e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:49.072821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63454b6fffc54658b56927f0655a2eb9', 'request_id': 'req-0b4b823b-557a-44a7-a8a0-0c499844c57e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:49.097258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] The token cache is being invalidate because project 63454b6fffc54658b56927f0655a2eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:45:49.097558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:49.098312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0b4b823b-557a-44a7-a8a0-0c499844c57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:45:49.100229 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3782/7561] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:45:48 2022] DELETE /identity/v3/projects/63454b6fffc54658b56927f0655a2eb9 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:49.105330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd280-08b1-49a7-9dd0-54ea73446e18 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.106451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd280-08b1-49a7-9dd0-54ea73446e18 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.106451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd280-08b1-49a7-9dd0-54ea73446e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.135050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1dbdd280-08b1-49a7-9dd0-54ea73446e18 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:49.136662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1dbdd280-08b1-49a7-9dd0-54ea73446e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:49.209537 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3780/7562] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:49.217623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d5801-c77b-40bb-ab0b-01475a2e3291 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.227680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d5801-c77b-40bb-ab0b-01475a2e3291 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.227680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d5801-c77b-40bb-ab0b-01475a2e3291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.247033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f23d5801-c77b-40bb-ab0b-01475a2e3291 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:49.248281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f23d5801-c77b-40bb-ab0b-01475a2e3291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:49.256811 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3783/7563] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:49.261351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdd280-08b1-49a7-9dd0-54ea73446e18 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:49.271515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdd280-08b1-49a7-9dd0-54ea73446e18 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:49.276416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:49.277051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.278163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.278597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.284720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:45:49.284720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:49.284720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:49.295345 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3781/7564] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:45:49.299742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d5801-c77b-40bb-ab0b-01475a2e3291 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:49.309628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d5801-c77b-40bb-ab0b-01475a2e3291 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:49.314512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:49.319128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.319128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.319128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.319128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:49.319128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:49.460085 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3784/7565] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:45:49 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:49.464408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:49.502962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf54bd-15b2-4461-8242-c92938d3366d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:49.546985 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:49.619363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:49.620316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.622855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.622855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.622855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:49.628057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:49.740656 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3782/7566] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:45:49 2022] POST /identity/v3/users => generated 285 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:45:49.745178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:49.765036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362526d-7060-45e3-8561-3ad9d2549a42 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:49.780688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:49.780688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.780928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.781053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.781715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:49.783389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:49.805684 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3785/7567] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:45:49.808828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:49.826251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dfa70-4aa6-4a6f-b619-9229c04686af admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:49.838396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9507-bfa6-4677-acb3-f69fdca7132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:49.842751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9507-bfa6-4677-acb3-f69fdca7132e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.842751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9507-bfa6-4677-acb3-f69fdca7132e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.842751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9507-bfa6-4677-acb3-f69fdca7132e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.842751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d9507-bfa6-4677-acb3-f69fdca7132e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:49.843934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d9507-bfa6-4677-acb3-f69fdca7132e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:49.872247 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3783/7568] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:45:49.875230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:49.888391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf3d0-a259-4883-96b5-57be089c1a8d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:49.903326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:49.904062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:49.904368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:49.904630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] PATH_INFO: `/v3/projects/626bfea80b1e45ab85467d76cdeb6fc1/users/cc61d21a75684c5ba60febffaaf145ed/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:49.929191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626bfea80b1e45ab85467d76cdeb6fc1, user_id=cc61d21a75684c5ba60febffaaf145ed, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:49.933659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:50.057477 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3786/7569] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:45:49 2022] PUT /identity/v3/projects/626bfea80b1e45ab85467d76cdeb6fc1/users/cc61d21a75684c5ba60febffaaf145ed/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:45:50.069405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:50.070046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:50.070441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:50.131923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] MFA Rules not processed for user `cc61d21a75684c5ba60febffaaf145ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:50.133160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:50.283174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3784/7570] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:50.291193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:50.292991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:50.403568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3a318-5cb3-4381-b3f6-82369c8f6f51 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:50.407418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:50.408183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:50.408529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:50.408793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:50.425066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:50.426571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:50.454741 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3787/7571] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:51.390441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:51.392705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:51.416561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca261c3-d9f7-4cb5-b6df-69b747c5fa6d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:51.427552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:51.428480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:51.428982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:51.429467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:51.438028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:51.646297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:51.648575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:51.692333 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3785/7572] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:54.386531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:54.404742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625d51c-a1d3-471f-87b8-699a47c055d6 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:54.425218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1064d-3a52-4d8f-95b0-82e59d3cb0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:54.425888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1064d-3a52-4d8f-95b0-82e59d3cb0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:54.426352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1064d-3a52-4d8f-95b0-82e59d3cb0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:54.426605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1064d-3a52-4d8f-95b0-82e59d3cb0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:54.435171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c9b1064d-3a52-4d8f-95b0-82e59d3cb0e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:54.476297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1064d-3a52-4d8f-95b0-82e59d3cb0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:54.479943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1064d-3a52-4d8f-95b0-82e59d3cb0e0 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:54.510562 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3788/7573] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:57.085532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:57.116877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac12ef-6be8-4a84-bb9f-e46b91b74bd2 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:57.122527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:57.124621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:57.125410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:57.126199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:57.176868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:57.260120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:57.263755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:57.314639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3786/7574] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:57.548007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:57.548911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:57.549333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:57.573344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] MFA Rules not processed for user `2630e3eda1df4f698cad1eda511ad76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:45:57.575833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:57.621622 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:57.672859 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3789/7575] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:45:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:45:58.078767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:58.092804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b6c8-8084-4b86-8b03-bfca9d447b0c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:58.102880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86b8a-399f-46f1-b554-72bc12e7442f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:58.103767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86b8a-399f-46f1-b554-72bc12e7442f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:58.104194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86b8a-399f-46f1-b554-72bc12e7442f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:58.104622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86b8a-399f-46f1-b554-72bc12e7442f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:58.108723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62e86b8a-399f-46f1-b554-72bc12e7442f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:58.122738 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:45:58.239514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e86b8a-399f-46f1-b554-72bc12e7442f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:58.241422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e86b8a-399f-46f1-b554-72bc12e7442f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:58.270479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3787/7576] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:45:59.845731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:45:59.848032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:59.873165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57018e-83df-478e-be78-dd6ae3f4d468 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:45:59.878984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:45:59.879600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:45:59.879863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:45:59.880128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:45:59.882147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:45:59.973384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:45:59.975099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:45:59.994511 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3790/7577] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:45:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:00.553057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:00.557536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:00.562148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:00.599537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:00.602912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:00.763170 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3788/7578] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:46:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:46:00.777685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:00.779433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:00.949489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fafee-433d-48ec-bd51-3e4f85057502 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:00.956097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:00.957121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:00.957408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:00.957831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:00.972243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:00.973864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:00.986051 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3791/7579] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:46:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:46:09.824093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:09.825912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:09.844552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33b366-70b6-408c-aca5-f2e14e5cea6c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:09.854717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:09.855628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:09.856079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:09.856499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] PATH_INFO: `/v3/users/b2985f6e7b7c4e91ac80db47d1f2dff4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:09.857882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2985f6e7b7c4e91ac80db47d1f2dff4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:09.860383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:10.149194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2985f6e7b7c4e91ac80db47d1f2dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:10.166852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2985f6e7b7c4e91ac80db47d1f2dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:10.167883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2985f6e7b7c4e91ac80db47d1f2dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:10.280495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2985f6e7b7c4e91ac80db47d1f2dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:10.282509 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2985f6e7b7c4e91ac80db47d1f2dff4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:10.335893 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3789/7580] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:46:09 2022] DELETE /identity/v3/users/b2985f6e7b7c4e91ac80db47d1f2dff4 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:10.980800 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=67 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:11.081188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:11.082837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:11.095958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:11.097407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:11.148239 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:11.226091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff958b-1782-4b26-8881-4e18b0925d3d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:11.235029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:11.235877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:11.236158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:11.236445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] PATH_INFO: `/v3/projects/3c6377f05e21462b8a374170ec06a211` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:11.237806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6377f05e21462b8a374170ec06a211)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:11.239947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:11.244839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6978d4-0ba7-4335-9e5d-be8567c52fd9 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:11.346030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599debd-95b3-4b6e-a7e8-e14a7b5292f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:11.346622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599debd-95b3-4b6e-a7e8-e14a7b5292f6 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:11.347048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599debd-95b3-4b6e-a7e8-e14a7b5292f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:11.347452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599debd-95b3-4b6e-a7e8-e14a7b5292f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:11.349670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8599debd-95b3-4b6e-a7e8-e14a7b5292f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:11.369400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599debd-95b3-4b6e-a7e8-e14a7b5292f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:11.371614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599debd-95b3-4b6e-a7e8-e14a7b5292f6 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:11.396125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3792/7581] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:46:11.453122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6377f05e21462b8a374170ec06a211', 'request_id': 'req-a27a3f52-5290-456b-b601-212554422115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:11.467547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6377f05e21462b8a374170ec06a211', 'request_id': 'req-a27a3f52-5290-456b-b601-212554422115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:11.593709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6377f05e21462b8a374170ec06a211', 'request_id': 'req-a27a3f52-5290-456b-b601-212554422115'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:11.617188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] The token cache is being invalidate because project 3c6377f05e21462b8a374170ec06a211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:46:11.617392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:11.618149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a27a3f52-5290-456b-b601-212554422115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:11.624974 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3790/7582] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:46:11 2022] DELETE /identity/v3/projects/3c6377f05e21462b8a374170ec06a211 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:11.626781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad631-fc1d-4257-a6e0-380254a6d5b2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:11.627065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad631-fc1d-4257-a6e0-380254a6d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:11.627335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad631-fc1d-4257-a6e0-380254a6d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:11.671675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6baad631-fc1d-4257-a6e0-380254a6d5b2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:11.677960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6baad631-fc1d-4257-a6e0-380254a6d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:11.808343 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3793/7583] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:11.817461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028724-2d88-4bef-a24a-b4d81b74c154 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:11.817664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028724-2d88-4bef-a24a-b4d81b74c154 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:11.817939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028724-2d88-4bef-a24a-b4d81b74c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:11.847895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-74028724-2d88-4bef-a24a-b4d81b74c154 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:11.848848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-74028724-2d88-4bef-a24a-b4d81b74c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:11.870199 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3791/7584] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:46:11.882491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad631-fc1d-4257-a6e0-380254a6d5b2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:11.895739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad631-fc1d-4257-a6e0-380254a6d5b2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:11.920262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:11.922569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:11.923008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:11.923522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:11.924482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:46:11.925167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:11.927904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:11.966132 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3794/7585] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:46:11.973812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028724-2d88-4bef-a24a-b4d81b74c154 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:12.006137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028724-2d88-4bef-a24a-b4d81b74c154 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:12.006137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:12.006137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:12.006137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:12.008286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:12.008286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:12.023539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:12.168670 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3792/7586] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:46:11 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:46:12.172713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:12.207005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077685-b40b-4831-87ad-08690d843b4c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:12.237806 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:12.314575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:12.322997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:12.322997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:12.322997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:12.322997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:12.322997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:12.449254 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3795/7587] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:46:12 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:46:12.454421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:12.477249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6dde-1d94-410a-91c3-c0479e7e2ebc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:12.493417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:12.494222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:12.494600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:12.496032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:12.496543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:12.499289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:12.518561 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3793/7588] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:46:12.522466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:12.536432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81320da-ce4c-4485-8f19-d965382c6363 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:12.546739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ad0bb-6d1d-4fe0-bc75-863d954012a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:12.550207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad0bb-6d1d-4fe0-bc75-863d954012a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:12.550207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad0bb-6d1d-4fe0-bc75-863d954012a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:12.550207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ad0bb-6d1d-4fe0-bc75-863d954012a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:12.553890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ad0bb-6d1d-4fe0-bc75-863d954012a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:12.553890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ad0bb-6d1d-4fe0-bc75-863d954012a7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:12.577116 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3796/7589] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:46:12.577584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:12.593070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22659986-8e7f-4baf-9d25-b9054ddd83a8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:12.599940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:12.600847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:12.601482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:12.601925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] PATH_INFO: `/v3/projects/21032a0fe87243ccad4fa0d91cffdee6/users/f8046787e3b6429b92c9679a0392db68/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:12.625661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21032a0fe87243ccad4fa0d91cffdee6, user_id=f8046787e3b6429b92c9679a0392db68, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:12.632954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:12.749455 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3794/7590] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:46:12 2022] PUT /identity/v3/projects/21032a0fe87243ccad4fa0d91cffdee6/users/f8046787e3b6429b92c9679a0392db68/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:12.760331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:12.761183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:12.761459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:12.802212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] MFA Rules not processed for user `f8046787e3b6429b92c9679a0392db68`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:12.802965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:12.912929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3797/7591] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:12.931980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:12.935003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:13.023602 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:13.034018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7510706-e6cc-4ddc-af00-d9bd996044f5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:13.040587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:13.051658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:13.051979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:13.052311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:13.069905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:13.072581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:13.084329 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3795/7592] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:15.035611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:15.037194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:15.167619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea59a66-5e64-47fa-bcc0-a506dfbdd661 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:15.181032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:15.181872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:15.182277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:15.182653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] PATH_INFO: `/v3/users/2ceec980f06b45a989a5cd6cbca9d5d1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:15.184262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ceec980f06b45a989a5cd6cbca9d5d1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:15.188516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:15.423180 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:15.456521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ceec980f06b45a989a5cd6cbca9d5d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:15.491382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ceec980f06b45a989a5cd6cbca9d5d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:15.492162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ceec980f06b45a989a5cd6cbca9d5d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:15.576797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ceec980f06b45a989a5cd6cbca9d5d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:15.577442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ceec980f06b45a989a5cd6cbca9d5d1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:15.598845 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3798/7593] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:46:15 2022] DELETE /identity/v3/users/2ceec980f06b45a989a5cd6cbca9d5d1 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:15.955961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:15.973570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9af3f-4e31-47d0-a11c-4bd0b18e6706 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:16.060477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:16.061544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:16.062065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:16.062563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] PATH_INFO: `/v3/projects/a2532e029d7c483bbcf901c75023e59f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:16.064117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2532e029d7c483bbcf901c75023e59f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:16.066489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:16.205333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2532e029d7c483bbcf901c75023e59f', 'request_id': 'req-b996b210-ef5c-4488-8e63-a56675f0f1a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.216462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2532e029d7c483bbcf901c75023e59f', 'request_id': 'req-b996b210-ef5c-4488-8e63-a56675f0f1a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.358563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2532e029d7c483bbcf901c75023e59f', 'request_id': 'req-b996b210-ef5c-4488-8e63-a56675f0f1a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.378060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] The token cache is being invalidate because project a2532e029d7c483bbcf901c75023e59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:46:16.378541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.381604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.394850 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3796/7594] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:46:15 2022] DELETE /identity/v3/projects/a2532e029d7c483bbcf901c75023e59f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:16.396456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:16.399107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:16.436806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ff430-39b6-41f4-894c-d3b2cd16bcc2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:16.536424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:16.537168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:16.537423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:16.537729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] PATH_INFO: `/v3/users/767b7a49f41948f5833a91fe521c92f9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:16.539708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767b7a49f41948f5833a91fe521c92f9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:16.555563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:16.855482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767b7a49f41948f5833a91fe521c92f9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.872195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767b7a49f41948f5833a91fe521c92f9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.873010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767b7a49f41948f5833a91fe521c92f9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.957700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767b7a49f41948f5833a91fe521c92f9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:16.960158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-89285df2-4b0f-45a1-8a64-8663fdb66f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767b7a49f41948f5833a91fe521c92f9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:17.013846 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3799/7595] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:46:16 2022] DELETE /identity/v3/users/767b7a49f41948f5833a91fe521c92f9 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:17.537429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:17.539702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:17.561548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996b210-ef5c-4488-8e63-a56675f0f1a2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:17.705680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:17.706614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:17.706982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:17.707344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] PATH_INFO: `/v3/projects/d631681159a54c1e8b5cae82d8068600` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:17.708868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d631681159a54c1e8b5cae82d8068600)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:17.712015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:17.747115 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:17.872495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd631681159a54c1e8b5cae82d8068600', 'request_id': 'req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:17.881166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd631681159a54c1e8b5cae82d8068600', 'request_id': 'req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:18.016797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd631681159a54c1e8b5cae82d8068600', 'request_id': 'req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:18.037703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] The token cache is being invalidate because project d631681159a54c1e8b5cae82d8068600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:46:18.037989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:18.038674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5b9da5b8-d89a-4cec-a743-9296b9ef7ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:18.045032 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3797/7596] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:46:17 2022] DELETE /identity/v3/projects/d631681159a54c1e8b5cae82d8068600 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:18.046606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55d64-85ae-45db-b50c-cd9e993d317b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.047049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55d64-85ae-45db-b50c-cd9e993d317b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.047156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55d64-85ae-45db-b50c-cd9e993d317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.088716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-97e55d64-85ae-45db-b50c-cd9e993d317b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:18.089770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-97e55d64-85ae-45db-b50c-cd9e993d317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:18.122481 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:18.191141 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3800/7597] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:18.200696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd52b-5e7c-457e-97c6-b815aa10c1df None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.200983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd52b-5e7c-457e-97c6-b815aa10c1df None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.201255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd52b-5e7c-457e-97c6-b815aa10c1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.267534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c07fd52b-5e7c-457e-97c6-b815aa10c1df None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:18.279214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c07fd52b-5e7c-457e-97c6-b815aa10c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:18.305176 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3798/7598] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:18.311561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55d64-85ae-45db-b50c-cd9e993d317b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:18.327986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55d64-85ae-45db-b50c-cd9e993d317b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:18.345206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:18.346120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.351570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.352178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.353260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:46:18.354263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:18.356201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:18.370944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3801/7599] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:46:18.375638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd52b-5e7c-457e-97c6-b815aa10c1df None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:18.395474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd52b-5e7c-457e-97c6-b815aa10c1df None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:18.401103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:18.401891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.402338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.402773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.404316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:18.408446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:18.524319 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3799/7600] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:46:18 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:46:18.525322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:18.536253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b6cd7-2fe7-41d9-8fd9-83f4a61281f9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:18.641554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:18.642213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.642491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.643014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.643498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:18.645601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:18.743822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:18.752986 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3802/7601] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:46:18 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:46:18.771421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360a1de-fb6c-46cd-93fb-1b12ca889b5d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:18.785375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:18.787301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.788333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.790491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.792265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:18.795244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:18.828222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:18.836104 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3800/7602] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:46:18.848390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816be8-f90d-401b-b1f6-f7920987e6a6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:18.855018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6371-09b1-4ce8-aaa9-73f8fcad4a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:18.855928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6371-09b1-4ce8-aaa9-73f8fcad4a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.856374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6371-09b1-4ce8-aaa9-73f8fcad4a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.856794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6371-09b1-4ce8-aaa9-73f8fcad4a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.858047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6371-09b1-4ce8-aaa9-73f8fcad4a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:18.860172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6371-09b1-4ce8-aaa9-73f8fcad4a04 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:18.876952 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3803/7603] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:46:18.881276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:18.896290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0abf22-0791-486c-bd63-8aa43ec9da9b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:18.902268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:18.902924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:18.903206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:18.903477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] PATH_INFO: `/v3/projects/13757f6a5da74eb494f5097be6a70823/users/69b44fee007d4e098a34f71c2530f6f2/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:18.924405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13757f6a5da74eb494f5097be6a70823, user_id=69b44fee007d4e098a34f71c2530f6f2, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:18.929529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:19.017587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3801/7604] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:46:18 2022] PUT /identity/v3/projects/13757f6a5da74eb494f5097be6a70823/users/69b44fee007d4e098a34f71c2530f6f2/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:19.022982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a811-3bbd-45f9-ac16-8bcae579e0fe None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:19.026689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a811-3bbd-45f9-ac16-8bcae579e0fe None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:19.027138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a811-3bbd-45f9-ac16-8bcae579e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:19.090706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2d56a811-3bbd-45f9-ac16-8bcae579e0fe None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:19.092271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2d56a811-3bbd-45f9-ac16-8bcae579e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:19.226500 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3804/7605] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:19.237405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:19.240292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:19.341843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59950532-964d-4d65-b22a-0ea85b8ad998 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:19.352276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:19.352973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:19.353256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:19.353529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:19.370327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:19.372051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:19.384516 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3802/7606] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:21.058712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a811-3bbd-45f9-ac16-8bcae579e0fe None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:21.078119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a811-3bbd-45f9-ac16-8bcae579e0fe None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:21.091817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4e583-94a9-48ab-ad52-2bab18c1f18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:21.092650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e583-94a9-48ab-ad52-2bab18c1f18a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:21.093077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e583-94a9-48ab-ad52-2bab18c1f18a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:21.093520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e583-94a9-48ab-ad52-2bab18c1f18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:21.101900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a8f4e583-94a9-48ab-ad52-2bab18c1f18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:21.187134 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:21.277706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e583-94a9-48ab-ad52-2bab18c1f18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:21.279556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e583-94a9-48ab-ad52-2bab18c1f18a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:21.351571 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3805/7607] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:28.775257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:28.778697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:28.808278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b358-6643-4e2c-a577-c94c6790aca8 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:28.822731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:28.827035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:28.827035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:28.827035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] PATH_INFO: `/v3/users/b5a712b35af040e68f7e57011c2bf4a2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:28.827035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a712b35af040e68f7e57011c2bf4a2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:28.830565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:29.120362 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:29.131925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a712b35af040e68f7e57011c2bf4a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:29.169456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a712b35af040e68f7e57011c2bf4a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:29.172167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a712b35af040e68f7e57011c2bf4a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:29.348623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a712b35af040e68f7e57011c2bf4a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:29.352483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a712b35af040e68f7e57011c2bf4a2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:29.409087 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3803/7608] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:46:28 2022] DELETE /identity/v3/users/b5a712b35af040e68f7e57011c2bf4a2 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:29.423000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c84b1-dc9f-48f6-96bc-dd43a8e8b51b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:29.423000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c84b1-dc9f-48f6-96bc-dd43a8e8b51b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:29.423000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c84b1-dc9f-48f6-96bc-dd43a8e8b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:29.479490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d18c84b1-dc9f-48f6-96bc-dd43a8e8b51b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:29.481776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d18c84b1-dc9f-48f6-96bc-dd43a8e8b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:29.733049 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3806/7609] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:29.786552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:29.788263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:29.841561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:29.842052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:29.842456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:29.888592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] MFA Rules not processed for user `037ed342980a4de9a2dfc8d576293aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:29.892408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:29.958244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968a7c4-d4e9-4195-af86-d22a83fd7db2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:29.963620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:29.964540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:29.964827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:29.965104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:29.981804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:29.984377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:30.019347 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3804/7610] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:30.020036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:30.021965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:30.072066 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3807/7611] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:46:30.191346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37698a3-cc4e-498f-8f1d-11536162112c service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:30.204984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbe4bd-7126-47df-ad29-146bf4f7aec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:30.206688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbe4bd-7126-47df-ad29-146bf4f7aec1 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:30.207867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbe4bd-7126-47df-ad29-146bf4f7aec1 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:30.208144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbe4bd-7126-47df-ad29-146bf4f7aec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:30.217635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b0fbe4bd-7126-47df-ad29-146bf4f7aec1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:30.375283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbe4bd-7126-47df-ad29-146bf4f7aec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:30.379697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbe4bd-7126-47df-ad29-146bf4f7aec1 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:30.408506 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3805/7612] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:46:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:46:31.997522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:31.997522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:32.013772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153b0de-8c19-4a2e-8ba4-7b05192e42bb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:32.029766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:32.030606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:32.030986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:32.031298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] PATH_INFO: `/v3/projects/8c7042f2d01c4556bb6486f55cb86da6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:32.032525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7042f2d01c4556bb6486f55cb86da6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:32.035125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:32.234709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7042f2d01c4556bb6486f55cb86da6', 'request_id': 'req-9e92ad47-dedb-4a30-b844-90f43f9b5d45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:32.242994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7042f2d01c4556bb6486f55cb86da6', 'request_id': 'req-9e92ad47-dedb-4a30-b844-90f43f9b5d45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:32.249343 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:32.351060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7042f2d01c4556bb6486f55cb86da6', 'request_id': 'req-9e92ad47-dedb-4a30-b844-90f43f9b5d45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:32.372196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] The token cache is being invalidate because project 8c7042f2d01c4556bb6486f55cb86da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:46:32.372765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:32.374923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9e92ad47-dedb-4a30-b844-90f43f9b5d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:46:32.376998 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3808/7613] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:46:31 2022] DELETE /identity/v3/projects/8c7042f2d01c4556bb6486f55cb86da6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:32.386379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b865-b209-49d0-8852-01627e9b6c8d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:32.388075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b865-b209-49d0-8852-01627e9b6c8d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:32.388559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b865-b209-49d0-8852-01627e9b6c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:32.402181 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:32.422925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0e95b865-b209-49d0-8852-01627e9b6c8d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:32.425243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e95b865-b209-49d0-8852-01627e9b6c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:32.571969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3806/7614] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:32.574788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d5d0b-43a7-4e27-86ad-beec59dbdc49 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:32.575433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d5d0b-43a7-4e27-86ad-beec59dbdc49 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:32.575772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d5d0b-43a7-4e27-86ad-beec59dbdc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:32.621019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c92d5d0b-43a7-4e27-86ad-beec59dbdc49 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:32.627098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c92d5d0b-43a7-4e27-86ad-beec59dbdc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:32.672040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3809/7615] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:32.676163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b865-b209-49d0-8852-01627e9b6c8d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:32.700521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b865-b209-49d0-8852-01627e9b6c8d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:32.719577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:32.720221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:32.720503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:32.720778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:32.721440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:46:32.721746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:32.724224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:32.770261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d5d0b-43a7-4e27-86ad-beec59dbdc49 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:32.771899 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3807/7616] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:46:32.783249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d5d0b-43a7-4e27-86ad-beec59dbdc49 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:32.807133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780a619-3418-4d13-8d40-4f4479a49ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:32.807521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a619-3418-4d13-8d40-4f4479a49ced admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:32.807809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a619-3418-4d13-8d40-4f4479a49ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:32.808080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a619-3418-4d13-8d40-4f4479a49ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:32.808725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780a619-3418-4d13-8d40-4f4479a49ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:32.810740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780a619-3418-4d13-8d40-4f4479a49ced admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:33.004457 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3810/7617] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:46:32 2022] POST /identity/v3/projects => generated 369 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:46:33.010818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:33.028826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f07cc-3aa7-47dd-9260-83962d2f69cf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:33.040989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.041625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.042162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.100415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] MFA Rules not processed for user `69b44fee007d4e098a34f71c2530f6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:33.100415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:33.258931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6f4bb-b3ff-4d6d-a29e-c918fdeb1deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:33.259598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f4bb-b3ff-4d6d-a29e-c918fdeb1deb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.259884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f4bb-b3ff-4d6d-a29e-c918fdeb1deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.260162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f4bb-b3ff-4d6d-a29e-c918fdeb1deb admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.260820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6f4bb-b3ff-4d6d-a29e-c918fdeb1deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:33.268806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6f4bb-b3ff-4d6d-a29e-c918fdeb1deb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:33.285739 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3811/7618] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:33.287245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:33.288858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:33.414298 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3808/7619] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:46:33 2022] POST /identity/v3/users => generated 285 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:46:33.417488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728435d0-b519-4c7b-8159-87ffc397aaa3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.417781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728435d0-b519-4c7b-8159-87ffc397aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.419681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728435d0-b519-4c7b-8159-87ffc397aaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.475429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-728435d0-b519-4c7b-8159-87ffc397aaa3 None None] MFA Rules not processed for user `69b44fee007d4e098a34f71c2530f6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:33.475429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-728435d0-b519-4c7b-8159-87ffc397aaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:33.490653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48b83-dc01-463e-8556-1756bf5588bb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:33.508342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:33.509923 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3809/7620] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:33.515251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.516084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.517063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728435d0-b519-4c7b-8159-87ffc397aaa3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:33.517524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.523531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:33.558262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728435d0-b519-4c7b-8159-87ffc397aaa3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:33.577500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:33.579264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:33.580119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.592847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.592847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.592847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:33.594732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:33.594911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:33.619046 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3812/7621] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:33.620078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:33.620819 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3810/7622] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:46:33.625833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:33.627049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:33.652338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069abf3-2ff6-4ec9-98f3-e0bab366faaa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:33.664689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:33.664689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.664689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.664689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.665912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:33.670091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:33.724456 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3811/7623] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:46:33.728647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:33.768929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ae4dc-97c1-4f21-8013-92839991e74a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:33.778447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc917f5d-d260-4571-be92-33464b0a1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:33.779151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc917f5d-d260-4571-be92-33464b0a1b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.779439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc917f5d-d260-4571-be92-33464b0a1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.779720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc917f5d-d260-4571-be92-33464b0a1b5f admin admin] PATH_INFO: `/v3/projects/295ed02bf3054280b0c9e46d481c5768/users/b7b2f0a00a204943b1774c940ecb4444/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.804671 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:33.825088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc917f5d-d260-4571-be92-33464b0a1b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=295ed02bf3054280b0c9e46d481c5768, user_id=b7b2f0a00a204943b1774c940ecb4444, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:33.831171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc917f5d-d260-4571-be92-33464b0a1b5f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:33.904577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd98f6-a718-4362-a67d-bf6d6caa13db service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:33.919469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:33.920112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.920651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.920991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.931533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:33.933934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:33.943692 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3812/7624] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:46:33 2022] PUT /identity/v3/projects/295ed02bf3054280b0c9e46d481c5768/users/b7b2f0a00a204943b1774c940ecb4444/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:46:33.955720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:33.956011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:33.956290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:33.961652 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3813/7625] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:34.054333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] MFA Rules not processed for user `b7b2f0a00a204943b1774c940ecb4444`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:46:34.055603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:34.111696 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:34.221667 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3813/7626] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:46:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:46:34.237765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:34.239970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:34.397213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84c28-74c0-47af-b5da-fd8cabf10665 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:34.505932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:34.521009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:34.521303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:34.521646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:34.549968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:34.555164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:34.608919 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3814/7627] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:44.570117 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=68 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:44.678478 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=19 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:46:47.129954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:46:47.132284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:47.245800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6e6ce-55f1-46af-84f8-4c0db8137294 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:46:47.252007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:46:47.253072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:46:47.253519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:46:47.254078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:46:47.256287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:46:47.278821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:46:47.281176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:46:47.314438 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3814/7628] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:46:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:46:57.294332 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=26 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:27.034202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:27.036209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:27.142898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef29a-3dd9-4998-a9b4-336e26f909ff service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:27.147713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:27.148358 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:27.148639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:27.148916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] PATH_INFO: `/v3/users/69b44fee007d4e098a34f71c2530f6f2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:27.150679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b44fee007d4e098a34f71c2530f6f2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:27.152752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:27.428434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b44fee007d4e098a34f71c2530f6f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:27.456323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b44fee007d4e098a34f71c2530f6f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:27.457250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b44fee007d4e098a34f71c2530f6f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:27.612305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b44fee007d4e098a34f71c2530f6f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:27.613079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0448ae2-1868-4411-a838-3f7c53c624ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b44fee007d4e098a34f71c2530f6f2'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:27.642366 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3815/7629] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:47:27 2022] DELETE /identity/v3/users/69b44fee007d4e098a34f71c2530f6f2 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:27.972912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:27.990044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed4040-74dc-4c0b-8ff0-9fa84de42d31 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:28.121928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:28.122623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:28.122909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:28.123188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] PATH_INFO: `/v3/projects/13757f6a5da74eb494f5097be6a70823` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:28.124900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13757f6a5da74eb494f5097be6a70823)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:28.128761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:28.294320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13757f6a5da74eb494f5097be6a70823', 'request_id': 'req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:28.301922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13757f6a5da74eb494f5097be6a70823', 'request_id': 'req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:28.358488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13757f6a5da74eb494f5097be6a70823', 'request_id': 'req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:28.383084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] The token cache is being invalidate because project 13757f6a5da74eb494f5097be6a70823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:47:28.384522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:28.385381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c5ec20f1-3807-4c11-9d50-26e86ea28ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:28.410193 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3815/7630] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:47:27 2022] DELETE /identity/v3/projects/13757f6a5da74eb494f5097be6a70823 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:28.415421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3035a0-83f9-4b4f-8763-606406f266bb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:28.416872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3035a0-83f9-4b4f-8763-606406f266bb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:28.417333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3035a0-83f9-4b4f-8763-606406f266bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:28.446202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2a3035a0-83f9-4b4f-8763-606406f266bb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:28.451777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2a3035a0-83f9-4b4f-8763-606406f266bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:28.605654 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3816/7631] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:28.607396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908deecb-e3e2-4f44-8970-3995895e0924 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:28.610684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908deecb-e3e2-4f44-8970-3995895e0924 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:28.611135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908deecb-e3e2-4f44-8970-3995895e0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:28.644278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-908deecb-e3e2-4f44-8970-3995895e0924 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:28.662241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-908deecb-e3e2-4f44-8970-3995895e0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:28.682010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3816/7632] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:28.691395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3035a0-83f9-4b4f-8763-606406f266bb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:28.704559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3035a0-83f9-4b4f-8763-606406f266bb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:28.712457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:28.718216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:28.718216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:28.718216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:28.718216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:47:28.718216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:28.718216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:28.736581 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3817/7633] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:47:28.740718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908deecb-e3e2-4f44-8970-3995895e0924 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:28.753769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908deecb-e3e2-4f44-8970-3995895e0924 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:28.757896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:28.758716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:28.759142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:28.759532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:28.760276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:28.762341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:28.944924 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3817/7634] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:47:28 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:47:28.946136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:28.971241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c87250-4aa6-4bea-b02a-93e9c573e10c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:28.976577 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:29.067905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:29.068691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:29.069431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:29.069714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:29.070475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:29.096816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:29.252407 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3818/7635] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:47:28 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:47:29.253791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:29.271353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca30d9-3ac9-4e4f-8a0c-023ae783451c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:29.285042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:29.285873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:29.286414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:29.286830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:29.287619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:29.289507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:29.310371 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3818/7636] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:47:29.313190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:29.325350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bff6-1454-47c7-a338-9ae30f8acf89 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:29.334696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46a91e-c42e-48b7-8d14-5f822783adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:29.335536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a91e-c42e-48b7-8d14-5f822783adcf admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:29.335959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a91e-c42e-48b7-8d14-5f822783adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:29.336629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a91e-c42e-48b7-8d14-5f822783adcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:29.338012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46a91e-c42e-48b7-8d14-5f822783adcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:29.340986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46a91e-c42e-48b7-8d14-5f822783adcf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:29.362932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:29.374197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3819/7637] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:47:29.378916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923703-5e20-445b-b609-1c6a04e2bc8f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:29.384676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:29.388589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:29.388589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:29.388589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] PATH_INFO: `/v3/projects/4b044ba72fb644d2b4cc6c5232016332/users/9c08981b4a544ced88daf9da9e9e8d21/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:29.423046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b044ba72fb644d2b4cc6c5232016332, user_id=9c08981b4a544ced88daf9da9e9e8d21, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:29.426072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:29.542333 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3819/7638] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:47:29 2022] PUT /identity/v3/projects/4b044ba72fb644d2b4cc6c5232016332/users/9c08981b4a544ced88daf9da9e9e8d21/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:29.547765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:29.548534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:29.548534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:29.570002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:29.572117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:29.689112 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3820/7639] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:29.767200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:29.777636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:29.815636 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:29.871480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e62338-c7ee-4f25-b059-8d827896a346 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:29.876276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:29.877171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:29.877532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:29.877885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:29.890564 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:29.892972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:29.906485 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3820/7640] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:47:36.626224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:36.629714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:36.735478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428a15a-c453-4539-9ee3-d333bc161f91 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:36.742389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:36.745096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:36.745680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:36.746707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:36.749863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:36.769673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:36.772099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:36.785942 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3821/7641] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:47:37.482183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:37.496465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c123fd4-7807-4ad2-a80d-122c2681a9e4 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:37.511508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35273-25ee-4ede-9f3c-d5ce18131c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:37.512537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35273-25ee-4ede-9f3c-d5ce18131c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:37.513003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35273-25ee-4ede-9f3c-d5ce18131c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:37.513671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35273-25ee-4ede-9f3c-d5ce18131c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:37.516572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ede35273-25ee-4ede-9f3c-d5ce18131c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:37.548513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35273-25ee-4ede-9f3c-d5ce18131c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:37.556108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35273-25ee-4ede-9f3c-d5ce18131c08 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:37.617364 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3821/7642] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:47:37.861093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:37.863570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:37.899191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa0e2-a969-48ea-b44a-75f018741dcd service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:37.906308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:37.906938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:37.907220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:37.907491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:37.909309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:37.956085 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:38.151814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:38.151814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:38.177781 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3822/7643] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:47:40.279650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:40.280211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:40.280211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:40.340327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] MFA Rules not processed for user `9c08981b4a544ced88daf9da9e9e8d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:40.341877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:40.498376 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3822/7644] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:40.518391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:40.520628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:40.564175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35b7b-634a-4dba-9c12-2abd6cfceb6e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:40.578646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f0c21-2e08-4ffd-80ac-0076cfacf5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:40.579799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f0c21-2e08-4ffd-80ac-0076cfacf5fc service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:40.580303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f0c21-2e08-4ffd-80ac-0076cfacf5fc service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:40.580799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f0c21-2e08-4ffd-80ac-0076cfacf5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:40.591422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f0c21-2e08-4ffd-80ac-0076cfacf5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:40.610591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f0c21-2e08-4ffd-80ac-0076cfacf5fc service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:40.644812 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3823/7645] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:47:47.860678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:47.860678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:47.881421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b5c0-4814-4be3-a25a-c09ceddb5acd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:47.887467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:47.889646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:47.892352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:47.896276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] PATH_INFO: `/v3/users/cc61d21a75684c5ba60febffaaf145ed` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:47.897405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc61d21a75684c5ba60febffaaf145ed)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:47.899625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:48.206605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc61d21a75684c5ba60febffaaf145ed'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:48.220323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc61d21a75684c5ba60febffaaf145ed'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:48.221553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc61d21a75684c5ba60febffaaf145ed'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:48.416799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc61d21a75684c5ba60febffaaf145ed'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:48.417761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc61d21a75684c5ba60febffaaf145ed'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:48.437596 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3823/7646] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:47:47 2022] DELETE /identity/v3/users/cc61d21a75684c5ba60febffaaf145ed => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:48.444740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:48.445150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:48.445430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:48.469680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:48.470955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:48.607521 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3824/7647] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:48.633589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:48.641131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:48.685117 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:48.773261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0325e-dfbb-4518-a432-8e204c657f86 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:48.779673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb9c12-b8a8-4c57-b8ee-1baed166e67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:48.780315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb9c12-b8a8-4c57-b8ee-1baed166e67b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:48.780582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb9c12-b8a8-4c57-b8ee-1baed166e67b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:48.781044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb9c12-b8a8-4c57-b8ee-1baed166e67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:48.794948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb9c12-b8a8-4c57-b8ee-1baed166e67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:48.797889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb9c12-b8a8-4c57-b8ee-1baed166e67b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:48.817623 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3824/7648] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:47:49.724043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:49.726756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:49.765000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cda94-5f76-4223-832b-84227bbe1d48 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:49.800583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:49.800991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:49.803722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:49.803722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] PATH_INFO: `/v3/projects/626bfea80b1e45ab85467d76cdeb6fc1` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:49.804969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626bfea80b1e45ab85467d76cdeb6fc1)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:49.806927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:50.055432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626bfea80b1e45ab85467d76cdeb6fc1', 'request_id': 'req-c99a3ea0-a426-49eb-9d6e-483375c25c45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:50.090397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626bfea80b1e45ab85467d76cdeb6fc1', 'request_id': 'req-c99a3ea0-a426-49eb-9d6e-483375c25c45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:50.219532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626bfea80b1e45ab85467d76cdeb6fc1', 'request_id': 'req-c99a3ea0-a426-49eb-9d6e-483375c25c45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:50.269631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] The token cache is being invalidate because project 626bfea80b1e45ab85467d76cdeb6fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:47:50.272978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:50.278394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c99a3ea0-a426-49eb-9d6e-483375c25c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:50.281604 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3825/7649] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:47:49 2022] DELETE /identity/v3/projects/626bfea80b1e45ab85467d76cdeb6fc1 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:50.286527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:50.287196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:50.287196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:50.351872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:50.353528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:50.442301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d94f-8bb9-44ab-862e-a348df4f6439 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:50.442586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d94f-8bb9-44ab-862e-a348df4f6439 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:50.442861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d94f-8bb9-44ab-862e-a348df4f6439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:50.447149 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3825/7650] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:50.493269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-78b3d94f-8bb9-44ab-862e-a348df4f6439 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:50.496525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78b3d94f-8bb9-44ab-862e-a348df4f6439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:50.514518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3826/7651] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:50.525380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:50.527920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:50.537364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d94f-8bb9-44ab-862e-a348df4f6439 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:50.548197 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:50.560848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d94f-8bb9-44ab-862e-a348df4f6439 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:50.597022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:50.597781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:50.598157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:50.598483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:50.599333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:47:50.599824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:50.602680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:50.618304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee039da4-2843-4976-9ca9-ea742ee8fc25 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:50.625772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:50.627184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:50.627184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:50.627184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:50.630587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:50.635071 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3827/7652] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:47:50.639807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:50.658624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a4897-e690-48a3-8bee-6789bb1b0dfe admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:50.665432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:50.666826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:50.667260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:50.667682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:50.668463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:50.671992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:50.672329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:50.672440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:50.713748 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3826/7653] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:47:50.828802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:50.831108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:50.875807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2396bd5-5c28-4158-a911-b95e081af2fb service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:50.885362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:50.885484 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3828/7654] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:47:50 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:47:50.885881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:50.885881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:50.885881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] PATH_INFO: `/v3/users/9c08981b4a544ced88daf9da9e9e8d21` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:50.887037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c08981b4a544ced88daf9da9e9e8d21)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:50.888687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:50.889031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:51.027222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38054734-aa13-4ad3-9367-2d2e2a8578e0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:51.040766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:51.042369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:51.047456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:51.047835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:51.052175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:51.059315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:51.189615 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:51.191949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c08981b4a544ced88daf9da9e9e8d21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:51.205877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c08981b4a544ced88daf9da9e9e8d21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:51.206861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c08981b4a544ced88daf9da9e9e8d21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:51.233680 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3829/7655] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:47:50 2022] POST /identity/v3/users => generated 288 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:47:51.235344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:51.250870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9f14f-5183-4dfb-a5ad-5e5cff800732 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:51.259268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:51.266616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:51.267301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:51.267796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:51.269224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:51.271329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:51.283294 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3830/7656] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:47:51.296455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:51.310410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a2393-d2ad-4f55-a40e-680348a5fddc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:51.315274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:51.315897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:51.316406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:51.316953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:51.317356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:51.318752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:51.334022 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3831/7657] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:47:51.334816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:51.346777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139b214-d500-4854-a186-516d34e522d5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:51.364965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:51.365649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:51.365945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:51.366254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] PATH_INFO: `/v3/projects/a5e8f4c059214d74956b783868e419ab/users/5dea5f47feeb4b6f8124dd7d85a0a16f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:51.373140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c08981b4a544ced88daf9da9e9e8d21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:51.375166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0facb8db-8295-4996-86e1-70996a5c4464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c08981b4a544ced88daf9da9e9e8d21'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:51.398743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e8f4c059214d74956b783868e419ab, user_id=5dea5f47feeb4b6f8124dd7d85a0a16f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:51.402528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:51.434547 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3827/7658] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:47:50 2022] DELETE /identity/v3/users/9c08981b4a544ced88daf9da9e9e8d21 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:51.563540 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3832/7659] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:47:51 2022] PUT /identity/v3/projects/a5e8f4c059214d74956b783868e419ab/users/5dea5f47feeb4b6f8124dd7d85a0a16f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:51.573382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:51.573888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:51.574335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:51.608186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] MFA Rules not processed for user `5dea5f47feeb4b6f8124dd7d85a0a16f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:51.609741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:51.718748 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3828/7660] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:51.732616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:51.734856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:51.890575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379129a-6b6a-4720-8e09-883e42d7955f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:51.890575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d874-bcc5-48cb-9770-a9e1be9f7e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:51.890575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d874-bcc5-48cb-9770-a9e1be9f7e25 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:51.890575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d874-bcc5-48cb-9770-a9e1be9f7e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:51.891368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d874-bcc5-48cb-9770-a9e1be9f7e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:51.900905 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285d874-bcc5-48cb-9770-a9e1be9f7e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:51.902601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285d874-bcc5-48cb-9770-a9e1be9f7e25 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:51.914979 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3833/7661] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:47:51.946522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:51.949087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:52.074204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd7bf-e9df-4b47-85a1-bd81e1bcd81d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:52.079721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:52.080446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:52.080700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:52.080980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] PATH_INFO: `/v3/projects/4b044ba72fb644d2b4cc6c5232016332` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:52.082371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b044ba72fb644d2b4cc6c5232016332)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:52.084336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:52.222376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b044ba72fb644d2b4cc6c5232016332', 'request_id': 'req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:52.226642 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:52.229434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b044ba72fb644d2b4cc6c5232016332', 'request_id': 'req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:52.321920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b044ba72fb644d2b4cc6c5232016332', 'request_id': 'req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:52.335939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] The token cache is being invalidate because project 4b044ba72fb644d2b4cc6c5232016332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:47:52.336275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:52.336846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d1f2f95-3bf3-4c47-a962-a6ff219dfc0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:52.339161 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3829/7662] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:47:51 2022] DELETE /identity/v3/projects/4b044ba72fb644d2b4cc6c5232016332 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:52.348984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cd766-1860-454b-b5ad-129e00d44c74 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:52.349263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cd766-1860-454b-b5ad-129e00d44c74 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:52.349531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cd766-1860-454b-b5ad-129e00d44c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:52.371176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b79cd766-1860-454b-b5ad-129e00d44c74 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:52.372434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b79cd766-1860-454b-b5ad-129e00d44c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:52.384967 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:52.448510 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3834/7663] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:52.456825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b4ad4-5085-4e8e-bcac-fed3f8e5d421 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:52.457575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b4ad4-5085-4e8e-bcac-fed3f8e5d421 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:52.457575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b4ad4-5085-4e8e-bcac-fed3f8e5d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:52.489746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-153b4ad4-5085-4e8e-bcac-fed3f8e5d421 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:52.496199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-153b4ad4-5085-4e8e-bcac-fed3f8e5d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:52.516673 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3830/7664] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:52.522388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cd766-1860-454b-b5ad-129e00d44c74 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:52.534433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cd766-1860-454b-b5ad-129e00d44c74 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:52.542906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:52.544166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:52.544631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:52.546185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:52.547185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:47:52.547870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:52.550737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:52.573586 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3835/7665] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:47:52.577684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b4ad4-5085-4e8e-bcac-fed3f8e5d421 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:52.587896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b4ad4-5085-4e8e-bcac-fed3f8e5d421 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:52.593041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:52.593791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:52.594214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:52.594635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:52.595372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:52.597544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:52.720402 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3831/7666] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:47:52 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:47:52.724411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:52.741581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976acfa-d0f7-42b1-b32b-9f0dce504ffa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:52.859656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:52.860272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:52.860580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:52.860862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:52.861501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:52.863675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:52.991247 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3836/7667] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:47:52 2022] POST /identity/v3/users => generated 281 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:47:52.996766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:53.007684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744defd-4eac-49a0-8622-07f874ae21fb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:53.015859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:53.017067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.017629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.018514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.024069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:53.024069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:53.035212 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3832/7668] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:47:53.038914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:53.069073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72fa00-b3f7-4f0c-82ea-26d056a68095 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:53.105316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b198ec-8c82-4b1d-ac09-1f0d851c0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:53.107928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b198ec-8c82-4b1d-ac09-1f0d851c0e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.108990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b198ec-8c82-4b1d-ac09-1f0d851c0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.109484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b198ec-8c82-4b1d-ac09-1f0d851c0e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.122103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b198ec-8c82-4b1d-ac09-1f0d851c0e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:53.125928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b198ec-8c82-4b1d-ac09-1f0d851c0e9b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:53.146634 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3837/7669] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:47:53.153771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:53.166002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285bff-5061-455c-95da-af47e7d4c2c7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:53.175569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f8088-987d-4085-a37e-9f129e6a3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:53.176557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8088-987d-4085-a37e-9f129e6a3789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.182748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8088-987d-4085-a37e-9f129e6a3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.182748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8088-987d-4085-a37e-9f129e6a3789 admin admin] PATH_INFO: `/v3/projects/1e3d782d89db4e8e9fee0cbbaae466f4/users/dce17d77e41642e2b3011c3331ebd0b6/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.216290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f8088-987d-4085-a37e-9f129e6a3789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3d782d89db4e8e9fee0cbbaae466f4, user_id=dce17d77e41642e2b3011c3331ebd0b6, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:53.219363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f8088-987d-4085-a37e-9f129e6a3789 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:53.332067 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3833/7670] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:47:53 2022] PUT /identity/v3/projects/1e3d782d89db4e8e9fee0cbbaae466f4/users/dce17d77e41642e2b3011c3331ebd0b6/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:47:53.332343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454304-a9dd-4fb3-ba7f-eec4b4f0f1d9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.332760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454304-a9dd-4fb3-ba7f-eec4b4f0f1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.333107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454304-a9dd-4fb3-ba7f-eec4b4f0f1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.372512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7e454304-a9dd-4fb3-ba7f-eec4b4f0f1d9 None None] MFA Rules not processed for user `dce17d77e41642e2b3011c3331ebd0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:53.373964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e454304-a9dd-4fb3-ba7f-eec4b4f0f1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:53.502026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3838/7671] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:53.507798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d9fa-df0a-440d-ac27-9843f136d4af None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.508358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d9fa-df0a-440d-ac27-9843f136d4af None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.508358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d9fa-df0a-440d-ac27-9843f136d4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.531745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cae2d9fa-df0a-440d-ac27-9843f136d4af None None] MFA Rules not processed for user `dce17d77e41642e2b3011c3331ebd0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:53.533108 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cae2d9fa-df0a-440d-ac27-9843f136d4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:53.544609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ec680-9eb9-498f-999f-985a15810658 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.545458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ec680-9eb9-498f-999f-985a15810658 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.545837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ec680-9eb9-498f-999f-985a15810658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.550069 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3834/7672] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:53 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:47:53.568575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fe3ec680-9eb9-498f-999f-985a15810658 None None] MFA Rules not processed for user `dce17d77e41642e2b3011c3331ebd0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:53.570244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fe3ec680-9eb9-498f-999f-985a15810658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:53.586916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d9fa-df0a-440d-ac27-9843f136d4af None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:53.589026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3839/7673] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:53 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:47:53.604565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d9fa-df0a-440d-ac27-9843f136d4af None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:53.627678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce17d77e41642e2b3011c3331ebd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e3d782d89db4e8e9fee0cbbaae466f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:53.628282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] REQUEST_METHOD: `HEAD` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.630362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.630656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.637795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorizing `identity:check_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:53.639488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:53.649207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3835/7674] 10.222.0.42 () {56 vars in 1264 bytes} [Sun Oct 23 01:47:53 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 23 01:47:53.653266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ec680-9eb9-498f-999f-985a15810658 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:53.663541 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:53.678178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ec680-9eb9-498f-999f-985a15810658 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:53.687590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce17d77e41642e2b3011c3331ebd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e3d782d89db4e8e9fee0cbbaae466f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:53.688405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.688838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.689289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.706808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:53.706808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:53.718656 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3840/7675] 10.222.0.42 () {56 vars in 1263 bytes} [Sun Oct 23 01:47:53 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:53.718881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:53.731834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650cb9-0c79-4649-b548-c9f9bbf03218 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:53.740453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef4d4-ada1-4894-b352-bea470553474 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce17d77e41642e2b3011c3331ebd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e3d782d89db4e8e9fee0cbbaae466f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:53.741341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef4d4-ada1-4894-b352-bea470553474 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.741770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef4d4-ada1-4894-b352-bea470553474 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.742225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef4d4-ada1-4894-b352-bea470553474 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.751248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef4d4-ada1-4894-b352-bea470553474 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:53.753707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef4d4-ada1-4894-b352-bea470553474 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:53.910256 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3836/7676] 10.222.0.42 () {56 vars in 1266 bytes} [Sun Oct 23 01:47:53 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:53.914352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:53.928564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad294-e0e8-4c2a-bd63-47101545ce5f tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:53.940001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce17d77e41642e2b3011c3331ebd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e3d782d89db4e8e9fee0cbbaae466f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:53.941772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] REQUEST_METHOD: `HEAD` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.942559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.943685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:53.947955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 23 01:47:53.966824 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 23 01:47:53.967995 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 23 01:47:53.969103 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:53.969103 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:53.969103 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 23 01:47:53.969103 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 23 01:47:53.969103 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 23 01:47:53.969103 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:47:53.970757 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3841/7677] 10.222.0.42 () {56 vars in 1264 bytes} [Sun Oct 23 01:47:53 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:47:53.976066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5166b-4623-4351-80af-079c9b3a320a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:53.976365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5166b-4623-4351-80af-079c9b3a320a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:53.976637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5166b-4623-4351-80af-079c9b3a320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:54.013177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9eb5166b-4623-4351-80af-079c9b3a320a None None] MFA Rules not processed for user `dce17d77e41642e2b3011c3331ebd0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:54.014833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9eb5166b-4623-4351-80af-079c9b3a320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:54.019783 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3837/7678] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:53 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 01:47:54.023729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:54.056557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b773c-2a0c-42bb-8722-446cf86a23d5 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:54.061961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce17d77e41642e2b3011c3331ebd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e3d782d89db4e8e9fee0cbbaae466f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:54.062701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:54.062955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:54.063359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:54.070598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:54.072782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:54.082027 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3842/7679] 10.222.0.42 () {56 vars in 1263 bytes} [Sun Oct 23 01:47:54 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 01:47:54.085459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5166b-4623-4351-80af-079c9b3a320a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:54.107312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5166b-4623-4351-80af-079c9b3a320a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:54.118959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce17d77e41642e2b3011c3331ebd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e3d782d89db4e8e9fee0cbbaae466f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:54.119902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:54.120391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:54.120847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:54.130640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:54.137742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:54.216288 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3838/7680] 10.222.0.42 () {56 vars in 1266 bytes} [Sun Oct 23 01:47:54 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:54.221538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:54.236810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88576d-729f-4431-8969-71b8d187a8b0 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:54.243801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329463a0-6f87-4709-87f5-cb06bf803884 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce17d77e41642e2b3011c3331ebd0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e3d782d89db4e8e9fee0cbbaae466f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:54.244763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329463a0-6f87-4709-87f5-cb06bf803884 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:54.245159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329463a0-6f87-4709-87f5-cb06bf803884 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:54.245529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329463a0-6f87-4709-87f5-cb06bf803884 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:54.247769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-329463a0-6f87-4709-87f5-cb06bf803884 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application [None req-329463a0-6f87-4709-87f5-cb06bf803884 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 23 01:47:54.262899 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 23 01:47:54.264008 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 23 01:47:54.269521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 01:47:54.269521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 01:47:54.269521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 23 01:47:54.269521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 23 01:47:54.269521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 23 01:47:54.269521 n-d-master-1 devstack@keystone.service[81936]: ERROR keystone.server.flask.application Oct 23 01:47:54.269521 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3843/7681] 10.222.0.42 () {56 vars in 1263 bytes} [Sun Oct 23 01:47:54 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 01:47:54.269954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:54.365465 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b75fa-2835-48eb-9431-2cf39877dad7 tempest-TokensV3Test-1237413568 tempest-TokensV3Test-1237413568-project] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:54.375114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:54.375673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:54.383420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:54.383420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] PATH_INFO: `/v3/users/dce17d77e41642e2b3011c3331ebd0b6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:54.383420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce17d77e41642e2b3011c3331ebd0b6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:54.385020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:54.413943 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:54.706458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce17d77e41642e2b3011c3331ebd0b6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:54.723376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce17d77e41642e2b3011c3331ebd0b6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:54.725714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce17d77e41642e2b3011c3331ebd0b6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:54.856562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce17d77e41642e2b3011c3331ebd0b6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:54.860391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce17d77e41642e2b3011c3331ebd0b6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:54.876166 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3839/7682] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:47:54 2022] DELETE /identity/v3/users/dce17d77e41642e2b3011c3331ebd0b6 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:54.880779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:54.881259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:54.881539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:54.902984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:54.904789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:54.999109 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3844/7683] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:55.008979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:55.011246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:55.120980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e883-00c5-4284-8c24-e4dcfc4b09e5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:55.142828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b461e3-8717-4b35-ae15-da167f0a6bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:55.143875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b461e3-8717-4b35-ae15-da167f0a6bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:55.144379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b461e3-8717-4b35-ae15-da167f0a6bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:55.156157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b461e3-8717-4b35-ae15-da167f0a6bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:55.174247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b461e3-8717-4b35-ae15-da167f0a6bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:55.179478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b461e3-8717-4b35-ae15-da167f0a6bd3 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:55.221045 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3840/7684] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:47:56.300976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:56.302556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:56.320253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daad00b-e243-4b40-b1da-e0b23e157974 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:56.360318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:56.360318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:56.360318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:56.360318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] PATH_INFO: `/v3/projects/1e3d782d89db4e8e9fee0cbbaae466f4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:56.364006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3d782d89db4e8e9fee0cbbaae466f4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:56.366097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:56.497902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3d782d89db4e8e9fee0cbbaae466f4', 'request_id': 'req-ad6c3432-66f7-4250-822c-472cdd1c434c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:56.504347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3d782d89db4e8e9fee0cbbaae466f4', 'request_id': 'req-ad6c3432-66f7-4250-822c-472cdd1c434c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:56.603680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3d782d89db4e8e9fee0cbbaae466f4', 'request_id': 'req-ad6c3432-66f7-4250-822c-472cdd1c434c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:56.620879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] The token cache is being invalidate because project 1e3d782d89db4e8e9fee0cbbaae466f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:47:56.621675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:56.622904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ad6c3432-66f7-4250-822c-472cdd1c434c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:56.630703 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3845/7685] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:47:56 2022] DELETE /identity/v3/projects/1e3d782d89db4e8e9fee0cbbaae466f4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:56.634063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6eb4-97a9-41fc-b060-d6129d67285a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:56.634512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6eb4-97a9-41fc-b060-d6129d67285a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:56.634602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6eb4-97a9-41fc-b060-d6129d67285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:56.674262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6a2c6eb4-97a9-41fc-b060-d6129d67285a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:56.675772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6a2c6eb4-97a9-41fc-b060-d6129d67285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:56.754935 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3841/7686] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:56.763475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621548e-e6bb-47ba-bf56-7b351c3b5b89 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:56.764019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621548e-e6bb-47ba-bf56-7b351c3b5b89 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:56.764298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621548e-e6bb-47ba-bf56-7b351c3b5b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:56.799862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3621548e-e6bb-47ba-bf56-7b351c3b5b89 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:56.801189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3621548e-e6bb-47ba-bf56-7b351c3b5b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:56.811089 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3846/7687] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:56.815659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6eb4-97a9-41fc-b060-d6129d67285a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:56.829070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6eb4-97a9-41fc-b060-d6129d67285a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:56.834192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:56.835125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:56.835480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:56.835953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:56.836789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:47:56.837325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:56.839169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:56.858064 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3842/7688] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:47:56.859043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621548e-e6bb-47ba-bf56-7b351c3b5b89 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:56.868981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621548e-e6bb-47ba-bf56-7b351c3b5b89 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:56.874571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:56.875411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:56.875757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:56.876116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:56.876812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:56.878972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:57.042202 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3847/7689] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:47:56 2022] POST /identity/v3/projects => generated 359 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:47:57.049273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:57.061293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545ded-03e1-4939-99ed-fd27801bf358 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:57.116874 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:57.246421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:57.247120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:57.247396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:57.247663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:57.248309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:57.250251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:57.385676 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3843/7690] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:47:57 2022] POST /identity/v3/users => generated 280 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:47:57.389752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:57.411043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43764f9-68a6-41b7-93f6-e92ac0e64cec admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:57.422498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:57.423391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:57.423866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:57.424296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:57.425265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:57.427367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:57.453527 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3848/7691] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:47:57.457836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:57.477659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcc13d-f08a-4618-afa2-13839d76d4b5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:57.498308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be957b17-946f-4668-91c4-f1a2de258cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:57.500545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957b17-946f-4668-91c4-f1a2de258cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:57.500545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957b17-946f-4668-91c4-f1a2de258cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:57.500545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957b17-946f-4668-91c4-f1a2de258cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:57.500545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957b17-946f-4668-91c4-f1a2de258cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:57.507324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957b17-946f-4668-91c4-f1a2de258cf2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:57.531650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3844/7692] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:47:57.536351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:57.548414 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:47:57.553215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faadbb-baff-4cbc-a9c7-e8b6c605f05c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:57.567206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:57.567206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:57.567206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:57.567206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] PATH_INFO: `/v3/projects/8fef49093d0e480fa4ad6de7d8f4b437/users/953fa39fd67843808049d4a2076d96ba/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:57.589882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fef49093d0e480fa4ad6de7d8f4b437, user_id=953fa39fd67843808049d4a2076d96ba, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:57.595783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:57.714411 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3849/7693] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:47:57 2022] PUT /identity/v3/projects/8fef49093d0e480fa4ad6de7d8f4b437/users/953fa39fd67843808049d4a2076d96ba/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:57.716653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0b93-08c5-4c41-bfe8-55f112bab916 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:57.717461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0b93-08c5-4c41-bfe8-55f112bab916 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:57.717906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0b93-08c5-4c41-bfe8-55f112bab916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:57.768123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-145e0b93-08c5-4c41-bfe8-55f112bab916 None None] MFA Rules not processed for user `953fa39fd67843808049d4a2076d96ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:57.769655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-145e0b93-08c5-4c41-bfe8-55f112bab916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:57.902379 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3845/7694] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:47:57.913082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:58.000305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fa66-dabf-44b4-866a-482430301e0e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:58.005544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:58.006378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:58.006662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:58.006932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] PATH_INFO: `/v3/users/953fa39fd67843808049d4a2076d96ba` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:58.008092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953fa39fd67843808049d4a2076d96ba)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:58.010959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:58.279679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953fa39fd67843808049d4a2076d96ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:58.315159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953fa39fd67843808049d4a2076d96ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:58.316287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953fa39fd67843808049d4a2076d96ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:58.408146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953fa39fd67843808049d4a2076d96ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:58.409146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953fa39fd67843808049d4a2076d96ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:47:58.485230 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3850/7695] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:47:57 2022] DELETE /identity/v3/users/953fa39fd67843808049d4a2076d96ba => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:47:58.491073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:58.491293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:58.491606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:58.541669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:47:58.546934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:58.675578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3846/7696] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:47:58.686558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:47:58.691028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:47:58.789428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9812bb-cafb-457b-96c3-a4774ce81ce3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:47:58.794066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99a5ba-76f9-45e6-a9bd-e05f916d0e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:47:58.794890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99a5ba-76f9-45e6-a9bd-e05f916d0e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:47:58.795320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99a5ba-76f9-45e6-a9bd-e05f916d0e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:47:58.796135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99a5ba-76f9-45e6-a9bd-e05f916d0e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:47:58.811308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99a5ba-76f9-45e6-a9bd-e05f916d0e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:47:58.814387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99a5ba-76f9-45e6-a9bd-e05f916d0e3b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:47:58.831280 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3851/7697] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:01.024713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:01.025793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:01.047513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015444d-5689-446d-8fb3-0901caa52b26 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:01.065969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:01.066663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:01.066941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:01.067213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] PATH_INFO: `/v3/projects/8fef49093d0e480fa4ad6de7d8f4b437` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:01.078836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fef49093d0e480fa4ad6de7d8f4b437)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:01.080804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:01.224345 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:01.264348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fef49093d0e480fa4ad6de7d8f4b437', 'request_id': 'req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:01.273947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fef49093d0e480fa4ad6de7d8f4b437', 'request_id': 'req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:01.365259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fef49093d0e480fa4ad6de7d8f4b437', 'request_id': 'req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:01.437710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] The token cache is being invalidate because project 8fef49093d0e480fa4ad6de7d8f4b437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:01.440410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:01.450185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7ffd5a0f-17c2-4ed8-a1a3-129f3d1e6e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:01.452785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3847/7698] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:01 2022] DELETE /identity/v3/projects/8fef49093d0e480fa4ad6de7d8f4b437 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:01.457948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0c4d-a488-43f5-9fd3-5ac81be60b13 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:01.458379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0c4d-a488-43f5-9fd3-5ac81be60b13 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:01.458379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0c4d-a488-43f5-9fd3-5ac81be60b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:01.485238 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:01.560737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e63a0c4d-a488-43f5-9fd3-5ac81be60b13 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:01.570399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e63a0c4d-a488-43f5-9fd3-5ac81be60b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:01.789435 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3852/7699] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:01.798400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a946-e3b2-4d22-8943-5fb4811e8e7d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:01.799168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a946-e3b2-4d22-8943-5fb4811e8e7d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:01.799609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a946-e3b2-4d22-8943-5fb4811e8e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:01.854067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c655a946-e3b2-4d22-8943-5fb4811e8e7d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:01.860494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c655a946-e3b2-4d22-8943-5fb4811e8e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:01.892472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3848/7700] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:01.897842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0c4d-a488-43f5-9fd3-5ac81be60b13 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:01.942734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0c4d-a488-43f5-9fd3-5ac81be60b13 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:01.966004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:01.967948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:01.968233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:01.971967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:01.973587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:48:01.974064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:01.977064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:01.997005 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3853/7701] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:48:02.002903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a946-e3b2-4d22-8943-5fb4811e8e7d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:02.014888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a946-e3b2-4d22-8943-5fb4811e8e7d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:02.021625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:02.022925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:02.023862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:02.023862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:02.024491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:02.027428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:02.174111 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3849/7702] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:02 2022] POST /identity/v3/projects => generated 389 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:02.175668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:02.188217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e823e3-17f0-41c5-bf6a-223198710a97 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:02.334343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:02.334981 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:02.342916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:02.342916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:02.342916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:02.342916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:02.474704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3854/7703] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:02 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:02.491720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:02.521933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5eb81-35b3-49da-b2c8-dbc16255200a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:02.537709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:02.538906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:02.540241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:02.541162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:02.543234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:02.546010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:02.558616 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3850/7704] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:02.562653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:02.587413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db732-b204-4414-a02f-0c76218bb1d0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:02.597541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f52bdd-74fa-4d65-bb63-0697d5238f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:02.598990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52bdd-74fa-4d65-bb63-0697d5238f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:02.598990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52bdd-74fa-4d65-bb63-0697d5238f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:02.599580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52bdd-74fa-4d65-bb63-0697d5238f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:02.601635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f52bdd-74fa-4d65-bb63-0697d5238f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:02.603567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f52bdd-74fa-4d65-bb63-0697d5238f6d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:02.650992 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3855/7705] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:02.653610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:02.668436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af3763-4220-40ba-98c7-772e800e430b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:02.692105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:02.696467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:02.696467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:02.696467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] PATH_INFO: `/v3/projects/67b2f59b4b2747f19220633af565c1be/users/a648f2f295f94a5d87e5caa7d0a46984/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:02.735523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b2f59b4b2747f19220633af565c1be, user_id=a648f2f295f94a5d87e5caa7d0a46984, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:02.753659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:02.870782 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3851/7706] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:02 2022] PUT /identity/v3/projects/67b2f59b4b2747f19220633af565c1be/users/a648f2f295f94a5d87e5caa7d0a46984/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:02.872045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881e9b-ebc0-4f3f-830a-7d4b271947e1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:02.872340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881e9b-ebc0-4f3f-830a-7d4b271947e1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:02.874773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881e9b-ebc0-4f3f-830a-7d4b271947e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:03.001557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4b881e9b-ebc0-4f3f-830a-7d4b271947e1 None None] MFA Rules not processed for user `a648f2f295f94a5d87e5caa7d0a46984`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:03.006353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4b881e9b-ebc0-4f3f-830a-7d4b271947e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:03.256494 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3856/7707] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:03.266176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:03.524541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0e97-92a9-4e9a-9ac6-3cae7365b202 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:03.524541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:03.524541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:03.524541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:03.528062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:03.528062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:03.528062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:03.651697 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3852/7708] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:03 2022] POST /identity/v3/projects => generated 391 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:03.652867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881e9b-ebc0-4f3f-830a-7d4b271947e1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:03.675301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881e9b-ebc0-4f3f-830a-7d4b271947e1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:03.800183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:03.800183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:03.800183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:03.800436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:03.800882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:03.802895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:03.922406 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3857/7709] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:03 2022] POST /identity/v3/users => generated 302 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:03.927502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:03.943198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3a3cd-68ae-4782-94ca-410e91e24ce4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:03.965833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:03.966550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:03.966874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:03.967144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:03.968179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:03.987307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:04.027482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3853/7710] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:04.027732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:04.041508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80f325-88f5-4859-b0b7-06997f987540 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:04.053849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:04.055023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:04.055023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:04.055262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] PATH_INFO: `/v3/projects/883076bab99e4a678dcbdf974aeedcc0/users/ab626104dcf1480195971860980cf44a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:04.091606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=883076bab99e4a678dcbdf974aeedcc0, user_id=ab626104dcf1480195971860980cf44a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:04.108773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:04.203793 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3858/7711] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:04 2022] PUT /identity/v3/projects/883076bab99e4a678dcbdf974aeedcc0/users/ab626104dcf1480195971860980cf44a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:04.208026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:04.231077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3fb4-2c95-4ce2-9c6d-094b6adfc683 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:04.347115 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:04.351464 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:04.504312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed70d9-a08d-4351-a15c-f04c9514849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:04.504965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed70d9-a08d-4351-a15c-f04c9514849e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:04.505225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed70d9-a08d-4351-a15c-f04c9514849e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:04.505495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed70d9-a08d-4351-a15c-f04c9514849e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:04.508719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed70d9-a08d-4351-a15c-f04c9514849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:04.510667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed70d9-a08d-4351-a15c-f04c9514849e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:04.541441 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3854/7712] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:04.543661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:04.575439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a39cc7-1191-4898-afc9-29e6d81b6aee admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:04.598807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:04.600473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:04.600473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:04.600659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] PATH_INFO: `/v3/projects/883076bab99e4a678dcbdf974aeedcc0/users/ab626104dcf1480195971860980cf44a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:04.609189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883076bab99e4a678dcbdf974aeedcc0, user_id=ab626104dcf1480195971860980cf44a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:04.617652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:04.676687 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3859/7713] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:04 2022] PUT /identity/v3/projects/883076bab99e4a678dcbdf974aeedcc0/users/ab626104dcf1480195971860980cf44a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:04.686655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:04.686655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:04.686655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:04.765698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] MFA Rules not processed for user `ab626104dcf1480195971860980cf44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:04.767749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:04.911812 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3855/7714] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:04.924198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:04.927116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:05.107969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf011ea-7095-4e58-98bd-7b8fb69c5aa2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:05.113529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3bdb4-a8c3-4673-92d6-4bd1437fe63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:05.114194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3bdb4-a8c3-4673-92d6-4bd1437fe63c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:05.114469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3bdb4-a8c3-4673-92d6-4bd1437fe63c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:05.115153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3bdb4-a8c3-4673-92d6-4bd1437fe63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:05.216756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3bdb4-a8c3-4673-92d6-4bd1437fe63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:05.219061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3bdb4-a8c3-4673-92d6-4bd1437fe63c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:05.231473 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3860/7715] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:07.908628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:07.910475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:08.074703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3b6b7-0420-49a8-9531-7926a6875e7d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:08.088599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:08.089293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:08.094568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:08.094568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] PATH_INFO: `/v3/users/f8046787e3b6429b92c9679a0392db68` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:08.094568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8046787e3b6429b92c9679a0392db68)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:08.098615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:08.401144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8046787e3b6429b92c9679a0392db68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:08.402602 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:08.420284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8046787e3b6429b92c9679a0392db68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:08.421536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8046787e3b6429b92c9679a0392db68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:08.499230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8046787e3b6429b92c9679a0392db68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:08.500293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8046787e3b6429b92c9679a0392db68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:08.535897 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3856/7716] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:07 2022] DELETE /identity/v3/users/f8046787e3b6429b92c9679a0392db68 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:08.540217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:08.542616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:08.543153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:08.562452 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:08.604042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:08.606262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:08.743930 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3861/7717] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:08.755332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:08.756870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:08.898749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5769-0dda-4f38-91c3-2f1fa3e6f364 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:08.903595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590b941-7285-4b52-83fa-db052cb6c0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:08.904220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b941-7285-4b52-83fa-db052cb6c0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:08.905315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b941-7285-4b52-83fa-db052cb6c0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:08.905600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b941-7285-4b52-83fa-db052cb6c0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:08.920710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590b941-7285-4b52-83fa-db052cb6c0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:08.925174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590b941-7285-4b52-83fa-db052cb6c0d6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:08.958471 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3857/7718] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:09.839930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:09.841758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:09.880863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fdab4-26b5-4772-a58f-4c24d6f51f6f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:09.898867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:09.899838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:09.900333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:09.900999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] PATH_INFO: `/v3/projects/21032a0fe87243ccad4fa0d91cffdee6` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:09.902788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21032a0fe87243ccad4fa0d91cffdee6)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:09.905893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:10.102111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21032a0fe87243ccad4fa0d91cffdee6', 'request_id': 'req-1d914174-aa77-4aa6-adea-112999de5669'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:10.116613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21032a0fe87243ccad4fa0d91cffdee6', 'request_id': 'req-1d914174-aa77-4aa6-adea-112999de5669'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:10.215106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21032a0fe87243ccad4fa0d91cffdee6', 'request_id': 'req-1d914174-aa77-4aa6-adea-112999de5669'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:10.235060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] The token cache is being invalidate because project 21032a0fe87243ccad4fa0d91cffdee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:10.235547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:10.237454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1d914174-aa77-4aa6-adea-112999de5669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:10.240135 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3862/7719] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:09 2022] DELETE /identity/v3/projects/21032a0fe87243ccad4fa0d91cffdee6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:10.245036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f168d88-39d0-4545-9802-c19a31f52d28 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:10.246076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f168d88-39d0-4545-9802-c19a31f52d28 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:10.246347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f168d88-39d0-4545-9802-c19a31f52d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:10.301062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7f168d88-39d0-4545-9802-c19a31f52d28 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:10.311650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7f168d88-39d0-4545-9802-c19a31f52d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:10.459545 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3858/7720] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:10.466201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e643a-e9f2-4766-84e8-6d3d8c544296 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:10.466804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e643a-e9f2-4766-84e8-6d3d8c544296 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:10.467360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e643a-e9f2-4766-84e8-6d3d8c544296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:10.532763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a51e643a-e9f2-4766-84e8-6d3d8c544296 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:10.538375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a51e643a-e9f2-4766-84e8-6d3d8c544296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:10.561801 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3863/7721] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:10.565720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f168d88-39d0-4545-9802-c19a31f52d28 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:10.580946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f168d88-39d0-4545-9802-c19a31f52d28 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:10.589050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:10.589050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:10.589050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:10.589050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:10.594352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:48:10.600052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:10.607722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:10.696995 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3859/7722] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:48:10.703534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e643a-e9f2-4766-84e8-6d3d8c544296 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:10.736101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e643a-e9f2-4766-84e8-6d3d8c544296 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:10.770420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:10.772146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:10.772603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:10.773011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:10.779119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:10.796107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:11.017185 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3864/7723] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:10 2022] POST /identity/v3/projects => generated 375 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:11.020857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:11.035522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92cdbc-715f-41bc-8334-233471832af5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:11.241938 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:11.268311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:11.270422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:11.270907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:11.275721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:11.275721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:11.275721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:11.442115 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3860/7724] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:11 2022] POST /identity/v3/users => generated 288 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:11.446970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:11.469602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccf492-2c33-4989-acf8-65eb7b183f91 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:11.483622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:11.484564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:11.485027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:11.485486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:11.486669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:11.490617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:11.519137 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3865/7725] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:11.523206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:11.571590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795278a3-de5e-4134-a258-39ac91e78863 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:11.621546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d05f0-e90f-4a42-a8d4-9973d396ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:11.631737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d05f0-e90f-4a42-a8d4-9973d396ef88 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:11.632328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d05f0-e90f-4a42-a8d4-9973d396ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:11.636656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d05f0-e90f-4a42-a8d4-9973d396ef88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:11.643972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d05f0-e90f-4a42-a8d4-9973d396ef88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:11.650251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d05f0-e90f-4a42-a8d4-9973d396ef88 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:11.712661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3861/7726] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:11.727326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:11.763519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d8610-a122-4075-ab4c-add1e1872c52 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:11.778276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:11.779023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:11.779733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:11.780241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] PATH_INFO: `/v3/projects/cddd64f7c80a4e869e77648648102c6d/users/b4039f0940ed4cb2a3f5de1ba80c2d15/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:11.837127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cddd64f7c80a4e869e77648648102c6d, user_id=b4039f0940ed4cb2a3f5de1ba80c2d15, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:11.842194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:12.040243 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3866/7727] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:11 2022] PUT /identity/v3/projects/cddd64f7c80a4e869e77648648102c6d/users/b4039f0940ed4cb2a3f5de1ba80c2d15/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:12.052929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:12.053113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:12.053244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:12.102203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] MFA Rules not processed for user `b4039f0940ed4cb2a3f5de1ba80c2d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:12.103876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:12.199558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3862/7728] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:12.211962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:12.218267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:12.297962 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:12.348590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa95f7a-7887-473f-b4ca-2b056cddc346 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:12.353008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d53c01-592b-474c-abba-098a3f66e45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:12.353878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d53c01-592b-474c-abba-098a3f66e45a service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:12.354239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d53c01-592b-474c-abba-098a3f66e45a service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:12.355238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d53c01-592b-474c-abba-098a3f66e45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:12.381749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d53c01-592b-474c-abba-098a3f66e45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:12.384460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d53c01-592b-474c-abba-098a3f66e45a service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:12.418092 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3867/7729] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:13.052375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:13.056470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:13.345345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ca041-94c3-4084-ba66-de278d39011a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:13.357071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032825a-d8b2-4daa-b5e9-2f5dc1ca4541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:13.357726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032825a-d8b2-4daa-b5e9-2f5dc1ca4541 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:13.358067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032825a-d8b2-4daa-b5e9-2f5dc1ca4541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:13.358311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032825a-d8b2-4daa-b5e9-2f5dc1ca4541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:13.365221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5032825a-d8b2-4daa-b5e9-2f5dc1ca4541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:13.570353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032825a-d8b2-4daa-b5e9-2f5dc1ca4541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:13.582146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032825a-d8b2-4daa-b5e9-2f5dc1ca4541 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:13.613762 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3863/7730] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:17.322362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:17.325467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:17.325804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:17.426877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] MFA Rules not processed for user `b4039f0940ed4cb2a3f5de1ba80c2d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:17.433839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:17.464069 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3868/7731] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:18.203579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe12d9-064e-4cff-84ad-c9224e102298 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:18.204111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe12d9-064e-4cff-84ad-c9224e102298 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:18.204111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe12d9-064e-4cff-84ad-c9224e102298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:18.254421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-44fe12d9-064e-4cff-84ad-c9224e102298 None None] MFA Rules not processed for user `2630e3eda1df4f698cad1eda511ad76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:18.255685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-44fe12d9-064e-4cff-84ad-c9224e102298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:18.285141 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:18.431332 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3864/7732] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:22.083386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:22.085637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:22.167949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c49964-0af6-4920-becf-8f51d50867bf None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:22.173312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:22.173439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:22.173637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:22.173903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] PATH_INFO: `/v3/users/a648f2f295f94a5d87e5caa7d0a46984` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:22.175055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a648f2f295f94a5d87e5caa7d0a46984)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:22.176959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:22.473558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a648f2f295f94a5d87e5caa7d0a46984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:22.483251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a648f2f295f94a5d87e5caa7d0a46984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:22.484467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a648f2f295f94a5d87e5caa7d0a46984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:22.558640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a648f2f295f94a5d87e5caa7d0a46984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:22.559622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a648f2f295f94a5d87e5caa7d0a46984'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:22.588366 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3869/7733] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:22 2022] DELETE /identity/v3/users/a648f2f295f94a5d87e5caa7d0a46984 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:22.594321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:22.594800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:22.595071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:22.616581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:22.618105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:22.682785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3865/7734] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:22.699835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:22.706622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:22.781566 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:22.809775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5beb84b-c026-4fee-859d-8a846beac972 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:22.816903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:22.824473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:22.824473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:22.824473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:22.837695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:22.840446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:22.868215 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3870/7735] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:23.176659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:23.178385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:23.202904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3a358-9b0f-42db-96ee-4376e8e6d00f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:23.218000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:23.219289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:23.220967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:23.221440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] PATH_INFO: `/v3/projects/67b2f59b4b2747f19220633af565c1be` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:23.226410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b2f59b4b2747f19220633af565c1be)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:23.231403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:23.392409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b2f59b4b2747f19220633af565c1be', 'request_id': 'req-34608c1a-ce80-4eda-9ea7-d2e94ac54927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.399354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b2f59b4b2747f19220633af565c1be', 'request_id': 'req-34608c1a-ce80-4eda-9ea7-d2e94ac54927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.486124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b2f59b4b2747f19220633af565c1be', 'request_id': 'req-34608c1a-ce80-4eda-9ea7-d2e94ac54927'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.498583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] The token cache is being invalidate because project 67b2f59b4b2747f19220633af565c1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:23.499062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.499806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.502630 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3866/7736] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:23 2022] DELETE /identity/v3/projects/67b2f59b4b2747f19220633af565c1be => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:23.506916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:23.520173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca3f2-dbdf-47bb-8c45-a90fec7cf96d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:23.606483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:23.607197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:23.607512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:23.607795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] PATH_INFO: `/v3/users/ab626104dcf1480195971860980cf44a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:23.609248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab626104dcf1480195971860980cf44a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:23.611339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:23.901664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab626104dcf1480195971860980cf44a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.913456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab626104dcf1480195971860980cf44a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.915082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab626104dcf1480195971860980cf44a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.990799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab626104dcf1480195971860980cf44a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:23.991656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979afb33-5fad-4adb-935a-94adc17f954b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab626104dcf1480195971860980cf44a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:24.032492 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3871/7737] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:23 2022] DELETE /identity/v3/users/ab626104dcf1480195971860980cf44a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:25.241146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:25.242794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:25.275217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34608c1a-ce80-4eda-9ea7-d2e94ac54927 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:25.368365 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:25.407398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:25.408384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:25.408878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:25.409357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] PATH_INFO: `/v3/projects/883076bab99e4a678dcbdf974aeedcc0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:25.410808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883076bab99e4a678dcbdf974aeedcc0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:25.412943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:25.595720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883076bab99e4a678dcbdf974aeedcc0', 'request_id': 'req-62f51387-7ad1-49e7-ad24-82283946ed15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:25.607733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883076bab99e4a678dcbdf974aeedcc0', 'request_id': 'req-62f51387-7ad1-49e7-ad24-82283946ed15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:25.688475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883076bab99e4a678dcbdf974aeedcc0', 'request_id': 'req-62f51387-7ad1-49e7-ad24-82283946ed15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:25.706728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] The token cache is being invalidate because project 883076bab99e4a678dcbdf974aeedcc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:25.707191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:25.708716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62f51387-7ad1-49e7-ad24-82283946ed15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:25.718173 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3867/7738] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:25 2022] DELETE /identity/v3/projects/883076bab99e4a678dcbdf974aeedcc0 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:25.719928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312c181-c81b-4181-aed2-4f5504eb08c3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:25.720424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312c181-c81b-4181-aed2-4f5504eb08c3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:25.725709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312c181-c81b-4181-aed2-4f5504eb08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:25.754456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6312c181-c81b-4181-aed2-4f5504eb08c3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:25.755679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6312c181-c81b-4181-aed2-4f5504eb08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:25.876921 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3872/7739] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:25.878787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9c52-437f-4c02-8793-157cd2f53f4b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:25.879076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9c52-437f-4c02-8793-157cd2f53f4b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:25.879345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9c52-437f-4c02-8793-157cd2f53f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:25.907776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-beac9c52-437f-4c02-8793-157cd2f53f4b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:25.909018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-beac9c52-437f-4c02-8793-157cd2f53f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:25.918860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3868/7740] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:25.923670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312c181-c81b-4181-aed2-4f5504eb08c3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:25.929169 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:25.935481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312c181-c81b-4181-aed2-4f5504eb08c3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:25.948319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:25.948319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:25.948319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:25.948319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:25.948757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:48:25.948757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:25.958706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:25.976183 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3873/7741] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:48:25.977758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac9c52-437f-4c02-8793-157cd2f53f4b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:25.989283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac9c52-437f-4c02-8793-157cd2f53f4b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:25.995055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:25.996680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:25.997471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:25.997905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:25.998818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:26.001605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:26.163964 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3869/7742] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:25 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:26.168796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:26.179884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d6633-7654-483a-a077-438336a5be64 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:26.232836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:26.235514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:26.293264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:26.294488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.294984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.295484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:26.296326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:26.299083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:26.389503 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3874/7743] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:26 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:26.393594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:26.396805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ebbac-a922-4ac4-b5db-ba87b3cbdb07 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:26.403121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:26.404012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.404545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.405402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] PATH_INFO: `/v3/users/5dea5f47feeb4b6f8124dd7d85a0a16f` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:26.407052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dea5f47feeb4b6f8124dd7d85a0a16f)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:26.409897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:26.423449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9967a4-6947-420d-96bb-e3db284a0217 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:26.436308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:26.436928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.437220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.437474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:26.438166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:26.439768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:26.462312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3875/7744] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:26.463206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:26.495107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275440e-9b6b-4ccc-9709-e41065032274 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:26.501107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:26.501819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.505009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.505009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:26.505009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:26.505009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:26.517645 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3876/7745] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:26.522083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:26.533783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb530f-1555-4b4a-8055-e38757b06c94 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:26.538616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcdfbf-503b-4410-97ef-5b8f23cb0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:26.539345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcdfbf-503b-4410-97ef-5b8f23cb0864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.539625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcdfbf-503b-4410-97ef-5b8f23cb0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.539898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcdfbf-503b-4410-97ef-5b8f23cb0864 admin admin] PATH_INFO: `/v3/projects/f2e76602ef7a4a3c9f8accdfd670c781/users/0bf11d0c91794c2e9ce6fd1f15a7b0ca/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:26.556462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcdfbf-503b-4410-97ef-5b8f23cb0864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e76602ef7a4a3c9f8accdfd670c781, user_id=0bf11d0c91794c2e9ce6fd1f15a7b0ca, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:26.560650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcdfbf-503b-4410-97ef-5b8f23cb0864 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:26.625968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dea5f47feeb4b6f8124dd7d85a0a16f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:26.639745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dea5f47feeb4b6f8124dd7d85a0a16f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:26.641054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dea5f47feeb4b6f8124dd7d85a0a16f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:26.684215 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3877/7746] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:26 2022] PUT /identity/v3/projects/f2e76602ef7a4a3c9f8accdfd670c781/users/0bf11d0c91794c2e9ce6fd1f15a7b0ca/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:26.685867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.688335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.688620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:26.724131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] MFA Rules not processed for user `0bf11d0c91794c2e9ce6fd1f15a7b0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:26.725851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:26.734921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dea5f47feeb4b6f8124dd7d85a0a16f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:26.737351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6a57b49d-6831-41d7-b6d2-262fd1acce6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dea5f47feeb4b6f8124dd7d85a0a16f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:26.779762 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3870/7747] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:26 2022] DELETE /identity/v3/users/5dea5f47feeb4b6f8124dd7d85a0a16f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:26.784176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.785441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.785931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:26.824628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:26.828125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:26.871668 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3878/7748] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:26.877781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:26.879434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:26.884309 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:26.946996 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3871/7749] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:26.957596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:26.960082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:26.989194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc31c5-4a31-490f-8702-3dd73e646cb6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:26.994716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:26.998720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:26.999226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:26.999639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.000436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.002701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:27.048526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578f57f-ccb7-44b6-996b-a889aaefc3fe None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:27.052898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:27.054029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.054418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.055194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.068588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.070296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:27.083698 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3872/7750] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:48:27.101027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:27.102709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:27.117657 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3879/7751] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:26 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:48:27.121797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:27.247131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a083a-d0a2-445d-8f7a-6d5127572c97 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:27.249328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a2fc-adaa-424b-a27f-ecc914ca9900 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:27.262449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:27.263469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.263469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.263703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.264187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.266139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:27.346409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:27.347054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.347332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.349331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.354139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:27.370517 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3880/7752] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:27 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:27.374995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:27.393002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.395419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:27.396451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006b987-bc0f-4b0f-996a-49bc226f8111 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:27.401389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:27.402050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.402334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.402609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.403257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.414101 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3873/7753] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:48:27.414636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:27.427032 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3881/7754] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:27.430768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:27.446591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b836a-06c2-4ede-92a3-a901e5df667b service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:27.450361 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:27.453839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aa072-420a-4c18-b761-7f7021c5f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:27.454537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa072-420a-4c18-b761-7f7021c5f91c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.454815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa072-420a-4c18-b761-7f7021c5f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.455087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa072-420a-4c18-b761-7f7021c5f91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.455867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa072-420a-4c18-b761-7f7021c5f91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.457464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa072-420a-4c18-b761-7f7021c5f91c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:27.499697 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3874/7755] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:27.500540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:27.523470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970ba10-7861-4f5f-b247-d637697e76eb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:27.529309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:27.530226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.530713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.531031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] PATH_INFO: `/v3/projects/3b2ec04630314a4b80ac94e106a28876/users/686b56d0ef2646188c4a1b86bc952f1f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.549869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2ec04630314a4b80ac94e106a28876, user_id=686b56d0ef2646188c4a1b86bc952f1f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.552829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:27.745445 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3882/7756] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:27 2022] PUT /identity/v3/projects/3b2ec04630314a4b80ac94e106a28876/users/686b56d0ef2646188c4a1b86bc952f1f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:27.840359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c103e-a326-4e22-921f-c58209793240 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.840646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c103e-a326-4e22-921f-c58209793240 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.840922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c103e-a326-4e22-921f-c58209793240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.865858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:27.867889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:27.887210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-521c103e-a326-4e22-921f-c58209793240 None None] MFA Rules not processed for user `686b56d0ef2646188c4a1b86bc952f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:27.888217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-521c103e-a326-4e22-921f-c58209793240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:27.966847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e6a33-7d71-412c-9400-48468ae8b92f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:27.973465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:27.974152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:27.974434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:27.974696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] PATH_INFO: `/v3/projects/a5e8f4c059214d74956b783868e419ab` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:27.975861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e8f4c059214d74956b783868e419ab)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:27.979828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.004969 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3875/7757] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:28.006149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c103e-a326-4e22-921f-c58209793240 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.018495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c103e-a326-4e22-921f-c58209793240 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.026201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.026955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.027971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.028758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.030071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.032127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.143812 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3876/7758] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:28 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:28.145007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.149880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e8f4c059214d74956b783868e419ab', 'request_id': 'req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:28.156900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e8f4c059214d74956b783868e419ab', 'request_id': 'req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:28.210226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccefbc-3cf1-4d80-a539-03e9eb0b70d8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.216095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.216731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.217007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.217279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.217913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.220196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.304852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e8f4c059214d74956b783868e419ab', 'request_id': 'req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:28.317466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] The token cache is being invalidate because project a5e8f4c059214d74956b783868e419ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:28.317738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:28.318421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-3a3d78d8-e0bf-45c8-b157-e8604331ff9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:28.320554 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3883/7759] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:27 2022] DELETE /identity/v3/projects/a5e8f4c059214d74956b783868e419ab => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:28.327202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6174-34d2-465b-819f-4c55e0d03ae1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.327476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6174-34d2-465b-819f-4c55e0d03ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.333363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6174-34d2-465b-819f-4c55e0d03ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.347548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-907c6174-34d2-465b-819f-4c55e0d03ae1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:28.348739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-907c6174-34d2-465b-819f-4c55e0d03ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:28.357729 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3884/7760] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:28.365226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea652a9-af50-4330-9bc7-5b62df16ad86 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.365628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea652a9-af50-4330-9bc7-5b62df16ad86 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.365900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea652a9-af50-4330-9bc7-5b62df16ad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.386029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8ea652a9-af50-4330-9bc7-5b62df16ad86 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:28.387764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8ea652a9-af50-4330-9bc7-5b62df16ad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:28.396313 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3885/7761] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:28.399945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea652a9-af50-4330-9bc7-5b62df16ad86 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.411495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea652a9-af50-4330-9bc7-5b62df16ad86 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.417260 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3877/7762] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:28 2022] POST /identity/v3/users => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:28.421016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.421895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.422309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.422686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.423219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.423774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:48:28.424261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.425954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.426500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:28.452335 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:28.457860 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3886/7763] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:48:28.459409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.459695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9103-453b-449c-af4b-7ded53ac6b8d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.469871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.471144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.471970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.472403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.473258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.487011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.493133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132a809-e45b-4452-82a3-462ff563a50d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.499679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.500389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.501225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.501616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.502412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.505021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.505624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3878/7764] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:28.525959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.528558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:28.601803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3887/7765] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:28 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:28.616543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.710346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2ac97-430e-441f-a1be-ea58b6fb287a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.730353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467d0a-789a-4e28-9c92-4c36341afe3a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.735554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.736418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.737100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.737100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] PATH_INFO: `/v3/projects/5c5f49ecb70e40a2927d276efa8203e5/users/2923021808c24680a74188720ae715a9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.768502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5f49ecb70e40a2927d276efa8203e5, user_id=2923021808c24680a74188720ae715a9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.772777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.808225 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:28.822818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.824668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.825101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.826332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.831907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:28.850024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.852589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:28.869264 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3888/7766] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:28 2022] PUT /identity/v3/projects/5c5f49ecb70e40a2927d276efa8203e5/users/2923021808c24680a74188720ae715a9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:28.870241 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3879/7767] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:28.870365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.873632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:28.889854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc643b4-8291-41ed-98dd-823b08dbe3e6 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.981015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c606e5-b4c4-4724-ac7a-f966ca283c15 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:28.986625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65553142-b880-4c43-bae2-7642799b9c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:28.987685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553142-b880-4c43-bae2-7642799b9c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:28.988086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553142-b880-4c43-bae2-7642799b9c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:28.988457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553142-b880-4c43-bae2-7642799b9c93 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:28.989326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65553142-b880-4c43-bae2-7642799b9c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:28.992101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65553142-b880-4c43-bae2-7642799b9c93 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:29.007614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:29.008261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.011178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.012065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.012827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:29.017265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:29.031213 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3880/7768] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:29.044519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:29.056997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb167-4080-4a67-8bbe-6b6da1451905 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:29.062848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:29.063713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.063992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.064875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] PATH_INFO: `/v3/projects/5c5f49ecb70e40a2927d276efa8203e5/users/2923021808c24680a74188720ae715a9/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.066524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5f49ecb70e40a2927d276efa8203e5, user_id=2923021808c24680a74188720ae715a9, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:29.070600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:29.093319 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3881/7769] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:29 2022] PUT /identity/v3/projects/5c5f49ecb70e40a2927d276efa8203e5/users/2923021808c24680a74188720ae715a9/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:29.093676 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3889/7770] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:28 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:29.093777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:29.096361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.096804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.097181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.144692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] MFA Rules not processed for user `2923021808c24680a74188720ae715a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:29.146521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:29.237318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2599-7380-4d20-a00a-bd3cdabee8b9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:29.254171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:29.255094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.255470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.255977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.257512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:29.260130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:29.287813 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3882/7771] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:29.293167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:29.301455 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3890/7772] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:29.310496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9981f-bba6-45bd-b899-1be0322a452c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:29.315677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:29.316502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.316916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.317291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.318091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:29.320106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:29.335044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:29.336639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:29.347870 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3883/7773] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:29.350154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:29.384308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e38e7e-9bd5-439f-b12b-9255ef782dd1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:29.405001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c3244-174b-4236-adbc-b43873da4d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:29.405001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c3244-174b-4236-adbc-b43873da4d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.405001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c3244-174b-4236-adbc-b43873da4d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.405001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c3244-174b-4236-adbc-b43873da4d08 admin admin] PATH_INFO: `/v3/projects/40cf542f8de14a2ea4e3213a412e4fd0/users/de28431264da4665bf3969787bfe619c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.448651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c3244-174b-4236-adbc-b43873da4d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cf542f8de14a2ea4e3213a412e4fd0, user_id=de28431264da4665bf3969787bfe619c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:29.451935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c3244-174b-4236-adbc-b43873da4d08 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:29.492947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9dc53-48fa-483a-8802-09ab50b1293a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:29.497411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:29.498201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.498564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.498938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.500820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:29.570006 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3884/7774] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:29 2022] PUT /identity/v3/projects/40cf542f8de14a2ea4e3213a412e4fd0/users/de28431264da4665bf3969787bfe619c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:29.580231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1bcee-2981-454e-8bde-3355273182d0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.580621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1bcee-2981-454e-8bde-3355273182d0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.581031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1bcee-2981-454e-8bde-3355273182d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.588346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:29.592763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:29.616519 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3891/7775] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:48:29.623893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b0a1bcee-2981-454e-8bde-3355273182d0 None None] MFA Rules not processed for user `de28431264da4665bf3969787bfe619c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:29.629152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b0a1bcee-2981-454e-8bde-3355273182d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:29.783036 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3885/7776] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:29.787768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:29.836047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cca3ae-f3c8-49d4-80fd-5493c06d308f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:29.959155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:29.960016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:29.960445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:29.960939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:29.961717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:29.964406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:30.138033 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3892/7777] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:29 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:48:30.141054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1bcee-2981-454e-8bde-3355273182d0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:30.162245 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:30.191400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1bcee-2981-454e-8bde-3355273182d0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:30.272630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:30.273273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:30.273597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:30.273873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:30.275048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:30.278002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:30.375573 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3886/7778] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:30 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:30.376848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:30.408293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8693e23-d454-4c43-ae5e-aaa0e6254c9c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:30.422654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:30.423667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:30.424505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:30.424817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:30.425761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:30.427505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:30.446866 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3893/7779] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:30.448241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:30.461105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce462c-2133-43ed-b2ce-75b678c4f7ba admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:30.492727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f59d2-54f2-409e-bf3b-a6a811556a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:30.494255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f59d2-54f2-409e-bf3b-a6a811556a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:30.495635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f59d2-54f2-409e-bf3b-a6a811556a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:30.497336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f59d2-54f2-409e-bf3b-a6a811556a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:30.498197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f59d2-54f2-409e-bf3b-a6a811556a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:30.502627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f59d2-54f2-409e-bf3b-a6a811556a56 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:30.521848 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3887/7780] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:30.522362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:30.530865 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:30.537030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65d3d-c75f-4ac3-b5ea-566ccfd18e58 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:30.544062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:30.545004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:30.545435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:30.545925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] PATH_INFO: `/v3/projects/f02150d8beb743a6bb6973c1d42badd7/users/eddb22efde12422a82d11ae364b7d91e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:30.588681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02150d8beb743a6bb6973c1d42badd7, user_id=eddb22efde12422a82d11ae364b7d91e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:30.591969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:30.704123 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3894/7781] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:30 2022] PUT /identity/v3/projects/f02150d8beb743a6bb6973c1d42badd7/users/eddb22efde12422a82d11ae364b7d91e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:30.817621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8e45-fb1d-4dae-b67d-3f5cad1da8bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:30.817907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8e45-fb1d-4dae-b67d-3f5cad1da8bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:30.818209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd8e45-fb1d-4dae-b67d-3f5cad1da8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:30.855045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9ecd8e45-fb1d-4dae-b67d-3f5cad1da8bd None None] MFA Rules not processed for user `eddb22efde12422a82d11ae364b7d91e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:30.857093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9ecd8e45-fb1d-4dae-b67d-3f5cad1da8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:31.010366 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3888/7782] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:31.012845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:31.110980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298294b-ab1f-4b38-89d0-0ff44faa48c3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:31.116986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:31.117962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:31.118574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:31.119120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:31.120271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:31.122411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:31.275486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3895/7783] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:31 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:31.279081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8e45-fb1d-4dae-b67d-3f5cad1da8bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:31.290343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd8e45-fb1d-4dae-b67d-3f5cad1da8bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:31.353136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:31.354006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:31.354731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:31.354731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:31.355408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:31.358026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:31.466649 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3889/7784] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:31 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:31.468141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:31.500708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03cce2-f005-4f2b-ab69-65de2d11c652 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:31.513911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:31.514595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:31.516455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:31.516930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:31.517596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:31.519548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:31.542040 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3896/7785] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:31.544894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:31.561965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990874-68d8-4929-bcbe-c5345547095f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:31.571104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:31.572029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:31.572355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:31.572626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] PATH_INFO: `/v3/projects/91837358d19443a085e758863de4a016/users/341c67e068b74464a702716a6199c5c0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:31.591478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91837358d19443a085e758863de4a016, user_id=341c67e068b74464a702716a6199c5c0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:31.594201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:31.711635 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3890/7786] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:31 2022] PUT /identity/v3/projects/91837358d19443a085e758863de4a016/users/341c67e068b74464a702716a6199c5c0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:31.716296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:31.732466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee69b31-9d3d-4a3b-b747-06c0130b91ec admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:31.849748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428adbc-5938-4a55-814e-11e464be6c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:31.850412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428adbc-5938-4a55-814e-11e464be6c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:31.851093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428adbc-5938-4a55-814e-11e464be6c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:31.851370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428adbc-5938-4a55-814e-11e464be6c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:31.852073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428adbc-5938-4a55-814e-11e464be6c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:31.853750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428adbc-5938-4a55-814e-11e464be6c4b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:31.869399 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3897/7787] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:31.870556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:31.882998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e032367-6d34-449f-8bff-99a1b8619d46 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:31.889170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:31.889908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:31.893218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:31.893218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] PATH_INFO: `/v3/projects/91837358d19443a085e758863de4a016/users/341c67e068b74464a702716a6199c5c0/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:31.894887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=91837358d19443a085e758863de4a016, user_id=341c67e068b74464a702716a6199c5c0, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:31.897453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:31.921394 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3891/7788] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:31 2022] PUT /identity/v3/projects/91837358d19443a085e758863de4a016/users/341c67e068b74464a702716a6199c5c0/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:31.930091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:31.930091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:31.930091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:31.969028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] MFA Rules not processed for user `341c67e068b74464a702716a6199c5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:31.972213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:32.070007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3898/7789] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:32.080151 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:32.087404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:32.089553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:32.190467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7261-ff68-4656-ae8b-17696148bdaf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:32.194771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:32.195659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:32.196000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:32.196335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:32.206813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:32.208450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:32.222236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3892/7790] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:48:32.585093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:32.588037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:32.704891 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:32.774908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac902314-e3c0-44b5-bcd4-c92381faf2d0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:32.781530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f354638-c7d7-48f5-9e42-4a29108a8708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:32.782440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f354638-c7d7-48f5-9e42-4a29108a8708 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:32.782440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f354638-c7d7-48f5-9e42-4a29108a8708 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:32.782725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f354638-c7d7-48f5-9e42-4a29108a8708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:32.789346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f354638-c7d7-48f5-9e42-4a29108a8708 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:32.877067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f354638-c7d7-48f5-9e42-4a29108a8708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:32.885615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f354638-c7d7-48f5-9e42-4a29108a8708 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:32.908786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3899/7791] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:34.215815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:34.218676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:34.248660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491fa1f-dc32-4ce3-9787-0e4074b736ce service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:34.283650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:34.499458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:34.499458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:34.499458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:34.499458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:34.499458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:34.499458 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3893/7792] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:34.688636 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:35.547146 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:36.973628 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:37.558183 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:37.596231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706064-96a8-43b9-8be0-58fcfdb362f5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:37.596519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706064-96a8-43b9-8be0-58fcfdb362f5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:37.596793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4706064-96a8-43b9-8be0-58fcfdb362f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:37.642571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c4706064-96a8-43b9-8be0-58fcfdb362f5 None None] MFA Rules not processed for user `037ed342980a4de9a2dfc8d576293aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:37.647619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c4706064-96a8-43b9-8be0-58fcfdb362f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:37.756878 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3900/7793] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:37.850493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:37.855231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:38.001663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae569-ac3b-4438-80dd-3cef79f2f807 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:38.019652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:38.021274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:38.021845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:38.023089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] PATH_INFO: `/v3/users/b7b2f0a00a204943b1774c940ecb4444` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:38.024804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b2f0a00a204943b1774c940ecb4444)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:38.027968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:38.400119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b2f0a00a204943b1774c940ecb4444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:38.425947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b2f0a00a204943b1774c940ecb4444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:38.426969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b2f0a00a204943b1774c940ecb4444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:38.501906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b2f0a00a204943b1774c940ecb4444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:38.502726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b2f0a00a204943b1774c940ecb4444'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:38.540048 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3894/7794] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:37 2022] DELETE /identity/v3/users/b7b2f0a00a204943b1774c940ecb4444 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:38.545390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:38.545965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:38.546789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:38.581380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:38.585628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:38.677410 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3901/7795] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:38.691267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:38.693084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:38.838500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364642dd-3738-4fc5-919f-521ba0868563 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:38.848368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fedf4e-8f04-43f6-9ebc-05157e5e4a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:38.850814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fedf4e-8f04-43f6-9ebc-05157e5e4a2e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:38.854048 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:38.856232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fedf4e-8f04-43f6-9ebc-05157e5e4a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:38.856768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fedf4e-8f04-43f6-9ebc-05157e5e4a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:38.878930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fedf4e-8f04-43f6-9ebc-05157e5e4a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:38.884344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fedf4e-8f04-43f6-9ebc-05157e5e4a2e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:38.910772 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3895/7796] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:40.182989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:40.185043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:40.214268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91df582-9e45-4050-b3ed-ac8d797b36ca None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:40.247573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:40.248447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:40.251641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:40.251921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] PATH_INFO: `/v3/projects/295ed02bf3054280b0c9e46d481c5768` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:40.257678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=295ed02bf3054280b0c9e46d481c5768)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:40.259660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:40.522665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295ed02bf3054280b0c9e46d481c5768', 'request_id': 'req-33cadbbd-34a3-4036-a067-96999327a6b3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:40.534283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295ed02bf3054280b0c9e46d481c5768', 'request_id': 'req-33cadbbd-34a3-4036-a067-96999327a6b3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:40.679019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295ed02bf3054280b0c9e46d481c5768', 'request_id': 'req-33cadbbd-34a3-4036-a067-96999327a6b3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:40.689015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] The token cache is being invalidate because project 295ed02bf3054280b0c9e46d481c5768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:40.689308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:40.690041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-33cadbbd-34a3-4036-a067-96999327a6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:40.691773 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3902/7797] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:40 2022] DELETE /identity/v3/projects/295ed02bf3054280b0c9e46d481c5768 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:40.705508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143feab-3fd9-4b6f-ac8c-bd230ae87b2b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:40.706629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143feab-3fd9-4b6f-ac8c-bd230ae87b2b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:40.706629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143feab-3fd9-4b6f-ac8c-bd230ae87b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:40.740535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7143feab-3fd9-4b6f-ac8c-bd230ae87b2b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:40.741850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7143feab-3fd9-4b6f-ac8c-bd230ae87b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:40.966575 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3896/7798] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:40.976046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae5956-c645-4fc8-ae98-9f1e259895fb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:40.976814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae5956-c645-4fc8-ae98-9f1e259895fb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:40.977298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae5956-c645-4fc8-ae98-9f1e259895fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:41.013996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e6ae5956-c645-4fc8-ae98-9f1e259895fb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:41.017394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e6ae5956-c645-4fc8-ae98-9f1e259895fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:41.043965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3903/7799] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:41.048136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143feab-3fd9-4b6f-ac8c-bd230ae87b2b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:41.064379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143feab-3fd9-4b6f-ac8c-bd230ae87b2b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:41.077217 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:41.081433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:41.082263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:41.082618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:41.084198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:48:41.086247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:41.096577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:41.112247 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:41.116308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3897/7800] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:48:41.121998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae5956-c645-4fc8-ae98-9f1e259895fb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:41.134477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae5956-c645-4fc8-ae98-9f1e259895fb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:41.140546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:41.141173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:41.141448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:41.141717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:41.142447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:41.144461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:41.164608 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:41.274236 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3904/7801] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:41 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:48:41.278481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:41.303293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e98c-8adc-482a-932c-740bfe517f56 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:41.403880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:41.404705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:41.405558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:41.406223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:41.407608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:41.411354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:41.545765 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3898/7802] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:41 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:41.550410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:41.565049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b118-c354-4349-98df-f43239c0f2ef admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:41.576387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:41.577585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:41.578216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:41.579173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:41.580058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:41.583051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:41.596368 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3905/7803] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:41.600540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:41.631969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e859f-8aa0-4c9a-942c-49374a13a1ce admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:41.650185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b062a-0ee4-4221-aec7-fcae5a562c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:41.651325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b062a-0ee4-4221-aec7-fcae5a562c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:41.651976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b062a-0ee4-4221-aec7-fcae5a562c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:41.652406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b062a-0ee4-4221-aec7-fcae5a562c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:41.654002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b062a-0ee4-4221-aec7-fcae5a562c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:41.656010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b062a-0ee4-4221-aec7-fcae5a562c71 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:41.727346 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3899/7804] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:41.732338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:41.757615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cc55b-478f-4e3e-80a2-3c247e1c7c3c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:41.769765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:41.772185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:41.774135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:41.774422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] PATH_INFO: `/v3/projects/ea87c7cf6a8b40ba914da392ab262edc/users/762ae558fed0436793d2f985617ac4d6/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:41.850471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea87c7cf6a8b40ba914da392ab262edc, user_id=762ae558fed0436793d2f985617ac4d6, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:41.850471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:41.963193 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3906/7805] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:41 2022] PUT /identity/v3/projects/ea87c7cf6a8b40ba914da392ab262edc/users/762ae558fed0436793d2f985617ac4d6/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:41.968805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0f6d6-564a-4f8b-a6bc-4fddd417c2b4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:41.969289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0f6d6-564a-4f8b-a6bc-4fddd417c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:41.969712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0f6d6-564a-4f8b-a6bc-4fddd417c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:42.024275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-62d0f6d6-564a-4f8b-a6bc-4fddd417c2b4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:42.026871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62d0f6d6-564a-4f8b-a6bc-4fddd417c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:42.159883 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3900/7806] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:42.171602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:42.175611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:42.289847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1650e7-88f8-4df8-8a7d-9d630f431d16 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:42.296132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:42.297386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:42.297904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:42.298413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:42.310953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:42.313118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:42.341418 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3907/7807] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:42.573402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54ccc-09f8-481b-916c-3320bb6c4481 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:42.573690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54ccc-09f8-481b-916c-3320bb6c4481 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:42.574481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54ccc-09f8-481b-916c-3320bb6c4481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:42.637609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c4a54ccc-09f8-481b-916c-3320bb6c4481 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:42.638881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c4a54ccc-09f8-481b-916c-3320bb6c4481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:42.808543 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3901/7808] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:48:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:43.057174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:43.058672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:43.177599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783000c0-e049-4546-ad7e-cb1c0b7245cb service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:43.187658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:43.188563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:43.188911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:43.189498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:43.202644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:43.205216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:43.216184 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3908/7809] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:48:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:48:44.599151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a18ec-1639-4965-982b-a69ecd42a4ea None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:44.599643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a18ec-1639-4965-982b-a69ecd42a4ea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:44.599756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a18ec-1639-4965-982b-a69ecd42a4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:44.654009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0e6a18ec-1639-4965-982b-a69ecd42a4ea None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:44.655256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e6a18ec-1639-4965-982b-a69ecd42a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:44.696219 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3902/7810] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:44.714028 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:44.733452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b160efb-725a-45d2-9282-5ca375688f6a service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:44.743701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:44.744626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:44.745064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:44.745496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:44.759026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:44.761436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:44.773963 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3909/7811] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:48:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:48:45.018523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d4a07-7337-4ed3-a659-e44844f07aab None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:45.018810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d4a07-7337-4ed3-a659-e44844f07aab None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:45.019083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d4a07-7337-4ed3-a659-e44844f07aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:45.116159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7c7d4a07-7337-4ed3-a659-e44844f07aab None None] MFA Rules not processed for user `762ae558fed0436793d2f985617ac4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:45.117327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7c7d4a07-7337-4ed3-a659-e44844f07aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:45.127193 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:45.287110 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3903/7812] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:45.291419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:45.306126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b55731-fd93-4f43-9dee-87b0699cffdb service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:45.315110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:45.316038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:45.316474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:45.316898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:45.317830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:45.321306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:45.453424 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3910/7813] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:45 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:45.457801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d4a07-7337-4ed3-a659-e44844f07aab None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:45.478123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d4a07-7337-4ed3-a659-e44844f07aab None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:45.573242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:45.574378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:45.575596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:45.576332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:45.577882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:45.580511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:45.708941 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3904/7814] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:45 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:45.713045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:45.730363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b35f-f5e1-4fc6-bbb8-47f5fe6cf3eb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:45.744545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42373e-ad47-4bba-b139-0a1998d445f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:45.745187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42373e-ad47-4bba-b139-0a1998d445f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:45.745474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42373e-ad47-4bba-b139-0a1998d445f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:45.745750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42373e-ad47-4bba-b139-0a1998d445f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:45.748991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42373e-ad47-4bba-b139-0a1998d445f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:45.750686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42373e-ad47-4bba-b139-0a1998d445f0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:45.762115 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3911/7815] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:45.766733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:45.782120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cdc9-42d1-4f80-bb79-bf9f7b4e5709 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:45.795676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:45.796360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:45.796660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:45.796915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] PATH_INFO: `/v3/projects/a08791cf8431433ca65c76fd3176b4dc/users/1031e4b72a4e49b093ed4219c90d46f8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:45.820691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08791cf8431433ca65c76fd3176b4dc, user_id=1031e4b72a4e49b093ed4219c90d46f8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:45.824170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:45.830540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690ca5-e2e2-4eb8-981d-b4576200c59b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:45.831004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690ca5-e2e2-4eb8-981d-b4576200c59b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:45.831345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690ca5-e2e2-4eb8-981d-b4576200c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:45.841055 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:45.852737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a6690ca5-e2e2-4eb8-981d-b4576200c59b None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:45.858129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a6690ca5-e2e2-4eb8-981d-b4576200c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:45.915279 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3905/7816] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:45 2022] PUT /identity/v3/projects/a08791cf8431433ca65c76fd3176b4dc/users/1031e4b72a4e49b093ed4219c90d46f8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:45.916507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:45.922922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:45.962221 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3912/7817] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:45.963064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6690ca5-e2e2-4eb8-981d-b4576200c59b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:45.984384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6690ca5-e2e2-4eb8-981d-b4576200c59b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:46.058363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c481c3-5448-4d15-bb7a-389d2639759d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:46.064237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:46.064836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:46.065290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:46.065714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:46.068855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:46.077639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:46.078249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:46.078527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:46.078794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:46.079435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:46.081126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:46.096214 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3913/7818] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:46.100348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:46.159875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:46.163610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:46.182747 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3906/7819] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:46.184594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:46.199580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18825c-3a4c-4c50-baff-0db9ad7d6b3b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:46.205186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:46.206367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:46.206814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:46.207355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] PATH_INFO: `/v3/projects/a08791cf8431433ca65c76fd3176b4dc/users/1031e4b72a4e49b093ed4219c90d46f8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:46.209734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08791cf8431433ca65c76fd3176b4dc, user_id=1031e4b72a4e49b093ed4219c90d46f8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:46.213322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:46.229370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3907/7820] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:46 2022] PUT /identity/v3/projects/a08791cf8431433ca65c76fd3176b4dc/users/1031e4b72a4e49b093ed4219c90d46f8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:46.229370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:46.239887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:46.263352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a4dca-97f7-4e2e-aa43-c97033c2aded admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:46.339931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789daee8-56ed-41e1-9d12-45f0b0f5746e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:46.344697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938d2a-44e4-4c4c-8c56-a4bd7e49e681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:46.345294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938d2a-44e4-4c4c-8c56-a4bd7e49e681 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:46.345575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938d2a-44e4-4c4c-8c56-a4bd7e49e681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:46.349699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938d2a-44e4-4c4c-8c56-a4bd7e49e681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:46.349699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a2938d2a-44e4-4c4c-8c56-a4bd7e49e681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:46.372014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d4e1-8f4a-4dfd-8dae-95943bcc6170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:46.378213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d4e1-8f4a-4dfd-8dae-95943bcc6170 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:46.378213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d4e1-8f4a-4dfd-8dae-95943bcc6170 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:46.378213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d4e1-8f4a-4dfd-8dae-95943bcc6170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:46.461907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d4e1-8f4a-4dfd-8dae-95943bcc6170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:46.463705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d4e1-8f4a-4dfd-8dae-95943bcc6170 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:46.473682 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3914/7821] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:48:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:48:46.481614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938d2a-44e4-4c4c-8c56-a4bd7e49e681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:46.490960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938d2a-44e4-4c4c-8c56-a4bd7e49e681 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:46.521794 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3908/7822] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:46.617610 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:47.530059 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:48.541631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff202-639e-40f8-a4ed-3984f3a6dd0d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:48.542363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff202-639e-40f8-a4ed-3984f3a6dd0d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:48.542363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff202-639e-40f8-a4ed-3984f3a6dd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:48.562099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646106-b4e0-41b7-9a39-a8e975dd456e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:48.562984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646106-b4e0-41b7-9a39-a8e975dd456e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:48.563403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646106-b4e0-41b7-9a39-a8e975dd456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:48.629422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0d4ff202-639e-40f8-a4ed-3984f3a6dd0d None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:48.631883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0d4ff202-639e-40f8-a4ed-3984f3a6dd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:48.649559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9b646106-b4e0-41b7-9a39-a8e975dd456e None None] MFA Rules not processed for user `1031e4b72a4e49b093ed4219c90d46f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:48.651893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b646106-b4e0-41b7-9a39-a8e975dd456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:48.652518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3915/7823] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:48.666608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff202-639e-40f8-a4ed-3984f3a6dd0d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:48.692185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff202-639e-40f8-a4ed-3984f3a6dd0d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:48.713284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:48.714077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:48.714419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:48.714761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:48.730787 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:48.734529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:48.740502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:48.762020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3909/7825] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:48.762884 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3916/7825] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:48:48.775615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5445-0d92-4e23-a025-fb3034aa4496 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:48.776038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5445-0d92-4e23-a025-fb3034aa4496 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:48.776307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5445-0d92-4e23-a025-fb3034aa4496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:48.815004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ccaf5445-0d92-4e23-a025-fb3034aa4496 None None] MFA Rules not processed for user `762ae558fed0436793d2f985617ac4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:48.816333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ccaf5445-0d92-4e23-a025-fb3034aa4496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:48.891848 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3910/7826] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:48.904970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:48.906730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:48.998686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74c69-27d6-4468-b471-23f15b7972dd service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:49.006049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:49.007434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:49.008686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:49.008967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:49.022245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:49.025134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:49.043612 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3917/7827] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:52.827948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5445-0d92-4e23-a025-fb3034aa4496 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:52.910197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5445-0d92-4e23-a025-fb3034aa4496 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:52.914271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:52.914935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:52.915308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:52.915678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:52.917510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:52.998411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:53.000228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:53.023854 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3911/7828] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:54.018589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:54.020958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:54.118136 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:54.156639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1f249-ee88-496c-b810-b73e723d5117 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:54.161846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:54.162587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:54.167383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:54.167383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] PATH_INFO: `/v3/users/de28431264da4665bf3969787bfe619c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:54.167383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de28431264da4665bf3969787bfe619c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:54.167383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:54.393469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de28431264da4665bf3969787bfe619c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.396086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:54.397592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:54.405617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de28431264da4665bf3969787bfe619c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.407655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de28431264da4665bf3969787bfe619c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.420112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035b53-6338-4b52-b789-f062f4b6f04e service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:54.424843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:54.425739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:54.426047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:54.426528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] PATH_INFO: `/v3/users/b4039f0940ed4cb2a3f5de1ba80c2d15` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:54.427711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4039f0940ed4cb2a3f5de1ba80c2d15)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:54.429623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:54.490525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de28431264da4665bf3969787bfe619c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.491825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-03e694ae-0a24-4f11-b90a-1b0a924ec731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de28431264da4665bf3969787bfe619c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.518223 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3918/7829] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:54 2022] DELETE /identity/v3/users/de28431264da4665bf3969787bfe619c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:54.519828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:54.520118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:54.520396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:54.553531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:54.554824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:54.624797 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3919/7830] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:54.635775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:54.636657 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:54.638341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:54.641572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4039f0940ed4cb2a3f5de1ba80c2d15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.656833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4039f0940ed4cb2a3f5de1ba80c2d15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.658410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4039f0940ed4cb2a3f5de1ba80c2d15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.707339 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:54.714480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e61d-f965-4a24-adb0-d17df0604ba0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:54.719339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d9c60-5618-40ec-83cd-52d6fb384de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:54.719339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9c60-5618-40ec-83cd-52d6fb384de1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:54.724521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9c60-5618-40ec-83cd-52d6fb384de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:54.724521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d9c60-5618-40ec-83cd-52d6fb384de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:54.730058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9c60-5618-40ec-83cd-52d6fb384de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:54.731655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d9c60-5618-40ec-83cd-52d6fb384de1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:54.742369 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3920/7831] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:48:54.750891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4039f0940ed4cb2a3f5de1ba80c2d15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.751722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4039f0940ed4cb2a3f5de1ba80c2d15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:54.776138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:54.776350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:54.776561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:54.779543 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3912/7832] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:54 2022] DELETE /identity/v3/users/b4039f0940ed4cb2a3f5de1ba80c2d15 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:54.797185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:54.798466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:54.877818 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3921/7833] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:54.902420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:54.905363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:54.975184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699156-33ca-47a0-84ea-f88aa0d3eab8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:54.992851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:54.993527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:54.993871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:54.994223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:55.011548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:55.013814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:55.029557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3913/7834] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:48:55.401862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:55.403544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:55.418380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bbdae-5773-460d-9149-61e367765fd9 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:55.424835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:55.425810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:55.426194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:55.426530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] PATH_INFO: `/v3/projects/40cf542f8de14a2ea4e3213a412e4fd0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:55.427749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cf542f8de14a2ea4e3213a412e4fd0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:55.429904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:55.552796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cf542f8de14a2ea4e3213a412e4fd0', 'request_id': 'req-450b3efe-d4e5-4aed-be71-84081f077dcd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.558379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cf542f8de14a2ea4e3213a412e4fd0', 'request_id': 'req-450b3efe-d4e5-4aed-be71-84081f077dcd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.628191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cf542f8de14a2ea4e3213a412e4fd0', 'request_id': 'req-450b3efe-d4e5-4aed-be71-84081f077dcd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.641640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] The token cache is being invalidate because project 40cf542f8de14a2ea4e3213a412e4fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:55.642151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.642903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.644602 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3922/7835] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:55 2022] DELETE /identity/v3/projects/40cf542f8de14a2ea4e3213a412e4fd0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:55.648631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:55.659556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84a5d-a199-4460-ba36-0fedb2c72399 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:55.664986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:55.666596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:55.732007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:55.732794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:55.733072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:55.733338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] PATH_INFO: `/v3/users/eddb22efde12422a82d11ae364b7d91e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:55.735260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddb22efde12422a82d11ae364b7d91e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:55.742994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:55.766765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b3efe-d4e5-4aed-be71-84081f077dcd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:55.773050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:55.773913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:55.774202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:55.775026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] PATH_INFO: `/v3/projects/cddd64f7c80a4e869e77648648102c6d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:55.776449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cddd64f7c80a4e869e77648648102c6d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:55.778683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:55.796817 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:55.935665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cddd64f7c80a4e869e77648648102c6d', 'request_id': 'req-61b7faeb-2755-42a5-9466-0ba3d989202a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.951842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddb22efde12422a82d11ae364b7d91e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.958730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cddd64f7c80a4e869e77648648102c6d', 'request_id': 'req-61b7faeb-2755-42a5-9466-0ba3d989202a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.962080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddb22efde12422a82d11ae364b7d91e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:55.963070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddb22efde12422a82d11ae364b7d91e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:56.011578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cddd64f7c80a4e869e77648648102c6d', 'request_id': 'req-61b7faeb-2755-42a5-9466-0ba3d989202a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:56.029419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] The token cache is being invalidate because project cddd64f7c80a4e869e77648648102c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:56.029784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:56.031920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-61b7faeb-2755-42a5-9466-0ba3d989202a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:56.034953 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3923/7836] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:55 2022] DELETE /identity/v3/projects/cddd64f7c80a4e869e77648648102c6d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:56.041147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668960-6c5e-462a-918b-b1aa4f95516e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.041541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668960-6c5e-462a-918b-b1aa4f95516e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.053889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668960-6c5e-462a-918b-b1aa4f95516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.064860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fc668960-6c5e-462a-918b-b1aa4f95516e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:56.066284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fc668960-6c5e-462a-918b-b1aa4f95516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:56.071437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddb22efde12422a82d11ae364b7d91e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:56.072092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6760ba9-592d-4f77-8ec0-82cfa1068cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddb22efde12422a82d11ae364b7d91e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:56.074513 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:56.099020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3914/7837] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:55 2022] DELETE /identity/v3/users/eddb22efde12422a82d11ae364b7d91e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:56.144140 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3924/7838] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:56.146200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725fa7-f454-41a1-bfaa-d2372577084e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.148634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725fa7-f454-41a1-bfaa-d2372577084e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.148634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725fa7-f454-41a1-bfaa-d2372577084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.177915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b9725fa7-f454-41a1-bfaa-d2372577084e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:56.179288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b9725fa7-f454-41a1-bfaa-d2372577084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:56.244919 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3915/7839] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:56.249410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc668960-6c5e-462a-918b-b1aa4f95516e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:56.259463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc668960-6c5e-462a-918b-b1aa4f95516e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:56.264226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:56.264835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.265109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.265376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.266118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:48:56.266430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:56.268095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:56.291424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725fa7-f454-41a1-bfaa-d2372577084e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:56.303381 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3925/7840] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:48:56.305948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725fa7-f454-41a1-bfaa-d2372577084e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:56.314361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:56.315219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.315657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.316072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.316754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:56.318841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:56.422140 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3916/7841] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:56 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:48:56.426820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:56.440302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e720c3-9380-40c5-9828-1125a00c3345 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:56.514942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:56.515804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.516156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.516497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.517229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:56.519423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:56.611995 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3926/7842] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:56 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:56.623231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:56.627741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe1d0-f476-47cc-997f-8c92529141aa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:56.633873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:56.634866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.635300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.635718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.636568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:56.638878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:56.652842 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3917/7843] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:56.658381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:56.671967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886c31d-c111-4b68-a074-6cc2a46cb1e4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:56.679528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c06b8f-6aad-4dc7-a195-abf03dbce8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:56.680155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06b8f-6aad-4dc7-a195-abf03dbce8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.680753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06b8f-6aad-4dc7-a195-abf03dbce8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.680753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06b8f-6aad-4dc7-a195-abf03dbce8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.681335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c06b8f-6aad-4dc7-a195-abf03dbce8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:56.683240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c06b8f-6aad-4dc7-a195-abf03dbce8aa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:56.696573 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3927/7844] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:56.701176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:56.711505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe9de5-7ad1-4289-8839-729b1b707c4a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:56.717377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:56.720453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.720453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.720453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] PATH_INFO: `/v3/projects/a028aafec3294eae9a1c1a9a4e907dc2/users/38c7799d37d747b08a9e20e15c3d6879/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.734832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a028aafec3294eae9a1c1a9a4e907dc2, user_id=38c7799d37d747b08a9e20e15c3d6879, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:56.737531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:56.817348 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3918/7845] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:56 2022] PUT /identity/v3/projects/a028aafec3294eae9a1c1a9a4e907dc2/users/38c7799d37d747b08a9e20e15c3d6879/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:56.827767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:56.828178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:56.828546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:56.853784 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:56.864469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] MFA Rules not processed for user `38c7799d37d747b08a9e20e15c3d6879`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:56.864469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:56.930470 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3928/7846] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:56.935623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:57.029105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:57.030882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:57.054801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81cc0a-f069-491b-ab83-fb9e946777d7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:57.060766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:57.061407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.061707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.061947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.062635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:57.065880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:57.147950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd694dc7-f4d2-4af3-9505-c296e95bca95 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:57.164221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:57.164985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.166075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.166453 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] PATH_INFO: `/v3/projects/f02150d8beb743a6bb6973c1d42badd7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.170132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02150d8beb743a6bb6973c1d42badd7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:57.172184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:57.179860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3919/7847] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:56 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:57.184132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:57.209923 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:57.297315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c57206-8d06-4a33-b2a9-1b8d36547938 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:57.305867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:57.306099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.307922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.308393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.309138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:57.311811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:57.354510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02150d8beb743a6bb6973c1d42badd7', 'request_id': 'req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:57.362733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02150d8beb743a6bb6973c1d42badd7', 'request_id': 'req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:57.422022 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3920/7848] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:57 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:57.425550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:57.438679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef484480-a3a1-41fd-9ae7-0a03adb29115 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:57.452692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02150d8beb743a6bb6973c1d42badd7', 'request_id': 'req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:57.521603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] The token cache is being invalidate because project f02150d8beb743a6bb6973c1d42badd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:57.522011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:57.525581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:57.531965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3929/7849] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:57 2022] DELETE /identity/v3/projects/f02150d8beb743a6bb6973c1d42badd7 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:57.536234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:57.541387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:57.629364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:57.630083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.630466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.630811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.631541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:57.633225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:57.647475 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3921/7850] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:57.651513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:57.653705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:57.666779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24930e7-32ed-4a71-af80-b47e403611fd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:57.671774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:57.672493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.672871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.673421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.674210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:57.676276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:57.690085 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3922/7851] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:57.694393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:57.709764 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:57.713675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6343a-2637-4be7-afa8-5f90eb316878 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:57.717024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1a5e-d27a-4ec8-a24d-049d269815e5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:57.721442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be24bb-e9d0-46a1-8c91-e5ae46c4b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:57.723171 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be24bb-e9d0-46a1-8c91-e5ae46c4b8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.723312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:57.723778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be24bb-e9d0-46a1-8c91-e5ae46c4b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.724114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.724376 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be24bb-e9d0-46a1-8c91-e5ae46c4b8ec admin admin] PATH_INFO: `/v3/projects/c6c13c5ccb0b4f0a818a5aef2be4f249/users/e15dc1d65e6c437f8dfb90c1d4b23b97/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.724492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.724837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] PATH_INFO: `/v3/users/341c67e068b74464a702716a6199c5c0` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.726813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=341c67e068b74464a702716a6199c5c0)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:57.728857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:57.751937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be24bb-e9d0-46a1-8c91-e5ae46c4b8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c13c5ccb0b4f0a818a5aef2be4f249, user_id=e15dc1d65e6c437f8dfb90c1d4b23b97, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:57.755643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be24bb-e9d0-46a1-8c91-e5ae46c4b8ec admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:57.896494 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3923/7852] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:57 2022] PUT /identity/v3/projects/c6c13c5ccb0b4f0a818a5aef2be4f249/users/e15dc1d65e6c437f8dfb90c1d4b23b97/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:48:57.909587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8bf97-6913-432d-baa7-06a16bee0f28 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:57.910624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8bf97-6913-432d-baa7-06a16bee0f28 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:57.911200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8bf97-6913-432d-baa7-06a16bee0f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:57.956065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a6d8bf97-6913-432d-baa7-06a16bee0f28 None None] MFA Rules not processed for user `e15dc1d65e6c437f8dfb90c1d4b23b97`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:57.957600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a6d8bf97-6913-432d-baa7-06a16bee0f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:57.981171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341c67e068b74464a702716a6199c5c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:57.993255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341c67e068b74464a702716a6199c5c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:57.994236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341c67e068b74464a702716a6199c5c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:58.056338 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3924/7853] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:48:58.061663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8bf97-6913-432d-baa7-06a16bee0f28 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:58.062753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341c67e068b74464a702716a6199c5c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:58.063526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341c67e068b74464a702716a6199c5c0'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:58.106724 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3930/7854] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:48:57 2022] DELETE /identity/v3/users/341c67e068b74464a702716a6199c5c0 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:58.124360 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:58.185310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8bf97-6913-432d-baa7-06a16bee0f28 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:58.277792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:58.278604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:58.278949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:58.279323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:58.280137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:58.282292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:58.378948 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3925/7855] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:58 2022] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:58.379427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:58.380963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:58.396171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed622e0-6afa-470d-a1cc-2fa1f58c1c08 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:58.466758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:58.467601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:58.467882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:58.468347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:58.476673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:58.479634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:58.609714 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3931/7856] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:58 2022] POST /identity/v3/users => generated 300 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:58.614207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:58.628420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79501256-7c82-4c30-a0cf-5ef92632aa21 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:58.646573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:58.648454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:58.654399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:58.655032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:58.655307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:58.655576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:58.656240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:58.657852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:58.673309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48047bcf-53c6-4792-b1e0-b2451838a0ba admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:58.687165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:58.688881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:58.689168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:58.689929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] PATH_INFO: `/v3/projects/91837358d19443a085e758863de4a016` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:58.693189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91837358d19443a085e758863de4a016)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:58.696088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:58.701413 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3926/7857] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:58.721871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:58.743206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d1a6-41dc-44a5-aad1-c8fd3f686b84 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:58.750143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:58.750939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:58.751214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:58.751573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] PATH_INFO: `/v3/projects/cac87264e0fe438681c22ee09d7022b2/users/be8197e50cff43bda8b0b19a6efc5afa/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:58.775322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac87264e0fe438681c22ee09d7022b2, user_id=be8197e50cff43bda8b0b19a6efc5afa, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:58.783098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:58.907834 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3927/7858] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:58 2022] PUT /identity/v3/projects/cac87264e0fe438681c22ee09d7022b2/users/be8197e50cff43bda8b0b19a6efc5afa/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:58.912490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:58.917708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91837358d19443a085e758863de4a016', 'request_id': 'req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:58.926895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91837358d19443a085e758863de4a016', 'request_id': 'req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:58.990210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00799-eacb-4a6a-8b99-aa874c9cbadd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.004063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91837358d19443a085e758863de4a016', 'request_id': 'req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:59.030155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] The token cache is being invalidate because project 91837358d19443a085e758863de4a016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:48:59.031024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:59.031957 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1530652f-c684-4ab5-b741-c4c3c2c1c4b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:48:59.037172 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3932/7859] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:48:58 2022] DELETE /identity/v3/projects/91837358d19443a085e758863de4a016 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:59.043315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f5a4a-5453-4f20-9a35-4f6da8530631 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.043952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f5a4a-5453-4f20-9a35-4f6da8530631 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.044231 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f5a4a-5453-4f20-9a35-4f6da8530631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.065865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.067338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.067338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.067555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.068842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.070525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.076736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-774f5a4a-5453-4f20-9a35-4f6da8530631 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:59.078860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-774f5a4a-5453-4f20-9a35-4f6da8530631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:59.085020 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3928/7860] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:59.089567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.090963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:59.101051 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3933/7861] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:59.102572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94011f25-7dd5-4c02-abe0-732265a2b7e0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.102862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94011f25-7dd5-4c02-abe0-732265a2b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.103133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94011f25-7dd5-4c02-abe0-732265a2b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.116216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba34b-99d2-4ba5-8daf-1c6a7215ac20 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.127283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd603-1f6d-4165-a21a-9eb90356fdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.127283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd603-1f6d-4165-a21a-9eb90356fdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.127283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd603-1f6d-4165-a21a-9eb90356fdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.127283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd603-1f6d-4165-a21a-9eb90356fdb4 admin admin] PATH_INFO: `/v3/projects/cac87264e0fe438681c22ee09d7022b2/users/be8197e50cff43bda8b0b19a6efc5afa/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.127692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-94011f25-7dd5-4c02-abe0-732265a2b7e0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:59.128952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-94011f25-7dd5-4c02-abe0-732265a2b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:59.129081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd603-1f6d-4165-a21a-9eb90356fdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac87264e0fe438681c22ee09d7022b2, user_id=be8197e50cff43bda8b0b19a6efc5afa, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.132695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd603-1f6d-4165-a21a-9eb90356fdb4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.140779 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3934/7862] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:59.146026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94011f25-7dd5-4c02-abe0-732265a2b7e0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.157959 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3929/7863] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:59 2022] PUT /identity/v3/projects/cac87264e0fe438681c22ee09d7022b2/users/be8197e50cff43bda8b0b19a6efc5afa/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:59.158297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94011f25-7dd5-4c02-abe0-732265a2b7e0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.161627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.166953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.166953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.167648 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:59.208088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] MFA Rules not processed for user `be8197e50cff43bda8b0b19a6efc5afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:59.209781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:59.231687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.232637 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:48:59.235839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.235839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.235839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.235839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:48:59.235839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.237844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.259523 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3935/7864] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:48:59.264549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.277166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef8072-51b0-41ea-8b01-11b6bc862a5f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.283574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.284439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.285455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.285733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.287333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.290734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.319266 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3930/7865] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:48:59.328338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.330453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:59.387628 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3936/7866] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:48:59 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:59.389250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.450215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddda53-3118-4636-bd93-cab1977c68af None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.474946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d74a-5947-44bd-8d15-5155de1c9cf2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.480207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.480948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.481845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.482209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.482851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.484780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.546513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.547339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.548041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.548041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.550687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:48:59.591237 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3937/7867] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:48:59 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:48:59.594645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.617872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720866-0550-4cdf-99e0-d25eefcf0d82 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.625347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.626341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.626934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.628352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.631530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.636797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.642485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.644229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.672772 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3931/7868] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:48:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:48:59.682156 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3938/7869] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:48:59.687201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.699573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaae11-cd67-497c-a7f7-0301a89a4247 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.706441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91f94e-b87e-4bf3-8ae0-4dfc11aefb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.707440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f94e-b87e-4bf3-8ae0-4dfc11aefb28 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.708018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f94e-b87e-4bf3-8ae0-4dfc11aefb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.708488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f94e-b87e-4bf3-8ae0-4dfc11aefb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.721503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91f94e-b87e-4bf3-8ae0-4dfc11aefb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.725856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91f94e-b87e-4bf3-8ae0-4dfc11aefb28 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.742102 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3932/7870] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:48:59.748491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:48:59.762668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ce06-fce3-4f22-b021-f0eaf79f7c2e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:48:59.768771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:48:59.770014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.770258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.771470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] PATH_INFO: `/v3/projects/d3bd0752e6594c34b24f2341a5dd04df/users/e76d47a5c7184fff9d133e9543aab19c/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.792417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bd0752e6594c34b24f2341a5dd04df, user_id=e76d47a5c7184fff9d133e9543aab19c, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:48:59.796261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:48:59.878865 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3939/7871] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:48:59 2022] PUT /identity/v3/projects/d3bd0752e6594c34b24f2341a5dd04df/users/e76d47a5c7184fff9d133e9543aab19c/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:48:59.898453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bfb94-38d9-4d24-ae4f-e423f26c0f9f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:48:59.898743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bfb94-38d9-4d24-ae4f-e423f26c0f9f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:48:59.899020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bfb94-38d9-4d24-ae4f-e423f26c0f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:48:59.972860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-858bfb94-38d9-4d24-ae4f-e423f26c0f9f None None] MFA Rules not processed for user `e76d47a5c7184fff9d133e9543aab19c`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:48:59.974823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-858bfb94-38d9-4d24-ae4f-e423f26c0f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:00.058409 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3933/7872] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:00.062767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:00.201790 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:00.212603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cdd6f-b4d4-4b57-a862-50836ddb5f04 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:00.224896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:00.225541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:00.225822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:00.226116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:00.226761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:00.228674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:00.496970 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3940/7873] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:00 2022] POST /identity/v3/projects => generated 383 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:00.501513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bfb94-38d9-4d24-ae4f-e423f26c0f9f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:00.522615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bfb94-38d9-4d24-ae4f-e423f26c0f9f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:00.625225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:00.625870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:00.626322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:00.627119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:00.627390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:00.629405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:00.661490 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:00.795155 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3934/7874] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:00 2022] POST /identity/v3/users => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:00.803144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:00.879921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5b205-ad84-4b77-8b93-60159be177a6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:00.886381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:00.887051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:00.887342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:00.887653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:00.888359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:00.890054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:00.903325 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3941/7875] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:00.907741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:00.923062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf974a-47cd-47bf-a2e8-9932a05b655f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:00.942728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:00.943909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:00.944198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:00.944477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] PATH_INFO: `/v3/projects/c1bfd6b64fb4427aaafe9ed22b483540/users/ce7ff22e73414ed1b77c4a01793199ed/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:01.002958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1bfd6b64fb4427aaafe9ed22b483540, user_id=ce7ff22e73414ed1b77c4a01793199ed, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:01.007688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:01.108702 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3935/7876] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:00 2022] PUT /identity/v3/projects/c1bfd6b64fb4427aaafe9ed22b483540/users/ce7ff22e73414ed1b77c4a01793199ed/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:01.110782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:01.136501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23142ef-1d6b-4dd0-9427-cc3da0f92159 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:01.240527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9586ca-9be1-42c3-a304-9f091af8a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:01.241269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9586ca-9be1-42c3-a304-9f091af8a3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:01.242198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9586ca-9be1-42c3-a304-9f091af8a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:01.242198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9586ca-9be1-42c3-a304-9f091af8a3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:01.242927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9586ca-9be1-42c3-a304-9f091af8a3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:01.244746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9586ca-9be1-42c3-a304-9f091af8a3e9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:01.260720 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3942/7877] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:01.261262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:01.273161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5198e4-e2a2-435b-848c-928994c47113 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:01.279421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:01.281052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:01.281764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:01.282628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] PATH_INFO: `/v3/projects/c1bfd6b64fb4427aaafe9ed22b483540/users/ce7ff22e73414ed1b77c4a01793199ed/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:01.285413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1bfd6b64fb4427aaafe9ed22b483540, user_id=ce7ff22e73414ed1b77c4a01793199ed, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:01.288601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:01.315527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253f4d-a20f-43fb-a5c9-be3017947388 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:01.315964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253f4d-a20f-43fb-a5c9-be3017947388 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:01.316309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253f4d-a20f-43fb-a5c9-be3017947388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:01.319184 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3936/7878] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:01 2022] PUT /identity/v3/projects/c1bfd6b64fb4427aaafe9ed22b483540/users/ce7ff22e73414ed1b77c4a01793199ed/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:01.351596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-87253f4d-a20f-43fb-a5c9-be3017947388 None None] MFA Rules not processed for user `ce7ff22e73414ed1b77c4a01793199ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:01.352990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-87253f4d-a20f-43fb-a5c9-be3017947388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:01.429567 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:01.471388 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3943/7879] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:01.478072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:01.490848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:01.593867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310376-fe6b-4131-a626-251ae01699ce admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:01.601067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:01.602359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:01.602359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:01.602558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:01.618124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:01.619628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:01.652594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3937/7880] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:01.776102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253f4d-a20f-43fb-a5c9-be3017947388 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:01.794128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253f4d-a20f-43fb-a5c9-be3017947388 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:01.799161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:01.800122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:01.800475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:01.801083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:01.888066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:01.889574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:01.908652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd8ae-e02c-4b13-8715-9c85a30c4eaa service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:01.925886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:01.931663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:01.931663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:01.931663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:01.931663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:01.939345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:01.941233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:01.971449 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3944/7881] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:02.064150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:02.065592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:02.090505 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3938/7882] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:49:02.621030 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:05.642866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:05.642866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:05.642866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a4f9-6a93-4801-9e76-7ccc17865638 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:05.644577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:05.644577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:05.644577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:05.644577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] PATH_INFO: `/v3/users/0bf11d0c91794c2e9ce6fd1f15a7b0ca` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:05.645932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf11d0c91794c2e9ce6fd1f15a7b0ca)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:05.645932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:05.962830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf11d0c91794c2e9ce6fd1f15a7b0ca'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:05.994105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf11d0c91794c2e9ce6fd1f15a7b0ca'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:05.998569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf11d0c91794c2e9ce6fd1f15a7b0ca'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:06.049004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:06.050557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:06.058743 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:06.088790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf11d0c91794c2e9ce6fd1f15a7b0ca'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:06.089561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-344ef9ee-8977-4e87-9eb6-32d2ec5d264b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf11d0c91794c2e9ce6fd1f15a7b0ca'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:06.099854 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:06.115038 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3945/7883] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:05 2022] DELETE /identity/v3/users/0bf11d0c91794c2e9ce6fd1f15a7b0ca => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:06.122725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:06.123009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:06.123317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:06.140960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5193-4cfa-4589-ae98-f8ef188258aa service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:06.197369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:06.205220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:06.262709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:06.267004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:06.267004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:06.267004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:06.267994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:06.352023 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3946/7884] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:06.361357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:06.363440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:06.391491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dd9df-5647-438d-969c-dac9f615d35b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:06.404735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:06.406398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:06.410556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:06.411189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:06.411466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:06.411735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:06.421949 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3939/7885] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:49:06.422271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:06.423770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:06.436304 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3947/7886] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:49:06.743772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:06.745598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:06.769950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b428cc-a1bd-4537-b584-6b67444328ea service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:06.780754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:06.781430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:06.781720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:06.782021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] PATH_INFO: `/v3/projects/f2e76602ef7a4a3c9f8accdfd670c781` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:06.785618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e76602ef7a4a3c9f8accdfd670c781)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:06.791455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:06.949252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e76602ef7a4a3c9f8accdfd670c781', 'request_id': 'req-ed90d5c3-f7a3-4857-b5bd-152853901765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:06.975920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e76602ef7a4a3c9f8accdfd670c781', 'request_id': 'req-ed90d5c3-f7a3-4857-b5bd-152853901765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.056737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e76602ef7a4a3c9f8accdfd670c781', 'request_id': 'req-ed90d5c3-f7a3-4857-b5bd-152853901765'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.059483 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:07.078541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] The token cache is being invalidate because project f2e76602ef7a4a3c9f8accdfd670c781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:07.078840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.080707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.086569 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3940/7887] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:06 2022] DELETE /identity/v3/projects/f2e76602ef7a4a3c9f8accdfd670c781 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:07.087245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:07.098704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc9e24-b3d9-479d-b4ff-259f744cc8ef service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:07.192654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:07.193633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:07.194196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:07.194668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] PATH_INFO: `/v3/users/686b56d0ef2646188c4a1b86bc952f1f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:07.196334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] RBAC: Authorizing `identity:delete_user(user_id=686b56d0ef2646188c4a1b86bc952f1f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:07.199102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:07.469583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686b56d0ef2646188c4a1b86bc952f1f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.499529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686b56d0ef2646188c4a1b86bc952f1f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.501442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686b56d0ef2646188c4a1b86bc952f1f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.585069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686b56d0ef2646188c4a1b86bc952f1f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.585724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686b56d0ef2646188c4a1b86bc952f1f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:07.608585 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:07.634997 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3948/7888] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:07 2022] DELETE /identity/v3/users/686b56d0ef2646188c4a1b86bc952f1f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:08.485188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:08.488048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:08.519444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90d5c3-f7a3-4857-b5bd-152853901765 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:08.689292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:08.690334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:08.691519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:08.691924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] PATH_INFO: `/v3/projects/3b2ec04630314a4b80ac94e106a28876` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:08.694070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2ec04630314a4b80ac94e106a28876)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:08.696408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:08.902158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2ec04630314a4b80ac94e106a28876', 'request_id': 'req-1b779d38-af31-4208-9c24-943785705979'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:08.910634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2ec04630314a4b80ac94e106a28876', 'request_id': 'req-1b779d38-af31-4208-9c24-943785705979'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.010331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2ec04630314a4b80ac94e106a28876', 'request_id': 'req-1b779d38-af31-4208-9c24-943785705979'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.026999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] The token cache is being invalidate because project 3b2ec04630314a4b80ac94e106a28876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:09.027446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.028260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.032809 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3941/7889] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:08 2022] DELETE /identity/v3/projects/3b2ec04630314a4b80ac94e106a28876 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:09.034774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:09.036304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:09.051790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2eb39-92d2-4ab1-ac1c-b1f05ccf618e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:09.132298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:09.133809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:09.174430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:09.177082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:09.177082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:09.177082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] PATH_INFO: `/v3/users/2923021808c24680a74188720ae715a9` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:09.178668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2923021808c24680a74188720ae715a9)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:09.180703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:09.304418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b779d38-af31-4208-9c24-943785705979 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:09.319400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:09.319797 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:09.320088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:09.320370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] PATH_INFO: `/v3/users/e76d47a5c7184fff9d133e9543aab19c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:09.321633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76d47a5c7184fff9d133e9543aab19c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:09.323592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:09.429940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2923021808c24680a74188720ae715a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.436209 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:09.449035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2923021808c24680a74188720ae715a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.450906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2923021808c24680a74188720ae715a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.556018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76d47a5c7184fff9d133e9543aab19c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.568092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76d47a5c7184fff9d133e9543aab19c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.575154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76d47a5c7184fff9d133e9543aab19c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.595503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2923021808c24680a74188720ae715a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.599006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1df98d56-89ab-4bd9-ac25-3831c8388c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2923021808c24680a74188720ae715a9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.643450 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3949/7890] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:09 2022] DELETE /identity/v3/users/2923021808c24680a74188720ae715a9 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:09.692363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76d47a5c7184fff9d133e9543aab19c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.696639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76d47a5c7184fff9d133e9543aab19c'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:09.780024 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3942/7891] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:09 2022] DELETE /identity/v3/users/e76d47a5c7184fff9d133e9543aab19c => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:09.781405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:09.781743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:09.782104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:09.839029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:09.846244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:09.974762 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3950/7892] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:49:09.987474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:09.989560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:10.280382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d856-66e1-4d73-9c13-3ba85d620148 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:10.290048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58311c01-167e-471a-829b-8fdf6dd3418f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:10.290694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311c01-167e-471a-829b-8fdf6dd3418f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:10.290969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311c01-167e-471a-829b-8fdf6dd3418f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:10.291239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311c01-167e-471a-829b-8fdf6dd3418f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:10.327320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58311c01-167e-471a-829b-8fdf6dd3418f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:10.327320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58311c01-167e-471a-829b-8fdf6dd3418f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:10.369739 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3943/7893] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:10.576389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:10.582141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:10.624606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f860125-5c18-4e7b-95d3-da73d420f5af None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:10.649223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:10.649901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:10.650212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:10.650482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] PATH_INFO: `/v3/projects/5c5f49ecb70e40a2927d276efa8203e5` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:10.660815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5f49ecb70e40a2927d276efa8203e5)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:10.680922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:10.713062 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:10.900795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5f49ecb70e40a2927d276efa8203e5', 'request_id': 'req-58cbd624-5065-4fe9-a811-79801d7a553b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:10.913063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5f49ecb70e40a2927d276efa8203e5', 'request_id': 'req-58cbd624-5065-4fe9-a811-79801d7a553b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.012100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5f49ecb70e40a2927d276efa8203e5', 'request_id': 'req-58cbd624-5065-4fe9-a811-79801d7a553b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.033670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] The token cache is being invalidate because project 5c5f49ecb70e40a2927d276efa8203e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:11.033958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.040257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-58cbd624-5065-4fe9-a811-79801d7a553b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.048195 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3951/7894] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:10 2022] DELETE /identity/v3/projects/5c5f49ecb70e40a2927d276efa8203e5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:11.053569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d0f2-4d31-45bf-8918-0a808fb8546b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:11.054518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d0f2-4d31-45bf-8918-0a808fb8546b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:11.055015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d0f2-4d31-45bf-8918-0a808fb8546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:11.199672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9b67d0f2-4d31-45bf-8918-0a808fb8546b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:11.201634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9b67d0f2-4d31-45bf-8918-0a808fb8546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:11.345177 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3944/7895] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:11.354888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:11.355172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:11.355448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:11.391203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:11.392443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:11.414269 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3952/7896] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:11.418421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d0f2-4d31-45bf-8918-0a808fb8546b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:11.429595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:11.431034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:11.431305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d0f2-4d31-45bf-8918-0a808fb8546b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:11.446600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:11.447394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:11.447978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:11.448119 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:11.448938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:11.449279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:11.455356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:11.460013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e60bd-5a90-4f41-83a6-429801fb7337 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:11.479075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:11.479743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:11.480015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:11.480291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] PATH_INFO: `/v3/projects/d3bd0752e6594c34b24f2341a5dd04df` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:11.488806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bd0752e6594c34b24f2341a5dd04df)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:11.488806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:11.492127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3945/7897] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:49:11.497256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:11.527631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8022-882f-4c8c-9b1b-49f0f400f3ec admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:11.533748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:11.534745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:11.535458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:11.535958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:11.536818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:11.541608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:11.559337 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:11.658445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3946/7898] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:11 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:11.663367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:11.689379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bd0752e6594c34b24f2341a5dd04df', 'request_id': 'req-950c9a85-346a-4c36-8c75-2c50dab8cc78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.722906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bd0752e6594c34b24f2341a5dd04df', 'request_id': 'req-950c9a85-346a-4c36-8c75-2c50dab8cc78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.798047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bd0752e6594c34b24f2341a5dd04df', 'request_id': 'req-950c9a85-346a-4c36-8c75-2c50dab8cc78'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.815768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] The token cache is being invalidate because project d3bd0752e6594c34b24f2341a5dd04df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:11.816059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.818121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fdc9e-8518-4346-bdf5-bd5d1984b395 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:11.819835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:11.822061 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3953/7899] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:11 2022] DELETE /identity/v3/projects/d3bd0752e6594c34b24f2341a5dd04df => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:11.827169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:11.829488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:11.831101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:11.850670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:11.851109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:11.852034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:11.853640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:11.859966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:11.988958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c9a85-346a-4c36-8c75-2c50dab8cc78 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:12.008296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:12.009227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:12.009471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:12.009590 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3947/7900] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:11 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:12.009867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] PATH_INFO: `/v3/users/ce7ff22e73414ed1b77c4a01793199ed` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:12.012290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7ff22e73414ed1b77c4a01793199ed)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:12.013844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:12.015628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:12.017015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:12.039546 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:12.043832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12b288-23c1-4c59-898c-0df212aba324 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:12.058910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:12.061679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:12.061679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:12.061679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:12.061679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:12.067908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:12.086452 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3948/7901] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:49:12.087404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:12.099319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661148aa-3a84-402a-a395-6c0a7fc9df75 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:12.109649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:12.110310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:12.110590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:12.113506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:12.113506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:12.113506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:12.134268 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3949/7902] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:12.135472 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:12.148957 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9dabd-dce4-4bb2-bdce-31f150ff0409 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:12.157035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace2096-a13a-4548-b7c5-ed4f45afbff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:12.157424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace2096-a13a-4548-b7c5-ed4f45afbff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:12.157779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace2096-a13a-4548-b7c5-ed4f45afbff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:12.158541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace2096-a13a-4548-b7c5-ed4f45afbff5 admin admin] PATH_INFO: `/v3/projects/2f738bd1ecb54e61814b20ef0f28902c/users/c04d0dfd92fa43cda7dc42358bf07d60/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:12.225965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace2096-a13a-4548-b7c5-ed4f45afbff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f738bd1ecb54e61814b20ef0f28902c, user_id=c04d0dfd92fa43cda7dc42358bf07d60, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:12.235745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace2096-a13a-4548-b7c5-ed4f45afbff5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:12.252723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7ff22e73414ed1b77c4a01793199ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:12.291512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7ff22e73414ed1b77c4a01793199ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:12.293195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7ff22e73414ed1b77c4a01793199ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:12.346133 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3950/7903] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:12 2022] PUT /identity/v3/projects/2f738bd1ecb54e61814b20ef0f28902c/users/c04d0dfd92fa43cda7dc42358bf07d60/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:12.354847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61500c48-a020-4870-a31c-1d1410be86e4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:12.356031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61500c48-a020-4870-a31c-1d1410be86e4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:12.359168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61500c48-a020-4870-a31c-1d1410be86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:12.406689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7ff22e73414ed1b77c4a01793199ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:12.407512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7ff22e73414ed1b77c4a01793199ed'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:12.412417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-61500c48-a020-4870-a31c-1d1410be86e4 None None] MFA Rules not processed for user `c04d0dfd92fa43cda7dc42358bf07d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:12.414178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-61500c48-a020-4870-a31c-1d1410be86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:12.442495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3954/7904] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:11 2022] DELETE /identity/v3/users/ce7ff22e73414ed1b77c4a01793199ed => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:12.593422 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3951/7905] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:49:12.594454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:12.595914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:12.733367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78556d23-f341-447a-ac0c-c4189ceb4dce admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:12.740154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:12.741201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:12.741604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:12.741882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:12.742600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:12.745398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:12.866192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3955/7906] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:12 2022] POST /identity/v3/projects => generated 367 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:12.870330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61500c48-a020-4870-a31c-1d1410be86e4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:12.914307 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:13.014230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61500c48-a020-4870-a31c-1d1410be86e4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.082817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.083482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.083766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.084042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.084749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.086851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.142933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.144762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:13.171180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43087-f11e-4d78-b569-ea5ef2024bd4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.176113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.177021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.177446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.177715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] PATH_INFO: `/v3/projects/c1bfd6b64fb4427aaafe9ed22b483540` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.179275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1bfd6b64fb4427aaafe9ed22b483540)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.181689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.227673 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3952/7907] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:12 2022] POST /identity/v3/users => generated 290 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:13.233304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.256734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067cc6c-2148-444f-9a2b-b91c78ac97ce admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.263576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.264349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.264746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.265122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.265874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.268212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.293128 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3953/7908] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:13.300400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.313347 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1eb7-09bd-4958-8f55-839c104bfc53 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.319579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.320468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.322494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.322941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] PATH_INFO: `/v3/projects/958539c3c0cd4c2daca12dca0282e52e/users/8d1396dd0f3243f297dff6dfa34fc1a3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.343738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] RBAC: Authorizing `identity:create_grant(project_id=958539c3c0cd4c2daca12dca0282e52e, user_id=8d1396dd0f3243f297dff6dfa34fc1a3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.346421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.350649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1bfd6b64fb4427aaafe9ed22b483540', 'request_id': 'req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:13.357011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1bfd6b64fb4427aaafe9ed22b483540', 'request_id': 'req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:13.436022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1bfd6b64fb4427aaafe9ed22b483540', 'request_id': 'req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:13.452445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3954/7909] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:13 2022] PUT /identity/v3/projects/958539c3c0cd4c2daca12dca0282e52e/users/8d1396dd0f3243f297dff6dfa34fc1a3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:13.453580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.454760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] The token cache is being invalidate because project c1bfd6b64fb4427aaafe9ed22b483540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:13.455307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:13.456603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-498d83ca-6a2f-43c6-8a59-c60d7b8168f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:13.460106 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3956/7910] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:13 2022] DELETE /identity/v3/projects/c1bfd6b64fb4427aaafe9ed22b483540 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:13.471965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf0e9-ea63-4df1-8622-e7dcc5584a23 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.472251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf0e9-ea63-4df1-8622-e7dcc5584a23 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.474193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf0e9-ea63-4df1-8622-e7dcc5584a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.491378 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:13.508583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-808cf0e9-ea63-4df1-8622-e7dcc5584a23 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:13.509897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-808cf0e9-ea63-4df1-8622-e7dcc5584a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:13.582544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d8e9-c52f-4d92-8da4-39f17a2c643c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.594240 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3957/7911] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:13.598475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.600452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1dd31-1f86-4893-8ae4-bbdb730e3cd2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.601207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1dd31-1f86-4893-8ae4-bbdb730e3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.601504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1dd31-1f86-4893-8ae4-bbdb730e3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.602395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.607932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.607932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.607932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.607932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.622046 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3955/7912] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:13.624129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.627546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:13.630334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b9b1dd31-1f86-4893-8ae4-bbdb730e3cd2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:13.633055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9b1dd31-1f86-4893-8ae4-bbdb730e3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:13.641593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98235-35ee-4af9-af79-308bd14ec478 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.645737 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3958/7913] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:13.646515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc0859-50fb-4360-bd15-dfddc8e74dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.646713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1dd31-1f86-4893-8ae4-bbdb730e3cd2 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.647201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc0859-50fb-4360-bd15-dfddc8e74dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.647481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc0859-50fb-4360-bd15-dfddc8e74dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.647759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc0859-50fb-4360-bd15-dfddc8e74dc4 admin admin] PATH_INFO: `/v3/projects/958539c3c0cd4c2daca12dca0282e52e/users/8d1396dd0f3243f297dff6dfa34fc1a3/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.649742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc0859-50fb-4360-bd15-dfddc8e74dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958539c3c0cd4c2daca12dca0282e52e, user_id=8d1396dd0f3243f297dff6dfa34fc1a3, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.662408 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1dd31-1f86-4893-8ae4-bbdb730e3cd2 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.666732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc0859-50fb-4360-bd15-dfddc8e74dc4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.668529 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.670332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.670728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.671245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.672526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:13.673215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.675866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.692760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3956/7914] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:13 2022] PUT /identity/v3/projects/958539c3c0cd4c2daca12dca0282e52e/users/8d1396dd0f3243f297dff6dfa34fc1a3/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:13.703749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.704039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.704315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.707784 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3959/7915] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:49:13.722517 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:13.732490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.744349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] MFA Rules not processed for user `8d1396dd0f3243f297dff6dfa34fc1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:13.746696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:13.752675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0866-45d2-4260-a6ce-c6d444fde808 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.834181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.834838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.835338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.835622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.839060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.843814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:13.854204 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3957/7916] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:13.862915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.864432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:13.962641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bb230-3142-4e12-8b07-1030bc7377c8 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:13.967848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:13.969319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:13.969319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:13.969319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:13.977538 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3960/7917] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:13 2022] POST /identity/v3/projects => generated 389 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:13.981675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:13.983884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:13.985330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:14.010558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3958/7918] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:49:14.071616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779fb81-b944-4135-bd12-61623b7542b0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:14.081391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:14.082222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.082543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.082962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.083601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:14.086172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:14.180405 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3961/7919] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:13 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:14.184457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:14.196144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a4914-5773-411e-92df-be39b857f6eb service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:14.201710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:14.203842 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.204155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.204429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.205173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:14.206875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:14.221571 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3959/7920] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:14.222133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:14.242747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76771f8e-ea21-4d42-96d4-742ee66667a2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:14.261757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1ed5a-a4dd-4c0a-adac-1c710d2d4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:14.262422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ed5a-a4dd-4c0a-adac-1c710d2d4828 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.265943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ed5a-a4dd-4c0a-adac-1c710d2d4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.265943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ed5a-a4dd-4c0a-adac-1c710d2d4828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.265943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1ed5a-a4dd-4c0a-adac-1c710d2d4828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:14.265943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1ed5a-a4dd-4c0a-adac-1c710d2d4828 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:14.280907 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3962/7921] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:14.282120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:14.293449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a47c-9374-4cbf-ae3e-fa81dd78c3e5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:14.299178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:14.299947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.300294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.300636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] PATH_INFO: `/v3/projects/4d36f60a80bb4500ba2d635dad955794/users/c9b2fb652e83421ca8d42537c99d0867/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.318567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d36f60a80bb4500ba2d635dad955794, user_id=c9b2fb652e83421ca8d42537c99d0867, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:14.321673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:14.403321 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3960/7922] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:14 2022] PUT /identity/v3/projects/4d36f60a80bb4500ba2d635dad955794/users/c9b2fb652e83421ca8d42537c99d0867/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:14.414611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dcbc-ab92-427d-8a06-45fd5b5cc211 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.415131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dcbc-ab92-427d-8a06-45fd5b5cc211 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.415563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dcbc-ab92-427d-8a06-45fd5b5cc211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.459311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5cd5dcbc-ab92-427d-8a06-45fd5b5cc211 None None] MFA Rules not processed for user `c9b2fb652e83421ca8d42537c99d0867`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:14.462240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5cd5dcbc-ab92-427d-8a06-45fd5b5cc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:14.552390 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3963/7923] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:14.557282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:14.647039 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:14.654937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c063fa8-f530-4704-87fc-d3c9dcb800ba admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:14.667577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:14.669812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.670362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.670621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.671479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:14.673374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:14.768884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7015eeb-a193-45ea-ac84-6032990e03f8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.770340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7015eeb-a193-45ea-ac84-6032990e03f8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.770860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7015eeb-a193-45ea-ac84-6032990e03f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.808707 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3961/7924] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:14 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:14.812877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:14.817076 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:14.824860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b7015eeb-a193-45ea-ac84-6032990e03f8 None None] MFA Rules not processed for user `38c7799d37d747b08a9e20e15c3d6879`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:14.826480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b7015eeb-a193-45ea-ac84-6032990e03f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:14.944104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc9451-54e7-4e85-b18a-c8d6cee89cd6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:14.955426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:14.956118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:14.956657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:14.956949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:14.957740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:14.962152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:14.972482 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3964/7925] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:15.078269 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3962/7926] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:14 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:49:15.082301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7015eeb-a193-45ea-ac84-6032990e03f8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:15.094071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7015eeb-a193-45ea-ac84-6032990e03f8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:15.098870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:15.100120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:15.100120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:15.100339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:15.101159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:15.102851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:15.122482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:15.130733 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3965/7927] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:15.136162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cef39e-daee-48ef-a1c1-9379d46b6ca1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:15.144918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:15.150925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:15.150925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:15.150925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] PATH_INFO: `/v3/projects/db30b7448cbe45b5af4bb5821512dba7/users/4a48521513be4df9986bfcc78214423e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:15.189161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db30b7448cbe45b5af4bb5821512dba7, user_id=4a48521513be4df9986bfcc78214423e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:15.193901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:15.336137 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3963/7928] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:15 2022] PUT /identity/v3/projects/db30b7448cbe45b5af4bb5821512dba7/users/4a48521513be4df9986bfcc78214423e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:15.342140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:15.360381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e628994-4ccb-4ebf-bbe2-d0461d88518f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:15.450841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11124186-df9b-4cd8-9894-cb6d2731e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:15.451550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11124186-df9b-4cd8-9894-cb6d2731e0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:15.451986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11124186-df9b-4cd8-9894-cb6d2731e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:15.452266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11124186-df9b-4cd8-9894-cb6d2731e0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:15.452968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11124186-df9b-4cd8-9894-cb6d2731e0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:15.460095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11124186-df9b-4cd8-9894-cb6d2731e0e8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:15.477340 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3966/7929] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:15.481420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:15.501176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4955-57fd-4269-ab2a-a99631564648 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:15.512566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:15.519496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:15.519875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:15.520155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] PATH_INFO: `/v3/projects/db30b7448cbe45b5af4bb5821512dba7/users/4a48521513be4df9986bfcc78214423e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:15.534360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db30b7448cbe45b5af4bb5821512dba7, user_id=4a48521513be4df9986bfcc78214423e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:15.540684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:15.561385 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3964/7930] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:15 2022] PUT /identity/v3/projects/db30b7448cbe45b5af4bb5821512dba7/users/4a48521513be4df9986bfcc78214423e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:15.572990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489dfa-5850-44ca-af2e-47d2ba7dff9f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:15.579430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489dfa-5850-44ca-af2e-47d2ba7dff9f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:15.579430 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489dfa-5850-44ca-af2e-47d2ba7dff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:15.626040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0b489dfa-5850-44ca-af2e-47d2ba7dff9f None None] MFA Rules not processed for user `4a48521513be4df9986bfcc78214423e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:15.627378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0b489dfa-5850-44ca-af2e-47d2ba7dff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:15.760368 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3967/7931] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:15.772352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:15.774580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:15.796212 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:15.859924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64193d-afa4-4522-be3b-7915d7a2b4f7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:15.864197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181ef6d-712a-4ab9-9db6-abec07899bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:15.864984 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ef6d-712a-4ab9-9db6-abec07899bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:15.865427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ef6d-712a-4ab9-9db6-abec07899bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:15.865747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ef6d-712a-4ab9-9db6-abec07899bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:15.877234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ef6d-712a-4ab9-9db6-abec07899bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:15.878751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ef6d-712a-4ab9-9db6-abec07899bc4 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:15.893347 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3965/7932] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:16.102607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b489dfa-5850-44ca-af2e-47d2ba7dff9f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:16.190159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b489dfa-5850-44ca-af2e-47d2ba7dff9f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:16.195260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:16.196004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:16.196386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:16.196783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] PATH_INFO: `/v3/users/c9b2fb652e83421ca8d42537c99d0867` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:16.197965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b2fb652e83421ca8d42537c99d0867)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:16.199969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:16.495247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b2fb652e83421ca8d42537c99d0867'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:16.505154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b2fb652e83421ca8d42537c99d0867'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:16.505950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b2fb652e83421ca8d42537c99d0867'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:16.584382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b2fb652e83421ca8d42537c99d0867'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:16.585035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b2fb652e83421ca8d42537c99d0867'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:16.605403 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3968/7933] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:16 2022] DELETE /identity/v3/users/c9b2fb652e83421ca8d42537c99d0867 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:16.610943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:16.611601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:16.612012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:16.639458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:16.641507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:16.680454 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:16.711512 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3966/7934] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:49:16.723027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:16.724516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:16.749002 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:16.803259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb86be-9b84-4030-9b4d-26e51aa6bf21 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:16.807184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:16.807872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:16.808264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:16.808560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:16.819442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:16.820758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:16.832260 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3969/7935] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:17.322159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:17.322159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:17.346042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1747273-b840-4d29-bd71-79134ecb81ae None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:17.353150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:17.354576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:17.354864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:17.355113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] PATH_INFO: `/v3/projects/4d36f60a80bb4500ba2d635dad955794` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:17.357382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d36f60a80bb4500ba2d635dad955794)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:17.360750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:17.510397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d36f60a80bb4500ba2d635dad955794', 'request_id': 'req-ada4d9b9-bac4-40bd-8c8c-9a975d765350'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:17.525558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d36f60a80bb4500ba2d635dad955794', 'request_id': 'req-ada4d9b9-bac4-40bd-8c8c-9a975d765350'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:17.600682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d36f60a80bb4500ba2d635dad955794', 'request_id': 'req-ada4d9b9-bac4-40bd-8c8c-9a975d765350'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:17.613989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] The token cache is being invalidate because project 4d36f60a80bb4500ba2d635dad955794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:17.614576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:17.615004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:17.616882 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3967/7936] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:17 2022] DELETE /identity/v3/projects/4d36f60a80bb4500ba2d635dad955794 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:17.621052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:17.632615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d68ee-82fd-49cd-95ab-16e7c9a8bccc service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:17.706704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:17.707988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:17.708735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:17.709021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] PATH_INFO: `/v3/users/4a48521513be4df9986bfcc78214423e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:17.710602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a48521513be4df9986bfcc78214423e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:17.714378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:17.942321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a48521513be4df9986bfcc78214423e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:17.951704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a48521513be4df9986bfcc78214423e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:17.952509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a48521513be4df9986bfcc78214423e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:18.044308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a48521513be4df9986bfcc78214423e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:18.045032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40b5f120-52de-4cfb-8da8-4059daf44641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a48521513be4df9986bfcc78214423e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:18.074221 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3970/7937] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:17 2022] DELETE /identity/v3/users/4a48521513be4df9986bfcc78214423e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:18.745295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:18.746263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:18.765074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4d9b9-bac4-40bd-8c8c-9a975d765350 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:18.839716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:18.843324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:18.843626 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:18.843908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] PATH_INFO: `/v3/projects/db30b7448cbe45b5af4bb5821512dba7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:18.849682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db30b7448cbe45b5af4bb5821512dba7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:18.852950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:18.981576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db30b7448cbe45b5af4bb5821512dba7', 'request_id': 'req-19c1aef7-d318-4aeb-95dd-64a81d626801'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:18.988913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db30b7448cbe45b5af4bb5821512dba7', 'request_id': 'req-19c1aef7-d318-4aeb-95dd-64a81d626801'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:19.007866 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:19.089801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db30b7448cbe45b5af4bb5821512dba7', 'request_id': 'req-19c1aef7-d318-4aeb-95dd-64a81d626801'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:19.104722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] The token cache is being invalidate because project db30b7448cbe45b5af4bb5821512dba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:19.105242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:19.106073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-19c1aef7-d318-4aeb-95dd-64a81d626801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:19.114838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80adba7-c3d2-4233-a90c-edebdf9a1bac None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.115387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80adba7-c3d2-4233-a90c-edebdf9a1bac None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.115671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80adba7-c3d2-4233-a90c-edebdf9a1bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.119832 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3968/7938] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:18 2022] DELETE /identity/v3/projects/db30b7448cbe45b5af4bb5821512dba7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:19.138143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e80adba7-c3d2-4233-a90c-edebdf9a1bac None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:19.139436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e80adba7-c3d2-4233-a90c-edebdf9a1bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:19.174568 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:19.207957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3971/7939] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:19.216004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9808-c362-49b9-8646-247235e99194 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.216380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9808-c362-49b9-8646-247235e99194 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.216667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9808-c362-49b9-8646-247235e99194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.239795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dc9c9808-c362-49b9-8646-247235e99194 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:19.242409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dc9c9808-c362-49b9-8646-247235e99194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:19.266059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80adba7-c3d2-4233-a90c-edebdf9a1bac None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:19.266273 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3969/7940] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:19.270045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80adba7-c3d2-4233-a90c-edebdf9a1bac None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:19.276680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:19.278530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.279622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.280233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.281158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:19.281766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:19.285056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:19.308539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9808-c362-49b9-8646-247235e99194 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:19.310258 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3972/7941] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:49:19.319715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9808-c362-49b9-8646-247235e99194 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:19.324924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:19.326125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.326125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.326310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.327144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:19.329062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:19.449153 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3970/7942] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:19 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:19.453607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:19.476808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389ad3-f880-468e-9e35-fb1b29c6b3fb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:19.549647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:19.550989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.550989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.550989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.551766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:19.554715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:19.696052 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3973/7943] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:19 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:19.697326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:19.718700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77660a69-84e0-4287-b3c7-f3a38ce58dd0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:19.745154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:19.745154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.745154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.745154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.746018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:19.747943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:19.774396 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3971/7944] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:19.774996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:19.788809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8161e94-6de3-4598-97cf-8567c0211e7b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:19.794952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df6e4a-f22d-4818-8335-2b67548cab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:19.801749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df6e4a-f22d-4818-8335-2b67548cab75 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.802389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df6e4a-f22d-4818-8335-2b67548cab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.802743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df6e4a-f22d-4818-8335-2b67548cab75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.803447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df6e4a-f22d-4818-8335-2b67548cab75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:19.805123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df6e4a-f22d-4818-8335-2b67548cab75 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:19.817346 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3974/7945] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:49:19.821562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:19.836194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29368c5-c4f0-4335-bf0d-66f27482dc27 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:19.845351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:19.846328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.846757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.847206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] PATH_INFO: `/v3/projects/747db77ea2bb4e03acf32aa3fcca654a/users/bfeb4d7b46c74535839dc08caedcef81/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.867431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] RBAC: Authorizing `identity:create_grant(project_id=747db77ea2bb4e03acf32aa3fcca654a, user_id=bfeb4d7b46c74535839dc08caedcef81, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:19.871325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:19.940292 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3972/7946] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:19 2022] PUT /identity/v3/projects/747db77ea2bb4e03acf32aa3fcca654a/users/bfeb4d7b46c74535839dc08caedcef81/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:19.951342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f0b6c-d2c7-4894-8dbf-ddd2dcbf01ad None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:19.951631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f0b6c-d2c7-4894-8dbf-ddd2dcbf01ad None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:19.951907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f0b6c-d2c7-4894-8dbf-ddd2dcbf01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:19.987254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7d4f0b6c-d2c7-4894-8dbf-ddd2dcbf01ad None None] MFA Rules not processed for user `bfeb4d7b46c74535839dc08caedcef81`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:20.002308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7d4f0b6c-d2c7-4894-8dbf-ddd2dcbf01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:20.081845 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3975/7947] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:20.086756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:20.204437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8404c-8d6b-40b7-806e-883f8f33aded admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:20.219868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:20.220728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:20.221213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:20.221641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:20.222489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:20.224820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:20.345082 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3973/7948] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:20 2022] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:20.349438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f0b6c-d2c7-4894-8dbf-ddd2dcbf01ad None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:20.362401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f0b6c-d2c7-4894-8dbf-ddd2dcbf01ad None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:20.392122 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:20.429074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:20.429826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:20.431573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:20.431573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:20.431573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:20.433558 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:20.598398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3976/7949] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:20 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:20.599884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:20.626116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf0509-2758-412b-9431-43f2ae322e56 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:20.638699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:20.639334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:20.639614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:20.639882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:20.644286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:20.650726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:20.671955 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3974/7950] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:20.674020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:20.685932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e644d66-b046-4f8e-ac14-e4d18f3ada01 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:20.691355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:20.692031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:20.692307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:20.692585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] PATH_INFO: `/v3/projects/2e5481195fe64d6e95298d1fb50bc06c/users/55f85dcd6f9e4b688887849126340366/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:20.710030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5481195fe64d6e95298d1fb50bc06c, user_id=55f85dcd6f9e4b688887849126340366, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:20.712990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:20.822317 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3977/7951] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:20 2022] PUT /identity/v3/projects/2e5481195fe64d6e95298d1fb50bc06c/users/55f85dcd6f9e4b688887849126340366/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:20.826640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:20.839340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609017-0b8e-43e8-9904-d96aeaa8835b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:20.922425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49429bf-5bd5-4ee2-ad7b-04f6dc3f6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:20.923540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49429bf-5bd5-4ee2-ad7b-04f6dc3f6fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:20.924139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49429bf-5bd5-4ee2-ad7b-04f6dc3f6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:20.924398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49429bf-5bd5-4ee2-ad7b-04f6dc3f6fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:20.925398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49429bf-5bd5-4ee2-ad7b-04f6dc3f6fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:20.927526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49429bf-5bd5-4ee2-ad7b-04f6dc3f6fdd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:20.930428 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:20.942286 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3975/7952] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:20.944805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:20.957306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f880966-c06f-4c29-bf4b-5f3cd622a433 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:20.962092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:20.963428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:20.963428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:20.963618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] PATH_INFO: `/v3/projects/2e5481195fe64d6e95298d1fb50bc06c/users/55f85dcd6f9e4b688887849126340366/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:20.965670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5481195fe64d6e95298d1fb50bc06c, user_id=55f85dcd6f9e4b688887849126340366, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:20.975823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:20.988021 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3978/7953] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:20 2022] PUT /identity/v3/projects/2e5481195fe64d6e95298d1fb50bc06c/users/55f85dcd6f9e4b688887849126340366/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:21.001407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809eaa-6f68-426d-9b27-2881b154f717 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:21.001770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809eaa-6f68-426d-9b27-2881b154f717 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:21.002179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809eaa-6f68-426d-9b27-2881b154f717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:21.038455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-40809eaa-6f68-426d-9b27-2881b154f717 None None] MFA Rules not processed for user `55f85dcd6f9e4b688887849126340366`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:21.039674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-40809eaa-6f68-426d-9b27-2881b154f717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:21.126410 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3976/7954] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:21.137562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:21.143597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:21.268219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14774160-7811-4ea5-bb68-430a0cdf259a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:21.275175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:21.276075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:21.276578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:21.277215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:21.298831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:21.301619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:21.354231 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3979/7955] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:21.652454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40809eaa-6f68-426d-9b27-2881b154f717 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:21.672834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40809eaa-6f68-426d-9b27-2881b154f717 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:21.683105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:21.684241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:21.684621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:21.685789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:21.772973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:21.774686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:21.805417 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3977/7956] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:24.701752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:24.704692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:24.787965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb3f21-3357-404c-847c-b16bdf2080e4 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:24.793059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1396dd0f3243f297dff6dfa34fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '958539c3c0cd4c2daca12dca0282e52e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:24.793769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:24.794297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:24.795339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:24.796112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:24.796444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:24.798059 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:24.814101 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3980/7957] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:49:24.815596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:24.826836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ca449-75c0-48a0-827d-9b2a8c81c656 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:24.831424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1396dd0f3243f297dff6dfa34fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '958539c3c0cd4c2daca12dca0282e52e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:24.832127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:24.832409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:24.832793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:24.833417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:24.835453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:24.909185 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3978/7958] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:24 2022] POST /identity/v3/projects => generated 348 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:24.910637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:24.922235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e4002-7d02-49aa-943f-54b995ab365f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:24.935599 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:24.979796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1396dd0f3243f297dff6dfa34fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '958539c3c0cd4c2daca12dca0282e52e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:24.980413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:24.980697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:24.980976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:24.981622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:24.981930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:24.983566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:24.995827 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3981/7959] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:49:25.814190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:25.824904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72625-f974-4fbb-abf1-0f6baf87581f tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:25.831949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1396dd0f3243f297dff6dfa34fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '958539c3c0cd4c2daca12dca0282e52e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:25.832576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:25.832856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:25.833124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] PATH_INFO: `/v3/projects/6d202c74dac641348307126244f85dd2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:25.834291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d202c74dac641348307126244f85dd2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:25.836166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:25.963729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d202c74dac641348307126244f85dd2', 'request_id': 'req-a6ff2c57-c9b9-42f0-bf89-e95e68527682'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:25.963729 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:25.965905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d202c74dac641348307126244f85dd2', 'request_id': 'req-a6ff2c57-c9b9-42f0-bf89-e95e68527682'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:26.070756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d202c74dac641348307126244f85dd2', 'request_id': 'req-a6ff2c57-c9b9-42f0-bf89-e95e68527682'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:26.101210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] The token cache is being invalidate because project 6d202c74dac641348307126244f85dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:26.101508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:26.102237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:26.104155 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3979/7960] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:25 2022] DELETE /identity/v3/projects/6d202c74dac641348307126244f85dd2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:49:26.118661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:26.118661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:26.195511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04bf4-6dec-41a0-b934-e13cc6618113 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:26.261890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:26.262842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:26.263325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:26.263884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:26.266034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:26.334988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:26.336461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:26.346692 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3982/7961] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:26.835200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:26.837298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:26.953241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff2c57-c9b9-42f0-bf89-e95e68527682 tempest-RoutersAdminTest-138810764 tempest-RoutersAdminTest-138810764-project-admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:26.958648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:26.959298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:26.959579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:26.959851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] PATH_INFO: `/v3/users/762ae558fed0436793d2f985617ac4d6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:26.960989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=762ae558fed0436793d2f985617ac4d6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:26.963097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:27.186640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762ae558fed0436793d2f985617ac4d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:27.199855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762ae558fed0436793d2f985617ac4d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:27.209201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762ae558fed0436793d2f985617ac4d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:27.321420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762ae558fed0436793d2f985617ac4d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:27.322081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762ae558fed0436793d2f985617ac4d6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:27.352187 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3980/7962] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:26 2022] DELETE /identity/v3/users/762ae558fed0436793d2f985617ac4d6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:27.835289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:27.847808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1bdb6-d896-4ad7-af1b-673bb2a75897 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:27.874598 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:27.931822 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:27.932492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:27.934058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:27.934464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] PATH_INFO: `/v3/projects/ea87c7cf6a8b40ba914da392ab262edc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:27.937082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea87c7cf6a8b40ba914da392ab262edc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:27.953695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:28.109896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea87c7cf6a8b40ba914da392ab262edc', 'request_id': 'req-d4062000-ea1d-4539-9129-51d03fee6629'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.117885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea87c7cf6a8b40ba914da392ab262edc', 'request_id': 'req-d4062000-ea1d-4539-9129-51d03fee6629'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.190259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea87c7cf6a8b40ba914da392ab262edc', 'request_id': 'req-d4062000-ea1d-4539-9129-51d03fee6629'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.203907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] The token cache is being invalidate because project ea87c7cf6a8b40ba914da392ab262edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:28.204121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.204755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.206608 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3983/7963] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:27 2022] DELETE /identity/v3/projects/ea87c7cf6a8b40ba914da392ab262edc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:28.210416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:28.212570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:28.228801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848e4c1-2dd1-4bfc-a12c-f243c0fbbe7d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:28.303350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:28.303350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:28.303350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:28.303350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] PATH_INFO: `/v3/users/1031e4b72a4e49b093ed4219c90d46f8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:28.303766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1031e4b72a4e49b093ed4219c90d46f8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:28.304665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:28.307285 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:28.533412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1031e4b72a4e49b093ed4219c90d46f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.540733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1031e4b72a4e49b093ed4219c90d46f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.541519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1031e4b72a4e49b093ed4219c90d46f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.618494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1031e4b72a4e49b093ed4219c90d46f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.619225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8e4cd427-e108-4fae-a2df-165bfbc4910f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1031e4b72a4e49b093ed4219c90d46f8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:28.642589 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3981/7964] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:28 2022] DELETE /identity/v3/users/1031e4b72a4e49b093ed4219c90d46f8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:28.947840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:28.949540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:28.981120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4062000-ea1d-4539-9129-51d03fee6629 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:29.050142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:29.051082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:29.051530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:29.051953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] PATH_INFO: `/v3/projects/a08791cf8431433ca65c76fd3176b4dc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:29.053486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08791cf8431433ca65c76fd3176b4dc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:29.055570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:29.211544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08791cf8431433ca65c76fd3176b4dc', 'request_id': 'req-97da25c4-1355-4fd6-bf9b-faf68774ba01'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:29.217224 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:29.220664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08791cf8431433ca65c76fd3176b4dc', 'request_id': 'req-97da25c4-1355-4fd6-bf9b-faf68774ba01'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:29.301499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08791cf8431433ca65c76fd3176b4dc', 'request_id': 'req-97da25c4-1355-4fd6-bf9b-faf68774ba01'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:29.317542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] The token cache is being invalidate because project a08791cf8431433ca65c76fd3176b4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:29.317918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:29.318701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-97da25c4-1355-4fd6-bf9b-faf68774ba01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:29.324249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3984/7965] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:28 2022] DELETE /identity/v3/projects/a08791cf8431433ca65c76fd3176b4dc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:29.327088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430813c-ccdc-4226-be7b-de1104ca4a72 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:29.328205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430813c-ccdc-4226-be7b-de1104ca4a72 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:29.328667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430813c-ccdc-4226-be7b-de1104ca4a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:29.352978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5430813c-ccdc-4226-be7b-de1104ca4a72 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:29.354644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5430813c-ccdc-4226-be7b-de1104ca4a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:29.429650 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3982/7966] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:29.438477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07aee4-38a9-4387-83b9-e943ea41a7d3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:29.438968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07aee4-38a9-4387-83b9-e943ea41a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:29.439472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07aee4-38a9-4387-83b9-e943ea41a7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:29.465646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ed07aee4-38a9-4387-83b9-e943ea41a7d3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:29.467703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ed07aee4-38a9-4387-83b9-e943ea41a7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:29.479565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3985/7967] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:49:29.484253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430813c-ccdc-4226-be7b-de1104ca4a72 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:29.496397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430813c-ccdc-4226-be7b-de1104ca4a72 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:29.502268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:29.502907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:29.508026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:29.508026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:29.508026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:29.508026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:29.508026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:29.523117 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3983/7968] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:49:29.529774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07aee4-38a9-4387-83b9-e943ea41a7d3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:29.556420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07aee4-38a9-4387-83b9-e943ea41a7d3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:29.566745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:29.567690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:29.568201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:29.583451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:29.584353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:29.591284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:29.772627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3986/7969] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:29 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:29.776654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:29.790175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1996d5f-293a-49ac-9676-6241710da9a6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:29.881772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:29.882833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:29.883326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:29.883895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:29.884748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:29.887228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:30.014722 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3984/7970] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:29 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:30.015528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:30.034174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7049c-6afc-4692-ad09-0177b3931b59 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:30.048122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:30.052423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:30.053216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:30.053737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:30.055066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:30.059336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:30.080519 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3987/7971] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:30.084327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:30.096226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a893-46b5-43d1-8e36-8fb0499a5388 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:30.101796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41965bc0-16dc-45c4-91d2-8679c13bb30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:30.102476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965bc0-16dc-45c4-91d2-8679c13bb30d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:30.102754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965bc0-16dc-45c4-91d2-8679c13bb30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:30.103024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965bc0-16dc-45c4-91d2-8679c13bb30d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:30.103688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41965bc0-16dc-45c4-91d2-8679c13bb30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:30.105397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41965bc0-16dc-45c4-91d2-8679c13bb30d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:30.117479 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3985/7972] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:30.121589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:30.131839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac880ca7-1eda-4c31-9720-3b3a637fe6b6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:30.136986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:30.137933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:30.138250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:30.139174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] PATH_INFO: `/v3/projects/b1ec0b5ecaa741eaaf40a50f1415e7f9/users/f2967d0d8c134d269c9bbe51c90f803a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:30.153486 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:30.156373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ec0b5ecaa741eaaf40a50f1415e7f9, user_id=f2967d0d8c134d269c9bbe51c90f803a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:30.159387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:30.264156 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3988/7973] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:30 2022] PUT /identity/v3/projects/b1ec0b5ecaa741eaaf40a50f1415e7f9/users/f2967d0d8c134d269c9bbe51c90f803a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:30.269141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:30.269729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:30.270174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:30.302029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:30.302029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:30.388536 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3986/7974] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:49:30.394923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:30.396930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:30.460077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee36e56-1f6e-47db-869b-7ad91fc40857 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:30.464050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf1114-78e2-4672-8c4f-1d12db9a9803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:30.464663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1114-78e2-4672-8c4f-1d12db9a9803 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:30.464940 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1114-78e2-4672-8c4f-1d12db9a9803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:30.465213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1114-78e2-4672-8c4f-1d12db9a9803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:30.480075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf1114-78e2-4672-8c4f-1d12db9a9803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:30.481539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf1114-78e2-4672-8c4f-1d12db9a9803 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:30.496869 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3989/7975] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:32.449044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:32.450523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:32.472083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf95ab-9a0f-4bfa-8c66-8f6e127b8d47 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:32.483197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:32.484330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:32.484800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:32.485261 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] PATH_INFO: `/v3/users/bfeb4d7b46c74535839dc08caedcef81` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:32.486651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfeb4d7b46c74535839dc08caedcef81)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:32.488772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:32.797380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfeb4d7b46c74535839dc08caedcef81'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:32.821810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfeb4d7b46c74535839dc08caedcef81'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:32.823029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfeb4d7b46c74535839dc08caedcef81'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:32.925923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfeb4d7b46c74535839dc08caedcef81'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:32.926835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfeb4d7b46c74535839dc08caedcef81'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:32.966170 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3987/7976] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:32 2022] DELETE /identity/v3/users/bfeb4d7b46c74535839dc08caedcef81 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:32.971532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:32.972065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:32.972065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:33.016001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:33.016001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:33.118810 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3990/7977] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:33.169090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:33.171550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:33.257061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b04001-23d5-4737-9d92-a060921a95af admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:33.259489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:33.260315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:33.260798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:33.261220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:33.276741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:33.278878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:33.315297 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3988/7978] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:34.385026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:34.387051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:34.421080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c0c8-a793-42f1-8039-213328f73e78 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:34.433582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:34.434542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:34.434977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:34.436131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] PATH_INFO: `/v3/projects/747db77ea2bb4e03acf32aa3fcca654a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:34.437550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] RBAC: Authorizing `identity:delete_project(project_id=747db77ea2bb4e03acf32aa3fcca654a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:34.439690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:34.477156 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:34.614325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747db77ea2bb4e03acf32aa3fcca654a', 'request_id': 'req-a79baee8-99cf-486b-b668-283c01ac267c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:34.635712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747db77ea2bb4e03acf32aa3fcca654a', 'request_id': 'req-a79baee8-99cf-486b-b668-283c01ac267c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:34.722269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747db77ea2bb4e03acf32aa3fcca654a', 'request_id': 'req-a79baee8-99cf-486b-b668-283c01ac267c'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:34.741501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] The token cache is being invalidate because project 747db77ea2bb4e03acf32aa3fcca654a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:34.741857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:34.742567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:34.756949 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3991/7979] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:34 2022] DELETE /identity/v3/projects/747db77ea2bb4e03acf32aa3fcca654a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:34.762362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:34.778631 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:34.791992 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d74368-713e-45f1-99b4-524475147fba service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:34.890717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:34.891655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:34.891655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:34.891870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] PATH_INFO: `/v3/users/55f85dcd6f9e4b688887849126340366` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:34.894659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f85dcd6f9e4b688887849126340366)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:34.898760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:35.163030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f85dcd6f9e4b688887849126340366'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:35.175307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f85dcd6f9e4b688887849126340366'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:35.184134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f85dcd6f9e4b688887849126340366'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:35.270216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f85dcd6f9e4b688887849126340366'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:35.297560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c87b2563-2541-49ea-9958-10f2c6de5d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f85dcd6f9e4b688887849126340366'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:35.381813 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3989/7980] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:34 2022] DELETE /identity/v3/users/55f85dcd6f9e4b688887849126340366 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:36.682943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:36.686716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:36.724709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79baee8-99cf-486b-b668-283c01ac267c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:36.850748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:36.850748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:36.850748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:36.850748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] PATH_INFO: `/v3/projects/2e5481195fe64d6e95298d1fb50bc06c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:36.851532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5481195fe64d6e95298d1fb50bc06c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:36.852767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:37.098540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5481195fe64d6e95298d1fb50bc06c', 'request_id': 'req-ae47e7be-9789-4580-8fc0-a5e065e8f80f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:37.131793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5481195fe64d6e95298d1fb50bc06c', 'request_id': 'req-ae47e7be-9789-4580-8fc0-a5e065e8f80f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:37.230499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5481195fe64d6e95298d1fb50bc06c', 'request_id': 'req-ae47e7be-9789-4580-8fc0-a5e065e8f80f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:37.249664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] The token cache is being invalidate because project 2e5481195fe64d6e95298d1fb50bc06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:37.250074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:37.253404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae47e7be-9789-4580-8fc0-a5e065e8f80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:37.258213 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3992/7981] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:36 2022] DELETE /identity/v3/projects/2e5481195fe64d6e95298d1fb50bc06c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:37.263038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0be65-d1e9-453d-9332-f188bb2ef20f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:37.264545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0be65-d1e9-453d-9332-f188bb2ef20f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:37.265023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0be65-d1e9-453d-9332-f188bb2ef20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:37.293938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-34d0be65-d1e9-453d-9332-f188bb2ef20f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:37.295250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-34d0be65-d1e9-453d-9332-f188bb2ef20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:37.395306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3990/7982] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:37.402805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6c771-44be-497b-8578-e33ea23eaf02 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:37.403294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6c771-44be-497b-8578-e33ea23eaf02 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:37.403728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6c771-44be-497b-8578-e33ea23eaf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:37.442105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dba6c771-44be-497b-8578-e33ea23eaf02 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:37.448498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dba6c771-44be-497b-8578-e33ea23eaf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:37.464475 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3993/7983] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:37.468663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0be65-d1e9-453d-9332-f188bb2ef20f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:37.483417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0be65-d1e9-453d-9332-f188bb2ef20f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:37.489727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:37.490523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:37.490943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:37.491414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:37.492440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:37.492849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:37.494790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:37.514151 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3991/7984] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:49:37.526666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6c771-44be-497b-8578-e33ea23eaf02 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:37.537757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6c771-44be-497b-8578-e33ea23eaf02 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:37.544670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:37.545334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:37.545621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:37.546686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:37.547494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:37.549757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:37.666935 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3994/7985] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:37 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:37.669082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:37.684362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9198c47-7836-44fb-8e26-3dbef330d6b8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:37.701680 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:37.831745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:37.833517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:37.833517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:37.833517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:37.833812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:37.835518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:37.978798 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3992/7986] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:37 2022] POST /identity/v3/users => generated 291 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:49:37.982950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:38.002439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160831e-7d55-4577-bad6-db02212dcd79 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:38.023322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:38.024267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:38.024718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:38.025160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:38.025999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:38.027798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:38.040781 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:38.074625 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3995/7987] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:38.079437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:38.098520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15327543-57b9-4f5f-9179-0904cdd07005 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:38.113432 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588548f-a4ab-4e19-9fa6-867890ec3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:38.114551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588548f-a4ab-4e19-9fa6-867890ec3cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:38.115062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588548f-a4ab-4e19-9fa6-867890ec3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:38.115577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588548f-a4ab-4e19-9fa6-867890ec3cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:38.117104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588548f-a4ab-4e19-9fa6-867890ec3cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:38.119910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588548f-a4ab-4e19-9fa6-867890ec3cb7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:38.148727 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3993/7988] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:38.153158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:38.165398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703e4a-023e-4a08-81a2-ae2747132855 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:38.171139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:38.172029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:38.172489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:38.172935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] PATH_INFO: `/v3/projects/dcb6422802df4ee1be8937913851c81c/users/42af0ae74406473382bde49946abbe89/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:38.196663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb6422802df4ee1be8937913851c81c, user_id=42af0ae74406473382bde49946abbe89, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:38.204417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:38.312734 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3996/7989] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:38 2022] PUT /identity/v3/projects/dcb6422802df4ee1be8937913851c81c/users/42af0ae74406473382bde49946abbe89/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:38.322874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e32e4-f898-470e-91d1-7c0afea49cd0 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:38.323394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e32e4-f898-470e-91d1-7c0afea49cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:38.323850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e32e4-f898-470e-91d1-7c0afea49cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:38.385423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-925e32e4-f898-470e-91d1-7c0afea49cd0 None None] MFA Rules not processed for user `42af0ae74406473382bde49946abbe89`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:38.390133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-925e32e4-f898-470e-91d1-7c0afea49cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:38.557723 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3994/7990] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:38.562244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:38.681943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef04846-eb74-448e-b6af-2d74d0447538 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:38.691024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:38.691663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:38.692172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:38.692452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:38.693269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:38.699501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:38.810663 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3997/7991] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:38 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:38.814603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e32e4-f898-470e-91d1-7c0afea49cd0 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:38.841481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e32e4-f898-470e-91d1-7c0afea49cd0 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:38.981469 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:38.982177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:38.983818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:38.984103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:38.984967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:38.992693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:39.102353 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3995/7992] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:38 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:39.106539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:39.122831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60d1df-ef32-429c-9690-2d4f4df46711 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:39.134394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:39.134970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:39.135250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:39.135526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:39.136179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:39.138036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:39.152305 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3998/7993] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:39.156095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:39.169176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1209-4751-450d-9eec-74412059b972 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:39.179012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:39.180032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:39.180318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:39.180760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] PATH_INFO: `/v3/projects/d21c3b1d42b44730892c28fc0b6e2a41/users/4db346bf608d444396fd0b9dbe6bae94/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:39.186769 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:39.219025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21c3b1d42b44730892c28fc0b6e2a41, user_id=4db346bf608d444396fd0b9dbe6bae94, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:39.223134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:39.327468 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3996/7994] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:39 2022] PUT /identity/v3/projects/d21c3b1d42b44730892c28fc0b6e2a41/users/4db346bf608d444396fd0b9dbe6bae94/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:39.328104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:39.340665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf5a33-6d21-4eb3-bbcb-0f78ab65146f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:39.431407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48244bbc-9cd5-434c-a026-312d2a929527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:39.432445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48244bbc-9cd5-434c-a026-312d2a929527 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:39.433088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48244bbc-9cd5-434c-a026-312d2a929527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:39.433626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48244bbc-9cd5-434c-a026-312d2a929527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:39.434656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48244bbc-9cd5-434c-a026-312d2a929527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:39.437698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48244bbc-9cd5-434c-a026-312d2a929527 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:39.456477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:39.476074 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 3999/7995] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:49:39.480048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d5205-5e0d-4196-83f6-a65640cf1c87 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:39.495429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:39.497001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:39.497592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:39.498750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] PATH_INFO: `/v3/projects/d21c3b1d42b44730892c28fc0b6e2a41/users/4db346bf608d444396fd0b9dbe6bae94/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:39.502883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21c3b1d42b44730892c28fc0b6e2a41, user_id=4db346bf608d444396fd0b9dbe6bae94, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:39.506147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:39.536324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3997/7996] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:39 2022] PUT /identity/v3/projects/d21c3b1d42b44730892c28fc0b6e2a41/users/4db346bf608d444396fd0b9dbe6bae94/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:39.539771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6765-680a-4a8b-950c-4cfa2af18abe None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:39.540056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6765-680a-4a8b-950c-4cfa2af18abe None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:39.540328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6765-680a-4a8b-950c-4cfa2af18abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:39.573071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5e5d6765-680a-4a8b-950c-4cfa2af18abe None None] MFA Rules not processed for user `4db346bf608d444396fd0b9dbe6bae94`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:39.574499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5e5d6765-680a-4a8b-950c-4cfa2af18abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:39.611602 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:39.662018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4000/7997] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:39.672840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:39.677753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:39.823520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf70f-e9ae-429e-8a82-4010f8161bb4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:39.831594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6bca9-3fd8-4b39-a38d-1b5ba3ed0369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:39.833695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6bca9-3fd8-4b39-a38d-1b5ba3ed0369 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:39.833695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6bca9-3fd8-4b39-a38d-1b5ba3ed0369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:39.833695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6bca9-3fd8-4b39-a38d-1b5ba3ed0369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:39.859219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6bca9-3fd8-4b39-a38d-1b5ba3ed0369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:39.861203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6bca9-3fd8-4b39-a38d-1b5ba3ed0369 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:39.874538 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3998/7998] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:40.602346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d6765-680a-4a8b-950c-4cfa2af18abe None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:40.705914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d6765-680a-4a8b-950c-4cfa2af18abe None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:40.718949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:40.720174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:40.722070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:40.723333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] PATH_INFO: `/v3/users/42af0ae74406473382bde49946abbe89` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:40.725138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42af0ae74406473382bde49946abbe89)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:40.730324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:41.027227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42af0ae74406473382bde49946abbe89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:41.052495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42af0ae74406473382bde49946abbe89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:41.053254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42af0ae74406473382bde49946abbe89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:41.120389 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42af0ae74406473382bde49946abbe89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:41.121678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42af0ae74406473382bde49946abbe89'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:41.163273 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4001/7999] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:40 2022] DELETE /identity/v3/users/42af0ae74406473382bde49946abbe89 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:41.167701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:41.168185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:41.168284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:41.210160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:41.211357 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:41.354938 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 3999/8000] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:41.380647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:41.382296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:41.485538 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:41.501762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a354b7-9ee1-4699-bfe2-a04e5f7bd44e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:41.506317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e6a5a-c337-4188-b583-9e0af67071ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:41.507160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e6a5a-c337-4188-b583-9e0af67071ef service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:41.507574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e6a5a-c337-4188-b583-9e0af67071ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:41.507997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e6a5a-c337-4188-b583-9e0af67071ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:41.518673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e6a5a-c337-4188-b583-9e0af67071ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:41.520547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e6a5a-c337-4188-b583-9e0af67071ef service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:41.570869 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4002/8001] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:42.687231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:42.687231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:42.730377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e42b85-92d1-40df-adbf-ae8b9fb46d4d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:42.744142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:42.747534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:42.747534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:42.747534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] PATH_INFO: `/v3/projects/dcb6422802df4ee1be8937913851c81c` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:42.750745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb6422802df4ee1be8937913851c81c)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:42.755645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:42.956944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb6422802df4ee1be8937913851c81c', 'request_id': 'req-a0cdc809-d241-42a5-ba10-7082b64daff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:42.966575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb6422802df4ee1be8937913851c81c', 'request_id': 'req-a0cdc809-d241-42a5-ba10-7082b64daff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:42.991775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:42.992291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:42.992291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:43.039867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:43.047523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:43.082162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb6422802df4ee1be8937913851c81c', 'request_id': 'req-a0cdc809-d241-42a5-ba10-7082b64daff2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.088682 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:43.100593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] The token cache is being invalidate because project dcb6422802df4ee1be8937913851c81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:43.100915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.101741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.104323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4000/8002] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:42 2022] DELETE /identity/v3/projects/dcb6422802df4ee1be8937913851c81c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:43.114708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:43.120639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:43.183321 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4003/8003] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:43.192164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:43.193926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:43.243565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdc809-d241-42a5-ba10-7082b64daff2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:43.250350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:43.251204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:43.251369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:43.251560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] PATH_INFO: `/v3/users/4db346bf608d444396fd0b9dbe6bae94` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:43.252873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db346bf608d444396fd0b9dbe6bae94)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:43.255209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:43.310646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c48fbf-9917-4a16-9e71-fc54c13b5ce7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:43.315632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:43.316199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:43.316474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:43.316805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:43.317442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:43.319468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:43.462999 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4004/8004] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:43 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:43.463766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:43.582552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfddb75-7d5c-40d9-9a47-a7f7c2c0ed0d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:43.582914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db346bf608d444396fd0b9dbe6bae94'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.583014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:43.583014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:43.583014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:43.583014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:43.583352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:43.583352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:43.583517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db346bf608d444396fd0b9dbe6bae94'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.587358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db346bf608d444396fd0b9dbe6bae94'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.600622 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:43.665444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db346bf608d444396fd0b9dbe6bae94'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.667395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db346bf608d444396fd0b9dbe6bae94'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:43.672057 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4005/8005] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:43 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:43.681589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:43.683730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:43.704098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454579c5-ccfc-401e-9798-e2c963552816 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:43.706127 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4001/8006] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:49:43 2022] DELETE /identity/v3/users/4db346bf608d444396fd0b9dbe6bae94 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:43.836412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:43.839412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:43.839412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:43.839412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:43.839793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:43.842769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:43.872336 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4006/8007] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:43.876785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:43.891440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3632a-dab8-42e2-b637-138a3e475284 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:43.896751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:43.897728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:43.898193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:43.898533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] PATH_INFO: `/v3/projects/a454e848a4e34c61901ab5aaaacdb2d9/users/13997879ffb0487bbdce6d258b125b46/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:43.919539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a454e848a4e34c61901ab5aaaacdb2d9, user_id=13997879ffb0487bbdce6d258b125b46, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:43.922720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:44.063653 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4002/8008] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:43 2022] PUT /identity/v3/projects/a454e848a4e34c61901ab5aaaacdb2d9/users/13997879ffb0487bbdce6d258b125b46/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:44.067872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:44.087664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf95158-0328-4300-8b7f-3a71e4bb6834 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:44.192722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:44.193439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:44.193791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:44.194206 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:44.194996 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:44.196801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:44.227357 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4007/8009] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:44.230255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:44.246327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba32f9-ca9d-41bf-b424-c9817516d848 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:44.254316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc976b4-e6fe-437c-a18b-65dd30bad724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:44.256163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc976b4-e6fe-437c-a18b-65dd30bad724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:44.262990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc976b4-e6fe-437c-a18b-65dd30bad724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:44.262990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc976b4-e6fe-437c-a18b-65dd30bad724 admin admin] PATH_INFO: `/v3/projects/a454e848a4e34c61901ab5aaaacdb2d9/users/13997879ffb0487bbdce6d258b125b46/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:44.262990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc976b4-e6fe-437c-a18b-65dd30bad724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a454e848a4e34c61901ab5aaaacdb2d9, user_id=13997879ffb0487bbdce6d258b125b46, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:44.277691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc976b4-e6fe-437c-a18b-65dd30bad724 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:44.307699 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4003/8010] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:44 2022] PUT /identity/v3/projects/a454e848a4e34c61901ab5aaaacdb2d9/users/13997879ffb0487bbdce6d258b125b46/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:44.442843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:44.442843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:44.442843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415079b2-2c0d-48e0-9b4d-4c964a96db42 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:44.533195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:44.534081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:44.534367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:44.534666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] PATH_INFO: `/v3/projects/d21c3b1d42b44730892c28fc0b6e2a41` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:44.535944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21c3b1d42b44730892c28fc0b6e2a41)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:44.537848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:44.745205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21c3b1d42b44730892c28fc0b6e2a41', 'request_id': 'req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:44.778180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21c3b1d42b44730892c28fc0b6e2a41', 'request_id': 'req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:44.901489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21c3b1d42b44730892c28fc0b6e2a41', 'request_id': 'req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:44.916221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] The token cache is being invalidate because project d21c3b1d42b44730892c28fc0b6e2a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:49:44.916832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:44.917712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b74420bc-fd9f-4aeb-9ebf-7c4375db6539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:49:44.923180 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4008/8011] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:49:44 2022] DELETE /identity/v3/projects/d21c3b1d42b44730892c28fc0b6e2a41 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:44.924755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621a0a-8da8-44bb-896a-321ee15286d5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:44.925221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621a0a-8da8-44bb-896a-321ee15286d5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:44.925338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621a0a-8da8-44bb-896a-321ee15286d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:44.961414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-da621a0a-8da8-44bb-896a-321ee15286d5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:44.963305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-da621a0a-8da8-44bb-896a-321ee15286d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:45.019689 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:45.057024 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:45.065072 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4004/8012] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:45.073883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768d6d1-2226-451e-a594-fd577faa3995 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.074420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768d6d1-2226-451e-a594-fd577faa3995 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.074656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768d6d1-2226-451e-a594-fd577faa3995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.104221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2768d6d1-2226-451e-a594-fd577faa3995 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:45.106446 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2768d6d1-2226-451e-a594-fd577faa3995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:45.122232 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4009/8013] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:45.124515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621a0a-8da8-44bb-896a-321ee15286d5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:45.134702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621a0a-8da8-44bb-896a-321ee15286d5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:45.140557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:45.141253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.141596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.142136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.142861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:49:45.143255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:45.144919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:45.156631 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4005/8014] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:49:45.161195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768d6d1-2226-451e-a594-fd577faa3995 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:45.173789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768d6d1-2226-451e-a594-fd577faa3995 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:45.196548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:45.197941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.200399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.200399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.200613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:45.203125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:45.335981 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4010/8015] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:49:45 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:49:45.340727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:45.359950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6875-70c6-4550-84de-da61a9638172 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:45.480124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:45.483568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.484039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.484612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.485490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:45.492238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:45.608297 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4006/8016] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:49:45 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:49:45.612304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:45.622827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16276a0-98c1-4995-9dd0-4a3f6865af14 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:45.628238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:45.628843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.629171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.629377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.630078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:45.631615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:45.643942 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4011/8017] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:45.648345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:45.659719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f6e3-cdcc-4b82-9e4d-9d8e533bcdbf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:45.664647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c97ff-b9eb-44ba-b089-a51cc5fcbd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:45.665296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c97ff-b9eb-44ba-b089-a51cc5fcbd85 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.665578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c97ff-b9eb-44ba-b089-a51cc5fcbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.665851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c97ff-b9eb-44ba-b089-a51cc5fcbd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.666524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c97ff-b9eb-44ba-b089-a51cc5fcbd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:45.668159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c97ff-b9eb-44ba-b089-a51cc5fcbd85 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:45.683048 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4007/8018] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:49:45.695227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:45.707647 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876913bc-d359-447a-b2d7-a5abf70a3311 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:45.713506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:45.714442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.714861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.717097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] PATH_INFO: `/v3/projects/83b41c66c9864d7dbe35a389f72fcd4d/users/4c880db3363a4aff92b82abfef14a8b0/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.750777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b41c66c9864d7dbe35a389f72fcd4d, user_id=4c880db3363a4aff92b82abfef14a8b0, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:45.758514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:45.861436 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4012/8019] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:49:45 2022] PUT /identity/v3/projects/83b41c66c9864d7dbe35a389f72fcd4d/users/4c880db3363a4aff92b82abfef14a8b0/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:49:45.875330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60912d-3dea-41ee-a636-fe1290478536 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:45.877620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60912d-3dea-41ee-a636-fe1290478536 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:45.878177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60912d-3dea-41ee-a636-fe1290478536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:45.936827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ef60912d-3dea-41ee-a636-fe1290478536 None None] MFA Rules not processed for user `4c880db3363a4aff92b82abfef14a8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:45.938511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ef60912d-3dea-41ee-a636-fe1290478536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:46.063466 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4008/8020] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:46.076972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:46.079701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:46.173731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae3f3-aa9c-404a-8e97-c8ceb9e379b7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:46.178524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1907f08-ce55-4514-82c3-7c2ed972552d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:46.180016 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1907f08-ce55-4514-82c3-7c2ed972552d service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:46.180325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1907f08-ce55-4514-82c3-7c2ed972552d service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:46.180868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1907f08-ce55-4514-82c3-7c2ed972552d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:46.191083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1907f08-ce55-4514-82c3-7c2ed972552d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:46.194477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1907f08-ce55-4514-82c3-7c2ed972552d service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:46.205113 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4013/8021] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:49.474138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b27dc-9bad-4688-9252-3029f6b1f6f9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:49.474663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b27dc-9bad-4688-9252-3029f6b1f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:49.474663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b27dc-9bad-4688-9252-3029f6b1f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:49.502593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-910b27dc-9bad-4688-9252-3029f6b1f6f9 None None] MFA Rules not processed for user `4c880db3363a4aff92b82abfef14a8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:49.504235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-910b27dc-9bad-4688-9252-3029f6b1f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:49.522641 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4009/8022] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:53.505044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c40b0-3af2-4563-87f0-61978325132a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:53.505545 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c40b0-3af2-4563-87f0-61978325132a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:53.506370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c40b0-3af2-4563-87f0-61978325132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:53.552310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-523c40b0-3af2-4563-87f0-61978325132a None None] MFA Rules not processed for user `13997879ffb0487bbdce6d258b125b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:53.553807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-523c40b0-3af2-4563-87f0-61978325132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:53.632329 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:49:53.665099 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4014/8023] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:53.674996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b27dc-9bad-4688-9252-3029f6b1f6f9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:53.698960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b27dc-9bad-4688-9252-3029f6b1f6f9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:53.703084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ca6cf-2f60-4bee-bc0a-a296b8566725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:53.704052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca6cf-2f60-4bee-bc0a-a296b8566725 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:53.704498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca6cf-2f60-4bee-bc0a-a296b8566725 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:53.704929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca6cf-2f60-4bee-bc0a-a296b8566725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:53.721166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ca6cf-2f60-4bee-bc0a-a296b8566725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:53.722651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ca6cf-2f60-4bee-bc0a-a296b8566725 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:53.735110 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4010/8024] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:54.032466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c40b0-3af2-4563-87f0-61978325132a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:54.047448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c40b0-3af2-4563-87f0-61978325132a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:54.053747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:54.054682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:54.055090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:54.055371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:54.057547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:54.168098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:54.168476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:54.183236 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4015/8025] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:49:57.666632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:57.666632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:57.666632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:57.684315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:49:57.685449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:57.697896 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4011/8026] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:49:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:49:58.249904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:49:58.251894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:58.369272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ee939-fc08-4248-99be-3a09bc2ebffb service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:49:58.375195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:49:58.375870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:49:58.376144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:49:58.379317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:49:58.379317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:49:58.401481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:49:58.403305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:49:58.415345 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4016/8027] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:49:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:00.146869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:00.148740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:00.174856 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:00.366289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031174b9-d860-4bcf-b540-8f5d0a6c7bce None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:00.372911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:00.374493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:00.375016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:00.375672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:00.382909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:00.404978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:00.407887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:00.429478 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4012/8028] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:01.519819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:01.536156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa522cf5-aef2-411b-bfad-07c29eaed7da service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:01.541761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61701-c75e-4ae3-b054-0099276e9aa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:01.542546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61701-c75e-4ae3-b054-0099276e9aa9 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:01.542827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61701-c75e-4ae3-b054-0099276e9aa9 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:01.543100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61701-c75e-4ae3-b054-0099276e9aa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:01.544887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-93c61701-c75e-4ae3-b054-0099276e9aa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:01.562974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61701-c75e-4ae3-b054-0099276e9aa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:01.564663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61701-c75e-4ae3-b054-0099276e9aa9 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:01.581857 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4017/8029] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:10.668300 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=34 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:11.571265 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=74 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:12.879815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:12.881329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:12.958819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872ad6-2e5b-4381-9441-13d7a8fb6a96 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:12.963637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:12.964263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:12.965095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:12.965095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] PATH_INFO: `/v3/users/c04d0dfd92fa43cda7dc42358bf07d60` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:12.965936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04d0dfd92fa43cda7dc42358bf07d60)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:12.968562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:13.221511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04d0dfd92fa43cda7dc42358bf07d60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:13.238921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04d0dfd92fa43cda7dc42358bf07d60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:13.239827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04d0dfd92fa43cda7dc42358bf07d60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:13.386541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04d0dfd92fa43cda7dc42358bf07d60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:13.387304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04d0dfd92fa43cda7dc42358bf07d60'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:13.421194 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4013/8030] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:50:12 2022] DELETE /identity/v3/users/c04d0dfd92fa43cda7dc42358bf07d60 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:13.425669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:13.427704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:13.427704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:13.464570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:13.466057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:13.562847 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4018/8031] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:13.573147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:13.574905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:13.668568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d3fb4-4700-4843-811c-a3b8ee5224dc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:13.674192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:13.675722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:13.676010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:13.676278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:13.710633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:13.712863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:13.739870 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4014/8032] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:14.319198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:14.320662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:14.335651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5721e-ca56-4815-8bac-8c271804fef4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:14.340794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:14.342034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:14.342034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:14.343062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] PATH_INFO: `/v3/projects/2f738bd1ecb54e61814b20ef0f28902c` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:14.344317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f738bd1ecb54e61814b20ef0f28902c)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:14.346339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:14.453785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f738bd1ecb54e61814b20ef0f28902c', 'request_id': 'req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.459587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f738bd1ecb54e61814b20ef0f28902c', 'request_id': 'req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.537232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f738bd1ecb54e61814b20ef0f28902c', 'request_id': 'req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.549303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] The token cache is being invalidate because project 2f738bd1ecb54e61814b20ef0f28902c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:50:14.549592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.550265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.551762 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4019/8033] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:50:14 2022] DELETE /identity/v3/projects/2f738bd1ecb54e61814b20ef0f28902c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:14.556085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:14.566141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c458e-584b-40a0-8c3a-2bfb23bf516f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:14.585680 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:14.624683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:14.625328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:14.625608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:14.625877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] PATH_INFO: `/v3/users/8d1396dd0f3243f297dff6dfa34fc1a3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:14.627161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1396dd0f3243f297dff6dfa34fc1a3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:14.629074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:14.803907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1396dd0f3243f297dff6dfa34fc1a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.812416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1396dd0f3243f297dff6dfa34fc1a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.813141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1396dd0f3243f297dff6dfa34fc1a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.897475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1396dd0f3243f297dff6dfa34fc1a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.898284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9a77bd0-6398-4098-97ce-6bf8e316b4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1396dd0f3243f297dff6dfa34fc1a3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:14.916908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4015/8034] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:50:14 2022] DELETE /identity/v3/users/8d1396dd0f3243f297dff6dfa34fc1a3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:15.332867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:15.335743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:15.358932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1627c-c8f8-4d1f-8bf8-2ba8cdcb846e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:15.434628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:15.435283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:15.435590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:15.435864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] PATH_INFO: `/v3/projects/958539c3c0cd4c2daca12dca0282e52e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:15.438445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] RBAC: Authorizing `identity:delete_project(project_id=958539c3c0cd4c2daca12dca0282e52e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:15.441041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:15.569614 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:15.588842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958539c3c0cd4c2daca12dca0282e52e', 'request_id': 'req-a3786bd6-d643-4dad-80ff-b8bdcb74040a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:15.594876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958539c3c0cd4c2daca12dca0282e52e', 'request_id': 'req-a3786bd6-d643-4dad-80ff-b8bdcb74040a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:15.676000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958539c3c0cd4c2daca12dca0282e52e', 'request_id': 'req-a3786bd6-d643-4dad-80ff-b8bdcb74040a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:15.714417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] The token cache is being invalidate because project 958539c3c0cd4c2daca12dca0282e52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:50:15.714857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:15.715672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a3786bd6-d643-4dad-80ff-b8bdcb74040a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:15.721279 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4020/8035] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:50:15 2022] DELETE /identity/v3/projects/958539c3c0cd4c2daca12dca0282e52e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:15.725678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f5ca-f3a8-4d72-8a12-7e29fb16aa4f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:15.725678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f5ca-f3a8-4d72-8a12-7e29fb16aa4f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:15.725678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f5ca-f3a8-4d72-8a12-7e29fb16aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:15.753596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0f54f5ca-f3a8-4d72-8a12-7e29fb16aa4f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:15.754993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0f54f5ca-f3a8-4d72-8a12-7e29fb16aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:15.829682 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4016/8036] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:15.839464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbec2-c2c4-4698-9708-71e75bf79190 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:15.839751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbec2-c2c4-4698-9708-71e75bf79190 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:15.840022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbec2-c2c4-4698-9708-71e75bf79190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:15.862023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-feecbec2-c2c4-4698-9708-71e75bf79190 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:15.863227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-feecbec2-c2c4-4698-9708-71e75bf79190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:15.872323 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4021/8037] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:15.876896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54f5ca-f3a8-4d72-8a12-7e29fb16aa4f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:15.887301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54f5ca-f3a8-4d72-8a12-7e29fb16aa4f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:15.893126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:15.893864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:15.895684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:15.896184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:15.896877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:50:15.897343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:15.899120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:15.917797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4017/8038] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:50:15.920450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecbec2-c2c4-4698-9708-71e75bf79190 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:15.930274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecbec2-c2c4-4698-9708-71e75bf79190 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:15.936349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:15.938412 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:15.938914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:15.939281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:15.940051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:15.942155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:16.045946 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4022/8039] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:50:15 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:50:16.047794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:16.065507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15abd57-804a-467e-b1fe-5e2a57d0215e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:16.131240 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:16.175462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:16.175462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:16.175462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:16.175462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:16.175958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:16.175958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:16.264638 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4018/8040] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:50:16 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:50:16.268775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:16.288641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601d5ec-512a-463d-916d-639ed2245907 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:16.295297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:16.296850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:16.297364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:16.297799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:16.298717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:16.302175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:16.319379 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4023/8041] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:50:16.323724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:16.334448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831673f7-4fca-4d50-b6c1-7230a060319e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:16.339862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0954d-bbe0-4c95-a7ae-a920be87fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:16.344498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0954d-bbe0-4c95-a7ae-a920be87fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:16.344498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0954d-bbe0-4c95-a7ae-a920be87fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:16.344498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0954d-bbe0-4c95-a7ae-a920be87fd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:16.344498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0954d-bbe0-4c95-a7ae-a920be87fd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:16.344498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0954d-bbe0-4c95-a7ae-a920be87fd0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:16.366540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4019/8042] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:50:16.368730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:16.383997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652da5f-98ea-4adc-8124-3da1e6f3f63a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:16.389711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:16.390863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:16.390863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:16.391145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] PATH_INFO: `/v3/projects/274d73c92c44470aa08b93ca67623828/users/6ac03fe41c9f41148b0d7294d9880734/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:16.411906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274d73c92c44470aa08b93ca67623828, user_id=6ac03fe41c9f41148b0d7294d9880734, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:16.416373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:16.512872 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4024/8043] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:50:16 2022] PUT /identity/v3/projects/274d73c92c44470aa08b93ca67623828/users/6ac03fe41c9f41148b0d7294d9880734/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:16.515417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bcd2c-2891-48b1-81e0-39e68fc35aa6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:16.515783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bcd2c-2891-48b1-81e0-39e68fc35aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:16.516148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bcd2c-2891-48b1-81e0-39e68fc35aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:16.552461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6a3bcd2c-2891-48b1-81e0-39e68fc35aa6 None None] MFA Rules not processed for user `6ac03fe41c9f41148b0d7294d9880734`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:16.553787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6a3bcd2c-2891-48b1-81e0-39e68fc35aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:16.640572 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4020/8044] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:16.647599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:16.650385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:16.736642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406b27d-e032-4f0d-93d7-c28aeabb2642 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:16.741941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:16.741941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:16.741941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:16.741941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:16.762617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:16.766811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:16.780059 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4025/8045] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:20.181024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cfc7-4293-490a-aa55-58b3eee86aea None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:20.187366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cfc7-4293-490a-aa55-58b3eee86aea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:20.187837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cfc7-4293-490a-aa55-58b3eee86aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:20.233391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c078cfc7-4293-490a-aa55-58b3eee86aea None None] MFA Rules not processed for user `38c7799d37d747b08a9e20e15c3d6879`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:20.234844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c078cfc7-4293-490a-aa55-58b3eee86aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:20.366517 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4021/8046] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:26.773505 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:30.351621 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:43.653294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:43.654781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:43.891693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6860e1-e1f1-4c49-b106-b237a205624c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:43.901546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:43.902749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:43.903356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:43.903869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] PATH_INFO: `/v3/users/037ed342980a4de9a2dfc8d576293aba` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:43.906471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] RBAC: Authorizing `identity:delete_user(user_id=037ed342980a4de9a2dfc8d576293aba)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:43.909471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:44.300667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037ed342980a4de9a2dfc8d576293aba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:44.311222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037ed342980a4de9a2dfc8d576293aba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:44.312070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037ed342980a4de9a2dfc8d576293aba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:44.461177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037ed342980a4de9a2dfc8d576293aba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:44.462910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037ed342980a4de9a2dfc8d576293aba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:44.495310 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4026/8047] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:50:43 2022] DELETE /identity/v3/users/037ed342980a4de9a2dfc8d576293aba => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:50:44.500558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:44.501190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:44.501190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:44.540227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:44.541959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:44.660894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4022/8048] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:44.684024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:44.686114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:44.817948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3600bf-c3af-48bf-b8f8-d58c0e06873e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:44.830017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:44.830017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:44.830017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:44.830017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:44.841073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:44.842649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:44.856104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4027/8049] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:45.430359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:45.432082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:45.464995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb83113-ce50-4431-94f5-ed35a6fde236 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:45.503801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:45.505193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:45.505635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:45.506106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] PATH_INFO: `/v3/projects/0c7f734a12da437e806e4c791d27d615` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:45.507563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7f734a12da437e806e4c791d27d615)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:45.509751 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:45.791256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7f734a12da437e806e4c791d27d615', 'request_id': 'req-6083721c-1adf-4d68-b930-875726e74b19'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:45.803190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7f734a12da437e806e4c791d27d615', 'request_id': 'req-6083721c-1adf-4d68-b930-875726e74b19'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:45.900604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7f734a12da437e806e4c791d27d615', 'request_id': 'req-6083721c-1adf-4d68-b930-875726e74b19'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:45.919312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] The token cache is being invalidate because project 0c7f734a12da437e806e4c791d27d615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:50:45.919967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:45.932491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:45.940431 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4023/8050] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:50:45 2022] DELETE /identity/v3/projects/0c7f734a12da437e806e4c791d27d615 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:45.944632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:45.964593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea41510-113a-4159-9374-df961af2cdae service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:46.005966 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:46.071171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:46.072029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:46.072277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:46.072586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] PATH_INFO: `/v3/users/d72ce81cad3c4014b4071ed5660e0ec4` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:46.073919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72ce81cad3c4014b4071ed5660e0ec4)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:46.079576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:46.394875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72ce81cad3c4014b4071ed5660e0ec4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:46.410946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72ce81cad3c4014b4071ed5660e0ec4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:46.412046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72ce81cad3c4014b4071ed5660e0ec4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:46.517366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72ce81cad3c4014b4071ed5660e0ec4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:46.518531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5962a074-3491-45d0-b7b2-3b2654f6c3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72ce81cad3c4014b4071ed5660e0ec4'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:46.558786 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4028/8051] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:50:45 2022] DELETE /identity/v3/users/d72ce81cad3c4014b4071ed5660e0ec4 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:47.243838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:47.243838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:47.262628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083721c-1adf-4d68-b930-875726e74b19 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:47.430488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:47.431271 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:47.431555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:47.431827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] PATH_INFO: `/v3/projects/e9a93c06024b4898ba981e02f9874d43` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:47.434305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a93c06024b4898ba981e02f9874d43)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:47.439420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:47.599706 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:47.639461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a93c06024b4898ba981e02f9874d43', 'request_id': 'req-fdf0bd11-7274-4946-b72e-71865c67d330'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:47.652937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a93c06024b4898ba981e02f9874d43', 'request_id': 'req-fdf0bd11-7274-4946-b72e-71865c67d330'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:47.744484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a93c06024b4898ba981e02f9874d43', 'request_id': 'req-fdf0bd11-7274-4946-b72e-71865c67d330'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:47.762348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] The token cache is being invalidate because project e9a93c06024b4898ba981e02f9874d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:50:47.762646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:47.763370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fdf0bd11-7274-4946-b72e-71865c67d330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:47.771579 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4024/8052] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:50:47 2022] DELETE /identity/v3/projects/e9a93c06024b4898ba981e02f9874d43 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:47.776667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a88e5-cfa3-4e72-b6b7-e4fdf9e6222d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:47.777527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a88e5-cfa3-4e72-b6b7-e4fdf9e6222d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:47.777958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a88e5-cfa3-4e72-b6b7-e4fdf9e6222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:47.815131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ac2a88e5-cfa3-4e72-b6b7-e4fdf9e6222d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:47.816273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ac2a88e5-cfa3-4e72-b6b7-e4fdf9e6222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:48.098469 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4029/8053] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:48.106954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd865c5-68bf-4362-acea-96640e7bd97c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:48.107461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd865c5-68bf-4362-acea-96640e7bd97c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:48.107886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd865c5-68bf-4362-acea-96640e7bd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:48.162723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bfd865c5-68bf-4362-acea-96640e7bd97c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:48.164214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bfd865c5-68bf-4362-acea-96640e7bd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:48.195840 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4025/8054] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:48.200404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a88e5-cfa3-4e72-b6b7-e4fdf9e6222d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:48.221444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a88e5-cfa3-4e72-b6b7-e4fdf9e6222d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:48.238084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:48.238761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:48.239041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:48.239360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:48.240147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:50:48.240434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:48.266139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:48.288478 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4030/8055] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:50:48.292875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd865c5-68bf-4362-acea-96640e7bd97c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:48.305633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd865c5-68bf-4362-acea-96640e7bd97c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:48.328931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:48.329745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:48.330308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:48.331372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:48.334770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:48.336913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:48.474206 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4026/8056] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:50:48 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:50:48.479063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:48.494458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ca5a-ad81-4d77-9085-db4986aa4ff0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:48.543401 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:48.664739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:48.665384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:48.665662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:48.665919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:48.666682 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:48.668638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:48.802340 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4031/8057] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:50:48 2022] POST /identity/v3/users => generated 294 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:50:48.802910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:48.817954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea87a-b14c-4f15-8dfc-6f9d886581f2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:48.828620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:48.830780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:48.832395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:48.835591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:48.839199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:48.843135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:48.868275 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4027/8058] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:50:48.870837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:48.894328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa90d6-0acf-4143-89de-6279a51bb9df admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:48.905260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38d8f0-73a1-47af-9c9b-467fe3751dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:48.907089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38d8f0-73a1-47af-9c9b-467fe3751dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:48.907588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38d8f0-73a1-47af-9c9b-467fe3751dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:48.908102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38d8f0-73a1-47af-9c9b-467fe3751dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:48.909171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38d8f0-73a1-47af-9c9b-467fe3751dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:48.911168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38d8f0-73a1-47af-9c9b-467fe3751dd8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:48.927043 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4032/8059] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:50:48.931163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:48.958105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569c750-8886-4f25-bf1c-c1b67b935b21 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:48.965227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:48.966067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:48.966436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:48.966788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] PATH_INFO: `/v3/projects/02894142d3074ec9a4ffd2cd0faa4434/users/5bbba03d2bff47f7981ecbac0cc5e7ac/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:48.994285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02894142d3074ec9a4ffd2cd0faa4434, user_id=5bbba03d2bff47f7981ecbac0cc5e7ac, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:48.997598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:49.098995 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4028/8060] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:50:48 2022] PUT /identity/v3/projects/02894142d3074ec9a4ffd2cd0faa4434/users/5bbba03d2bff47f7981ecbac0cc5e7ac/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:49.112233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebc29-a604-42b7-a9e1-1d905526fb60 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:49.112846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebc29-a604-42b7-a9e1-1d905526fb60 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:49.113277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebc29-a604-42b7-a9e1-1d905526fb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:49.199026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c18ebc29-a604-42b7-a9e1-1d905526fb60 None None] MFA Rules not processed for user `5bbba03d2bff47f7981ecbac0cc5e7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:49.200260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c18ebc29-a604-42b7-a9e1-1d905526fb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:49.348722 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4033/8061] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:49.354582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:49.593941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3247b0f-3bc7-40e2-820f-0b997efd4d5a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:49.630335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:49.635529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:49.635743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:49.635996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:49.646823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:49.657455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:49.821886 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4029/8062] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:50:49 2022] POST /identity/v3/projects => generated 385 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:50:49.827936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ebc29-a604-42b7-a9e1-1d905526fb60 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:49.840124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ebc29-a604-42b7-a9e1-1d905526fb60 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:49.951964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:49.953471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:49.953896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:49.954381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:49.955387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:49.959348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:50.084610 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4034/8063] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:50:49 2022] POST /identity/v3/users => generated 300 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:50:50.088684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:50.103976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00242f-ed60-45dc-b82b-f3d298922719 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:50.118388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58663-60df-4137-bf10-e116c602e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:50.119033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58663-60df-4137-bf10-e116c602e6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:50.119316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58663-60df-4137-bf10-e116c602e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:50.119576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58663-60df-4137-bf10-e116c602e6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:50.120230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58663-60df-4137-bf10-e116c602e6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:50.121869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58663-60df-4137-bf10-e116c602e6d5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:50.147189 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4030/8064] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:50:50.147668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:50.162503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2385557-08f2-46d1-b141-a146e919c4c6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:50.167663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:50.168344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:50.168625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:50.168899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] PATH_INFO: `/v3/projects/49cf8fd0ce5e48328136f4c8c95dbc26/users/eb5a3a5978a448669278c9445c7a44ee/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:50.197330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cf8fd0ce5e48328136f4c8c95dbc26, user_id=eb5a3a5978a448669278c9445c7a44ee, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:50.202400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:50.358653 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4035/8065] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:50:50 2022] PUT /identity/v3/projects/49cf8fd0ce5e48328136f4c8c95dbc26/users/eb5a3a5978a448669278c9445c7a44ee/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:50.376831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb42f-9c14-4ed5-84d1-b0313b6108cd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:50.378070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb42f-9c14-4ed5-84d1-b0313b6108cd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:50.378070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb42f-9c14-4ed5-84d1-b0313b6108cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:50.439352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-52eeb42f-9c14-4ed5-84d1-b0313b6108cd None None] MFA Rules not processed for user `eb5a3a5978a448669278c9445c7a44ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:50.442702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-52eeb42f-9c14-4ed5-84d1-b0313b6108cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:50.476643 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:50.648210 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4031/8066] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:50 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:50.707932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:50.709919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:50.720735 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:50.910732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4c337-227c-472a-a22a-0b2b764f0407 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:50.929796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:50.930467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:50.930921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:50.931197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:50.968919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:50.970596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:50.999920 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4036/8067] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:50:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:50:52.600214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:52.601064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:52.601490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:52.647449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:52.650584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:52.781798 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4032/8068] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:52.838055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:52.840187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:53.016256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3e1a-bc39-44ac-90ff-a4de1285f518 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:53.028165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:53.028810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:53.037305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:53.037305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:53.037305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:53.235184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:53.235184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:53.255612 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4037/8069] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:53.994109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:53.995721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:54.180123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafde848-95b9-47d8-a574-a8cfe7213b59 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:54.186527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e440049-1c99-4ac3-a844-8eba5ba9dd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:54.187799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440049-1c99-4ac3-a844-8eba5ba9dd15 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:54.188071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440049-1c99-4ac3-a844-8eba5ba9dd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:54.188393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440049-1c99-4ac3-a844-8eba5ba9dd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:54.190654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8e440049-1c99-4ac3-a844-8eba5ba9dd15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:54.206377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e440049-1c99-4ac3-a844-8eba5ba9dd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:54.212363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e440049-1c99-4ac3-a844-8eba5ba9dd15 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:54.222786 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4033/8070] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:54.770613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:54.785892 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:54.953576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2be7-fffc-49ee-9ae4-17a4781101b7 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:54.972787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:54.973685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:54.974174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:54.976949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] PATH_INFO: `/v3/users/5bbba03d2bff47f7981ecbac0cc5e7ac` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:54.978701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbba03d2bff47f7981ecbac0cc5e7ac)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:54.983622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:55.335662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbba03d2bff47f7981ecbac0cc5e7ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:55.375023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbba03d2bff47f7981ecbac0cc5e7ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:55.376262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbba03d2bff47f7981ecbac0cc5e7ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:55.508489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbba03d2bff47f7981ecbac0cc5e7ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:55.509681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbba03d2bff47f7981ecbac0cc5e7ac'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:55.547278 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4038/8071] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:50:54 2022] DELETE /identity/v3/users/5bbba03d2bff47f7981ecbac0cc5e7ac => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:55.551521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:55.552003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:55.552105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:55.629535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:50:55.633688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:55.746034 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4034/8072] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:50:55.910255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:55.911707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:56.054977 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8def36-4f35-4c2f-ab72-5bdf8c2f1096 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:56.066069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:56.067553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:56.069885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:56.070511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:56.095146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:56.099667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:56.125006 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4039/8073] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:56.845685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:56.847745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:56.855474 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:56.871088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fd313-1d5a-4d29-afc7-8627dfdf4956 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:56.879616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:56.880539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:56.880847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:56.881082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:56.886511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:57.028922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:57.031201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:57.058308 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4035/8074] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:50:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:50:57.363769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:57.366492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:50:57.392176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99c14-b24d-452d-a257-934a84a5e892 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:57.408105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:57.410859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:57.412135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:57.412615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] PATH_INFO: `/v3/projects/02894142d3074ec9a4ffd2cd0faa4434` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:57.414320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] RBAC: Authorizing `identity:delete_project(project_id=02894142d3074ec9a4ffd2cd0faa4434)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:57.424282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:57.588223 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:50:57.632321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02894142d3074ec9a4ffd2cd0faa4434', 'request_id': 'req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:57.657811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02894142d3074ec9a4ffd2cd0faa4434', 'request_id': 'req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:57.725704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02894142d3074ec9a4ffd2cd0faa4434', 'request_id': 'req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:57.748599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] The token cache is being invalidate because project 02894142d3074ec9a4ffd2cd0faa4434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:50:57.748901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:57.750315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:57.757275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:57.757478 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4040/8075] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:50:57 2022] DELETE /identity/v3/projects/02894142d3074ec9a4ffd2cd0faa4434 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:57.777133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5254a-ee71-48fc-8e97-3683f93b0034 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:50:57.941395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:50:57.943122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:50:57.943620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:50:57.944067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] PATH_INFO: `/v3/users/eb5a3a5978a448669278c9445c7a44ee` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:50:57.945878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5a3a5978a448669278c9445c7a44ee)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:50:57.948103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:50:58.177926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5a3a5978a448669278c9445c7a44ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:58.193819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5a3a5978a448669278c9445c7a44ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:58.195103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5a3a5978a448669278c9445c7a44ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:58.313458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5a3a5978a448669278c9445c7a44ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:58.315136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-797423f0-5831-49ec-832b-6ab5d539ed26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5a3a5978a448669278c9445c7a44ee'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:50:58.362357 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4036/8076] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:50:57 2022] DELETE /identity/v3/users/eb5a3a5978a448669278c9445c7a44ee => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:50:59.974239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:50:59.976669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:00.017265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0863-9e7d-48b0-99cd-5c65b3f575be admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:00.213833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:00.214520 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:00.214798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:00.215068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] PATH_INFO: `/v3/projects/49cf8fd0ce5e48328136f4c8c95dbc26` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:00.216568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cf8fd0ce5e48328136f4c8c95dbc26)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:00.226303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:00.499337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cf8fd0ce5e48328136f4c8c95dbc26', 'request_id': 'req-463cf9ef-3c60-43cb-aab9-ae027b6672ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:00.531288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cf8fd0ce5e48328136f4c8c95dbc26', 'request_id': 'req-463cf9ef-3c60-43cb-aab9-ae027b6672ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:00.617474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cf8fd0ce5e48328136f4c8c95dbc26', 'request_id': 'req-463cf9ef-3c60-43cb-aab9-ae027b6672ba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:00.658168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] The token cache is being invalidate because project 49cf8fd0ce5e48328136f4c8c95dbc26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:51:00.658485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:00.659274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-463cf9ef-3c60-43cb-aab9-ae027b6672ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:00.668682 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4041/8077] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:50:59 2022] DELETE /identity/v3/projects/49cf8fd0ce5e48328136f4c8c95dbc26 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:00.675028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d5e5-b0e1-4d08-b072-29c934720c77 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:00.678669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d5e5-b0e1-4d08-b072-29c934720c77 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:00.678669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d5e5-b0e1-4d08-b072-29c934720c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:00.719343 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:00.750833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d8a4d5e5-b0e1-4d08-b072-29c934720c77 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:00.752389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d8a4d5e5-b0e1-4d08-b072-29c934720c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:00.957984 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4037/8078] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:00.970494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681655-bfbe-4791-9494-44184701c340 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:00.974291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681655-bfbe-4791-9494-44184701c340 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:00.974291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681655-bfbe-4791-9494-44184701c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.004705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cf681655-bfbe-4791-9494-44184701c340 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:01.006692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cf681655-bfbe-4791-9494-44184701c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:01.017671 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4042/8079] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:01.022433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d5e5-b0e1-4d08-b072-29c934720c77 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:01.036435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d5e5-b0e1-4d08-b072-29c934720c77 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:01.051014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:01.052265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:01.053643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:01.054354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.057175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:51:01.057739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:01.059940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:01.080270 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4038/8080] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:51:01.085281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681655-bfbe-4791-9494-44184701c340 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:01.102271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681655-bfbe-4791-9494-44184701c340 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:01.120532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:01.121167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:01.121815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:01.123703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.124556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:01.128752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:01.334230 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4043/8081] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:51:01 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:51:01.341681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:01.361560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216beda1-ab29-4d81-9855-8ceb75e3a19e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:01.485175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:01.485175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:01.485175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:01.485175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.485742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:01.494028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:01.634432 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4039/8082] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:51:01 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:51:01.638574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:01.668519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac4517-4185-47c4-878a-5e01456ef9f0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:01.686285 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:01.686974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:01.688086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:01.688506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.689347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:01.691276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:01.694182 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:01.704769 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4044/8083] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:51:01.708691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:01.725597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a9c9-c1ad-4484-9644-45eaf3c2dd09 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:01.748815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11f78a-b0ce-4b82-82b3-79395208d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:01.748815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11f78a-b0ce-4b82-82b3-79395208d3df admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:01.748815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11f78a-b0ce-4b82-82b3-79395208d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:01.748815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11f78a-b0ce-4b82-82b3-79395208d3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.749306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11f78a-b0ce-4b82-82b3-79395208d3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:01.751088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11f78a-b0ce-4b82-82b3-79395208d3df admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:01.774775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:01.783612 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4040/8084] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:51:01.797101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ce8d-c478-4430-9f4c-c6f5940c3e9d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:01.802724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:01.803573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:01.804198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:01.804585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] PATH_INFO: `/v3/projects/a940d505170d4ef4bc4d78eb58e0a3fb/users/423f522a9e074022a85d3bba14ea0884/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.845129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a940d505170d4ef4bc4d78eb58e0a3fb, user_id=423f522a9e074022a85d3bba14ea0884, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:01.851459 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:01.952172 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4045/8085] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:51:01 2022] PUT /identity/v3/projects/a940d505170d4ef4bc4d78eb58e0a3fb/users/423f522a9e074022a85d3bba14ea0884/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:01.957742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258aa36-6fa1-43b8-9af5-45da0de44c85 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:01.958292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258aa36-6fa1-43b8-9af5-45da0de44c85 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:01.958724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258aa36-6fa1-43b8-9af5-45da0de44c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:01.993764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8258aa36-6fa1-43b8-9af5-45da0de44c85 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:01.996027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8258aa36-6fa1-43b8-9af5-45da0de44c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:02.145005 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4041/8086] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:02.178406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:02.180934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:02.339442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7a80a-28ba-4c82-94b3-77aa2b69f0c1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:02.348076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:02.349083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:02.349491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:02.349858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:02.362913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:02.365256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:02.382518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4046/8087] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:03.042496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258aa36-6fa1-43b8-9af5-45da0de44c85 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:03.076573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258aa36-6fa1-43b8-9af5-45da0de44c85 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:03.087122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:03.088513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:03.090314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:03.092250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:03.096817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:03.127334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:03.129090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:03.141227 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:03.156552 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4042/8088] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:03.185044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:03.186696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:03.350296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a6a1-835f-4ef7-96eb-befebc086809 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:03.365641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cca1b3-76c2-4cf7-89fb-c3b273789935 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:03.366437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cca1b3-76c2-4cf7-89fb-c3b273789935 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:03.366929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cca1b3-76c2-4cf7-89fb-c3b273789935 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:03.367356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cca1b3-76c2-4cf7-89fb-c3b273789935 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:03.369443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78cca1b3-76c2-4cf7-89fb-c3b273789935 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:03.454308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cca1b3-76c2-4cf7-89fb-c3b273789935 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:03.456643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cca1b3-76c2-4cf7-89fb-c3b273789935 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:03.493547 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4047/8089] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:51:13.462236 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:18.698296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:18.702139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:18.724880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1606f-2706-4877-8cab-a1305f9458a5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:18.730063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:18.731339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:18.731781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:18.732210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] PATH_INFO: `/v3/users/38c7799d37d747b08a9e20e15c3d6879` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:18.733715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c7799d37d747b08a9e20e15c3d6879)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:18.736867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:18.979325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c7799d37d747b08a9e20e15c3d6879'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:18.991354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c7799d37d747b08a9e20e15c3d6879'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:18.996577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c7799d37d747b08a9e20e15c3d6879'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:19.060283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c7799d37d747b08a9e20e15c3d6879'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:19.061142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c7799d37d747b08a9e20e15c3d6879'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:19.086716 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4043/8090] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:51:18 2022] DELETE /identity/v3/users/38c7799d37d747b08a9e20e15c3d6879 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:19.091034 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:19.091512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:19.091691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:19.135259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:19.136508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:19.319749 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4048/8091] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:19.330468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:19.332134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:19.428980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cda47-8d3a-4a88-a55c-c7ceae166ece admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:19.434121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:19.435418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:19.435864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:19.440933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:19.464327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:19.465862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:19.494315 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4044/8092] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:20.053936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:20.056481 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:20.082791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c1398-8f3f-45cd-ac13-26c564892eac None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:20.091985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:20.092698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:20.093020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:20.093372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] PATH_INFO: `/v3/projects/a028aafec3294eae9a1c1a9a4e907dc2` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:20.095633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a028aafec3294eae9a1c1a9a4e907dc2)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:20.098584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:20.289764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a028aafec3294eae9a1c1a9a4e907dc2', 'request_id': 'req-899d13bf-db62-49f5-95f0-72bec8e15d7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.311384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a028aafec3294eae9a1c1a9a4e907dc2', 'request_id': 'req-899d13bf-db62-49f5-95f0-72bec8e15d7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.420870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a028aafec3294eae9a1c1a9a4e907dc2', 'request_id': 'req-899d13bf-db62-49f5-95f0-72bec8e15d7d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.443668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] The token cache is being invalidate because project a028aafec3294eae9a1c1a9a4e907dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:51:20.444887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.446485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.450848 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4049/8093] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:51:20 2022] DELETE /identity/v3/projects/a028aafec3294eae9a1c1a9a4e907dc2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:20.455316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:20.479135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3700e-cfd3-408a-aa3b-47bf902fe0e5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:20.607302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:20.608120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:20.608457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:20.608737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] PATH_INFO: `/v3/users/e15dc1d65e6c437f8dfb90c1d4b23b97` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:20.611809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15dc1d65e6c437f8dfb90c1d4b23b97)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:20.614209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:20.664673 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:20.851728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15dc1d65e6c437f8dfb90c1d4b23b97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.865123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15dc1d65e6c437f8dfb90c1d4b23b97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.867138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15dc1d65e6c437f8dfb90c1d4b23b97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.959724 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15dc1d65e6c437f8dfb90c1d4b23b97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:20.961647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c6f3a583-8e0a-4191-8699-4fa560c8001e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15dc1d65e6c437f8dfb90c1d4b23b97'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:21.007554 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4045/8094] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:51:20 2022] DELETE /identity/v3/users/e15dc1d65e6c437f8dfb90c1d4b23b97 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:21.729279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:21.730891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:21.757958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d13bf-db62-49f5-95f0-72bec8e15d7d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:21.923337 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:21.924305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:21.924794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:21.926248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] PATH_INFO: `/v3/projects/c6c13c5ccb0b4f0a818a5aef2be4f249` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:21.928738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c13c5ccb0b4f0a818a5aef2be4f249)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:21.931517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:22.085768 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:22.112751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c13c5ccb0b4f0a818a5aef2be4f249', 'request_id': 'req-40954c11-ba89-41ee-9b2a-bec0f52d9480'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.121329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c13c5ccb0b4f0a818a5aef2be4f249', 'request_id': 'req-40954c11-ba89-41ee-9b2a-bec0f52d9480'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.175027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:22.175517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:22.175648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:22.191565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c13c5ccb0b4f0a818a5aef2be4f249', 'request_id': 'req-40954c11-ba89-41ee-9b2a-bec0f52d9480'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.229040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] The token cache is being invalidate because project c6c13c5ccb0b4f0a818a5aef2be4f249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:51:22.229617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.230599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.232797 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4050/8095] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:51:21 2022] DELETE /identity/v3/projects/c6c13c5ccb0b4f0a818a5aef2be4f249 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:22.236830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:22.240934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:22.261052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] MFA Rules not processed for user `423f522a9e074022a85d3bba14ea0884`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:22.267549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:22.373116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954c11-ba89-41ee-9b2a-bec0f52d9480 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:22.387000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:22.387950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:22.388394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:22.388823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] PATH_INFO: `/v3/users/be8197e50cff43bda8b0b19a6efc5afa` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:22.392030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8197e50cff43bda8b0b19a6efc5afa)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:22.395394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:22.455897 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4046/8096] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:51:22.462856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:22.485896 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:22.552661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6820b-4ffb-4ec8-9c77-bf743860a9ce None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:22.559489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:22.560794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:22.561372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:22.561873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:22.562786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:22.569832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:22.642397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8197e50cff43bda8b0b19a6efc5afa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.654755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8197e50cff43bda8b0b19a6efc5afa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.655676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8197e50cff43bda8b0b19a6efc5afa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.705014 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4047/8097] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:51:22 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:51:22.708233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:22.748452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8197e50cff43bda8b0b19a6efc5afa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.750321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8197e50cff43bda8b0b19a6efc5afa'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:22.804584 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4051/8098] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:51:22 2022] DELETE /identity/v3/users/be8197e50cff43bda8b0b19a6efc5afa => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:51:22.807210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf8be-c257-40b9-91a7-a872997b1737 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:22.818152 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:22.955008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:22.955008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:22.955345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:22.955669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:22.956689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:22.979563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:23.143896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:23.145164 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4048/8099] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:51:22 2022] POST /identity/v3/users => generated 293 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:51:23.145913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:23.164171 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675045e-c9b3-40d5-bf63-01cf5842f4c4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:23.201538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:23.203506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:23.213510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:23.214431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:23.219278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:23.219806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:23.224643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:23.224643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:23.243172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da1362-1ffc-4db8-953e-00c451324184 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:23.257393 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4052/8100] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:51:23.263530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:23.265493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:23.266637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:23.266915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:23.279247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] PATH_INFO: `/v3/projects/cac87264e0fe438681c22ee09d7022b2` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:23.281188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac87264e0fe438681c22ee09d7022b2)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:23.291018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:23.305340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfdffe-c8f8-4b47-8edb-a6aa5e7c1a5c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:23.321719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:23.322592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:23.323959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:23.324360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] PATH_INFO: `/v3/projects/333acdf852374aa4a4c5e1c299274ddb/users/c554eff49e424172b1f23f6791a72ce8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:23.412582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333acdf852374aa4a4c5e1c299274ddb, user_id=c554eff49e424172b1f23f6791a72ce8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:23.413153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:23.491833 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:23.497965 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4053/8101] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:51:23 2022] PUT /identity/v3/projects/333acdf852374aa4a4c5e1c299274ddb/users/c554eff49e424172b1f23f6791a72ce8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:23.502413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:23.523810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac87264e0fe438681c22ee09d7022b2', 'request_id': 'req-75e15561-9dad-4835-99af-6ac3947357c3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:23.535807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac87264e0fe438681c22ee09d7022b2', 'request_id': 'req-75e15561-9dad-4835-99af-6ac3947357c3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:23.615043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac87264e0fe438681c22ee09d7022b2', 'request_id': 'req-75e15561-9dad-4835-99af-6ac3947357c3'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:23.647667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] The token cache is being invalidate because project cac87264e0fe438681c22ee09d7022b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:51:23.648051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:23.650025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:23.659871 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4049/8102] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:51:23 2022] DELETE /identity/v3/projects/cac87264e0fe438681c22ee09d7022b2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:51:23.673112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff957c-5a3a-462a-a033-427bf98a8ae1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:23.880557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:23.886958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:23.887400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:23.887746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:23.888531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:23.895056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:23.942263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:23.944151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:23.964284 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4054/8103] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:51:23.974662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e15561-9dad-4835-99af-6ac3947357c3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:23.994655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:24.004175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:24.004575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:24.005048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] PATH_INFO: `/v3/projects/333acdf852374aa4a4c5e1c299274ddb/users/c554eff49e424172b1f23f6791a72ce8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:24.010701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=333acdf852374aa4a4c5e1c299274ddb, user_id=c554eff49e424172b1f23f6791a72ce8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:24.022113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:24.071811 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4050/8104] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:51:23 2022] PUT /identity/v3/projects/333acdf852374aa4a4c5e1c299274ddb/users/c554eff49e424172b1f23f6791a72ce8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:25.355254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:25.357895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:25.504995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9ab0-764b-424b-94f4-5057750647fd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:25.601088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:25.602539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:25.608114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:25.608114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:25.608114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:25.617563 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:25.733181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:25.749551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:25.773219 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4055/8105] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:28.256092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:28.258588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:28.432587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1f9f7-9c11-4351-b4a0-d382d88f42fe admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:28.442749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:28.443688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:28.444524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:28.444977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:28.447237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:28.504866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:28.506647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:28.512687 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:28.532534 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4051/8106] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:28.665109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:28.670507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:28.712196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bd374-b7a2-43de-be84-d813c2c67e96 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:28.724761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:28.731131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:28.731131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:28.731131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] PATH_INFO: `/v3/users/2630e3eda1df4f698cad1eda511ad76a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:28.731131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2630e3eda1df4f698cad1eda511ad76a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:28.731131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:29.038549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2630e3eda1df4f698cad1eda511ad76a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:29.065562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2630e3eda1df4f698cad1eda511ad76a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:29.066800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2630e3eda1df4f698cad1eda511ad76a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:29.164454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2630e3eda1df4f698cad1eda511ad76a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:29.165345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e0cf348e-0663-43cb-b432-deca3266c10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2630e3eda1df4f698cad1eda511ad76a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:29.215440 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4056/8107] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:51:28 2022] DELETE /identity/v3/users/2630e3eda1df4f698cad1eda511ad76a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:29.716348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:29.763541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ba692-c5d5-4020-a3de-99e2d2c8aa79 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:29.884658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:29.885539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:29.887480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:29.887838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] PATH_INFO: `/v3/projects/7e64fd5446d541da9d10af97a24ea037` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:29.889248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e64fd5446d541da9d10af97a24ea037)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:29.895998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:30.021950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e64fd5446d541da9d10af97a24ea037', 'request_id': 'req-e78d6d03-09c5-4390-96aa-8a7f1de6a326'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:30.058830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e64fd5446d541da9d10af97a24ea037', 'request_id': 'req-e78d6d03-09c5-4390-96aa-8a7f1de6a326'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:30.135809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e64fd5446d541da9d10af97a24ea037', 'request_id': 'req-e78d6d03-09c5-4390-96aa-8a7f1de6a326'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:30.158450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] The token cache is being invalidate because project 7e64fd5446d541da9d10af97a24ea037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:51:30.158750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:30.159435 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-e78d6d03-09c5-4390-96aa-8a7f1de6a326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:51:30.164445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4052/8108] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:51:29 2022] DELETE /identity/v3/projects/7e64fd5446d541da9d10af97a24ea037 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:51:30.166190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1da96-748c-480b-a0ef-1d9097290464 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:30.166652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1da96-748c-480b-a0ef-1d9097290464 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:30.166777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1da96-748c-480b-a0ef-1d9097290464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:30.206874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4cf1da96-748c-480b-a0ef-1d9097290464 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:30.208269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4cf1da96-748c-480b-a0ef-1d9097290464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:30.348450 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4057/8109] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:30.357474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f218-3881-4a6b-9e66-a7ddae54de1f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:30.357760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f218-3881-4a6b-9e66-a7ddae54de1f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:30.358068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f218-3881-4a6b-9e66-a7ddae54de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:30.443531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3939f218-3881-4a6b-9e66-a7ddae54de1f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:30.444587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3939f218-3881-4a6b-9e66-a7ddae54de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:30.482594 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4053/8110] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:30.487406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1da96-748c-480b-a0ef-1d9097290464 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:30.499477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1da96-748c-480b-a0ef-1d9097290464 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:30.507047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:30.509567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:30.509730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:30.510252 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:30.511599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:51:30.512122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:30.515329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:30.558631 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4058/8111] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:51:30.561561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f218-3881-4a6b-9e66-a7ddae54de1f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:30.565712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f218-3881-4a6b-9e66-a7ddae54de1f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:30.575997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:30.576823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:30.577649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:30.577929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:30.578686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:30.581034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:30.709484 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4054/8112] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:51:30 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:51:30.713638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:30.733862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901026b-2865-43de-8c33-9bc47034999b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:30.741253 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:30.854272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:30.855321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:30.856138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:30.856574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:30.858086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:30.861778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:31.007766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:31.009223 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4059/8113] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:51:30 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:51:31.028267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d604c-0e9e-4717-8979-86928d648218 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:31.042783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:31.043761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:31.044209 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:31.044647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:31.045793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:31.048178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:31.061111 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4055/8114] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:51:31.075844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:31.108800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a6d0b-c8e6-4eae-b969-2939bc7a58e1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:31.123517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548a9d7-77a1-48b4-ae1f-3cc0775124b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:31.124774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a9d7-77a1-48b4-ae1f-3cc0775124b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:31.125787 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a9d7-77a1-48b4-ae1f-3cc0775124b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:31.126278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a9d7-77a1-48b4-ae1f-3cc0775124b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:31.127157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548a9d7-77a1-48b4-ae1f-3cc0775124b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:31.129626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548a9d7-77a1-48b4-ae1f-3cc0775124b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:31.145926 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4060/8115] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:51:31.150730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:31.163667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7ee7-5509-4ec8-9da2-046987ad97ea admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:31.176101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:31.177042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:31.177476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:31.178148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] PATH_INFO: `/v3/projects/2d2eed6aa1254866af0c7afe641b4848/users/88aa9c3bafb84edab2560e25f32a26e7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:31.239192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2eed6aa1254866af0c7afe641b4848, user_id=88aa9c3bafb84edab2560e25f32a26e7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:31.242456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:31.340887 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4056/8116] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:51:31 2022] PUT /identity/v3/projects/2d2eed6aa1254866af0c7afe641b4848/users/88aa9c3bafb84edab2560e25f32a26e7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:51:31.352274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a934-97aa-4183-b7ab-8e3b9e1c7995 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:31.353118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a934-97aa-4183-b7ab-8e3b9e1c7995 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:31.353679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a934-97aa-4183-b7ab-8e3b9e1c7995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:31.415167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8e38a934-97aa-4183-b7ab-8e3b9e1c7995 None None] MFA Rules not processed for user `88aa9c3bafb84edab2560e25f32a26e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:31.416596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8e38a934-97aa-4183-b7ab-8e3b9e1c7995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:31.704611 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4061/8117] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:31.716287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:31.718179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:31.823551 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:31.952491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429578-b53d-4cbc-8644-6055f3a5fddf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:31.971647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:31.972417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:31.972757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:31.973622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:32.011035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:32.014409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:32.059882 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4057/8118] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:36.216107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb97c4-d757-4357-babb-8a6db399e4d2 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:36.216634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb97c4-d757-4357-babb-8a6db399e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:36.216634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb97c4-d757-4357-babb-8a6db399e4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:36.266135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5bfb97c4-d757-4357-babb-8a6db399e4d2 None None] MFA Rules not processed for user `c554eff49e424172b1f23f6791a72ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:36.266546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5bfb97c4-d757-4357-babb-8a6db399e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:36.389601 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:36.423951 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4062/8119] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:36.448638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:36.451018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:36.606533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202aa4-0433-4ec4-9843-c00edfdeabce service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:36.612695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:36.613310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:36.613587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:36.613861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:36.623054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:36.625258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:36.636525 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4058/8120] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:36.724375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:36.725781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:36.729265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:36.767576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] MFA Rules not processed for user `423f522a9e074022a85d3bba14ea0884`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:36.770580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:36.891471 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4063/8121] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:51:38.500025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:38.502168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:38.658241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7edc5-caac-4aeb-9482-f73d0369f623 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:38.669789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5a4be-cff6-4427-9236-8b20aecbd60d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:38.673874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5a4be-cff6-4427-9236-8b20aecbd60d service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:38.673874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5a4be-cff6-4427-9236-8b20aecbd60d service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:38.673874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5a4be-cff6-4427-9236-8b20aecbd60d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:38.676157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c6e5a4be-cff6-4427-9236-8b20aecbd60d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:38.708702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5a4be-cff6-4427-9236-8b20aecbd60d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:38.710390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5a4be-cff6-4427-9236-8b20aecbd60d service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:38.754146 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4059/8122] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:46.877124 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=25 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:48.727920 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=81 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:51:53.305127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:51:53.306965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:53.435318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d413-05dc-49e3-8fe7-8880d10bf8a0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:51:53.446902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:51:53.456976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:53.456976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:53.456976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:53.456976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:53.465949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:51:53.470153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:51:53.503114 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4064/8123] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:51:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:51:57.243367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455deb13-14ac-465b-b905-4cfaed45c599 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:51:57.243748 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455deb13-14ac-465b-b905-4cfaed45c599 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:51:57.243905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455deb13-14ac-465b-b905-4cfaed45c599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:51:57.271476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-455deb13-14ac-465b-b905-4cfaed45c599 None None] MFA Rules not processed for user `423f522a9e074022a85d3bba14ea0884`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:51:57.273226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-455deb13-14ac-465b-b905-4cfaed45c599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:51:57.282739 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4060/8124] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:51:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:52:03.494222 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=26 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:04.768898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:04.864157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f481c47-94a9-46d5-b38d-36d153cc519b service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:04.869727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:04.870502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:04.870845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:04.872037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] PATH_INFO: `/v3/users/88aa9c3bafb84edab2560e25f32a26e7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:04.873322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88aa9c3bafb84edab2560e25f32a26e7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:04.881130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:05.600769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88aa9c3bafb84edab2560e25f32a26e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:05.618043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88aa9c3bafb84edab2560e25f32a26e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:05.618448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88aa9c3bafb84edab2560e25f32a26e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:05.739654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88aa9c3bafb84edab2560e25f32a26e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:05.740562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88aa9c3bafb84edab2560e25f32a26e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:05.763048 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4065/8125] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:52:04 2022] DELETE /identity/v3/users/88aa9c3bafb84edab2560e25f32a26e7 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:52:05.768733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:05.769275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:05.770186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:05.822773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:52:05.822773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:05.963310 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4061/8126] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:52:06.032247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:06.033727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:06.113258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eca2a-b6a2-43b8-9f79-2e3e831f7af8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:06.132367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa34b4-4182-45fa-8a2d-6ad5bc078d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:06.133278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa34b4-4182-45fa-8a2d-6ad5bc078d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:06.133564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa34b4-4182-45fa-8a2d-6ad5bc078d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:06.133844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa34b4-4182-45fa-8a2d-6ad5bc078d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:06.146301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa34b4-4182-45fa-8a2d-6ad5bc078d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:06.148311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa34b4-4182-45fa-8a2d-6ad5bc078d32 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:06.170670 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4066/8127] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:52:06.906549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:06.912702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:06.932063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee29fe-9c6c-4bf0-9125-58f89e962c97 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:06.948256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:06.948256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:06.948256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:06.948256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] PATH_INFO: `/v3/projects/2d2eed6aa1254866af0c7afe641b4848` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:06.950257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2eed6aa1254866af0c7afe641b4848)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:06.955115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:07.099878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2eed6aa1254866af0c7afe641b4848', 'request_id': 'req-b1a8fe36-3861-498b-aefe-4055304814ab'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:07.111409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2eed6aa1254866af0c7afe641b4848', 'request_id': 'req-b1a8fe36-3861-498b-aefe-4055304814ab'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:07.208047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2eed6aa1254866af0c7afe641b4848', 'request_id': 'req-b1a8fe36-3861-498b-aefe-4055304814ab'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:07.225875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] The token cache is being invalidate because project 2d2eed6aa1254866af0c7afe641b4848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:52:07.226360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:07.228134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:07.239829 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4062/8128] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:52:06 2022] DELETE /identity/v3/projects/2d2eed6aa1254866af0c7afe641b4848 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:52:16.155530 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:17.222072 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:28.050255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c272b-7ce2-4cce-9ffb-58ad1766e23e None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:28.050790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c272b-7ce2-4cce-9ffb-58ad1766e23e None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:28.050790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c272b-7ce2-4cce-9ffb-58ad1766e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:28.084155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-692c272b-7ce2-4cce-9ffb-58ad1766e23e None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:52:28.086552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-692c272b-7ce2-4cce-9ffb-58ad1766e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:28.210335 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4067/8129] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:52:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:52:37.846531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:37.848402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:37.953350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8fe36-3861-498b-aefe-4055304814ab admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:37.960425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:37.961548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:37.962210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:37.962829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] PATH_INFO: `/v3/users/423f522a9e074022a85d3bba14ea0884` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:37.964383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423f522a9e074022a85d3bba14ea0884)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:37.967173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:38.191020 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=25 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:38.222730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423f522a9e074022a85d3bba14ea0884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:38.234501 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423f522a9e074022a85d3bba14ea0884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:38.235274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423f522a9e074022a85d3bba14ea0884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:38.336135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423f522a9e074022a85d3bba14ea0884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:38.336806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423f522a9e074022a85d3bba14ea0884'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:38.360918 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4063/8130] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:52:37 2022] DELETE /identity/v3/users/423f522a9e074022a85d3bba14ea0884 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:52:38.838242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c272b-7ce2-4cce-9ffb-58ad1766e23e None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:38.858464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c272b-7ce2-4cce-9ffb-58ad1766e23e None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:38.981393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:38.982069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:38.982349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:38.982800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] PATH_INFO: `/v3/projects/a940d505170d4ef4bc4d78eb58e0a3fb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:38.984043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a940d505170d4ef4bc4d78eb58e0a3fb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:38.986040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:39.167846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a940d505170d4ef4bc4d78eb58e0a3fb', 'request_id': 'req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.180552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a940d505170d4ef4bc4d78eb58e0a3fb', 'request_id': 'req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.262765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a940d505170d4ef4bc4d78eb58e0a3fb', 'request_id': 'req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.282385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] The token cache is being invalidate because project a940d505170d4ef4bc4d78eb58e0a3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:52:39.284189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.287263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.292794 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4068/8131] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:52:38 2022] DELETE /identity/v3/projects/a940d505170d4ef4bc4d78eb58e0a3fb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:52:39.294647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:39.296163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:39.311725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fa3ef-195d-4f49-afa7-553d30d53b31 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:39.425319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:39.426213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:39.426742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:39.427213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] PATH_INFO: `/v3/users/c554eff49e424172b1f23f6791a72ce8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:39.428441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c554eff49e424172b1f23f6791a72ce8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:39.430707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:39.464108 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:39.671167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c554eff49e424172b1f23f6791a72ce8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.681431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c554eff49e424172b1f23f6791a72ce8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.682307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c554eff49e424172b1f23f6791a72ce8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.789291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c554eff49e424172b1f23f6791a72ce8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.790131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-39e1db3a-af96-4fce-8afa-7a71309798ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c554eff49e424172b1f23f6791a72ce8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:39.842552 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4064/8132] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:52:39 2022] DELETE /identity/v3/users/c554eff49e424172b1f23f6791a72ce8 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:52:40.257243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:40.258722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:40.286055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbac14f-1b14-4d92-91c4-6d5c5f45a654 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:40.374949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:40.375664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:40.375965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:40.376242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] PATH_INFO: `/v3/projects/333acdf852374aa4a4c5e1c299274ddb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:40.377477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333acdf852374aa4a4c5e1c299274ddb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:40.379420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:40.543985 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:40.565080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333acdf852374aa4a4c5e1c299274ddb', 'request_id': 'req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:40.571884 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333acdf852374aa4a4c5e1c299274ddb', 'request_id': 'req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:40.668736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333acdf852374aa4a4c5e1c299274ddb', 'request_id': 'req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:40.688769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] The token cache is being invalidate because project 333acdf852374aa4a4c5e1c299274ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:52:40.689780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:40.690771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2522d6ad-2916-4ab6-b4f2-8f10a31c73b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:52:40.693431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4069/8133] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:52:40 2022] DELETE /identity/v3/projects/333acdf852374aa4a4c5e1c299274ddb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:52:40.698639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ff56-2e31-4d4c-8bd1-607f5363257b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:40.699557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ff56-2e31-4d4c-8bd1-607f5363257b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:40.700132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ff56-2e31-4d4c-8bd1-607f5363257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:40.726452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1809ff56-2e31-4d4c-8bd1-607f5363257b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:52:40.731202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1809ff56-2e31-4d4c-8bd1-607f5363257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:40.811150 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4065/8134] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:52:40.819427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713814a-74c1-45d9-9ca2-8de8704f9885 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:40.820044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713814a-74c1-45d9-9ca2-8de8704f9885 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:40.820484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713814a-74c1-45d9-9ca2-8de8704f9885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:40.843767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0713814a-74c1-45d9-9ca2-8de8704f9885 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:52:40.845603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0713814a-74c1-45d9-9ca2-8de8704f9885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:40.858303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4070/8135] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:52:40.863286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ff56-2e31-4d4c-8bd1-607f5363257b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:40.873873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ff56-2e31-4d4c-8bd1-607f5363257b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:40.880404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:40.881141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:40.881489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:40.881831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:40.882603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:52:40.882975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:40.884693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:40.906030 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4066/8136] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:52:40.907892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713814a-74c1-45d9-9ca2-8de8704f9885 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:40.927190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713814a-74c1-45d9-9ca2-8de8704f9885 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:40.932060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:40.932683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:40.932962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:40.933230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:40.933868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:40.935799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:41.063615 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4071/8137] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:52:40 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:52:41.068504 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:41.091372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9916c-ab60-40e8-8c29-0e8e7991812e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:41.204534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:41.209760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:41.209760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:41.209760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:41.209760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:41.209760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:41.346220 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4067/8138] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:52:41 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:52:41.358546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:41.392519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c8ba1-319c-4823-af0a-3f5033bd8263 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:41.400077 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:41.400728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:41.401006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:41.401278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:41.401926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:41.403685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:41.417790 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4072/8139] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:52:41.419572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:41.429644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fbecd-0ce8-472b-b3bb-820edd8669c5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:41.434682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d52cc0-b696-4b15-aea9-58bc207a3ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:41.435557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52cc0-b696-4b15-aea9-58bc207a3ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:41.436070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52cc0-b696-4b15-aea9-58bc207a3ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:41.436728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52cc0-b696-4b15-aea9-58bc207a3ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:41.437625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d52cc0-b696-4b15-aea9-58bc207a3ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:41.439388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d52cc0-b696-4b15-aea9-58bc207a3ebe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:41.454762 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4068/8140] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:52:41.456201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:41.467840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd424fb-aef9-4a1b-a330-0bb341972887 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:41.477841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:41.477841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:41.477841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:41.477841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] PATH_INFO: `/v3/projects/530303744266461da10d50db53a0e409/users/f949b4b3b7b143158acb8aa6ee0a7da8/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:41.508216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] RBAC: Authorizing `identity:create_grant(project_id=530303744266461da10d50db53a0e409, user_id=f949b4b3b7b143158acb8aa6ee0a7da8, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:41.517516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:41.641653 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4073/8141] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:52:41 2022] PUT /identity/v3/projects/530303744266461da10d50db53a0e409/users/f949b4b3b7b143158acb8aa6ee0a7da8/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:52:41.647557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b9f5-72c5-446e-9456-e05c0a79d170 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:41.647872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b9f5-72c5-446e-9456-e05c0a79d170 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:41.648180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b9f5-72c5-446e-9456-e05c0a79d170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:41.682529 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:41.706196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1a58b9f5-72c5-446e-9456-e05c0a79d170 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:52:41.708327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a58b9f5-72c5-446e-9456-e05c0a79d170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:41.813669 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4069/8142] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:52:41.827150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:41.829548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:41.897123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d72c10-ac3f-4f93-8b64-e34ba22a295c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:41.900857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:41.901508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:41.901786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:41.902088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:41.912101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:41.913525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:41.924235 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4074/8143] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:52:50.714683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c147-1793-4ab2-b285-b08bcd84f9df None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:50.714683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c147-1793-4ab2-b285-b08bcd84f9df None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:50.714683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c147-1793-4ab2-b285-b08bcd84f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:50.786494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a4e6c147-1793-4ab2-b285-b08bcd84f9df None None] MFA Rules not processed for user `f949b4b3b7b143158acb8aa6ee0a7da8`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:52:50.786494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a4e6c147-1793-4ab2-b285-b08bcd84f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:52:51.032832 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4070/8144] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:52:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:52:51.033630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:51.046505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c651f-0164-4100-9c40-a1b680c9b1e9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:51.060869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:51.061480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:51.061757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:51.063828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:51.064473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:51.083630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:51.226703 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4075/8145] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:52:51 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:52:51.230290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6c147-1793-4ab2-b285-b08bcd84f9df None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:51.246983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6c147-1793-4ab2-b285-b08bcd84f9df None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:51.361690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:51.361690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:51.361690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:51.361690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:51.362167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:51.362167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:51.480810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4071/8146] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:52:51 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:52:51.481876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:51.493632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73982a-6626-4d40-8fbf-7df47ee15b12 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:51.500130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:51.501740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:51.502203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:51.502910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:51.516998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:51.516998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:51.533489 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4076/8147] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:52:51.537312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:51.549066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cf4b1-0104-41d8-8ae2-cb732828270a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:51.554093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:51.561692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:51.561692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:51.561692 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] PATH_INFO: `/v3/projects/df06581fbc3a46ff89c58ad880a8e11e/users/10749b926c094d78b58eccd14d7e309b/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:51.578482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] RBAC: Authorizing `identity:create_grant(project_id=df06581fbc3a46ff89c58ad880a8e11e, user_id=10749b926c094d78b58eccd14d7e309b, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:51.581777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:51.664094 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:51.672474 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4072/8148] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:52:51 2022] PUT /identity/v3/projects/df06581fbc3a46ff89c58ad880a8e11e/users/10749b926c094d78b58eccd14d7e309b/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:52:51.676734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:51.692533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc25ad-a834-4ebd-868b-4abc6395b3d9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:51.744930 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:52:51.814284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a74c35-e2be-4dfb-b3e5-35f3413eb4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:51.814919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74c35-e2be-4dfb-b3e5-35f3413eb4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:51.815445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74c35-e2be-4dfb-b3e5-35f3413eb4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:51.815725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a74c35-e2be-4dfb-b3e5-35f3413eb4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:51.822009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a74c35-e2be-4dfb-b3e5-35f3413eb4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:51.823824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a74c35-e2be-4dfb-b3e5-35f3413eb4fe admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:51.838347 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4077/8149] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:52:51.845405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:52:51.856167 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291bbb-8afb-4ea2-8665-db7a6c4391df admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:52:51.862726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:52:51.863404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:52:51.864224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:52:51.864224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] PATH_INFO: `/v3/projects/df06581fbc3a46ff89c58ad880a8e11e/users/10749b926c094d78b58eccd14d7e309b/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:52:51.865966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df06581fbc3a46ff89c58ad880a8e11e, user_id=10749b926c094d78b58eccd14d7e309b, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:52:51.872887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:52:51.888688 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4073/8150] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:52:51 2022] PUT /identity/v3/projects/df06581fbc3a46ff89c58ad880a8e11e/users/10749b926c094d78b58eccd14d7e309b/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:53:02.193941 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=5,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:02.606902 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=17 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:02.835968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:02.836244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:02.836715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:02.878914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] MFA Rules not processed for user `10749b926c094d78b58eccd14d7e309b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:02.880749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:03.020156 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4078/8151] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:03.037064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:03.038940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:03.188393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7fcf9-236f-4e9b-991c-5800a5e60c28 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:03.208002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef320387-e0b9-4959-9091-9b858997d5d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:03.209173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320387-e0b9-4959-9091-9b858997d5d5 service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:03.209588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320387-e0b9-4959-9091-9b858997d5d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:03.209927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320387-e0b9-4959-9091-9b858997d5d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:03.347672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef320387-e0b9-4959-9091-9b858997d5d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:03.349387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef320387-e0b9-4959-9091-9b858997d5d5 service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:03.360638 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4074/8152] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:53:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:53:03.809589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:03.811096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:03.905554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f01ce-9c2b-4d85-b06f-2f81bb30363a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:03.911812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:03.912454 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:03.912983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:03.913424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] PATH_INFO: `/v3/users/6ac03fe41c9f41148b0d7294d9880734` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:03.917463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac03fe41c9f41148b0d7294d9880734)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:03.920054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:04.118802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac03fe41c9f41148b0d7294d9880734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:04.128561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac03fe41c9f41148b0d7294d9880734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:04.129556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac03fe41c9f41148b0d7294d9880734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:04.404251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac03fe41c9f41148b0d7294d9880734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:04.405483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac03fe41c9f41148b0d7294d9880734'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:04.434958 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4079/8153] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:53:03 2022] DELETE /identity/v3/users/6ac03fe41c9f41148b0d7294d9880734 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:53:04.439746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:04.440148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:04.440346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:04.489831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:04.491110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:04.649332 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4075/8154] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:04.659591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:04.661127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:04.668651 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:04.800109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a29cd-47fb-4883-96e9-516f712f1fad admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:04.800109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7290af-8381-4544-87da-c013084dac09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:04.800109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7290af-8381-4544-87da-c013084dac09 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:04.800109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7290af-8381-4544-87da-c013084dac09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:04.801128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7290af-8381-4544-87da-c013084dac09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:04.801128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7290af-8381-4544-87da-c013084dac09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:04.801128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7290af-8381-4544-87da-c013084dac09 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:04.801128 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4080/8155] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:53:05.118003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:05.119491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:05.139317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf47cdc-3fd8-4b07-b874-32e967622983 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:05.157184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:05.157852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:05.158163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:05.158423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] PATH_INFO: `/v3/projects/274d73c92c44470aa08b93ca67623828` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:05.160155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274d73c92c44470aa08b93ca67623828)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:05.162162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:05.321548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274d73c92c44470aa08b93ca67623828', 'request_id': 'req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:05.323135 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:05.330088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274d73c92c44470aa08b93ca67623828', 'request_id': 'req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:05.459285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274d73c92c44470aa08b93ca67623828', 'request_id': 'req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:05.473882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] The token cache is being invalidate because project 274d73c92c44470aa08b93ca67623828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:53:05.474629 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:05.475683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ed4afd1a-29cc-49c7-9cd7-4a09748eed91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:05.481010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4076/8156] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:53:05 2022] DELETE /identity/v3/projects/274d73c92c44470aa08b93ca67623828 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:53:05.493159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3e33c-db32-4b3e-8529-e9c7b0c63e3d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:05.493159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3e33c-db32-4b3e-8529-e9c7b0c63e3d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:05.493159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3e33c-db32-4b3e-8529-e9c7b0c63e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:05.529391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-02b3e33c-db32-4b3e-8529-e9c7b0c63e3d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:05.529391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-02b3e33c-db32-4b3e-8529-e9c7b0c63e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:05.626862 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4081/8157] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:05.637799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889141b0-60c7-4cb4-b346-a0f93449b90e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:05.638930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889141b0-60c7-4cb4-b346-a0f93449b90e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:05.639706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889141b0-60c7-4cb4-b346-a0f93449b90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:05.681071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-889141b0-60c7-4cb4-b346-a0f93449b90e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:05.683911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-889141b0-60c7-4cb4-b346-a0f93449b90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:05.694746 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4077/8158] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:05.698846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3e33c-db32-4b3e-8529-e9c7b0c63e3d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:05.712429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3e33c-db32-4b3e-8529-e9c7b0c63e3d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:05.731828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:05.733235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:05.734577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:05.735008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:05.735779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:53:05.737084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:05.743603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:05.760047 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4082/8159] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 01:53:05.764256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889141b0-60c7-4cb4-b346-a0f93449b90e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:05.780670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889141b0-60c7-4cb4-b346-a0f93449b90e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:05.786249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:05.787143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:05.787423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:05.788597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:05.792126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:05.795266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:05.979557 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4078/8160] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:53:05 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:53:05.982246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:05.995440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f03e8-aaeb-44c3-9576-d433984c234f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:06.092783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:06.093411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:06.093691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:06.093964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:06.094678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:06.096609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:06.201139 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4083/8161] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:53:05 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:53:06.205331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:06.217621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0c80-6ab8-476a-8238-da52932bf3d6 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:06.230530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:06.231486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:06.231772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:06.232040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:06.232686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:06.234319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:06.253506 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4079/8162] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:53:06.258950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:06.272362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776bcf1-2a00-4306-a718-64b6b3e6884c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:06.277658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f0f1-f67f-485d-b78e-25d2bc7e8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:06.278752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f0f1-f67f-485d-b78e-25d2bc7e8e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:06.279272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f0f1-f67f-485d-b78e-25d2bc7e8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:06.279613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f0f1-f67f-485d-b78e-25d2bc7e8e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:06.280947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f0f1-f67f-485d-b78e-25d2bc7e8e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:06.283795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f0f1-f67f-485d-b78e-25d2bc7e8e23 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:06.298814 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4084/8163] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:53:06.306461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:06.326823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352c7f-dbe8-4bb2-999c-c7ff2ea6d218 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:06.334850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:06.335907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:06.336369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:06.336609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] PATH_INFO: `/v3/projects/f57198521d4046508cb526e9a525d98b/users/661df3cb84bf4a6b9c489017c5d0aaba/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:06.364633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57198521d4046508cb526e9a525d98b, user_id=661df3cb84bf4a6b9c489017c5d0aaba, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:06.367502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:06.447323 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4080/8164] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:53:06 2022] PUT /identity/v3/projects/f57198521d4046508cb526e9a525d98b/users/661df3cb84bf4a6b9c489017c5d0aaba/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:53:06.458249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1913-0860-4ee3-859c-b0b92fd0f252 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:06.458530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1913-0860-4ee3-859c-b0b92fd0f252 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:06.458825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1913-0860-4ee3-859c-b0b92fd0f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:06.517838 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:06.521123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-106a1913-0860-4ee3-859c-b0b92fd0f252 None None] MFA Rules not processed for user `661df3cb84bf4a6b9c489017c5d0aaba`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:06.522633 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-106a1913-0860-4ee3-859c-b0b92fd0f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:06.610278 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4085/8165] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:06.617848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:06.619844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:06.690385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e66951-7328-4c09-ad62-1362f5864d0d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:06.696303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a86de-53df-405c-b8db-2608aa7903a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:06.697174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a86de-53df-405c-b8db-2608aa7903a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:06.697445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a86de-53df-405c-b8db-2608aa7903a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:06.697717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a86de-53df-405c-b8db-2608aa7903a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:06.708663 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a86de-53df-405c-b8db-2608aa7903a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:06.710154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a86de-53df-405c-b8db-2608aa7903a9 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:06.720728 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4081/8166] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:53:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:53:07.519105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1913-0860-4ee3-859c-b0b92fd0f252 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:07.604107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1913-0860-4ee3-859c-b0b92fd0f252 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:07.609669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:07.611047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:07.611518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:07.612019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] PATH_INFO: `/v3/users/661df3cb84bf4a6b9c489017c5d0aaba` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:07.613164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661df3cb84bf4a6b9c489017c5d0aaba)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:07.615122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:07.803421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661df3cb84bf4a6b9c489017c5d0aaba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:07.811612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661df3cb84bf4a6b9c489017c5d0aaba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:07.812590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661df3cb84bf4a6b9c489017c5d0aaba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:08.394385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661df3cb84bf4a6b9c489017c5d0aaba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:08.395248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661df3cb84bf4a6b9c489017c5d0aaba'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:08.418025 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4086/8167] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:53:07 2022] DELETE /identity/v3/users/661df3cb84bf4a6b9c489017c5d0aaba => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:53:08.421071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:08.421557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:08.421683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:08.445302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:08.446781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:08.523614 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4082/8168] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:08.534022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:08.536330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:08.567807 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:08.606762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c4f52-2987-47b9-96b0-70c4cd0055a1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:08.612112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafcae9-bf5c-48ce-a8aa-fc4bbc6798a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:08.612730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafcae9-bf5c-48ce-a8aa-fc4bbc6798a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:08.613012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafcae9-bf5c-48ce-a8aa-fc4bbc6798a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:08.613292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafcae9-bf5c-48ce-a8aa-fc4bbc6798a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:08.623802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafcae9-bf5c-48ce-a8aa-fc4bbc6798a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:08.631186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafcae9-bf5c-48ce-a8aa-fc4bbc6798a3 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:08.643254 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4087/8169] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:53:09.196085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:09.196085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:09.208153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59634-64be-489b-89b1-9baaceb138eb None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:09.214729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:09.215389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:09.215671 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:09.216065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] PATH_INFO: `/v3/projects/f57198521d4046508cb526e9a525d98b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:09.217133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57198521d4046508cb526e9a525d98b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:09.219033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:09.249397 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:09.409747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57198521d4046508cb526e9a525d98b', 'request_id': 'req-62647a8e-2acd-4826-8323-3f5232841819'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:09.420106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57198521d4046508cb526e9a525d98b', 'request_id': 'req-62647a8e-2acd-4826-8323-3f5232841819'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:09.528148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57198521d4046508cb526e9a525d98b', 'request_id': 'req-62647a8e-2acd-4826-8323-3f5232841819'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:09.546656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] The token cache is being invalidate because project f57198521d4046508cb526e9a525d98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:53:09.548521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:09.549714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-62647a8e-2acd-4826-8323-3f5232841819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:53:09.556285 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4083/8170] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:53:09 2022] DELETE /identity/v3/projects/f57198521d4046508cb526e9a525d98b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:53:09.557066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd6ae-e43c-400b-a6a5-e3e191594bb5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:09.557549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd6ae-e43c-400b-a6a5-e3e191594bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:09.557739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd6ae-e43c-400b-a6a5-e3e191594bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:09.600271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d8ddd6ae-e43c-400b-a6a5-e3e191594bb5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:09.601820 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d8ddd6ae-e43c-400b-a6a5-e3e191594bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:09.703454 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4088/8171] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:53:09.706805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6fed-a760-4624-923a-72e4e86502ee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:09.707122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6fed-a760-4624-923a-72e4e86502ee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:09.707451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6fed-a760-4624-923a-72e4e86502ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:09.736214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3aae6fed-a760-4624-923a-72e4e86502ee None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:09.738574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3aae6fed-a760-4624-923a-72e4e86502ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:09.754486 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4084/8172] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:09.755172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd6ae-e43c-400b-a6a5-e3e191594bb5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:09.767690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd6ae-e43c-400b-a6a5-e3e191594bb5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:09.774021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:09.776212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:09.777092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:09.778009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:09.778908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:53:09.779617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:09.782271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:09.803822 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4089/8173] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:53:09.804483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae6fed-a760-4624-923a-72e4e86502ee None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:09.816516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae6fed-a760-4624-923a-72e4e86502ee None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:09.821904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:09.822575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:09.823039 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:09.825461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:09.826391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:09.828675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:09.939122 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:09.940108 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4085/8174] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:53:09 2022] POST /identity/v3/projects => generated 361 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:53:09.956582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa16f-5f60-4ce5-a5b5-11f3f747f2eb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:10.050739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:10.051492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:10.051890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:10.052233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:10.052962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:10.055654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:10.159614 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4090/8175] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:53:09 2022] POST /identity/v3/users => generated 281 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:53:10.163105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:10.177199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79df85f-e29c-46dd-bf70-6b61c079e54c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:10.182662 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:10.183366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:10.183848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:10.184239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:10.184979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:10.186709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:10.202099 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4086/8176] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:53:10.207970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:10.221937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c29a4-9c5b-4a5e-9af4-3da0fd31e3c8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:10.228207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc763a-79d5-4270-bd3b-d3bf88112bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:10.229311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc763a-79d5-4270-bd3b-d3bf88112bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:10.229840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc763a-79d5-4270-bd3b-d3bf88112bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:10.230384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc763a-79d5-4270-bd3b-d3bf88112bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:10.231259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc763a-79d5-4270-bd3b-d3bf88112bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:10.233202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc763a-79d5-4270-bd3b-d3bf88112bbc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:10.250300 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4091/8177] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:53:10.254581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:10.271033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc9976-6069-47b2-a465-57bf22ac5255 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:10.277338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:10.278476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:10.278872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:10.279236 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] PATH_INFO: `/v3/projects/6dbad9b95be84a88a01340f5ff381f95/users/3fbef3a81af34e8a9c2a3737df191cf8/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:10.299454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbad9b95be84a88a01340f5ff381f95, user_id=3fbef3a81af34e8a9c2a3737df191cf8, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:10.302760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:10.500032 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4087/8178] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:53:10 2022] PUT /identity/v3/projects/6dbad9b95be84a88a01340f5ff381f95/users/3fbef3a81af34e8a9c2a3737df191cf8/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:53:10.511017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:10.511941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:10.511941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:10.556456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] MFA Rules not processed for user `3fbef3a81af34e8a9c2a3737df191cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:53:10.557761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:10.599901 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:10.706276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4092/8179] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:53:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:53:10.711257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:10.713120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:10.830322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c2774-c521-49e0-addc-bb6043509384 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:10.836380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:10.837530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:10.838306 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:10.838791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:10.853382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:10.855620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:10.880336 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4088/8180] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:53:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:53:20.687733 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=18 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:20.873613 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:21.069480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:21.071665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:21.207298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26452853-199a-4b36-bbd3-af22f57244ff None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:21.213663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:21.214605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:21.215139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:21.215821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:21.218039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:21.234218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:21.236468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:21.251332 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4093/8181] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:53:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:53:29.689047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:29.691307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:29.803184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29813e86-d511-461c-b4d5-500b258a65d6 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:29.815848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd2ba4-d99e-4775-bc6a-510b1c5d9c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:29.816706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2ba4-d99e-4775-bc6a-510b1c5d9c34 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:29.817499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2ba4-d99e-4775-bc6a-510b1c5d9c34 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:29.817780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2ba4-d99e-4775-bc6a-510b1c5d9c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:29.821486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e0dd2ba4-d99e-4775-bc6a-510b1c5d9c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:29.848947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd2ba4-d99e-4775-bc6a-510b1c5d9c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:29.850895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd2ba4-d99e-4775-bc6a-510b1c5d9c34 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:29.867991 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4089/8182] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:53:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:53:31.243391 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=32 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:39.858899 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=38 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:53:44.655830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:53:44.658541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:44.786653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12ed0-9cb7-4609-b735-b8c5345a6b70 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:53:44.793065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:53:44.793899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:53:44.794362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:53:44.794793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:53:44.796784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:53:44.895960 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:53:44.898600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:53:44.913704 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4094/8183] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:53:54.906819 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=63 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:19.988873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214510-be41-415f-810b-1c776beedcf2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:19.989395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214510-be41-415f-810b-1c776beedcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:19.989616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214510-be41-415f-810b-1c776beedcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:20.017056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-dd214510-be41-415f-810b-1c776beedcf2 None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:20.018983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dd214510-be41-415f-810b-1c776beedcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:20.090040 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4090/8184] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:29.371075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:29.463797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a648c-384d-4952-a6f3-0e6047a5e8be service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:29.479929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:29.480895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:29.488649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:29.488649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] PATH_INFO: `/v3/users/3fbef3a81af34e8a9c2a3737df191cf8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:29.488649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbef3a81af34e8a9c2a3737df191cf8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:29.488649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:29.718404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbef3a81af34e8a9c2a3737df191cf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:29.735476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbef3a81af34e8a9c2a3737df191cf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:29.736629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbef3a81af34e8a9c2a3737df191cf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:29.807888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbef3a81af34e8a9c2a3737df191cf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:29.808606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbef3a81af34e8a9c2a3737df191cf8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:29.858070 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4095/8185] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:54:29 2022] DELETE /identity/v3/users/3fbef3a81af34e8a9c2a3737df191cf8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:29.862620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:29.863095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:29.863200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:29.886503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:29.887954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:29.990578 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4091/8186] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:54:30.000568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:30.002235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:30.112260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df35c58-1cff-4bcd-9262-0c4f046ceb63 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:30.120388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edcb1d-2989-4190-882f-b37c183d3fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:30.122417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edcb1d-2989-4190-882f-b37c183d3fea service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:30.122867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edcb1d-2989-4190-882f-b37c183d3fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:30.123236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edcb1d-2989-4190-882f-b37c183d3fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:30.134045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edcb1d-2989-4190-882f-b37c183d3fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:30.135477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edcb1d-2989-4190-882f-b37c183d3fea service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:30.148930 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4096/8187] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:54:30.491403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:30.493010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:30.515329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3ece-8e20-4eec-a1a5-accff6a1e870 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:30.537297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:30.538157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:30.538654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:30.538820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] PATH_INFO: `/v3/projects/6dbad9b95be84a88a01340f5ff381f95` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:30.540690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbad9b95be84a88a01340f5ff381f95)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:30.542968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:30.799656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbad9b95be84a88a01340f5ff381f95', 'request_id': 'req-f1183d62-184b-4406-b9c6-c2d600f6ff6d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:30.807131 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbad9b95be84a88a01340f5ff381f95', 'request_id': 'req-f1183d62-184b-4406-b9c6-c2d600f6ff6d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:30.887742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbad9b95be84a88a01340f5ff381f95', 'request_id': 'req-f1183d62-184b-4406-b9c6-c2d600f6ff6d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:30.903313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] The token cache is being invalidate because project 6dbad9b95be84a88a01340f5ff381f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:54:30.903884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:30.905165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f1183d62-184b-4406-b9c6-c2d600f6ff6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:30.907684 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4092/8188] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:54:30 2022] DELETE /identity/v3/projects/6dbad9b95be84a88a01340f5ff381f95 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:30.912637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181c90-7898-48d5-97c5-7bb247b4e38b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:30.913551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181c90-7898-48d5-97c5-7bb247b4e38b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:30.914144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181c90-7898-48d5-97c5-7bb247b4e38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:30.926699 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:30.940711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-53181c90-7898-48d5-97c5-7bb247b4e38b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:30.942402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-53181c90-7898-48d5-97c5-7bb247b4e38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:31.019276 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4097/8189] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:31.028312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c076c-1cfd-4960-8982-615c4a5a02ee None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.028790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c076c-1cfd-4960-8982-615c4a5a02ee None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.029372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c076c-1cfd-4960-8982-615c4a5a02ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.050349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ea4c076c-1cfd-4960-8982-615c4a5a02ee None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:31.051532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ea4c076c-1cfd-4960-8982-615c4a5a02ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:31.059376 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4093/8190] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:31.063802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53181c90-7898-48d5-97c5-7bb247b4e38b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:31.073952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53181c90-7898-48d5-97c5-7bb247b4e38b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:31.079310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:31.080522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.080801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.081075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.081720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:54:31.082048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:31.083642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:31.096048 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4098/8191] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:54:31.100361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c076c-1cfd-4960-8982-615c4a5a02ee None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:31.109930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c076c-1cfd-4960-8982-615c4a5a02ee None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:31.114799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:31.120012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.120012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.120012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.120012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:31.120012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:31.200073 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:31.218045 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4094/8192] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:54:31 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:31.219875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:31.235754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de5d2f-0ae7-4af8-bce5-1fbb89add24c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:31.341007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:31.342227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.342923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.343411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.344303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:31.346614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:31.432710 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4099/8193] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:54:31 2022] POST /identity/v3/users => generated 303 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:31.436747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:31.453061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde58b1-b0dd-489e-b201-cb10397d945a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:31.469559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:31.470486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.470947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.471384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.472188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:31.473940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:31.496005 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4095/8194] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:54:31.499841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:31.519130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb5095-b020-4423-aa45-bfcd41020d4b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:31.524234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57c0da-3613-4e37-92e1-620b106591b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:31.524921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57c0da-3613-4e37-92e1-620b106591b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.525268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57c0da-3613-4e37-92e1-620b106591b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.525605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57c0da-3613-4e37-92e1-620b106591b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.526395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57c0da-3613-4e37-92e1-620b106591b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:31.528314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57c0da-3613-4e37-92e1-620b106591b8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:31.559513 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4100/8195] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:54:31.564191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:31.581077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491427-da1e-416f-acad-f519261b1434 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:31.591507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:31.592286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.592636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.592976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] PATH_INFO: `/v3/projects/a0f951451f53465b9fa7959a9a3f2039/users/def76258061d41649335f5aee3b5334b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.623421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f951451f53465b9fa7959a9a3f2039, user_id=def76258061d41649335f5aee3b5334b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:31.629285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:31.717357 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4096/8196] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:54:31 2022] PUT /identity/v3/projects/a0f951451f53465b9fa7959a9a3f2039/users/def76258061d41649335f5aee3b5334b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:31.723234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58684-e001-48a0-8f77-a2f5864b01fc None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.725944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58684-e001-48a0-8f77-a2f5864b01fc None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.725944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58684-e001-48a0-8f77-a2f5864b01fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.745746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e0e58684-e001-48a0-8f77-a2f5864b01fc None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:31.747087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e0e58684-e001-48a0-8f77-a2f5864b01fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:31.823836 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4101/8197] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:31.834536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:31.836872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:31.916453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6744b-5409-4ed9-b347-9009a7a6d609 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:31.920605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:31.921438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:31.921789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:31.922888 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:31.933337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:31.934962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:31.950826 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4097/8198] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:54:33.501025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d12328-42e5-4a03-b9fd-d18b0fe5df84 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:33.501521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d12328-42e5-4a03-b9fd-d18b0fe5df84 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:33.502743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d12328-42e5-4a03-b9fd-d18b0fe5df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:33.543738 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:33.552277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-19d12328-42e5-4a03-b9fd-d18b0fe5df84 None None] MFA Rules not processed for user `def76258061d41649335f5aee3b5334b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:33.553576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-19d12328-42e5-4a03-b9fd-d18b0fe5df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:33.633457 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4102/8199] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:33.637790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:33.650612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1f27-0498-406c-a0d9-63bb652f12da service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:33.656652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:33.657584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:33.658120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:33.658603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:33.659523 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:33.662083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:33.763916 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4098/8200] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:54:33 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:33.768599 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d12328-42e5-4a03-b9fd-d18b0fe5df84 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:33.779569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d12328-42e5-4a03-b9fd-d18b0fe5df84 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:33.844616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:33.845327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:33.845814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:33.846194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:33.846961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:33.848986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:33.945873 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4103/8201] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:54:33 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:33.949680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:33.966885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f04a06-f2d8-45e4-8ad4-61ba4286a3fc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:33.972126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:33.972778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:33.973078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:33.973334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:33.974022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:33.975694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:33.990260 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4099/8202] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:54:33.993406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:34.004712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89d325-a130-479c-9779-dd72216b9c2c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:34.010938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:34.011603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:34.011881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:34.012153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] PATH_INFO: `/v3/projects/4e19cacfc05348b090fe743b639107bf/users/0c13285c9b0842e3b2ba4bd87252e25b/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:34.028458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e19cacfc05348b090fe743b639107bf, user_id=0c13285c9b0842e3b2ba4bd87252e25b, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:34.031251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:34.081823 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4104/8203] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:54:33 2022] PUT /identity/v3/projects/4e19cacfc05348b090fe743b639107bf/users/0c13285c9b0842e3b2ba4bd87252e25b/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:34.085781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:34.097329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21d02c-9f84-411e-831b-df015f1828b0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:34.167378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0c09-fedb-4cc3-9b1a-7160433492d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:34.167900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0c09-fedb-4cc3-9b1a-7160433492d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:34.168180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0c09-fedb-4cc3-9b1a-7160433492d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:34.168450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0c09-fedb-4cc3-9b1a-7160433492d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:34.169402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc0c09-fedb-4cc3-9b1a-7160433492d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:34.171130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc0c09-fedb-4cc3-9b1a-7160433492d6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:34.185221 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4100/8204] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:54:34.190294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:34.202307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890ec0a-6f93-47a6-baca-3f4b60a61999 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:34.207434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:34.213405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:34.213405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:34.213405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] PATH_INFO: `/v3/projects/4e19cacfc05348b090fe743b639107bf/users/0c13285c9b0842e3b2ba4bd87252e25b/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:34.213405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e19cacfc05348b090fe743b639107bf, user_id=0c13285c9b0842e3b2ba4bd87252e25b, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:34.214038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:34.229249 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4105/8205] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:54:34 2022] PUT /identity/v3/projects/4e19cacfc05348b090fe743b639107bf/users/0c13285c9b0842e3b2ba4bd87252e25b/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:54:35.541968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844d8a1-df8a-4274-8d25-d9e97a5f3c72 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:35.545410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844d8a1-df8a-4274-8d25-d9e97a5f3c72 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:35.545410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844d8a1-df8a-4274-8d25-d9e97a5f3c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:35.586568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7844d8a1-df8a-4274-8d25-d9e97a5f3c72 None None] MFA Rules not processed for user `0c13285c9b0842e3b2ba4bd87252e25b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:35.588535 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7844d8a1-df8a-4274-8d25-d9e97a5f3c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:35.612206 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:35.671245 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4101/8206] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:35 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:37.133590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:37.180697 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:37.191706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f1af9-ab53-43fd-99d3-979272710718 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:37.202022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:37.202022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:37.202022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:37.202022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] PATH_INFO: `/v3/users/def76258061d41649335f5aee3b5334b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:37.202493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def76258061d41649335f5aee3b5334b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:37.202493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:37.347222 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def76258061d41649335f5aee3b5334b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:37.355274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def76258061d41649335f5aee3b5334b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:37.356051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def76258061d41649335f5aee3b5334b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:37.395654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def76258061d41649335f5aee3b5334b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:37.396384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def76258061d41649335f5aee3b5334b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:37.419175 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4106/8207] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:54:37 2022] DELETE /identity/v3/users/def76258061d41649335f5aee3b5334b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:37.695850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844d8a1-df8a-4274-8d25-d9e97a5f3c72 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:37.707470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844d8a1-df8a-4274-8d25-d9e97a5f3c72 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:37.792602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:37.797768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:37.797768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:37.797768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] PATH_INFO: `/v3/projects/a0f951451f53465b9fa7959a9a3f2039` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:37.797768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f951451f53465b9fa7959a9a3f2039)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:37.797768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:37.952789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f951451f53465b9fa7959a9a3f2039', 'request_id': 'req-7d2e4d99-944a-4dfd-956a-a5338d66213a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:37.958820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f951451f53465b9fa7959a9a3f2039', 'request_id': 'req-7d2e4d99-944a-4dfd-956a-a5338d66213a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.046328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f951451f53465b9fa7959a9a3f2039', 'request_id': 'req-7d2e4d99-944a-4dfd-956a-a5338d66213a'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.059541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] The token cache is being invalidate because project a0f951451f53465b9fa7959a9a3f2039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:54:38.059832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.060487 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.065097 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4102/8208] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:54:37 2022] DELETE /identity/v3/projects/a0f951451f53465b9fa7959a9a3f2039 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:38.066354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:38.068668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:38.110386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ae05a-8408-4bb4-9cb7-25a22cdbdf19 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:38.168185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:38.168967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:38.169257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:38.169528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] PATH_INFO: `/v3/users/0c13285c9b0842e3b2ba4bd87252e25b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:38.170828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c13285c9b0842e3b2ba4bd87252e25b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:38.173304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:38.318420 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c13285c9b0842e3b2ba4bd87252e25b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.326066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c13285c9b0842e3b2ba4bd87252e25b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.326729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c13285c9b0842e3b2ba4bd87252e25b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.372920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c13285c9b0842e3b2ba4bd87252e25b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.373537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efa6988a-79c9-493d-954f-6e54a795b796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c13285c9b0842e3b2ba4bd87252e25b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.383084 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:38.394199 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4107/8209] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:54:38 2022] DELETE /identity/v3/users/0c13285c9b0842e3b2ba4bd87252e25b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:38.626973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:38.629490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:38.648059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e4d99-944a-4dfd-956a-a5338d66213a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:38.707304 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:38.721407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:38.722239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:38.722616 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:38.722991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] PATH_INFO: `/v3/projects/4e19cacfc05348b090fe743b639107bf` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:38.724733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e19cacfc05348b090fe743b639107bf)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:38.726883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:38.859902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e19cacfc05348b090fe743b639107bf', 'request_id': 'req-3990872c-6a2e-43ff-a403-5c24f6399460'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.867079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e19cacfc05348b090fe743b639107bf', 'request_id': 'req-3990872c-6a2e-43ff-a403-5c24f6399460'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.932534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e19cacfc05348b090fe743b639107bf', 'request_id': 'req-3990872c-6a2e-43ff-a403-5c24f6399460'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.947105 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] The token cache is being invalidate because project 4e19cacfc05348b090fe743b639107bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:54:38.947397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.948246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3990872c-6a2e-43ff-a403-5c24f6399460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:38.950290 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4103/8210] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:54:38 2022] DELETE /identity/v3/projects/4e19cacfc05348b090fe743b639107bf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:38.955314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a71b-b735-4a41-ae4c-02a40ff014eb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:38.955602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a71b-b735-4a41-ae4c-02a40ff014eb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:38.955877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a71b-b735-4a41-ae4c-02a40ff014eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:38.976725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5fa4a71b-b735-4a41-ae4c-02a40ff014eb None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:38.977968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5fa4a71b-b735-4a41-ae4c-02a40ff014eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:39.054465 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4108/8211] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:39.063392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9692c3-1b47-4b5c-90c6-cf2e7ab10f15 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.064018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9692c3-1b47-4b5c-90c6-cf2e7ab10f15 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.064295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9692c3-1b47-4b5c-90c6-cf2e7ab10f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.085674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ab9692c3-1b47-4b5c-90c6-cf2e7ab10f15 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:39.087021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ab9692c3-1b47-4b5c-90c6-cf2e7ab10f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:39.095768 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4104/8212] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:39.101555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a71b-b735-4a41-ae4c-02a40ff014eb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:39.112382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a71b-b735-4a41-ae4c-02a40ff014eb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:39.117780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:39.118625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.119391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.119867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.120790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:54:39.121195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:39.123214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:39.136038 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4109/8213] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:54:39.140380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9692c3-1b47-4b5c-90c6-cf2e7ab10f15 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:39.150488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9692c3-1b47-4b5c-90c6-cf2e7ab10f15 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:39.155198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:39.155915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.156196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.156490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.157795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:39.159733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:39.287421 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4105/8214] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:54:39 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:39.288552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:39.298911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c95a-e574-4136-8082-3817e158139e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:39.355046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:39.355645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.355922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.356194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.356814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:39.358745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:39.460353 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4110/8215] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:54:39 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:39.464895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:39.497180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106946-7e04-40ba-a66d-f0863e1effad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:39.520438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:39.520985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.521266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.521537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.522241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:39.524081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:39.538474 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4106/8216] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:54:39.544200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:39.555274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66945987-3fac-4797-b3cb-bd10aa44f1e7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:39.559938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0f42-b9a7-4efb-bc6c-45a388a39b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:39.560546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0f42-b9a7-4efb-bc6c-45a388a39b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.560819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0f42-b9a7-4efb-bc6c-45a388a39b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.561456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0f42-b9a7-4efb-bc6c-45a388a39b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.561724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead0f42-b9a7-4efb-bc6c-45a388a39b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:39.563915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead0f42-b9a7-4efb-bc6c-45a388a39b6c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:39.575197 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4111/8217] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:54:39.579838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:39.591014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c927759-432a-471c-a11f-0f14927aa596 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:39.595914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:39.596678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.597058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.597442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] PATH_INFO: `/v3/projects/fbca23819886491b936193e32f3530a4/users/4629aab8b5784a989b2e24f3f81dda59/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.612897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbca23819886491b936193e32f3530a4, user_id=4629aab8b5784a989b2e24f3f81dda59, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:39.615673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:39.699799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4107/8218] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:54:39 2022] PUT /identity/v3/projects/fbca23819886491b936193e32f3530a4/users/4629aab8b5784a989b2e24f3f81dda59/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:39.710796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210e40-2ae6-4b67-8f52-7f7769a0cf77 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.711084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210e40-2ae6-4b67-8f52-7f7769a0cf77 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.711383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210e40-2ae6-4b67-8f52-7f7769a0cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.739659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-58210e40-2ae6-4b67-8f52-7f7769a0cf77 None None] MFA Rules not processed for user `4629aab8b5784a989b2e24f3f81dda59`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:39.740893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-58210e40-2ae6-4b67-8f52-7f7769a0cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:39.788765 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:39.806332 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4112/8219] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:39.811012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:39.898851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ece9-031d-4053-a0f3-d28deb241bf1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:39.904015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:39.904630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:39.904993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:39.905162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:39.905791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:39.907897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:40.025644 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:40.035087 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4108/8220] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:54:39 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:40.038935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58210e40-2ae6-4b67-8f52-7f7769a0cf77 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:40.052049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58210e40-2ae6-4b67-8f52-7f7769a0cf77 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:40.147290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:40.148009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:40.150456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:40.150456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:40.150456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:40.151462 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:40.258007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4113/8221] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:54:40 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:54:40.259667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:40.270715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29e97b-cde0-4974-8281-c2ffb1e695c8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:40.275418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:40.276067 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:40.276349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:40.276645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:40.277401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:40.279173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:40.295678 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4109/8222] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:54:40.298891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:40.317160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d2be-28c6-4137-9237-e7708ff4b843 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:40.322956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:40.323741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:40.324084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:40.324468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] PATH_INFO: `/v3/projects/026894fd21fb4098a37873852bfb29a6/users/deee996a07d3404ca74400d8002f1efb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:40.341207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026894fd21fb4098a37873852bfb29a6, user_id=deee996a07d3404ca74400d8002f1efb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:40.344048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:40.413223 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4114/8223] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:54:40 2022] PUT /identity/v3/projects/026894fd21fb4098a37873852bfb29a6/users/deee996a07d3404ca74400d8002f1efb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:40.417459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:40.427870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af55f8c-29c4-49c6-a7f1-3bf831e75267 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:40.503014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705a9d0-b55e-4d33-bbf3-8e2dbf15afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:40.503905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a9d0-b55e-4d33-bbf3-8e2dbf15afe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:40.504361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a9d0-b55e-4d33-bbf3-8e2dbf15afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:40.504826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705a9d0-b55e-4d33-bbf3-8e2dbf15afe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:40.505633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705a9d0-b55e-4d33-bbf3-8e2dbf15afe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:40.507566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705a9d0-b55e-4d33-bbf3-8e2dbf15afe9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:40.518861 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4110/8224] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:54:40.522974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:40.533697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c0f90-c05d-46c1-acc0-d8706e48eb19 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:40.538770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:40.539610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:40.540085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:40.540530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] PATH_INFO: `/v3/projects/026894fd21fb4098a37873852bfb29a6/users/deee996a07d3404ca74400d8002f1efb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:40.542759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026894fd21fb4098a37873852bfb29a6, user_id=deee996a07d3404ca74400d8002f1efb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:40.545574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:40.564764 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4115/8225] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:54:40 2022] PUT /identity/v3/projects/026894fd21fb4098a37873852bfb29a6/users/deee996a07d3404ca74400d8002f1efb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:54:40.575455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e3f8-ffd5-49dc-bfff-9fd25f93cb05 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:40.575747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e3f8-ffd5-49dc-bfff-9fd25f93cb05 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:40.576020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e3f8-ffd5-49dc-bfff-9fd25f93cb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:40.608894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2f85e3f8-ffd5-49dc-bfff-9fd25f93cb05 None None] MFA Rules not processed for user `deee996a07d3404ca74400d8002f1efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:40.610676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2f85e3f8-ffd5-49dc-bfff-9fd25f93cb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:40.684066 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4111/8226] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:54:40.696624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:40.698677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:40.772256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cb6d6-c193-48d2-9bd8-7ee70f0c5dd5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:40.776373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:40.777044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:40.777323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:40.777616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:40.792587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:40.794075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:40.806076 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4116/8227] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:54:41.039929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85e3f8-ffd5-49dc-bfff-9fd25f93cb05 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:41.052763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85e3f8-ffd5-49dc-bfff-9fd25f93cb05 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:41.057032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:41.057579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:41.057855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:41.058155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:41.127969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:41.130309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:41.138475 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4112/8228] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:54:43.775086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:43.776533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:43.813118 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:43.855537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e366a93-4a3c-443e-a337-4bfc03269adc service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:43.861402 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625f859-e060-43b8-bb4c-5919849e9033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:43.862218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625f859-e060-43b8-bb4c-5919849e9033 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:43.862628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625f859-e060-43b8-bb4c-5919849e9033 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:43.863065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625f859-e060-43b8-bb4c-5919849e9033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:43.864858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9625f859-e060-43b8-bb4c-5919849e9033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:43.881174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625f859-e060-43b8-bb4c-5919849e9033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:43.882910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625f859-e060-43b8-bb4c-5919849e9033 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:43.897750 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4117/8229] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:54:46.363821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:46.377844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a533-f551-44ef-9464-b17c4443c20f service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:46.382213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:46.383115 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:46.383609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:46.384047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:46.386691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:46.394347 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:46.492117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:46.494699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:46.507191 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4113/8230] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:54:48.168270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cf07-3bad-456b-ae2a-24f160c0aa55 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:48.169113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cf07-3bad-456b-ae2a-24f160c0aa55 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:48.169547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cf07-3bad-456b-ae2a-24f160c0aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:48.236297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1b62cf07-3bad-456b-ae2a-24f160c0aa55 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:48.237488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1b62cf07-3bad-456b-ae2a-24f160c0aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:48.305120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4118/8231] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 01:54:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:48.470932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:48.474138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:48.577362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063898d8-d6dd-4f61-9817-dbc98e52ccf5 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:48.600864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:48.604402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:48.605000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:48.605441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:48.638954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:48.639415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:48.651794 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4114/8232] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:54:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:54:50.222017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6892d-be54-49b8-bd92-81fcdca4a5f8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:50.223158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6892d-be54-49b8-bd92-81fcdca4a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:50.223826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6892d-be54-49b8-bd92-81fcdca4a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:50.245854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3fa6892d-be54-49b8-bd92-81fcdca4a5f8 None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:50.248396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3fa6892d-be54-49b8-bd92-81fcdca4a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:50.319897 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4119/8233] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:54.595234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:54.598208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:54.621720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df9da7-c9d2-4fb2-88fc-fc42397225d5 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:54.629156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dd7e0-d38b-41f0-8155-4fe716a410c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:54.630007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dd7e0-d38b-41f0-8155-4fe716a410c5 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:54.634423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dd7e0-d38b-41f0-8155-4fe716a410c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:54.634423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dd7e0-d38b-41f0-8155-4fe716a410c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:54.634423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-825dd7e0-d38b-41f0-8155-4fe716a410c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:54.644561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dd7e0-d38b-41f0-8155-4fe716a410c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:54.646300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dd7e0-d38b-41f0-8155-4fe716a410c5 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:54.656540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4115/8234] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:54:55.967352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6892d-be54-49b8-bd92-81fcdca4a5f8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:56.031394 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:56.081823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6892d-be54-49b8-bd92-81fcdca4a5f8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:56.087542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:56.088638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:56.089262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:56.089701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] PATH_INFO: `/v3/users/4629aab8b5784a989b2e24f3f81dda59` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:56.091132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4629aab8b5784a989b2e24f3f81dda59)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:56.094198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:56.273855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4629aab8b5784a989b2e24f3f81dda59'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:56.286187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4629aab8b5784a989b2e24f3f81dda59'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:56.287769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4629aab8b5784a989b2e24f3f81dda59'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:56.354072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4629aab8b5784a989b2e24f3f81dda59'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:56.357317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4629aab8b5784a989b2e24f3f81dda59'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:56.401203 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4120/8235] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:54:55 2022] DELETE /identity/v3/users/4629aab8b5784a989b2e24f3f81dda59 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:56.404133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:56.409758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:56.409758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:56.432152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:56.433806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:56.604959 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4116/8236] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:56.619452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:56.621555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:56.719313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebf85-38ac-4247-8f35-a80ef3246fbf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:56.726641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:56.727546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:56.728021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:56.729151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:56.759370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:56.761125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:56.774139 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4121/8237] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:54:57.572913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:57.574778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:57.603275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6eba-6445-41f3-8732-b52d8ba10a58 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:57.616755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:57.618975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:57.618975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:57.620923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] PATH_INFO: `/v3/projects/fbca23819886491b936193e32f3530a4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:57.624290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbca23819886491b936193e32f3530a4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:57.629054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:57.672885 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:57.780480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbca23819886491b936193e32f3530a4', 'request_id': 'req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:57.795359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbca23819886491b936193e32f3530a4', 'request_id': 'req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:57.848233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbca23819886491b936193e32f3530a4', 'request_id': 'req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:57.868034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] The token cache is being invalidate because project fbca23819886491b936193e32f3530a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:54:57.868601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:57.869813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:57.874363 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4117/8238] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:54:57 2022] DELETE /identity/v3/projects/fbca23819886491b936193e32f3530a4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:57.879326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:57.892584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e09e3-adee-431e-b55a-8bb63c72020c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:57.971602 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:54:57.989124 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:57.989958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:57.990374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:57.990789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] PATH_INFO: `/v3/users/deee996a07d3404ca74400d8002f1efb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:57.992258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] RBAC: Authorizing `identity:delete_user(user_id=deee996a07d3404ca74400d8002f1efb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:57.994437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:58.212766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deee996a07d3404ca74400d8002f1efb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:58.230497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deee996a07d3404ca74400d8002f1efb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:58.231268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deee996a07d3404ca74400d8002f1efb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:58.310395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deee996a07d3404ca74400d8002f1efb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:58.311388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-a9bf85bf-2cc2-4bd8-83f7-6668ad9b112d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deee996a07d3404ca74400d8002f1efb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:58.354436 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4122/8239] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:54:57 2022] DELETE /identity/v3/users/deee996a07d3404ca74400d8002f1efb => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:54:59.117331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:59.119006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:59.158799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcb5e4-6db5-45b2-bb8a-633e17b61255 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:59.262615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:59.264764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:59.264764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:59.264764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] PATH_INFO: `/v3/projects/026894fd21fb4098a37873852bfb29a6` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:59.266033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026894fd21fb4098a37873852bfb29a6)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:59.268265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:59.402946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026894fd21fb4098a37873852bfb29a6', 'request_id': 'req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:59.413184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026894fd21fb4098a37873852bfb29a6', 'request_id': 'req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:59.481929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026894fd21fb4098a37873852bfb29a6', 'request_id': 'req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:59.496884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] The token cache is being invalidate because project 026894fd21fb4098a37873852bfb29a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:54:59.497542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:59.498322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eaf51a6f-e5ea-4f94-be3b-8b8ef7f80544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:54:59.500797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4118/8240] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:54:59 2022] DELETE /identity/v3/projects/026894fd21fb4098a37873852bfb29a6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:54:59.505705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49df8-ba59-4634-8fab-94d26f794925 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:59.509098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49df8-ba59-4634-8fab-94d26f794925 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:59.509098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49df8-ba59-4634-8fab-94d26f794925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:59.528624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-31a49df8-ba59-4634-8fab-94d26f794925 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:59.531339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-31a49df8-ba59-4634-8fab-94d26f794925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:59.678913 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4123/8241] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:59.681034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a960-476d-496b-8707-2620d32b6a3f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:59.681330 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a960-476d-496b-8707-2620d32b6a3f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:59.681609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a960-476d-496b-8707-2620d32b6a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:59.710556 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-edb5a960-476d-496b-8707-2620d32b6a3f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:54:59.711780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-edb5a960-476d-496b-8707-2620d32b6a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:54:59.743282 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4119/8242] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:54:59.744896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a49df8-ba59-4634-8fab-94d26f794925 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:59.759730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a49df8-ba59-4634-8fab-94d26f794925 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:59.770592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:59.772458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:59.772740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:59.773109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:59.773781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:54:59.774202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:59.775949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:59.789324 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4124/8243] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:54:59.793496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a960-476d-496b-8707-2620d32b6a3f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:54:59.816987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a960-476d-496b-8707-2620d32b6a3f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:54:59.832265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:54:59.832924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:54:59.833275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:54:59.833677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:54:59.834427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:54:59.836578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:54:59.981584 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4120/8244] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:54:59 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:54:59.986632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:00.001259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a97b0-a0b6-4e1d-8d22-f19790ab87e5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:00.119851 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:00.130257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:00.131605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:00.131605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:00.131605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:00.132378 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:00.135956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:00.254034 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4125/8245] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:54:59 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:00.257772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:00.272277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ce91b-7a32-4854-ad50-1ff92175235c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:00.278222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:00.279242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:00.280299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:00.280759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:00.282536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:00.284969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:00.286846 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:00.299785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4121/8246] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:00.303706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:00.321007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c919-9b23-44b5-8cac-7860c5c05f84 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:00.326979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5d77-753e-4289-999d-05a7a6e15b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:00.327785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5d77-753e-4289-999d-05a7a6e15b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:00.328280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5d77-753e-4289-999d-05a7a6e15b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:00.328743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5d77-753e-4289-999d-05a7a6e15b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:00.329557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5d77-753e-4289-999d-05a7a6e15b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:00.331808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5d77-753e-4289-999d-05a7a6e15b86 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:00.345387 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4126/8247] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:00.349433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:00.363515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687581ee-6c05-459a-a6b4-6f4513a46447 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:00.370180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:00.371245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:00.374981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:00.377193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] PATH_INFO: `/v3/projects/5ae837e84abf46f38daa613602c225de/users/29d3733d9d664dd8ada318eb15119829/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:00.417385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae837e84abf46f38daa613602c225de, user_id=29d3733d9d664dd8ada318eb15119829, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:00.417385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:00.499458 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4122/8248] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:00 2022] PUT /identity/v3/projects/5ae837e84abf46f38daa613602c225de/users/29d3733d9d664dd8ada318eb15119829/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:00.504638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c6b32-136e-4e50-9872-0bee58136140 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:00.504923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c6b32-136e-4e50-9872-0bee58136140 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:00.505234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c6b32-136e-4e50-9872-0bee58136140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:00.541193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0c4c6b32-136e-4e50-9872-0bee58136140 None None] MFA Rules not processed for user `29d3733d9d664dd8ada318eb15119829`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:00.542963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0c4c6b32-136e-4e50-9872-0bee58136140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:00.634169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4127/8249] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:00.634996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:00.748972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6182f5-1584-486f-987e-cf0a3e4102aa admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:00.768993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:00.770362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:00.770987 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:00.771489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:00.772477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:00.774643 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:00.895835 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4123/8250] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:00 2022] POST /identity/v3/projects => generated 371 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:55:00.897271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c6b32-136e-4e50-9872-0bee58136140 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:00.914006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c6b32-136e-4e50-9872-0bee58136140 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:00.994669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:00.995575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:00.996023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:00.996510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:00.997150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:00.999571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:01.104508 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4128/8251] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:00 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:01.105699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:01.138882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94bf06-b9c2-49e4-a1a0-d7a367edf657 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:01.145417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:01.147136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:01.148457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:01.148806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:01.151601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:01.155477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:01.174987 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4124/8252] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:01.178254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:01.191243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681c4f-83ae-4a09-b803-a0a9ee7b6aef admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:01.207531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:01.208119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:01.208400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:01.208675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] PATH_INFO: `/v3/projects/9c6f7b36f4f54e73979a753749b6ba65/users/44d710960bbc473aaa521794a80240d8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:01.241366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6f7b36f4f54e73979a753749b6ba65, user_id=44d710960bbc473aaa521794a80240d8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:01.245243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:01.317536 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4129/8253] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:01 2022] PUT /identity/v3/projects/9c6f7b36f4f54e73979a753749b6ba65/users/44d710960bbc473aaa521794a80240d8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:01.319101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:01.353256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7b7d9-f9e8-4314-9b94-e32b1b2244f9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:01.454995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c0e8b-5334-426b-974a-f5deacf53134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:01.455765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c0e8b-5334-426b-974a-f5deacf53134 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:01.456100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c0e8b-5334-426b-974a-f5deacf53134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:01.456426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c0e8b-5334-426b-974a-f5deacf53134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:01.457126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c0e8b-5334-426b-974a-f5deacf53134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:01.459753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c0e8b-5334-426b-974a-f5deacf53134 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:01.480347 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4125/8254] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:55:01.492571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:01.508465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee1408-2514-412b-adb2-18993f2fa772 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:01.514106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:01.514875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:01.515250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:01.515617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] PATH_INFO: `/v3/projects/9c6f7b36f4f54e73979a753749b6ba65/users/44d710960bbc473aaa521794a80240d8/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:01.517841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6f7b36f4f54e73979a753749b6ba65, user_id=44d710960bbc473aaa521794a80240d8, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:01.530956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:01.551064 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4130/8255] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:01 2022] PUT /identity/v3/projects/9c6f7b36f4f54e73979a753749b6ba65/users/44d710960bbc473aaa521794a80240d8/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:01.569130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09bdef-cbf7-4d59-82c1-40a22fa042bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:01.569327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09bdef-cbf7-4d59-82c1-40a22fa042bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:01.569599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09bdef-cbf7-4d59-82c1-40a22fa042bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:01.632101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2a09bdef-cbf7-4d59-82c1-40a22fa042bd None None] MFA Rules not processed for user `44d710960bbc473aaa521794a80240d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:01.633672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2a09bdef-cbf7-4d59-82c1-40a22fa042bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:01.673833 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:01.722624 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4126/8256] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:01.737583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:01.739407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:01.767786 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:01.819999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969eacb-8760-48c5-b21b-bf73565b0037 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:01.824035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e2c2a-567b-4f39-9315-904834f56cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:01.832158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2c2a-567b-4f39-9315-904834f56cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:01.832158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2c2a-567b-4f39-9315-904834f56cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:01.832158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2c2a-567b-4f39-9315-904834f56cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:01.838728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e2c2a-567b-4f39-9315-904834f56cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:01.840178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e2c2a-567b-4f39-9315-904834f56cb1 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:01.850877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4131/8257] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:03.163340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09bdef-cbf7-4d59-82c1-40a22fa042bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:03.237176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09bdef-cbf7-4d59-82c1-40a22fa042bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:03.242051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:03.249794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:03.249794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:03.249794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] PATH_INFO: `/v3/users/29d3733d9d664dd8ada318eb15119829` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:03.249794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d3733d9d664dd8ada318eb15119829)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:03.249794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:03.496484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d3733d9d664dd8ada318eb15119829'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:03.505734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d3733d9d664dd8ada318eb15119829'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:03.506529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d3733d9d664dd8ada318eb15119829'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:03.591117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d3733d9d664dd8ada318eb15119829'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:03.591759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d3733d9d664dd8ada318eb15119829'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:03.614421 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4127/8258] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:03 2022] DELETE /identity/v3/users/29d3733d9d664dd8ada318eb15119829 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:03.619592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:03.620327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:03.620658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:03.639995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:03.641692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:03.708267 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4132/8259] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:03.723259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:03.724763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:03.790066 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:03.799087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8078-017a-4f8d-9638-0c8d424a913e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:03.802704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:03.811529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:03.811529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:03.811529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:03.821161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:03.822878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:03.835274 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4128/8260] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:04.343576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:04.345959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:04.359764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da864b9-3de3-4475-91f4-85392c353f46 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:04.367650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:04.368541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:04.368855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:04.369315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] PATH_INFO: `/v3/projects/5ae837e84abf46f38daa613602c225de` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:04.370670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae837e84abf46f38daa613602c225de)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:04.372730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:04.525834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae837e84abf46f38daa613602c225de', 'request_id': 'req-2cc91018-3c85-4951-ae8e-a023fd545a37'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:04.532150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae837e84abf46f38daa613602c225de', 'request_id': 'req-2cc91018-3c85-4951-ae8e-a023fd545a37'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:04.612720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae837e84abf46f38daa613602c225de', 'request_id': 'req-2cc91018-3c85-4951-ae8e-a023fd545a37'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:04.626022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] The token cache is being invalidate because project 5ae837e84abf46f38daa613602c225de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:04.626612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:04.626955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:04.628506 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4133/8261] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:04 2022] DELETE /identity/v3/projects/5ae837e84abf46f38daa613602c225de => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:04.633349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:04.645479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad26d3-783f-43f7-a034-d4687c805b34 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:04.710492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:04.711187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:04.711476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:04.711750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] PATH_INFO: `/v3/users/44d710960bbc473aaa521794a80240d8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:04.713023 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d710960bbc473aaa521794a80240d8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:04.714975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:04.964623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d710960bbc473aaa521794a80240d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:04.971541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d710960bbc473aaa521794a80240d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:04.973727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d710960bbc473aaa521794a80240d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:05.036746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d710960bbc473aaa521794a80240d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:05.037675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d710960bbc473aaa521794a80240d8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:05.074236 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4129/8262] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:04 2022] DELETE /identity/v3/users/44d710960bbc473aaa521794a80240d8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:05.202725 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:05.204234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:05.304020 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:05.393540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91018-3c85-4951-ae8e-a023fd545a37 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:05.508443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc879-52d2-48aa-b76b-f6dbd93f8d64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:05.509164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc879-52d2-48aa-b76b-f6dbd93f8d64 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:05.509442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc879-52d2-48aa-b76b-f6dbd93f8d64 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:05.509740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc879-52d2-48aa-b76b-f6dbd93f8d64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:05.517449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-476bc879-52d2-48aa-b76b-f6dbd93f8d64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:05.534294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc879-52d2-48aa-b76b-f6dbd93f8d64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:05.537279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc879-52d2-48aa-b76b-f6dbd93f8d64 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:05.561730 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4134/8263] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:05.697248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:05.699268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:05.837517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f09100-09bb-4927-a5bf-62c3a5ecd423 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:05.843144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:05.844398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:05.844685 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:05.844961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] PATH_INFO: `/v3/projects/9c6f7b36f4f54e73979a753749b6ba65` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:05.846344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6f7b36f4f54e73979a753749b6ba65)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:05.849386 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:05.872786 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:06.021539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6f7b36f4f54e73979a753749b6ba65', 'request_id': 'req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:06.040466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6f7b36f4f54e73979a753749b6ba65', 'request_id': 'req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:06.162860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6f7b36f4f54e73979a753749b6ba65', 'request_id': 'req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:06.211679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] The token cache is being invalidate because project 9c6f7b36f4f54e73979a753749b6ba65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:06.212113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:06.212714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3b35297a-b7f2-430e-9e8b-7fcc418db6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:06.217764 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4130/8264] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:05 2022] DELETE /identity/v3/projects/9c6f7b36f4f54e73979a753749b6ba65 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:06.219635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ade9e-dda5-49cb-ac84-9c039d860c09 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.220092 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ade9e-dda5-49cb-ac84-9c039d860c09 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.224618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ade9e-dda5-49cb-ac84-9c039d860c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.243185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f15ade9e-dda5-49cb-ac84-9c039d860c09 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:06.244488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f15ade9e-dda5-49cb-ac84-9c039d860c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:06.309657 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4135/8265] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:06.318170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049f91-c16f-4036-91cd-06130f04f9a9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.318457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049f91-c16f-4036-91cd-06130f04f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.318728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049f91-c16f-4036-91cd-06130f04f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.344640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-61049f91-c16f-4036-91cd-06130f04f9a9 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:06.348458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-61049f91-c16f-4036-91cd-06130f04f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:06.362189 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4131/8266] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:55:06.365373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ade9e-dda5-49cb-ac84-9c039d860c09 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:06.384223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ade9e-dda5-49cb-ac84-9c039d860c09 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:06.392238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:06.392999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.393375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.393799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.394853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:55:06.395338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:06.396947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:06.414169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4136/8267] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:55:06.416557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61049f91-c16f-4036-91cd-06130f04f9a9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:06.432049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61049f91-c16f-4036-91cd-06130f04f9a9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:06.437056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:06.438272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.438625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.438945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.439880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:06.442607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:06.573884 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4132/8268] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:06 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:55:06.579507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:06.590694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47ced0-da49-4a92-9d40-7046b2d5e726 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:06.660608 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:06.668459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:06.688186 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:06.697735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:06.698407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.698685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.698956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.699654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:06.701612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:06.764540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607cc7-14a6-4db6-8bb0-1b0e41c23726 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:06.770705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:06.771322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.771603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.771878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.779581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:06.799877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:06.799877 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:06.806835 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4137/8269] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:06 2022] POST /identity/v3/users => generated 282 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:55:06.808139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:06.819872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4238c-6520-4263-8488-ef039e75e5c6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:06.820224 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4133/8270] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:06.825238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:06.825902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.826233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.826505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.828942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:06.829607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:06.845028 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4138/8271] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:06.849292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:06.863965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a8ea-5604-435e-b74b-9199b0cfabd9 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:06.869181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff869c-73d4-4e6b-91ed-3797941cc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:06.869787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff869c-73d4-4e6b-91ed-3797941cc94a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.870109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff869c-73d4-4e6b-91ed-3797941cc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.870385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff869c-73d4-4e6b-91ed-3797941cc94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.871025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff869c-73d4-4e6b-91ed-3797941cc94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:06.872695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff869c-73d4-4e6b-91ed-3797941cc94a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:06.884392 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4134/8272] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:06.888863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:06.901282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50a9c-481c-468d-be49-f963a75d0935 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:06.906293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:06.906950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:06.907282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:06.907579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] PATH_INFO: `/v3/projects/1b75765737354fa68c9585d4ef74d815/users/28e5dc0a0bf64bb689ded01e7c2fbf82/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:06.923619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b75765737354fa68c9585d4ef74d815, user_id=28e5dc0a0bf64bb689ded01e7c2fbf82, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:06.926268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:07.043389 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4139/8273] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:06 2022] PUT /identity/v3/projects/1b75765737354fa68c9585d4ef74d815/users/28e5dc0a0bf64bb689ded01e7c2fbf82/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:07.059151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4456e7-059c-4988-8a29-d1885820ee17 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:07.059498 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4456e7-059c-4988-8a29-d1885820ee17 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:07.059771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4456e7-059c-4988-8a29-d1885820ee17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:07.097152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4f4456e7-059c-4988-8a29-d1885820ee17 None None] MFA Rules not processed for user `28e5dc0a0bf64bb689ded01e7c2fbf82`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:07.098599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4f4456e7-059c-4988-8a29-d1885820ee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:07.155327 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:07.184274 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4135/8274] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:07.190072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:07.281934 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b707-c138-4d46-9f0b-57fd4a1bd6a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:07.287166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:07.287773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:07.288045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:07.288523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:07.289667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:07.292072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:07.497402 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4140/8275] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:07 2022] POST /identity/v3/projects => generated 365 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:07.501640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4456e7-059c-4988-8a29-d1885820ee17 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:07.513021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4456e7-059c-4988-8a29-d1885820ee17 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:07.580630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:07.581257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:07.581533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:07.581895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:07.582970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:07.584442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:07.710055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4136/8276] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:07 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:07.710393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:07.732804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b8143-0599-4ba6-a949-07a6fc63ac96 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:07.738132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:07.738752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:07.738948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:07.739217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:07.739859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:07.741473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:07.757383 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4141/8277] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:07.761400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:07.775627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86ddf0-fa0e-4570-b029-ef3b7353bdc7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:07.782301 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:07.783117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:07.783516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:07.783893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] PATH_INFO: `/v3/projects/712f5c0fd29241c5ad3d3578a36af082/users/bf788f70113449bb9a5ba34cb237e301/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:07.805175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=712f5c0fd29241c5ad3d3578a36af082, user_id=bf788f70113449bb9a5ba34cb237e301, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:07.808346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:07.885055 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4137/8278] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:07 2022] PUT /identity/v3/projects/712f5c0fd29241c5ad3d3578a36af082/users/bf788f70113449bb9a5ba34cb237e301/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:07.889065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:07.924307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868357f-87f4-4755-a8d6-e020acc972b3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:07.986627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51a44e-d90e-43ca-8c28-9989dc17fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:07.987276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51a44e-d90e-43ca-8c28-9989dc17fc6b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:07.987705 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51a44e-d90e-43ca-8c28-9989dc17fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:07.987983 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51a44e-d90e-43ca-8c28-9989dc17fc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:07.988660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51a44e-d90e-43ca-8c28-9989dc17fc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:07.992062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51a44e-d90e-43ca-8c28-9989dc17fc6b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:08.001689 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4142/8279] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:08.006053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:08.022371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38ca8-7631-4849-b8cc-2a57639a5fac admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:08.028051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:08.028734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:08.029013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:08.029284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] PATH_INFO: `/v3/projects/712f5c0fd29241c5ad3d3578a36af082/users/bf788f70113449bb9a5ba34cb237e301/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:08.031813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=712f5c0fd29241c5ad3d3578a36af082, user_id=bf788f70113449bb9a5ba34cb237e301, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:08.034612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:08.051380 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4138/8280] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:08 2022] PUT /identity/v3/projects/712f5c0fd29241c5ad3d3578a36af082/users/bf788f70113449bb9a5ba34cb237e301/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:08.065053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a8370-daec-4bdd-b121-a953c9629376 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:08.065053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a8370-daec-4bdd-b121-a953c9629376 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:08.066302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a8370-daec-4bdd-b121-a953c9629376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:08.101899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c83a8370-daec-4bdd-b121-a953c9629376 None None] MFA Rules not processed for user `bf788f70113449bb9a5ba34cb237e301`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:08.103513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c83a8370-daec-4bdd-b121-a953c9629376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:08.117407 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:08.192839 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4143/8281] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:08.204915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:08.207216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:08.299839 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cccf6-ca5d-4241-9092-c105d66229ee admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:08.305479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664220f6-10cd-4b51-a316-ed6bbaac294e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:08.306899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664220f6-10cd-4b51-a316-ed6bbaac294e service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:08.307378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664220f6-10cd-4b51-a316-ed6bbaac294e service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:08.307741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664220f6-10cd-4b51-a316-ed6bbaac294e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:08.319858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664220f6-10cd-4b51-a316-ed6bbaac294e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:08.321799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664220f6-10cd-4b51-a316-ed6bbaac294e service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:08.333831 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4139/8282] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:09.592528 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a8370-daec-4bdd-b121-a953c9629376 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:09.700832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a8370-daec-4bdd-b121-a953c9629376 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:09.709052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:09.709713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:09.710068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:09.710342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] PATH_INFO: `/v3/users/28e5dc0a0bf64bb689ded01e7c2fbf82` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:09.711548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e5dc0a0bf64bb689ded01e7c2fbf82)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:09.713612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:09.952415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e5dc0a0bf64bb689ded01e7c2fbf82'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:09.967304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e5dc0a0bf64bb689ded01e7c2fbf82'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:09.969915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e5dc0a0bf64bb689ded01e7c2fbf82'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:10.095070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e5dc0a0bf64bb689ded01e7c2fbf82'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:10.095738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e5dc0a0bf64bb689ded01e7c2fbf82'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:10.125803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4144/8283] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:09 2022] DELETE /identity/v3/users/28e5dc0a0bf64bb689ded01e7c2fbf82 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:10.130012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:10.130537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:10.130537 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:10.162463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:10.163571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:10.205998 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:10.252921 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4140/8284] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:10.260051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:10.262950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:10.325777 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:10.407338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68721-43d9-43de-9c94-0c4020caa59c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:10.417444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:10.418213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:10.418507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:10.418968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:10.445333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:10.447091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:10.464800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4145/8285] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:11.067650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:11.067650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:11.086128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9dc1-13e1-4b95-8fb0-b58219618a7e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:11.091270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:11.094006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:11.094426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:11.094795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] PATH_INFO: `/v3/projects/1b75765737354fa68c9585d4ef74d815` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:11.096383 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b75765737354fa68c9585d4ef74d815)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:11.098746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:11.255521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b75765737354fa68c9585d4ef74d815', 'request_id': 'req-f57c887e-d2fe-48a0-b639-2fcff90f4794'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.261228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b75765737354fa68c9585d4ef74d815', 'request_id': 'req-f57c887e-d2fe-48a0-b639-2fcff90f4794'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.343781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b75765737354fa68c9585d4ef74d815', 'request_id': 'req-f57c887e-d2fe-48a0-b639-2fcff90f4794'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.359309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] The token cache is being invalidate because project 1b75765737354fa68c9585d4ef74d815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:11.360415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.361084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.362629 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4141/8286] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:11 2022] DELETE /identity/v3/projects/1b75765737354fa68c9585d4ef74d815 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:11.366912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:11.380732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c0851-da1e-478a-85e5-b1a176fbc0a5 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:11.456238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:11.458194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:11.458194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:11.458194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] PATH_INFO: `/v3/users/bf788f70113449bb9a5ba34cb237e301` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:11.459716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf788f70113449bb9a5ba34cb237e301)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:11.461808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:11.710649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf788f70113449bb9a5ba34cb237e301'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.718364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf788f70113449bb9a5ba34cb237e301'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.719094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf788f70113449bb9a5ba34cb237e301'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.836548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf788f70113449bb9a5ba34cb237e301'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.837201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-0974da1b-48c8-4eb8-a709-253743ae0d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf788f70113449bb9a5ba34cb237e301'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:11.856544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4146/8287] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:11 2022] DELETE /identity/v3/users/bf788f70113449bb9a5ba34cb237e301 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:12.434780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:12.436924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:12.457715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c887e-d2fe-48a0-b639-2fcff90f4794 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:12.539202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:12.542149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:12.542149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:12.542149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] PATH_INFO: `/v3/projects/712f5c0fd29241c5ad3d3578a36af082` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:12.542149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712f5c0fd29241c5ad3d3578a36af082)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:12.544350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:12.743032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712f5c0fd29241c5ad3d3578a36af082', 'request_id': 'req-9d92608e-07bd-4af9-924a-b75e89987f68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:12.759136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712f5c0fd29241c5ad3d3578a36af082', 'request_id': 'req-9d92608e-07bd-4af9-924a-b75e89987f68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:12.761650 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:12.916100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712f5c0fd29241c5ad3d3578a36af082', 'request_id': 'req-9d92608e-07bd-4af9-924a-b75e89987f68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:12.923729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] The token cache is being invalidate because project 712f5c0fd29241c5ad3d3578a36af082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:12.924095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:12.932603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9d92608e-07bd-4af9-924a-b75e89987f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:12.932603 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4142/8288] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:12 2022] DELETE /identity/v3/projects/712f5c0fd29241c5ad3d3578a36af082 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:12.935065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52783-fe5a-413e-b82f-9d3fabe423f6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:12.935685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52783-fe5a-413e-b82f-9d3fabe423f6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:12.935799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb52783-fe5a-413e-b82f-9d3fabe423f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:12.958403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5fb52783-fe5a-413e-b82f-9d3fabe423f6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:12.959612 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5fb52783-fe5a-413e-b82f-9d3fabe423f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:13.001901 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:13.020024 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4147/8289] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:13.027883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1149-5017-4b68-9f33-a26daabe984d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.028181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1149-5017-4b68-9f33-a26daabe984d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.028449 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1149-5017-4b68-9f33-a26daabe984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.050918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e8dd1149-5017-4b68-9f33-a26daabe984d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:13.052195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e8dd1149-5017-4b68-9f33-a26daabe984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:13.060916 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4143/8290] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:55:13.065757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb52783-fe5a-413e-b82f-9d3fabe423f6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.076368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb52783-fe5a-413e-b82f-9d3fabe423f6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:13.081223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:13.081935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.082307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.082649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.083363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:55:13.083844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:13.085526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:13.098290 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4148/8291] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:55:13.102742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1149-5017-4b68-9f33-a26daabe984d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.113521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1149-5017-4b68-9f33-a26daabe984d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:13.119193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:13.119858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.120146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.120443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.121069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:13.123041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:13.246701 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4144/8292] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:13 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:55:13.247866 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.258427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20409c59-d0a0-4afb-84e8-0a979e2e18b7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:13.317391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:13.318058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.318375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.318628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.319307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:13.321657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:13.434780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4149/8293] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:13 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:55:13.436070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.447428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fab11-4477-4360-aef6-7839e889f48c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:13.453505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:13.454232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.459256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.459256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.459256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:13.459256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:13.472506 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4145/8294] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:13.477613 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.489443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6164ec5-48f0-44ba-b28e-8818631580a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:13.496303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c95ee-630b-4945-9e8a-a458475e7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:13.497030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c95ee-630b-4945-9e8a-a458475e7bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.497294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c95ee-630b-4945-9e8a-a458475e7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.497631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c95ee-630b-4945-9e8a-a458475e7bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.498248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c95ee-630b-4945-9e8a-a458475e7bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:13.500107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c95ee-630b-4945-9e8a-a458475e7bdb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:13.522492 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4150/8295] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:13.528154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.539730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2db1-c5ea-438b-ab7a-907299e91b47 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:13.546779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:13.548405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.548529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.548928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] PATH_INFO: `/v3/projects/95d3b52c14c0410a911b8561839bfe31/users/2d8222cf37bc401fa16899f20a5528b7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.566573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d3b52c14c0410a911b8561839bfe31, user_id=2d8222cf37bc401fa16899f20a5528b7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:13.569365 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:13.677105 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4146/8296] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:13 2022] PUT /identity/v3/projects/95d3b52c14c0410a911b8561839bfe31/users/2d8222cf37bc401fa16899f20a5528b7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:55:13.689278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd831-43a5-4599-abb8-eabfcf687938 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.689566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd831-43a5-4599-abb8-eabfcf687938 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.689841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd831-43a5-4599-abb8-eabfcf687938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.719902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-bc2bd831-43a5-4599-abb8-eabfcf687938 None None] MFA Rules not processed for user `2d8222cf37bc401fa16899f20a5528b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:13.721150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-bc2bd831-43a5-4599-abb8-eabfcf687938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:13.794521 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4151/8297] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:13.799634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.886230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987211-ee6b-41b1-91fb-dde27b0c4f2f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:13.891285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:13.892157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:13.892490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:13.898346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:13.898346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:13.898346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:13.973258 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4147/8298] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:13 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:55:13.982177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd831-43a5-4599-abb8-eabfcf687938 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:13.994007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd831-43a5-4599-abb8-eabfcf687938 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:14.045567 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:14.066593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:14.067307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:14.067672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:14.068012 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:14.068710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:14.071650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:14.199518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4152/8299] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:13 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:14.200785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:14.211476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ae05-dbcc-4796-b23d-7b4b7f03d413 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:14.219358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:14.219978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:14.220978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:14.220978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:14.221223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:14.222990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:14.235655 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4148/8300] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:14.240073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:14.255049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ae2e-06b1-4a29-9393-0b5b9f423ec2 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:14.261088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:14.261824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:14.262194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:14.262472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] PATH_INFO: `/v3/projects/a0483607968744b58477f61e6fd78727/users/a9507c1d2dde41609dcb64d6c246b4fb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:14.282009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0483607968744b58477f61e6fd78727, user_id=a9507c1d2dde41609dcb64d6c246b4fb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:14.285062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:14.406176 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4153/8301] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:14 2022] PUT /identity/v3/projects/a0483607968744b58477f61e6fd78727/users/a9507c1d2dde41609dcb64d6c246b4fb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:14.407180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:14.417859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151ffba-03e3-4477-ab0e-fc0e9be3caf0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:14.479201 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:14.494765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3148810-b2f8-4a13-b493-281bfe2afffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:14.494765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3148810-b2f8-4a13-b493-281bfe2afffd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:14.494765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3148810-b2f8-4a13-b493-281bfe2afffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:14.494765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3148810-b2f8-4a13-b493-281bfe2afffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:14.495274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3148810-b2f8-4a13-b493-281bfe2afffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:14.495274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3148810-b2f8-4a13-b493-281bfe2afffd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:14.505191 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4149/8302] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:14.511350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:14.532017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c02b9-e374-4848-b869-0d0f7551207e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:14.532017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:14.532017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:14.532017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:14.532581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] PATH_INFO: `/v3/projects/a0483607968744b58477f61e6fd78727/users/a9507c1d2dde41609dcb64d6c246b4fb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:14.540081 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0483607968744b58477f61e6fd78727, user_id=a9507c1d2dde41609dcb64d6c246b4fb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:14.542870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:14.562373 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4154/8303] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:14 2022] PUT /identity/v3/projects/a0483607968744b58477f61e6fd78727/users/a9507c1d2dde41609dcb64d6c246b4fb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:14.581264 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:14.581709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:14.582100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:14.632355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] MFA Rules not processed for user `a9507c1d2dde41609dcb64d6c246b4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:14.633725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:14.740383 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4150/8304] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:14.755451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:14.757373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:14.849773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9073291-0caa-41be-990b-3729be9502f9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:14.854966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:14.856069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:14.856559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:14.856909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:14.942018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:14.943808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:14.956898 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4155/8305] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:17.898981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:17.900384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:17.916054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307093b8-0847-44c9-a0a3-176cbbec80a9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:17.925385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6334a-4440-4cf0-ba4a-d44e0f58f64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:17.926044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6334a-4440-4cf0-ba4a-d44e0f58f64a service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:17.926335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6334a-4440-4cf0-ba4a-d44e0f58f64a service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:17.926606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6334a-4440-4cf0-ba4a-d44e0f58f64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:17.937125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6334a-4440-4cf0-ba4a-d44e0f58f64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:17.944177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6334a-4440-4cf0-ba4a-d44e0f58f64a service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:17.948892 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4151/8306] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:24.951537 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:26.876088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:26.947794 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3eda9-792a-4085-87cf-085f38e9cca1 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:26.955392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:26.956272 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:26.956611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:26.956943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] PATH_INFO: `/v3/users/2d8222cf37bc401fa16899f20a5528b7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:26.959163 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8222cf37bc401fa16899f20a5528b7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:26.961470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:27.227371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8222cf37bc401fa16899f20a5528b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:27.237469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8222cf37bc401fa16899f20a5528b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:27.238304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8222cf37bc401fa16899f20a5528b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:27.345746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8222cf37bc401fa16899f20a5528b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:27.346669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8222cf37bc401fa16899f20a5528b7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:27.397339 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4156/8307] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:26 2022] DELETE /identity/v3/users/2d8222cf37bc401fa16899f20a5528b7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:27.401836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:27.402325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:27.402440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:27.433331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:27.457531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:27.522845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4152/8308] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:55:27.533490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:27.534994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:27.620991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e236074-6222-4783-9405-b93ef811e254 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:27.624695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:27.625816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:27.626246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:27.626517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:27.636381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:27.637844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:27.650896 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4157/8309] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:28.095570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:28.097436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:28.127089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f637c-3d9a-4b03-916f-0b844658f119 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:28.132570 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:28.133289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:28.133649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:28.134025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] PATH_INFO: `/v3/projects/95d3b52c14c0410a911b8561839bfe31` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:28.135270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d3b52c14c0410a911b8561839bfe31)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:28.137473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:28.339440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d3b52c14c0410a911b8561839bfe31', 'request_id': 'req-0e52b021-5905-4bf2-a1a1-480f7a703783'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:28.346322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d3b52c14c0410a911b8561839bfe31', 'request_id': 'req-0e52b021-5905-4bf2-a1a1-480f7a703783'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:28.349562 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:28.435675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d3b52c14c0410a911b8561839bfe31', 'request_id': 'req-0e52b021-5905-4bf2-a1a1-480f7a703783'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:28.452143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] The token cache is being invalidate because project 95d3b52c14c0410a911b8561839bfe31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:28.452545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:28.454052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:28.455891 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4153/8310] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:28 2022] DELETE /identity/v3/projects/95d3b52c14c0410a911b8561839bfe31 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:28.465487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:28.496322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f14093-83e5-4e86-8349-faf6907a62fa service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:28.518803 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:28.559525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:28.560494 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:28.560889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:28.567194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] PATH_INFO: `/v3/users/a9507c1d2dde41609dcb64d6c246b4fb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:28.570343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9507c1d2dde41609dcb64d6c246b4fb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:28.570698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:28.868421 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9507c1d2dde41609dcb64d6c246b4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:28.875734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9507c1d2dde41609dcb64d6c246b4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:28.876440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9507c1d2dde41609dcb64d6c246b4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:29.129224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9507c1d2dde41609dcb64d6c246b4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:29.129224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-78aef508-af81-4e61-b43b-4fbc81e5e18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9507c1d2dde41609dcb64d6c246b4fb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:29.129224 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4158/8311] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:28 2022] DELETE /identity/v3/users/a9507c1d2dde41609dcb64d6c246b4fb => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:29.877953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:29.879453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:29.893451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52b021-5905-4bf2-a1a1-480f7a703783 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:29.952512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:29.953177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:29.953462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:29.953734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] PATH_INFO: `/v3/projects/a0483607968744b58477f61e6fd78727` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:29.954874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0483607968744b58477f61e6fd78727)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:29.956775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:30.113137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0483607968744b58477f61e6fd78727', 'request_id': 'req-8d502443-5db3-4500-b1db-913aac3c2e1f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:30.118639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0483607968744b58477f61e6fd78727', 'request_id': 'req-8d502443-5db3-4500-b1db-913aac3c2e1f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:30.221433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0483607968744b58477f61e6fd78727', 'request_id': 'req-8d502443-5db3-4500-b1db-913aac3c2e1f'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:30.233716 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] The token cache is being invalidate because project a0483607968744b58477f61e6fd78727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:30.234043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:30.234740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d502443-5db3-4500-b1db-913aac3c2e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:30.236542 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4154/8312] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:29 2022] DELETE /identity/v3/projects/a0483607968744b58477f61e6fd78727 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:30.241789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9d71-8322-4eb4-80c7-2b82249681fa None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.246007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9d71-8322-4eb4-80c7-2b82249681fa None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.246007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9d71-8322-4eb4-80c7-2b82249681fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:30.263474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3a5f9d71-8322-4eb4-80c7-2b82249681fa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:30.264774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3a5f9d71-8322-4eb4-80c7-2b82249681fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:30.323997 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4159/8313] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:30.332388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ab06-c833-4d95-b17d-fcb45cbaf955 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.332670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ab06-c833-4d95-b17d-fcb45cbaf955 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.332941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ab06-c833-4d95-b17d-fcb45cbaf955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:30.354725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e4e3ab06-c833-4d95-b17d-fcb45cbaf955 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:30.356006 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e4e3ab06-c833-4d95-b17d-fcb45cbaf955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:30.364856 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4155/8314] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:30.369667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9d71-8322-4eb4-80c7-2b82249681fa None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:30.381140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9d71-8322-4eb4-80c7-2b82249681fa None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:30.386460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:30.387182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.387525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.387872 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:30.388715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:55:30.389226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:30.391103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:30.408053 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4160/8315] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:55:30.412879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ab06-c833-4d95-b17d-fcb45cbaf955 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:30.431429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ab06-c833-4d95-b17d-fcb45cbaf955 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:30.439488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:30.440356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.440741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.441129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:30.442216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:30.445043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:30.663045 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4156/8316] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:30 2022] POST /identity/v3/projects => generated 401 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:30.667160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:30.678055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9507-649e-4ebe-b6e6-20fcdb9c5bbd admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:30.704084 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:30.737071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:30.737678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.737958 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.738258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:30.738887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:30.740773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:30.855570 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4161/8317] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:30 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:30.857329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:30.868674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05f7a-9397-4281-9cbf-6e2ea9f917f4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:30.894889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:30.895713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.896890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.900730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:30.901618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:30.914507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:30.938782 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4157/8318] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:30.942890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:30.956308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac03dc-1d7a-40f0-99e6-2798635e4cc5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:30.962037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acece08f-3c2a-44a3-b747-80ac7d5ca77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:30.962662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece08f-3c2a-44a3-b747-80ac7d5ca77d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.962950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece08f-3c2a-44a3-b747-80ac7d5ca77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.963205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece08f-3c2a-44a3-b747-80ac7d5ca77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:30.963857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acece08f-3c2a-44a3-b747-80ac7d5ca77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:30.965508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acece08f-3c2a-44a3-b747-80ac7d5ca77d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:30.978010 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4162/8319] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:30.981514 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:30.992164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890001e0-f9a5-4ef1-8095-5bb7883c951c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:30.997572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:30.998512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:30.999054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:30.999574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] PATH_INFO: `/v3/projects/0bc04e745f334b7785aa39443ab632a4/users/37ecd5ac1d5f44caac6554d6a4c6e18b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:31.015517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc04e745f334b7785aa39443ab632a4, user_id=37ecd5ac1d5f44caac6554d6a4c6e18b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:31.018801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:31.123194 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4158/8320] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:30 2022] PUT /identity/v3/projects/0bc04e745f334b7785aa39443ab632a4/users/37ecd5ac1d5f44caac6554d6a4c6e18b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:31.226896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206682a-2433-4f83-900d-ffa852fc9e54 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:31.227179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206682a-2433-4f83-900d-ffa852fc9e54 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:31.227451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206682a-2433-4f83-900d-ffa852fc9e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:31.260266 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7206682a-2433-4f83-900d-ffa852fc9e54 None None] MFA Rules not processed for user `37ecd5ac1d5f44caac6554d6a4c6e18b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:31.263242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7206682a-2433-4f83-900d-ffa852fc9e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:31.345693 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4163/8321] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:31.350507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:31.367838 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:31.412378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2eb310-8452-49a7-9517-425397a7ea0d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:31.417394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:31.418154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:31.418389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:31.418658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:31.419295 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:31.422046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:31.555116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4159/8322] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:31 2022] POST /identity/v3/projects => generated 399 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:31.556294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206682a-2433-4f83-900d-ffa852fc9e54 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:31.571571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206682a-2433-4f83-900d-ffa852fc9e54 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:31.636394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:31.637011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:31.637294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:31.637598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:31.638246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:31.640597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:31.807324 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4164/8323] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:31 2022] POST /identity/v3/users => generated 306 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:31.808798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:31.821218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dae69-bfee-4898-88ba-d8149c0ab585 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:31.828657 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:31.829336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:31.829598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:31.829874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:31.830650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:31.832680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:31.846266 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4160/8324] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:31.850237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:31.861470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44484-bb3f-4e3d-bd33-864ef74c5502 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:31.867007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:31.867663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:31.867949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:31.868220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] PATH_INFO: `/v3/projects/6adecd8af01445e3b48f93b7570b9c5e/users/0250962bd0154818859fa348a3d6692e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:31.884130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adecd8af01445e3b48f93b7570b9c5e, user_id=0250962bd0154818859fa348a3d6692e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:31.886836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:31.959800 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4165/8325] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:31 2022] PUT /identity/v3/projects/6adecd8af01445e3b48f93b7570b9c5e/users/0250962bd0154818859fa348a3d6692e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:31.959915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:31.970143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f3a0-8961-49f5-8347-eddae5c173a5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:32.039736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924d4c4-d2af-40f6-815d-6b345b9f5e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:32.040257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924d4c4-d2af-40f6-815d-6b345b9f5e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:32.040533 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924d4c4-d2af-40f6-815d-6b345b9f5e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:32.040899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924d4c4-d2af-40f6-815d-6b345b9f5e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:32.041526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924d4c4-d2af-40f6-815d-6b345b9f5e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:32.043141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924d4c4-d2af-40f6-815d-6b345b9f5e68 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:32.055348 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4161/8326] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:55:32.069859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:32.069859 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:32.071220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f04d2-79cb-46bf-a61e-13496d5b2e8d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:32.076630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:32.077282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:32.077559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:32.077851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] PATH_INFO: `/v3/projects/6adecd8af01445e3b48f93b7570b9c5e/users/0250962bd0154818859fa348a3d6692e/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:32.079970 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adecd8af01445e3b48f93b7570b9c5e, user_id=0250962bd0154818859fa348a3d6692e, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:32.082591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:32.092815 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4166/8327] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:32 2022] PUT /identity/v3/projects/6adecd8af01445e3b48f93b7570b9c5e/users/0250962bd0154818859fa348a3d6692e/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:32.104409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2e6e5-5ad7-47f9-be22-8099250e8b88 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:32.104409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2e6e5-5ad7-47f9-be22-8099250e8b88 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:32.104409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2e6e5-5ad7-47f9-be22-8099250e8b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:32.143287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-94d2e6e5-5ad7-47f9-be22-8099250e8b88 None None] MFA Rules not processed for user `0250962bd0154818859fa348a3d6692e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:32.144658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-94d2e6e5-5ad7-47f9-be22-8099250e8b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:32.223391 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4162/8328] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:32.233759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:32.236251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:32.315192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d6bc8-a8d4-4054-be76-651b09202500 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:32.324188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:32.324188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:32.324188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:32.324188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:32.332600 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:32.334078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:32.345495 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4167/8329] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:32.600544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2e6e5-5ad7-47f9-be22-8099250e8b88 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:32.614122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2e6e5-5ad7-47f9-be22-8099250e8b88 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:32.618037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece8da-59d5-428a-8754-0349671ee3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:32.618821 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece8da-59d5-428a-8754-0349671ee3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:32.619097 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece8da-59d5-428a-8754-0349671ee3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:32.619371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece8da-59d5-428a-8754-0349671ee3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:32.631995 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:32.684282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece8da-59d5-428a-8754-0349671ee3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:32.685915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece8da-59d5-428a-8754-0349671ee3c5 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:32.695760 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4163/8330] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:32 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:41.384111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:41.507701 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e142f-9155-4314-8637-348485b34784 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:41.512782 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:41.513523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:41.514157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:41.514157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] PATH_INFO: `/v3/users/37ecd5ac1d5f44caac6554d6a4c6e18b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:41.515672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ecd5ac1d5f44caac6554d6a4c6e18b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:41.518260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:41.825743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ecd5ac1d5f44caac6554d6a4c6e18b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:41.835076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ecd5ac1d5f44caac6554d6a4c6e18b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:41.836296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ecd5ac1d5f44caac6554d6a4c6e18b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:41.928359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ecd5ac1d5f44caac6554d6a4c6e18b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:41.928989 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ecd5ac1d5f44caac6554d6a4c6e18b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:41.964556 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4168/8331] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:41 2022] DELETE /identity/v3/users/37ecd5ac1d5f44caac6554d6a4c6e18b => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:41.969285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:41.975243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:41.975243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:41.999387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:42.010175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:42.069299 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4164/8332] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:42.080203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:42.081709 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:42.095737 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:42.141858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6a8c4-cb32-4c9e-94b9-12cacfb3efd6 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:42.145743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:42.146383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:42.146662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:42.146936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:42.158045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:42.159428 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:42.169929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4169/8333] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:42.656084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:42.657563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:42.670084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e50b0f-2f71-4bce-86be-bc97d8d33df7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:42.675130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:42.675796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:42.676080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:42.676352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] PATH_INFO: `/v3/projects/0bc04e745f334b7785aa39443ab632a4` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:42.677594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc04e745f334b7785aa39443ab632a4)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:42.679554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:42.809901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc04e745f334b7785aa39443ab632a4', 'request_id': 'req-08b8b7be-5e92-45b1-a291-b528042add38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:42.819124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc04e745f334b7785aa39443ab632a4', 'request_id': 'req-08b8b7be-5e92-45b1-a291-b528042add38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:42.928785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc04e745f334b7785aa39443ab632a4', 'request_id': 'req-08b8b7be-5e92-45b1-a291-b528042add38'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:42.928785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] The token cache is being invalidate because project 0bc04e745f334b7785aa39443ab632a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:42.928785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:42.928785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:42.928785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4165/8334] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:42 2022] DELETE /identity/v3/projects/0bc04e745f334b7785aa39443ab632a4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:42.932055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:42.943353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79b2d-d1d8-48c4-be2d-e8aca5a3b996 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:43.004514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:43.005164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:43.005456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:43.005715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] PATH_INFO: `/v3/users/0250962bd0154818859fa348a3d6692e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:43.006898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0250962bd0154818859fa348a3d6692e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:43.008829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:43.250349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0250962bd0154818859fa348a3d6692e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:43.257093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0250962bd0154818859fa348a3d6692e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:43.257751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0250962bd0154818859fa348a3d6692e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:43.378703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0250962bd0154818859fa348a3d6692e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:43.379339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-52b5ef75-ebf5-4a76-8b33-773becfb1b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0250962bd0154818859fa348a3d6692e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:43.397788 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4170/8335] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:42 2022] DELETE /identity/v3/users/0250962bd0154818859fa348a3d6692e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:43.928906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:43.928906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:43.947555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8b7be-5e92-45b1-a291-b528042add38 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:43.996389 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:44.027095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:44.030009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.030009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.030009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] PATH_INFO: `/v3/projects/6adecd8af01445e3b48f93b7570b9c5e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.030009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adecd8af01445e3b48f93b7570b9c5e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:44.031308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:44.197958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adecd8af01445e3b48f93b7570b9c5e', 'request_id': 'req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:44.203559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adecd8af01445e3b48f93b7570b9c5e', 'request_id': 'req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:44.385404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adecd8af01445e3b48f93b7570b9c5e', 'request_id': 'req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:44.397524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] The token cache is being invalidate because project 6adecd8af01445e3b48f93b7570b9c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:55:44.397808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:44.398496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5852370d-7b1c-4bde-ae80-763b3f2dcc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:44.399967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4166/8336] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:55:43 2022] DELETE /identity/v3/projects/6adecd8af01445e3b48f93b7570b9c5e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:44.404875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0be25d-11ba-49d3-aec1-2fed23ee4de1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.405357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0be25d-11ba-49d3-aec1-2fed23ee4de1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.405508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0be25d-11ba-49d3-aec1-2fed23ee4de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.433088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1e0be25d-11ba-49d3-aec1-2fed23ee4de1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:44.434946 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1e0be25d-11ba-49d3-aec1-2fed23ee4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:44.472735 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:44.506937 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4171/8337] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:44.515441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe536-a9eb-454b-81d6-c2aa2f8d4f9e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.515719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe536-a9eb-454b-81d6-c2aa2f8d4f9e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.515989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fe536-a9eb-454b-81d6-c2aa2f8d4f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.536725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ac7fe536-a9eb-454b-81d6-c2aa2f8d4f9e None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:44.537963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ac7fe536-a9eb-454b-81d6-c2aa2f8d4f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:44.546869 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4167/8338] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:44.554320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0be25d-11ba-49d3-aec1-2fed23ee4de1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:44.569022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0be25d-11ba-49d3-aec1-2fed23ee4de1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:44.576556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:44.577588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.578274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.578950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.579777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:55:44.581114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:44.583225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:44.599999 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4172/8339] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:55:44.604287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe536-a9eb-454b-81d6-c2aa2f8d4f9e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:44.615851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fe536-a9eb-454b-81d6-c2aa2f8d4f9e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:44.621808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:44.622675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.622996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.623482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.624207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:44.627602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:44.753136 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4168/8340] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:55:44 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:55:44.757218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:44.767662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32880-ef70-419d-96d4-41e07a10d96b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:44.824736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:44.825342 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.825622 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.825895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.826549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:44.828605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:44.901110 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4173/8341] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:55:44 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:55:44.905595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:44.918691 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6793-b764-4941-8fae-436e809c3725 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:44.925785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:44.926575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.927391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.927391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.927678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:44.929316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:44.946099 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4169/8342] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:44.947904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:44.962839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad418b7-36b0-470c-8f1a-9ded0867a3fb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:44.967652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84a959-56a7-483d-b9b8-9b2ab762d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:44.968314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84a959-56a7-483d-b9b8-9b2ab762d037 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:44.968538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84a959-56a7-483d-b9b8-9b2ab762d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:44.968923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84a959-56a7-483d-b9b8-9b2ab762d037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:44.970117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84a959-56a7-483d-b9b8-9b2ab762d037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:44.971698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84a959-56a7-483d-b9b8-9b2ab762d037 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:44.986679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4174/8343] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:55:44.991459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:45.006004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b44d2b-a96d-4744-b881-7d5dcc04175c admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:45.010690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:45.011346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:45.011624 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:45.011894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] PATH_INFO: `/v3/projects/80e77890a94d48829f261d04dd6d6cb7/users/a378facb3b974d218594cd3fa8269d20/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:45.031845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e77890a94d48829f261d04dd6d6cb7, user_id=a378facb3b974d218594cd3fa8269d20, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:45.034346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:45.129186 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4170/8344] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:55:44 2022] PUT /identity/v3/projects/80e77890a94d48829f261d04dd6d6cb7/users/a378facb3b974d218594cd3fa8269d20/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:55:45.139948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:45.140332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:45.140502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:45.174316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] MFA Rules not processed for user `a378facb3b974d218594cd3fa8269d20`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:55:45.175596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:45.243641 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4175/8345] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:55:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:55:45.254583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:45.256286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:45.318943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3601c-11c2-46de-8dbc-ccf198bbdd7a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:45.323211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:45.323889 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:45.324233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:45.324566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:45.334879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:45.336540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:45.348031 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4171/8346] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:54.035088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:54.038136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:54.104673 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:54.141738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67a888-90a0-48fe-9426-fbc2fb9e3bd7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:54.146089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:54.147987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:54.147987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:54.147987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:54.150247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:54.243226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:54.244804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:54.263344 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4176/8347] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:55.342843 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:55:57.944483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:57.957015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2af6-9aaf-492f-aa80-2817a08ddafe service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:57.960575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922133c-539f-4a86-b837-d5761b92c8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:57.961226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922133c-539f-4a86-b837-d5761b92c8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:57.961510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922133c-539f-4a86-b837-d5761b92c8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:57.967453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922133c-539f-4a86-b837-d5761b92c8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:57.967453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1922133c-539f-4a86-b837-d5761b92c8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:55:57.989138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922133c-539f-4a86-b837-d5761b92c8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:57.990959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922133c-539f-4a86-b837-d5761b92c8d8 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:58.022309 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4172/8348] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:55:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:55:59.571542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:55:59.660805 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475b77-53bc-4c76-9ce7-0ae9c93d3ce1 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:55:59.666027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:55:59.666684 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:55:59.666963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:55:59.667234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] PATH_INFO: `/v3/users/a378facb3b974d218594cd3fa8269d20` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:55:59.668382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a378facb3b974d218594cd3fa8269d20)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:55:59.670931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:55:59.940143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a378facb3b974d218594cd3fa8269d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:59.948694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a378facb3b974d218594cd3fa8269d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:55:59.949554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a378facb3b974d218594cd3fa8269d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:00.060107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a378facb3b974d218594cd3fa8269d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:00.060788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a378facb3b974d218594cd3fa8269d20'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:00.070230 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:00.085676 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4177/8349] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:55:59 2022] DELETE /identity/v3/users/a378facb3b974d218594cd3fa8269d20 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:56:00.087429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:00.087921 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:00.088199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:00.108266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:00.118073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:00.207279 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4173/8350] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:00.226518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:00.228196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:00.296889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925fcd-3373-4014-9bae-b4de671c3be8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:00.300948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9533d2-04d3-433a-bd90-b70d68750b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:00.301576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9533d2-04d3-433a-bd90-b70d68750b8a service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:00.301855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9533d2-04d3-433a-bd90-b70d68750b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:00.302165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9533d2-04d3-433a-bd90-b70d68750b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:00.312962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9533d2-04d3-433a-bd90-b70d68750b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:00.314476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9533d2-04d3-433a-bd90-b70d68750b8a service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:00.334157 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4178/8351] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:00.748186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:00.749710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:00.766719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ac6b9-5727-44ea-913a-a032b12372c5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:00.773010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:00.773667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:00.774053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:00.774297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] PATH_INFO: `/v3/projects/80e77890a94d48829f261d04dd6d6cb7` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:00.776025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e77890a94d48829f261d04dd6d6cb7)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:00.778676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:00.942764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e77890a94d48829f261d04dd6d6cb7', 'request_id': 'req-f5b22cac-9cda-4ca2-9e18-30254e96cc15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:00.949327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e77890a94d48829f261d04dd6d6cb7', 'request_id': 'req-f5b22cac-9cda-4ca2-9e18-30254e96cc15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:01.019923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e77890a94d48829f261d04dd6d6cb7', 'request_id': 'req-f5b22cac-9cda-4ca2-9e18-30254e96cc15'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:01.033572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] The token cache is being invalidate because project 80e77890a94d48829f261d04dd6d6cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:56:01.033856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:01.034977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f5b22cac-9cda-4ca2-9e18-30254e96cc15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:01.036467 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4174/8352] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:56:00 2022] DELETE /identity/v3/projects/80e77890a94d48829f261d04dd6d6cb7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:01.041452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625997fc-781c-408e-a7de-15c3ef042a77 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.041906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625997fc-781c-408e-a7de-15c3ef042a77 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.042033 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625997fc-781c-408e-a7de-15c3ef042a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.066878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-625997fc-781c-408e-a7de-15c3ef042a77 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:01.068202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-625997fc-781c-408e-a7de-15c3ef042a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:01.150574 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4179/8353] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:01.152398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e15f3-c08a-4de9-8a8b-de5375ad11fa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.152828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e15f3-c08a-4de9-8a8b-de5375ad11fa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.153077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e15f3-c08a-4de9-8a8b-de5375ad11fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.176252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7d9e15f3-c08a-4de9-8a8b-de5375ad11fa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:01.177578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7d9e15f3-c08a-4de9-8a8b-de5375ad11fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:01.185852 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4175/8354] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:01.190815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625997fc-781c-408e-a7de-15c3ef042a77 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:01.200922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625997fc-781c-408e-a7de-15c3ef042a77 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:01.205679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:01.206390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.206780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.207086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.207735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:56:01.208038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:01.209624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:01.225848 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4180/8355] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:56:01.227652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e15f3-c08a-4de9-8a8b-de5375ad11fa None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:01.238124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e15f3-c08a-4de9-8a8b-de5375ad11fa None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:01.243083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:01.246201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.246201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.246201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.246201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:01.247017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:01.387482 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4176/8356] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:56:01 2022] POST /identity/v3/projects => generated 359 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:56:01.391321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:01.401490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888329b-d3b5-4c09-9701-4df8ae0082a8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:01.461895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:01.462543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.462818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.463084 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.463719 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:01.465615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:01.557881 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4181/8357] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:56:01 2022] POST /identity/v3/users => generated 280 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:56:01.562228 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:01.575969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b1554-d803-42fa-aa01-4100716d088a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:01.581529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:01.583998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.583998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.583998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.583998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:01.585109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:01.600558 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4177/8358] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:56:01.602126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:01.614982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9b150-49f6-43f8-81df-e51829419f95 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:01.622777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d014994-be9d-4291-b2f5-ce4182c7328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:01.623688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d014994-be9d-4291-b2f5-ce4182c7328e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.624138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d014994-be9d-4291-b2f5-ce4182c7328e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.624630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d014994-be9d-4291-b2f5-ce4182c7328e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.625484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d014994-be9d-4291-b2f5-ce4182c7328e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:01.627948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d014994-be9d-4291-b2f5-ce4182c7328e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:01.631292 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:01.646277 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4182/8359] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:56:01.647304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:01.663816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff5451-bfb3-42e2-8895-4b4dd9ff368b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:01.681683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:01.681683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.682029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.682245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] PATH_INFO: `/v3/projects/ecc01662d3d846c88634da15988fb619/users/a7f59a9f0050476882405322adb9136d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.703701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc01662d3d846c88634da15988fb619, user_id=a7f59a9f0050476882405322adb9136d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:01.707270 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:01.812774 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4178/8360] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:56:01 2022] PUT /identity/v3/projects/ecc01662d3d846c88634da15988fb619/users/a7f59a9f0050476882405322adb9136d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:56:01.819491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279055-9f1e-4e70-93b7-300599c84392 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:01.819777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279055-9f1e-4e70-93b7-300599c84392 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:01.820049 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279055-9f1e-4e70-93b7-300599c84392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:01.855588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a5279055-9f1e-4e70-93b7-300599c84392 None None] MFA Rules not processed for user `a7f59a9f0050476882405322adb9136d`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:01.857188 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a5279055-9f1e-4e70-93b7-300599c84392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:01.936374 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4183/8361] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:01.974882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:01.976719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:01.988195 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:02.039136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d74d-b7ad-47f3-b62f-91c4eba087ba admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:02.043958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4673a-d29e-4e5c-b59d-1ffe219aa600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:02.044562 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4673a-d29e-4e5c-b59d-1ffe219aa600 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:02.044846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4673a-d29e-4e5c-b59d-1ffe219aa600 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:02.045101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4673a-d29e-4e5c-b59d-1ffe219aa600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:02.054524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4673a-d29e-4e5c-b59d-1ffe219aa600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:02.055998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4673a-d29e-4e5c-b59d-1ffe219aa600 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:02.066091 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4179/8362] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:02.082635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5279055-9f1e-4e70-93b7-300599c84392 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:02.150107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5279055-9f1e-4e70-93b7-300599c84392 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:02.155147 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:02.155914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:02.156292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:02.156663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] PATH_INFO: `/v3/users/a7f59a9f0050476882405322adb9136d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:02.157936 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f59a9f0050476882405322adb9136d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:02.160624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:02.325850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f59a9f0050476882405322adb9136d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:02.336478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f59a9f0050476882405322adb9136d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:02.337742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f59a9f0050476882405322adb9136d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:02.408929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f59a9f0050476882405322adb9136d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:02.409598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f59a9f0050476882405322adb9136d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:02.431017 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4184/8363] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:56:02 2022] DELETE /identity/v3/users/a7f59a9f0050476882405322adb9136d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:02.432758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:02.433218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:02.433312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:02.481828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:02.485542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:02.575267 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4180/8364] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:02.585809 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:02.587267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:02.600942 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:02.659874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d530e2-4061-45e9-99dc-cad7acfb918b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:02.664095 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:02.665078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:02.665503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:02.665839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:02.676932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:02.678427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:02.689954 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4185/8365] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:56:03.210084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:03.211872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:03.230334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b108-3765-45c0-973f-910ed943716d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:03.235238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:03.235892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:03.236172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:03.236772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] PATH_INFO: `/v3/projects/ecc01662d3d846c88634da15988fb619` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:03.237931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc01662d3d846c88634da15988fb619)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:03.239876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:03.289852 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:03.291354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:03.366173 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526f6c-228b-4194-b290-b7ac08487063 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:03.380659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc01662d3d846c88634da15988fb619', 'request_id': 'req-843f5c2e-fba3-4e17-9a2b-f09eb670d216'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:03.386860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc01662d3d846c88634da15988fb619', 'request_id': 'req-843f5c2e-fba3-4e17-9a2b-f09eb670d216'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:03.432141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac186c-c69d-4044-86ba-b6e535b0a574 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:03.432776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac186c-c69d-4044-86ba-b6e535b0a574 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:03.433057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac186c-c69d-4044-86ba-b6e535b0a574 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:03.433330 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac186c-c69d-4044-86ba-b6e535b0a574 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:03.435264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1fac186c-c69d-4044-86ba-b6e535b0a574 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:03.454110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc01662d3d846c88634da15988fb619', 'request_id': 'req-843f5c2e-fba3-4e17-9a2b-f09eb670d216'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:03.470955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] The token cache is being invalidate because project ecc01662d3d846c88634da15988fb619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:56:03.471912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:03.474102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-843f5c2e-fba3-4e17-9a2b-f09eb670d216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:03.480567 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4181/8366] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:56:03 2022] DELETE /identity/v3/projects/ecc01662d3d846c88634da15988fb619 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:03.482584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e15c8-1c88-4661-911e-0af371926750 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:03.483092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e15c8-1c88-4661-911e-0af371926750 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:03.483768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e15c8-1c88-4661-911e-0af371926750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:03.510698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5b6e15c8-1c88-4661-911e-0af371926750 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:03.511500 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:03.512752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b6e15c8-1c88-4661-911e-0af371926750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:03.516152 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac186c-c69d-4044-86ba-b6e535b0a574 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:03.518903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac186c-c69d-4044-86ba-b6e535b0a574 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:03.537104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4186/8367] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:56:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 01:56:03.554366 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:03.585471 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4182/8368] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:03.593250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba218636-f903-477e-b0d1-7901401b04c4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:03.593551 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba218636-f903-477e-b0d1-7901401b04c4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:03.593815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba218636-f903-477e-b0d1-7901401b04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:03.613574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ba218636-f903-477e-b0d1-7901401b04c4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:03.614802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ba218636-f903-477e-b0d1-7901401b04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:03.622988 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4187/8369] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:03.627843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e15c8-1c88-4661-911e-0af371926750 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:03.637255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e15c8-1c88-4661-911e-0af371926750 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:03.642244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:03.643424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:03.646076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:03.646076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:03.646076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:56:03.646076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:03.647316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:03.659876 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4183/8370] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:56:03.664445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba218636-f903-477e-b0d1-7901401b04c4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:03.674087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba218636-f903-477e-b0d1-7901401b04c4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:03.678903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:03.679480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:03.679758 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:03.680032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:03.680667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:03.682650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:03.839496 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4188/8371] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:56:03 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:56:03.843134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:03.859125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826b81-1cce-4b91-8509-b9c220c4e6f8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:03.922293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:03.922910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:03.923220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:03.923555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:03.924940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:03.927046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.052649 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4184/8372] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:56:03 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:56:04.053731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.081432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd009d-7572-4d73-931a-f9cd5a5f2190 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:04.086291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:04.087043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.087320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.087597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.088245 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:04.089839 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.101004 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4189/8373] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:56:04.105421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.116252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e0034-216b-4d2c-8133-64d59a4bab9d admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:04.121790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef27e-8396-45c5-9925-2bfa59d4fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:04.122448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef27e-8396-45c5-9925-2bfa59d4fb18 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.122722 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef27e-8396-45c5-9925-2bfa59d4fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.123205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef27e-8396-45c5-9925-2bfa59d4fb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.123802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef27e-8396-45c5-9925-2bfa59d4fb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:04.125429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef27e-8396-45c5-9925-2bfa59d4fb18 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.141511 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4185/8374] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:56:04.146259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.159265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a3129-3b9b-4717-8e75-2a3f99dcafae admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:04.164619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:04.165398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.165630 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.165910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] PATH_INFO: `/v3/projects/5dcb66f87f5640d791f3a7f7ef723c51/users/a40c2f5b0e444bc08be33b03fc837449/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.185265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dcb66f87f5640d791f3a7f7ef723c51, user_id=a40c2f5b0e444bc08be33b03fc837449, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:04.188025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.296702 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4190/8375] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:56:04 2022] PUT /identity/v3/projects/5dcb66f87f5640d791f3a7f7ef723c51/users/a40c2f5b0e444bc08be33b03fc837449/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:04.307956 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fdbd8-a84b-4bb3-b58f-96f71859a06e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.308244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fdbd8-a84b-4bb3-b58f-96f71859a06e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.308524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fdbd8-a84b-4bb3-b58f-96f71859a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.338255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-642fdbd8-a84b-4bb3-b58f-96f71859a06e None None] MFA Rules not processed for user `a40c2f5b0e444bc08be33b03fc837449`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:04.339489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-642fdbd8-a84b-4bb3-b58f-96f71859a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:04.404791 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4186/8376] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:04.410038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.474126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5a423-6fcf-4674-9622-7d884ee57d22 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:04.481710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:04.482380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.482658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.482928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.483629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:04.485592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.596773 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4191/8377] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:56:04 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:56:04.597499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fdbd8-a84b-4bb3-b58f-96f71859a06e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.608759 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fdbd8-a84b-4bb3-b58f-96f71859a06e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:04.635369 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:04.677298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:04.678344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.678344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.678558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.679134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:04.681040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.794279 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4187/8378] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:56:04 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:56:04.798192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.808754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81ecbd-4181-4119-b062-b0f72482f69e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:04.813464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:04.814130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.814410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.814675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.815343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:04.817086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.828275 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4192/8379] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:56:04.833170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.844201 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869d323-37e6-4c91-97b4-9586854110f2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:04.849433 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:04.850121 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:04.850401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:04.850678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] PATH_INFO: `/v3/projects/2377f3a4b0df40c89048c9f5f9985846/users/5c2997c0a17e4d66b1b050b30b936b68/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:04.866906 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2377f3a4b0df40c89048c9f5f9985846, user_id=5c2997c0a17e4d66b1b050b30b936b68, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:04.869661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:04.952248 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4188/8380] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:56:04 2022] PUT /identity/v3/projects/2377f3a4b0df40c89048c9f5f9985846/users/5c2997c0a17e4d66b1b050b30b936b68/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:56:04.957127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:04.969191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0d6ed-f5e5-4fef-8505-9bf9c7f8c6b4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:05.031899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669937c8-40d9-4e15-99d1-302ce1f43bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:05.032510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669937c8-40d9-4e15-99d1-302ce1f43bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:05.032789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669937c8-40d9-4e15-99d1-302ce1f43bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:05.033062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669937c8-40d9-4e15-99d1-302ce1f43bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:05.033694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669937c8-40d9-4e15-99d1-302ce1f43bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:05.035325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669937c8-40d9-4e15-99d1-302ce1f43bb8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:05.040227 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:05.049287 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4193/8381] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 01:56:05.050615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:05.062863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b5d55-cf14-433d-95a9-087b127888b7 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:05.072706 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:05.073745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:05.074093 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:05.074375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] PATH_INFO: `/v3/projects/2377f3a4b0df40c89048c9f5f9985846/users/5c2997c0a17e4d66b1b050b30b936b68/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:05.076452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2377f3a4b0df40c89048c9f5f9985846, user_id=5c2997c0a17e4d66b1b050b30b936b68, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:05.079226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:05.090590 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4189/8382] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:56:05 2022] PUT /identity/v3/projects/2377f3a4b0df40c89048c9f5f9985846/users/5c2997c0a17e4d66b1b050b30b936b68/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:05.101751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:05.102112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:05.102390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:05.130094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] MFA Rules not processed for user `5c2997c0a17e4d66b1b050b30b936b68`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:05.131280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:05.200312 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4194/8383] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:05.213822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:05.215602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:05.281486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5e078-e4d5-4e90-8a01-83de7a92bf58 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:05.285251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7289c5-1199-46e4-9954-0926070c713b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:05.285925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7289c5-1199-46e4-9954-0926070c713b service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:05.286161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7289c5-1199-46e4-9954-0926070c713b service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:05.286429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7289c5-1199-46e4-9954-0926070c713b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:05.352531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7289c5-1199-46e4-9954-0926070c713b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:05.354059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7289c5-1199-46e4-9954-0926070c713b service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:05.365049 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4190/8384] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:06.337557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:06.340189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:06.412423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78cc44-159b-444a-b540-2c9555ef13ff None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:06.416499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:06.417102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:06.417375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:06.417640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:06.420387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:06.433798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:06.435377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:06.447081 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4195/8385] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:07.251064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c5c1-09de-48f8-b0a5-b813e8b8176b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:07.251618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c5c1-09de-48f8-b0a5-b813e8b8176b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:07.251799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c5c1-09de-48f8-b0a5-b813e8b8176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:07.286062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4354c5c1-09de-48f8-b0a5-b813e8b8176b None None] MFA Rules not processed for user `f949b4b3b7b143158acb8aa6ee0a7da8`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:07.287507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4354c5c1-09de-48f8-b0a5-b813e8b8176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:07.321388 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:07.352050 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4191/8386] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:07.795236 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:07.797954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:07.812471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808fd1-33b1-4649-b7cf-6ed9a6cabc3c service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:07.816849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd0c62-4324-4bc0-add8-0014438109b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:07.817593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0c62-4324-4bc0-add8-0014438109b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:07.818082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0c62-4324-4bc0-add8-0014438109b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:07.818359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0c62-4324-4bc0-add8-0014438109b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:07.820151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-28fd0c62-4324-4bc0-add8-0014438109b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:07.834973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd0c62-4324-4bc0-add8-0014438109b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:07.836343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd0c62-4324-4bc0-add8-0014438109b9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:07.849026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4196/8387] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:11.876014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354c5c1-09de-48f8-b0a5-b813e8b8176b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:11.989149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354c5c1-09de-48f8-b0a5-b813e8b8176b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:11.996052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:11.996834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:11.997323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:11.998122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] PATH_INFO: `/v3/users/a40c2f5b0e444bc08be33b03fc837449` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:11.999356 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40c2f5b0e444bc08be33b03fc837449)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:12.002795 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:12.252954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40c2f5b0e444bc08be33b03fc837449'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:12.262507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40c2f5b0e444bc08be33b03fc837449'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:12.263783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40c2f5b0e444bc08be33b03fc837449'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:12.334868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40c2f5b0e444bc08be33b03fc837449'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:12.335528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40c2f5b0e444bc08be33b03fc837449'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:12.373107 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4192/8388] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:56:11 2022] DELETE /identity/v3/users/a40c2f5b0e444bc08be33b03fc837449 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:12.380460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:12.381366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:12.381899 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:12.417964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:12.419945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:12.523780 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4197/8389] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:12.541882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:12.543799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:12.646524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf5692-c771-42f9-a0ae-16431812ba14 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:12.650635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:12.651262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:12.651540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:12.653764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:12.669569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:12.671055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:12.686476 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4193/8390] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:13.270747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:13.272518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:13.313769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c602401-7135-4d02-8413-1ce0f721155b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:13.330264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:13.331368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:13.331626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:13.331901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] PATH_INFO: `/v3/projects/5dcb66f87f5640d791f3a7f7ef723c51` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:13.336860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dcb66f87f5640d791f3a7f7ef723c51)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:13.342849 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:13.383895 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:13.645000 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dcb66f87f5640d791f3a7f7ef723c51', 'request_id': 'req-273c4631-2508-410b-a683-dab1b0e88404'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:13.685743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dcb66f87f5640d791f3a7f7ef723c51', 'request_id': 'req-273c4631-2508-410b-a683-dab1b0e88404'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:13.770593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dcb66f87f5640d791f3a7f7ef723c51', 'request_id': 'req-273c4631-2508-410b-a683-dab1b0e88404'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:13.784257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] The token cache is being invalidate because project 5dcb66f87f5640d791f3a7f7ef723c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:56:13.784569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:13.785318 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:13.787088 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4198/8391] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:56:13 2022] DELETE /identity/v3/projects/5dcb66f87f5640d791f3a7f7ef723c51 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:13.791110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:13.800973 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:13.802925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0613e-5a4c-41b8-ba83-3c37a9b0af9a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:13.885185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:13.886138 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:13.886429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:13.886705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] PATH_INFO: `/v3/users/5c2997c0a17e4d66b1b050b30b936b68` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:13.888860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2997c0a17e4d66b1b050b30b936b68)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:13.892634 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:14.167470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2997c0a17e4d66b1b050b30b936b68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:14.192152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2997c0a17e4d66b1b050b30b936b68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:14.193792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2997c0a17e4d66b1b050b30b936b68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:14.248681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2997c0a17e4d66b1b050b30b936b68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:14.249849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f71594b0-fe1d-4a0f-95bb-3c9097518509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2997c0a17e4d66b1b050b30b936b68'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:14.269711 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4194/8392] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:56:13 2022] DELETE /identity/v3/users/5c2997c0a17e4d66b1b050b30b936b68 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:14.827869 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:14.829452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:14.853343 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4631-2508-410b-a683-dab1b0e88404 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:14.977141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:14.978221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:14.978575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:14.978941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] PATH_INFO: `/v3/projects/2377f3a4b0df40c89048c9f5f9985846` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:14.980390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2377f3a4b0df40c89048c9f5f9985846)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:14.982486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:15.129057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2377f3a4b0df40c89048c9f5f9985846', 'request_id': 'req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:15.135038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2377f3a4b0df40c89048c9f5f9985846', 'request_id': 'req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:15.208685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2377f3a4b0df40c89048c9f5f9985846', 'request_id': 'req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:15.234017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] The token cache is being invalidate because project 2377f3a4b0df40c89048c9f5f9985846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:56:15.234413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:15.235165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-35fb7dbd-43a5-44ff-abb6-ba76d94f5fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:56:15.236745 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4199/8393] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:56:14 2022] DELETE /identity/v3/projects/2377f3a4b0df40c89048c9f5f9985846 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:15.241810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38df2-5cca-437b-9290-ef0e1c5f849a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.245229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38df2-5cca-437b-9290-ef0e1c5f849a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.245229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38df2-5cca-437b-9290-ef0e1c5f849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.263337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c9c38df2-5cca-437b-9290-ef0e1c5f849a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:15.268137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c9c38df2-5cca-437b-9290-ef0e1c5f849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:15.329038 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4195/8394] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:15.337439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4c1f1-a3e2-4746-978c-17d7d5e633d6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.337992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4c1f1-a3e2-4746-978c-17d7d5e633d6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.338352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4c1f1-a3e2-4746-978c-17d7d5e633d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.359904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f8f4c1f1-a3e2-4746-978c-17d7d5e633d6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:15.361218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f8f4c1f1-a3e2-4746-978c-17d7d5e633d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:15.370581 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4200/8395] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:15.374997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c38df2-5cca-437b-9290-ef0e1c5f849a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:15.386351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c38df2-5cca-437b-9290-ef0e1c5f849a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:15.391068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:15.391679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.391955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.392245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.392912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:56:15.393211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:15.395508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:15.411572 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4196/8396] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:56:15.412826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4c1f1-a3e2-4746-978c-17d7d5e633d6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:15.422768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4c1f1-a3e2-4746-978c-17d7d5e633d6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:15.427759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:15.428363 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.428640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.428902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.429515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:15.431679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:15.530197 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:15.537647 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4201/8397] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:56:15 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:56:15.541820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:15.552892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc4340-0ca4-4605-83d3-69d0104861e1 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:15.558366 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:15.616231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:15.617017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.617546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.617898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.618711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:15.620635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:15.729328 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4197/8398] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:56:15 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:56:15.735126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:15.750014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29efb81-809c-4964-97b8-1bbfff3ed59c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:15.756503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:15.757261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.757544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.757823 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.758513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:15.760120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:15.777104 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4202/8399] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:56:15.780817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:15.799636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406d80-9c13-460e-8efb-dc4c5b96c459 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:15.805613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea1230-1367-4273-980d-57b9ae1af3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:15.806274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1230-1367-4273-980d-57b9ae1af3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.806557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1230-1367-4273-980d-57b9ae1af3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.806830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea1230-1367-4273-980d-57b9ae1af3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.808073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea1230-1367-4273-980d-57b9ae1af3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:15.810363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea1230-1367-4273-980d-57b9ae1af3b3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:15.826008 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4198/8400] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:56:15.830136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:15.844110 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221eac2-a085-4bc5-bae7-3511bbb4d5cc admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:15.849120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:15.849798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:15.850169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:15.850496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] PATH_INFO: `/v3/projects/82c8a51a777a4f99afa7df30e2f18f14/users/bda00295bd7d470c9add6ff058bb455e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:15.873466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c8a51a777a4f99afa7df30e2f18f14, user_id=bda00295bd7d470c9add6ff058bb455e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:15.876417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:15.992653 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4203/8401] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:56:15 2022] PUT /identity/v3/projects/82c8a51a777a4f99afa7df30e2f18f14/users/bda00295bd7d470c9add6ff058bb455e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:56:16.004656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:16.005221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:16.005673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:16.047822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] MFA Rules not processed for user `bda00295bd7d470c9add6ff058bb455e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:16.049128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:16.127895 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4199/8402] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:56:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:20.193784 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:20.195894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:20.261492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb9164-c63c-4a3c-a588-c80d322a8039 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:20.265127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:20.265728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:20.266053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:20.266350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:20.275467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:20.276882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:20.286730 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4204/8403] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:26.123789 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=62,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:30.282634 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:35.543848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:35.545462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:35.626977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c621eb7-6b76-4c00-978a-d7340f72991a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:35.631427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0ad2b-ff83-4ec3-a01f-c810b5982706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:35.632047 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ad2b-ff83-4ec3-a01f-c810b5982706 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:35.632326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ad2b-ff83-4ec3-a01f-c810b5982706 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:35.632596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ad2b-ff83-4ec3-a01f-c810b5982706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:35.634387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cee0ad2b-ff83-4ec3-a01f-c810b5982706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:35.724965 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0ad2b-ff83-4ec3-a01f-c810b5982706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:35.726494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0ad2b-ff83-4ec3-a01f-c810b5982706 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:35.736572 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4200/8404] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:38.613113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:38.614875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:38.712099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368a569-e240-4b3e-962d-5e2a31e7377c service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:38.721447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:38.722145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:38.722427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:38.722700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:38.724712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:38.760181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:38.762149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:38.784814 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4205/8405] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:56:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:56:42.805232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f28a-22bc-468a-9cdd-18a7919a5bd5 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:42.810898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f28a-22bc-468a-9cdd-18a7919a5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:42.810898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f28a-22bc-468a-9cdd-18a7919a5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:42.851565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7788f28a-22bc-468a-9cdd-18a7919a5bd5 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:56:42.852838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7788f28a-22bc-468a-9cdd-18a7919a5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:42.937501 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4201/8406] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 01:56:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:56:43.185772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:56:43.187801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:56:43.305032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3b97e-f6a9-4923-89d4-463f53fd9776 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:56:43.310357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882564d-746d-4c50-9776-5892b6bcd8be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:56:43.311062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882564d-746d-4c50-9776-5892b6bcd8be service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:56:43.311334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882564d-746d-4c50-9776-5892b6bcd8be service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:56:43.315965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882564d-746d-4c50-9776-5892b6bcd8be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:56:43.321020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882564d-746d-4c50-9776-5892b6bcd8be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:56:43.322757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882564d-746d-4c50-9776-5892b6bcd8be service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:56:43.345368 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4206/8407] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 01:56:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:56:52.919055 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=75 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:56:53.328956 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=66 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:07.451684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788f28a-22bc-468a-9cdd-18a7919a5bd5 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:07.464223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788f28a-22bc-468a-9cdd-18a7919a5bd5 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:07.467831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:07.468441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:07.468721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:07.468991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:07.470790 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:07.484410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:07.485837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:07.496992 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4202/8408] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:57:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:57:15.881205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739781a-4f08-44c8-b1ae-41df726b4ad5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:15.881205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739781a-4f08-44c8-b1ae-41df726b4ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:15.881795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739781a-4f08-44c8-b1ae-41df726b4ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:15.900197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2739781a-4f08-44c8-b1ae-41df726b4ad5 None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:15.901403 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2739781a-4f08-44c8-b1ae-41df726b4ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:15.976496 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4207/8409] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:57:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:57:17.182133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:17.183682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:17.280467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5682e45-6000-479e-aa21-82d0fdd52fd5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:17.285887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:17.286640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:17.287011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:17.287474 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:17.289314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:17.307157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:17.308907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:17.323958 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4203/8410] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:57:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:57:25.957423 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=25 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:27.315776 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=38 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:41.509663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739781a-4f08-44c8-b1ae-41df726b4ad5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:41.523233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739781a-4f08-44c8-b1ae-41df726b4ad5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:41.526804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5616e3-f4b6-4888-8d9d-aec0e1d036f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:41.527400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5616e3-f4b6-4888-8d9d-aec0e1d036f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:41.527674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5616e3-f4b6-4888-8d9d-aec0e1d036f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:41.527990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5616e3-f4b6-4888-8d9d-aec0e1d036f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:41.529693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce5616e3-f4b6-4888-8d9d-aec0e1d036f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:41.597534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5616e3-f4b6-4888-8d9d-aec0e1d036f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:41.599056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5616e3-f4b6-4888-8d9d-aec0e1d036f6 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:41.609278 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4208/8411] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:57:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:57:51.604560 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=30 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:57:59.243302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.323690 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5662-9ae3-40b5-af7f-674169107831 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:59.328746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:59.329438 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.329721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.330018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] PATH_INFO: `/v3/users/bda00295bd7d470c9add6ff058bb455e` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.331369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda00295bd7d470c9add6ff058bb455e)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:59.334056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:59.575552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda00295bd7d470c9add6ff058bb455e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:57:59.586499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda00295bd7d470c9add6ff058bb455e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:57:59.587590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda00295bd7d470c9add6ff058bb455e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:57:59.654883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda00295bd7d470c9add6ff058bb455e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:57:59.655990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda00295bd7d470c9add6ff058bb455e'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:57:59.684029 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4204/8412] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:57:59 2022] DELETE /identity/v3/users/bda00295bd7d470c9add6ff058bb455e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:57:59.688697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.689550 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.690022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.712145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:57:59.713843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:59.812974 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4209/8413] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:57:59.825429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:57:59.827571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:57:59.904033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bd126-ddb9-42e5-93aa-b6faed832176 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:57:59.915837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b40904-a04d-430f-a5f5-f79fc3bd7c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:57:59.916993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b40904-a04d-430f-a5f5-f79fc3bd7c2d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:57:59.916993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b40904-a04d-430f-a5f5-f79fc3bd7c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:57:59.917420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b40904-a04d-430f-a5f5-f79fc3bd7c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:57:59.930401 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b40904-a04d-430f-a5f5-f79fc3bd7c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:57:59.932414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b40904-a04d-430f-a5f5-f79fc3bd7c2d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:57:59.948153 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4205/8414] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:00.425180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.427251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:00.453991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba48b4f-05d9-424d-854b-4703e593ada6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.480314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.482157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.482535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.483024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] PATH_INFO: `/v3/projects/82c8a51a777a4f99afa7df30e2f18f14` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.484541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c8a51a777a4f99afa7df30e2f18f14)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.487305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.613001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c8a51a777a4f99afa7df30e2f18f14', 'request_id': 'req-7099a70a-1ac4-49db-84b7-57fd3488c5fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:00.619949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c8a51a777a4f99afa7df30e2f18f14', 'request_id': 'req-7099a70a-1ac4-49db-84b7-57fd3488c5fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:00.711700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c8a51a777a4f99afa7df30e2f18f14', 'request_id': 'req-7099a70a-1ac4-49db-84b7-57fd3488c5fd'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:00.726010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] The token cache is being invalidate because project 82c8a51a777a4f99afa7df30e2f18f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:58:00.726451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:00.727190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-7099a70a-1ac4-49db-84b7-57fd3488c5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:00.733378 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4210/8415] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:58:00 2022] DELETE /identity/v3/projects/82c8a51a777a4f99afa7df30e2f18f14 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:00.735361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5125d2-6940-4946-a3b4-e03c288df5ec None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.736345 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5125d2-6940-4946-a3b4-e03c288df5ec None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.736855 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5125d2-6940-4946-a3b4-e03c288df5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.760198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3d5125d2-6940-4946-a3b4-e03c288df5ec None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:00.761728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3d5125d2-6940-4946-a3b4-e03c288df5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:00.782886 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:00.831399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4206/8416] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:00.839858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d129-ca17-4194-9658-d66a5542a7b6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.840240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d129-ca17-4194-9658-d66a5542a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.840640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58d129-ca17-4194-9658-d66a5542a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.864826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0f58d129-ca17-4194-9658-d66a5542a7b6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:00.866030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0f58d129-ca17-4194-9658-d66a5542a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:00.878062 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4211/8417] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:00.881156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5125d2-6940-4946-a3b4-e03c288df5ec None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.894220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5125d2-6940-4946-a3b4-e03c288df5ec None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.900213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.901030 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.901541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.902125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.903183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:00.903553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.905283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:00.925399 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4207/8418] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:00.926370 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d129-ca17-4194-9658-d66a5542a7b6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:00.952554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58d129-ca17-4194-9658-d66a5542a7b6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:00.959307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:00.960448 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:00.961105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:00.961601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:00.963116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:00.965369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.072039 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4212/8419] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:58:00 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:58:01.073392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:01.084698 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db00dbe-97c7-4c24-8eaf-aa216d7ddd59 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:01.150125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.150756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.151135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.151492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.152215 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:01.154372 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.268243 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4208/8420] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:58:01 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:58:01.272677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:01.284096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378141a-7509-4b50-9e3e-e57acc2ab1f1 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:01.290022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.294435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.294435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.294435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.294435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:01.294435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.306120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4213/8421] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:58:01.310808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:01.322294 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8970f-464e-44bb-bfc4-3fa3738c8711 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:01.327452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8143b-765e-4d63-bbbf-18317761d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.328169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8143b-765e-4d63-bbbf-18317761d38f admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.328544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8143b-765e-4d63-bbbf-18317761d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.328951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8143b-765e-4d63-bbbf-18317761d38f admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.329715 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8143b-765e-4d63-bbbf-18317761d38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:01.331479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8143b-765e-4d63-bbbf-18317761d38f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.345540 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4209/8422] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:58:01.354269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:01.390115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235420a-5667-4808-889e-61f49e091703 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:01.400880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.401540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.401825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.402141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] PATH_INFO: `/v3/projects/e76b081c02814da98ab62bfc2fe5536b/users/d2f253afef5849d19f4e1d99b038697b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.429667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b081c02814da98ab62bfc2fe5536b, user_id=d2f253afef5849d19f4e1d99b038697b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:01.434391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.502776 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4214/8423] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:58:01 2022] PUT /identity/v3/projects/e76b081c02814da98ab62bfc2fe5536b/users/d2f253afef5849d19f4e1d99b038697b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:01.516324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ede7-15a7-4573-9d55-d3296529b9e9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.516696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ede7-15a7-4573-9d55-d3296529b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.517026 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ede7-15a7-4573-9d55-d3296529b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.547164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3213ede7-15a7-4573-9d55-d3296529b9e9 None None] MFA Rules not processed for user `d2f253afef5849d19f4e1d99b038697b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:01.548348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3213ede7-15a7-4573-9d55-d3296529b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:01.630713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:01.632078 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4210/8424] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:01.666900 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:01.714944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c47c5-67af-451a-8d8b-e0b227bdfef4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:01.719665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.720374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.720560 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.720796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.721414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:01.725556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.800196 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4215/8425] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:58:01 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 01:58:01.804737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ede7-15a7-4573-9d55-d3296529b9e9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:01.816468 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ede7-15a7-4573-9d55-d3296529b9e9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:01.830551 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:01.874762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.875456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.875833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.876377 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:01.877181 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:01.879572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:01.976129 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4211/8426] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:58:01 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:01.980540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:01.992562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e90e-1f85-4b47-ade4-0ca4c2cf1fa7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:01.998322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:01.999044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:01.999491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:01.999770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:02.000517 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:02.002353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:02.015098 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4216/8427] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:58:02.021009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:02.032402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e4de1-c9fb-4ad4-b9e6-febf4b942fd8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:02.038517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:02.039220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:02.039503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:02.039784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] PATH_INFO: `/v3/projects/02231c13740447c1815861f1b190350d/users/af133a2f86f54dfe92d70c06628e8a70/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:02.060902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=02231c13740447c1815861f1b190350d, user_id=af133a2f86f54dfe92d70c06628e8a70, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:02.065265 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:02.184155 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4212/8428] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:58:02 2022] PUT /identity/v3/projects/02231c13740447c1815861f1b190350d/users/af133a2f86f54dfe92d70c06628e8a70/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:02.188382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:02.200315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5596-ec68-4112-99ed-afb5b280ff04 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:02.278868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e647eda-7910-4a9e-abf6-b2553688ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:02.279597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647eda-7910-4a9e-abf6-b2553688ae2f admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:02.279953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647eda-7910-4a9e-abf6-b2553688ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:02.280387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647eda-7910-4a9e-abf6-b2553688ae2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:02.281185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e647eda-7910-4a9e-abf6-b2553688ae2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:02.282953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e647eda-7910-4a9e-abf6-b2553688ae2f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:02.295562 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4217/8429] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:58:02.299831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:02.310864 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a78a8-bbdb-4ec6-ba9d-8fda4f400ccf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:02.315926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:02.316777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:02.317076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:02.317448 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] PATH_INFO: `/v3/projects/02231c13740447c1815861f1b190350d/users/af133a2f86f54dfe92d70c06628e8a70/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:02.319584 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02231c13740447c1815861f1b190350d, user_id=af133a2f86f54dfe92d70c06628e8a70, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:02.322333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:02.349382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:02.349670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:02.349953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:02.352702 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4213/8430] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:58:02 2022] PUT /identity/v3/projects/02231c13740447c1815861f1b190350d/users/af133a2f86f54dfe92d70c06628e8a70/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:02.384568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] MFA Rules not processed for user `af133a2f86f54dfe92d70c06628e8a70`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:02.385932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:02.492742 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4218/8431] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:02.503340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:02.505680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:02.579351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac6ba6-d741-4ff6-9dd4-beaf3b7d3bc8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:02.583986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:02.584581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:02.584858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:02.585127 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:02.649687 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:02.651162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:02.660869 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4214/8432] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:03.537516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:03.539106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:03.560514 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:03.630585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11487-2ece-4db3-a4ee-c460ea99282f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:03.636500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a8e4a-8eb7-40ba-a5fd-347e0503d802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:03.637716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a8e4a-8eb7-40ba-a5fd-347e0503d802 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:03.638238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a8e4a-8eb7-40ba-a5fd-347e0503d802 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:03.638900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a8e4a-8eb7-40ba-a5fd-347e0503d802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:03.641023 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-604a8e4a-8eb7-40ba-a5fd-347e0503d802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:03.711819 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a8e4a-8eb7-40ba-a5fd-347e0503d802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:03.713656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a8e4a-8eb7-40ba-a5fd-347e0503d802 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:03.728204 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4219/8433] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:05.364962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:05.366441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:05.380837 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccc53c-b1ca-407a-a176-3942c74dda82 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:05.385527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:05.386252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:05.386583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:05.388802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:05.400169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:05.401728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:05.412980 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4215/8434] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:13.719840 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=49 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:13.889543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764e0a1-af8f-48ba-bd36-db093494ff75 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:13.890326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764e0a1-af8f-48ba-bd36-db093494ff75 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:13.890861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764e0a1-af8f-48ba-bd36-db093494ff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:13.958226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7764e0a1-af8f-48ba-bd36-db093494ff75 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:13.959755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7764e0a1-af8f-48ba-bd36-db093494ff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:13.973260 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4220/8435] 10.222.0.42 () {58 vars in 1061 bytes} [Sun Oct 23 01:58:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:13.976051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:13.989918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97165ded-069c-4668-be09-fbe0f6103efa service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:13.994001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:13.994730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:13.995250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:13.995953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:14.001052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:14.017374 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:14.079710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:14.081705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:14.095472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4216/8436] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:14.835614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:14.836466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:14.836749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:14.858894 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] MFA Rules not processed for user `d2f253afef5849d19f4e1d99b038697b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:14.860126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:14.868007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4221/8437] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:15.556726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:15.566232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64533d71-5028-43d0-849a-a22ef6257c94 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:15.570266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:15.570882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:15.571163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:15.571437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:15.573461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:15.587251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:15.588775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:15.600640 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4217/8438] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:24.380433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:24.382214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:24.477208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811b3b0-9277-420e-8d1a-bcd4fb240126 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.487635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.488244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.488583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.489457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.491369 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:24.507362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.508980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.523283 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4222/8439] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:24.526191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:24.528027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:24.546812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72339916-f54b-4ef3-9da7-268bef5a55a2 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:24.553074 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:24.553705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:24.554156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:24.554601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] PATH_INFO: `/v3/users/f949b4b3b7b143158acb8aa6ee0a7da8` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:24.556399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f949b4b3b7b143158acb8aa6ee0a7da8)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:24.559540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:24.746272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f949b4b3b7b143158acb8aa6ee0a7da8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:24.754374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f949b4b3b7b143158acb8aa6ee0a7da8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:24.755389 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f949b4b3b7b143158acb8aa6ee0a7da8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:24.866774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f949b4b3b7b143158acb8aa6ee0a7da8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:24.867407 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f949b4b3b7b143158acb8aa6ee0a7da8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:24.900134 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4218/8440] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:58:24 2022] DELETE /identity/v3/users/f949b4b3b7b143158acb8aa6ee0a7da8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:25.202889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:25.223763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63527d0-009f-413b-a398-e16bba8ff4ce service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:25.286597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:25.287243 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:25.287519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:25.287791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] PATH_INFO: `/v3/projects/530303744266461da10d50db53a0e409` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:25.288922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530303744266461da10d50db53a0e409)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:25.291207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:25.404444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530303744266461da10d50db53a0e409', 'request_id': 'req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.410265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530303744266461da10d50db53a0e409', 'request_id': 'req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.491778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:25.493187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:25.508500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a710e8-328b-4aff-a74f-e07c27653706 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:25.523287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530303744266461da10d50db53a0e409', 'request_id': 'req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.527248 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:25.544674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] The token cache is being invalidate because project 530303744266461da10d50db53a0e409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:58:25.544972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.546361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.549431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4223/8441] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:58:25 2022] DELETE /identity/v3/projects/530303744266461da10d50db53a0e409 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:25.554202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:25.555793 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:25.588135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:25.588952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:25.589331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:25.589707 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] PATH_INFO: `/v3/users/4c880db3363a4aff92b82abfef14a8b0` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:25.591016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c880db3363a4aff92b82abfef14a8b0)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:25.593048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:25.599605 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:25.641687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2d1e-c24a-4293-a5d3-7fff8dbc3393 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:25.646932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:25.654216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:25.654216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:25.654216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] PATH_INFO: `/v3/users/10749b926c094d78b58eccd14d7e309b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:25.654216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10749b926c094d78b58eccd14d7e309b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:25.654216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:25.797557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c880db3363a4aff92b82abfef14a8b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.805396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c880db3363a4aff92b82abfef14a8b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.806109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c880db3363a4aff92b82abfef14a8b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.883169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c880db3363a4aff92b82abfef14a8b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.883907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-33d7a25a-2ce9-4f4f-886e-49b6f89cf8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c880db3363a4aff92b82abfef14a8b0'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.899993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10749b926c094d78b58eccd14d7e309b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.906244 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4219/8442] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:58:25 2022] DELETE /identity/v3/users/4c880db3363a4aff92b82abfef14a8b0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:25.907845 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10749b926c094d78b58eccd14d7e309b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.908584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10749b926c094d78b58eccd14d7e309b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:25.910360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:25.911293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:25.912195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:25.932368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:25.933569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:25.994538 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4220/8443] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:58:26.004444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:26.005786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.021021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10749b926c094d78b58eccd14d7e309b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.021656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10749b926c094d78b58eccd14d7e309b'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.043382 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4224/8444] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:58:25 2022] DELETE /identity/v3/users/10749b926c094d78b58eccd14d7e309b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:26.068633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a697bf0-0429-4c34-9f0e-614a202a14ff None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:26.113331 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:26.125404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:26.126390 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.128745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.128745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.129532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.196429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:26.197917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:26.213487 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4221/8445] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:58:26.384237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:26.385643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.400142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585cad-f62f-4bf2-8fe2-f17ecdaad721 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:26.406760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:26.408410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.408856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.409273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] PATH_INFO: `/v3/projects/df06581fbc3a46ff89c58ad880a8e11e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.411427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df06581fbc3a46ff89c58ad880a8e11e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:26.413510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:26.537013 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:26.538750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.548312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df06581fbc3a46ff89c58ad880a8e11e', 'request_id': 'req-46275c14-9a60-4d78-aec3-980df0b62c45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.553935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d725-26bc-4b93-afe1-93d05db07e82 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:26.555313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df06581fbc3a46ff89c58ad880a8e11e', 'request_id': 'req-46275c14-9a60-4d78-aec3-980df0b62c45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.615305 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:26.615876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.616154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.616430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] PATH_INFO: `/v3/projects/83b41c66c9864d7dbe35a389f72fcd4d` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.617559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b41c66c9864d7dbe35a389f72fcd4d)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:26.619480 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:26.643187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df06581fbc3a46ff89c58ad880a8e11e', 'request_id': 'req-46275c14-9a60-4d78-aec3-980df0b62c45'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.648469 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:26.655753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] The token cache is being invalidate because project df06581fbc3a46ff89c58ad880a8e11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:58:26.656035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.656681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-46275c14-9a60-4d78-aec3-980df0b62c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.658192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4225/8446] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:58:26 2022] DELETE /identity/v3/projects/df06581fbc3a46ff89c58ad880a8e11e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:58:26.730045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b41c66c9864d7dbe35a389f72fcd4d', 'request_id': 'req-79cd38f3-fb29-47f0-8725-e49a2998113d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.737418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b41c66c9864d7dbe35a389f72fcd4d', 'request_id': 'req-79cd38f3-fb29-47f0-8725-e49a2998113d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.803593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b41c66c9864d7dbe35a389f72fcd4d', 'request_id': 'req-79cd38f3-fb29-47f0-8725-e49a2998113d'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.818414 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] The token cache is being invalidate because project 83b41c66c9864d7dbe35a389f72fcd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:58:26.819044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.819733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-79cd38f3-fb29-47f0-8725-e49a2998113d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:26.821483 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4222/8447] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:58:26 2022] DELETE /identity/v3/projects/83b41c66c9864d7dbe35a389f72fcd4d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:58:26.827273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd2be9-a3ef-4971-a743-b302ac0dec22 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.828008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd2be9-a3ef-4971-a743-b302ac0dec22 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.828379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd2be9-a3ef-4971-a743-b302ac0dec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.855186 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c5fd2be9-a3ef-4971-a743-b302ac0dec22 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:26.856676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c5fd2be9-a3ef-4971-a743-b302ac0dec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.930034 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4226/8448] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:26.938250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfc19-6e55-4d84-a752-8df26d7a90e1 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.938539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfc19-6e55-4d84-a752-8df26d7a90e1 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.938962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bfc19-6e55-4d84-a752-8df26d7a90e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:26.965960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-cf8bfc19-6e55-4d84-a752-8df26d7a90e1 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:26.967540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cf8bfc19-6e55-4d84-a752-8df26d7a90e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:26.980750 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4223/8449] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:26.982011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd2be9-a3ef-4971-a743-b302ac0dec22 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:26.993051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd2be9-a3ef-4971-a743-b302ac0dec22 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:26.998359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:26.998925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:26.999176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:26.999447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.000103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 01:58:27.000405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.002039 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.016618 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4227/8450] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 01:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 01:58:27.021486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfc19-6e55-4d84-a752-8df26d7a90e1 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.031951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bfc19-6e55-4d84-a752-8df26d7a90e1 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.037001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.037642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.038003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.038303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.042188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.042188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.055015 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.162572 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4224/8451] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 01:58:27 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:27.167020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.179116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94005b8-1baf-4496-9243-40f882634973 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.244204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.249635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.249635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.249635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.249635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.249635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.381851 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4228/8452] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 01:58:27 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 01:58:27.385808 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.395934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0ebb8-c3c3-4574-8480-5b977c446c2f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.400290 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.400876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.401154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.401419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.402072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.403771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.414466 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4225/8453] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:58:27.419288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.430518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046a5c-8237-4985-b8ad-958f5909a97e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.439071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa9b0e-90f8-4cec-82ff-643fbceff091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.439071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9b0e-90f8-4cec-82ff-643fbceff091 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.439071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9b0e-90f8-4cec-82ff-643fbceff091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.439071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9b0e-90f8-4cec-82ff-643fbceff091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.439534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa9b0e-90f8-4cec-82ff-643fbceff091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.439534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa9b0e-90f8-4cec-82ff-643fbceff091 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.453100 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4229/8454] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 01:58:27.455164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.465088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9009c-2152-475b-94d4-8d12ed68fd82 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.470234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.470872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.471150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.471408 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] PATH_INFO: `/v3/projects/da21c9103bb54e2897dbd44a977dd486/users/5321da8a67e9445e812d12ce09fc37a8/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.489547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da21c9103bb54e2897dbd44a977dd486, user_id=5321da8a67e9445e812d12ce09fc37a8, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.492221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.575296 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4226/8455] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 01:58:27 2022] PUT /identity/v3/projects/da21c9103bb54e2897dbd44a977dd486/users/5321da8a67e9445e812d12ce09fc37a8/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:27.586423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb904-89fd-49fa-9f07-41c666958715 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.586704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb904-89fd-49fa-9f07-41c666958715 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.586978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb904-89fd-49fa-9f07-41c666958715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.618139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-33bcb904-89fd-49fa-9f07-41c666958715 None None] MFA Rules not processed for user `5321da8a67e9445e812d12ce09fc37a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:27.619356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-33bcb904-89fd-49fa-9f07-41c666958715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:27.667890 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:27.684679 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4230/8456] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:27.696040 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.697818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:27.758310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d357a8-72aa-47be-9c6e-cebc9293b379 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.761909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abb762-dba7-4c67-a318-6c9d73036c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.762536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb762-dba7-4c67-a318-6c9d73036c28 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.762818 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb762-dba7-4c67-a318-6c9d73036c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.763083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb762-dba7-4c67-a318-6c9d73036c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.771908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abb762-dba7-4c67-a318-6c9d73036c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.773360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abb762-dba7-4c67-a318-6c9d73036c28 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:27.782568 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4227/8457] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:27.808070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcb904-89fd-49fa-9f07-41c666958715 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:27.869706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcb904-89fd-49fa-9f07-41c666958715 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:27.874365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:27.874993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:27.875271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:27.875542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] PATH_INFO: `/v3/users/5321da8a67e9445e812d12ce09fc37a8` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:27.876660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5321da8a67e9445e812d12ce09fc37a8)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:27.878628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.079937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5321da8a67e9445e812d12ce09fc37a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:28.087470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5321da8a67e9445e812d12ce09fc37a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:28.092645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5321da8a67e9445e812d12ce09fc37a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:28.197281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5321da8a67e9445e812d12ce09fc37a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:28.197931 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4c5a884b-2861-4e3f-8e07-268449a706fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5321da8a67e9445e812d12ce09fc37a8'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:28.216172 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4231/8458] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 01:58:27 2022] DELETE /identity/v3/users/5321da8a67e9445e812d12ce09fc37a8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:28.221319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d741-8497-4b07-912f-995a7f952274 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.221319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d741-8497-4b07-912f-995a7f952274 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.221516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d741-8497-4b07-912f-995a7f952274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.241179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2717d741-8497-4b07-912f-995a7f952274 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:28.242429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2717d741-8497-4b07-912f-995a7f952274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:28.301324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4228/8459] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:28.310827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.311115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.311387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.334871 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:58:28.335995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:28.386906 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4232/8460] 10.222.0.42 () {58 vars in 1061 bytes} [Sun Oct 23 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:58:28.392996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717d741-8497-4b07-912f-995a7f952274 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:28.403327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717d741-8497-4b07-912f-995a7f952274 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.406942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b7437-7259-4965-a583-e245314adc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.407568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7437-7259-4965-a583-e245314adc1f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.407853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7437-7259-4965-a583-e245314adc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.408165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7437-7259-4965-a583-e245314adc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.417242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b7437-7259-4965-a583-e245314adc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.418679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b7437-7259-4965-a583-e245314adc1f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.428495 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4229/8461] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:58:28.884658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:58:28.886155 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:58:28.901507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dce90-557d-4476-8d8d-45a4075517cd None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:58:28.908659 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:58:28.909393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:58:28.909746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:58:28.911253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] PATH_INFO: `/v3/projects/da21c9103bb54e2897dbd44a977dd486` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:58:28.911997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da21c9103bb54e2897dbd44a977dd486)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:58:28.914500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:58:28.935399 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:29.006579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da21c9103bb54e2897dbd44a977dd486', 'request_id': 'req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:29.012159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da21c9103bb54e2897dbd44a977dd486', 'request_id': 'req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:29.066086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da21c9103bb54e2897dbd44a977dd486', 'request_id': 'req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:29.077927 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] The token cache is being invalidate because project da21c9103bb54e2897dbd44a977dd486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:58:29.078229 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:29.078864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-efc5b9ed-04d9-48b0-87f3-e7a3f1c38ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:58:29.080349 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4233/8462] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 01:58:28 2022] DELETE /identity/v3/projects/da21c9103bb54e2897dbd44a977dd486 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:58:38.423843 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:58:39.352371 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:13.228081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:13.228652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:13.228652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:13.257879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] MFA Rules not processed for user `d2f253afef5849d19f4e1d99b038697b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:13.259155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:13.330010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4230/8463] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 01:59:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:59:14.021461 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.022373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.022828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.073070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:59:14.074341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:14.157874 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4234/8464] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 01:59:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:59:14.170363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:14.171774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:14.189636 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24971-f346-405e-be0c-a02dfa008508 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:14.194517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:14.195110 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:14.195381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:14.195646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:14.203910 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:14.206187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:14.215532 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4231/8465] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:59:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:59:17.977326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:17.978985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:18.062195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24264b-a473-4a48-980e-ae4ad5be8376 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:18.067693 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:18.068309 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:18.068587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:18.068856 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:18.071253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:18.087218 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:18.088892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:18.103020 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4235/8466] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:59:24.211596 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=43 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:28.095400 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:59:59.163776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:59:59.165246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:59.182096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f31f67-a1c6-4647-beba-66c845532294 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:59:59.187322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:59:59.187961 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:59:59.188240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:59:59.188511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:59:59.190262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:59:59.206464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:59:59.208041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:59:59.220817 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4232/8467] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 01:59:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:00:09.214200 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:12.795468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:12.818555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b96457-796a-4cce-9158-49dd35904e6a service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:12.830680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f33c5-f61b-4c78-b240-81028b6551d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:12.831921 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f33c5-f61b-4c78-b240-81028b6551d8 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:12.832210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f33c5-f61b-4c78-b240-81028b6551d8 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:12.832489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f33c5-f61b-4c78-b240-81028b6551d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:12.835205 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-828f33c5-f61b-4c78-b240-81028b6551d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:12.879549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f33c5-f61b-4c78-b240-81028b6551d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:12.879549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f33c5-f61b-4c78-b240-81028b6551d8 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:12.891875 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4236/8468] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:00:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:00:13.143766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:13.160135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82d8c0-6e19-4cdf-a80c-509d74e84ae9 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:13.166894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27e718-6458-4145-bc9b-93c4ad59a85b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:13.167778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e718-6458-4145-bc9b-93c4ad59a85b service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:13.168142 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e718-6458-4145-bc9b-93c4ad59a85b service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:13.168427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e718-6458-4145-bc9b-93c4ad59a85b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:13.170362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b27e718-6458-4145-bc9b-93c4ad59a85b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:13.195824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e718-6458-4145-bc9b-93c4ad59a85b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:13.200008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e718-6458-4145-bc9b-93c4ad59a85b service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:13.220325 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4233/8469] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:00:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:00:17.306691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734772-8f9f-4750-a05c-c4a4db072487 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:17.307158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734772-8f9f-4750-a05c-c4a4db072487 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:17.307253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62734772-8f9f-4750-a05c-c4a4db072487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:17.325702 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-62734772-8f9f-4750-a05c-c4a4db072487 None None] MFA Rules not processed for user `d2f253afef5849d19f4e1d99b038697b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:17.326922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-62734772-8f9f-4750-a05c-c4a4db072487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:17.333889 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4237/8470] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:00:18.012817 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:18.013253 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:18.016297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:18.033232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:18.034489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:18.044588 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4234/8471] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:00:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:00:18.056935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734772-8f9f-4750-a05c-c4a4db072487 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:18.072524 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62734772-8f9f-4750-a05c-c4a4db072487 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:18.077728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:18.079978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:18.079978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:18.079978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:18.088548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:18.090126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:18.099640 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4238/8472] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:00:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:00:20.793308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:20.794800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:20.812730 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d276bd-fb49-4bf3-95b7-bc49fefabfe2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:20.818362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6379b-32bd-4554-99f8-631994d1a0d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:20.818981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6379b-32bd-4554-99f8-631994d1a0d0 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:20.819256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6379b-32bd-4554-99f8-631994d1a0d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:20.819525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6379b-32bd-4554-99f8-631994d1a0d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:20.821297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-91e6379b-32bd-4554-99f8-631994d1a0d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:20.922567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6379b-32bd-4554-99f8-631994d1a0d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:20.924157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6379b-32bd-4554-99f8-631994d1a0d0 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:20.945734 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4235/8473] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:00:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:00:28.095691 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=20 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:29.606209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:00:29.623123 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab463bd-7be6-4b0f-a53d-3930ed34627e service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:00:29.629720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:00:29.630733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:29.630830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:29.631024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:29.633010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:29.653394 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:00:29.655646 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:00:29.659793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:00:29.660298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:00:29.660399 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:00:29.670211 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4239/8474] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:00:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:00:29.690324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:00:29.691549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:00:29.698661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4236/8475] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:00:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:00:39.662156 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:00:39.687467 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=56 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:07.772316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:07.773747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:07.841742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac608f-e957-4d90-b3ba-26a433ee4c66 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:07.845302 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:07.845898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:07.846199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:07.846465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:07.848262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:07.860146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:07.861597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:07.872905 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4240/8476] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:01:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:01:11.335869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:11.337396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:11.349464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5b721-efa5-4ddf-8953-06bf0baee5b3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:11.353245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:11.353923 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:11.354308 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:11.354652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:11.356982 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:11.388826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:11.390568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:11.405500 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4237/8477] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:01:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:01:12.611732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:12.621002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba673da-0865-4e5e-842a-85810efef12f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:12.625450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5371a5-cd22-4460-b754-14ba5dc0eb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:12.626116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5371a5-cd22-4460-b754-14ba5dc0eb62 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:12.626404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5371a5-cd22-4460-b754-14ba5dc0eb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:12.626713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5371a5-cd22-4460-b754-14ba5dc0eb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:12.628576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e5371a5-cd22-4460-b754-14ba5dc0eb62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:12.646495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5371a5-cd22-4460-b754-14ba5dc0eb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:12.648260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5371a5-cd22-4460-b754-14ba5dc0eb62 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:12.662424 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4241/8478] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:01:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:01:19.696274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:19.699395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:19.796968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be38e5-0eab-403a-832a-11a1a760011e service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:19.801507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:19.802184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:19.802463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:19.802735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] PATH_INFO: `/v3/users/d2f253afef5849d19f4e1d99b038697b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:19.803845 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f253afef5849d19f4e1d99b038697b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:19.805727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:19.925230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f253afef5849d19f4e1d99b038697b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:19.932169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f253afef5849d19f4e1d99b038697b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:19.932882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f253afef5849d19f4e1d99b038697b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.002317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f253afef5849d19f4e1d99b038697b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.002922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f253afef5849d19f4e1d99b038697b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.021244 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4238/8479] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:01:19 2022] DELETE /identity/v3/users/d2f253afef5849d19f4e1d99b038697b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:01:20.026062 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:20.026568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:20.026676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:20.054368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:01:20.055553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:20.114556 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4242/8480] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:01:20.124765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:20.126288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:20.166673 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:20.183273 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1e28-109c-4e6c-9b50-fd5bdcd0d589 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:20.188346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:20.189007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:20.189286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:20.189551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:20.198611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:20.200009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:20.210805 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4239/8481] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:01:20.490368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:20.491843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:20.505984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a0248-322e-497d-8129-df82cc0bd1d6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:20.518301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:20.518301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:20.518301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:20.518301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] PATH_INFO: `/v3/projects/e76b081c02814da98ab62bfc2fe5536b` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:20.519788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76b081c02814da98ab62bfc2fe5536b)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:20.519788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:20.655175 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76b081c02814da98ab62bfc2fe5536b', 'request_id': 'req-4d78175d-cc2d-482e-93f9-bd7783f27694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.660625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76b081c02814da98ab62bfc2fe5536b', 'request_id': 'req-4d78175d-cc2d-482e-93f9-bd7783f27694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.757679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76b081c02814da98ab62bfc2fe5536b', 'request_id': 'req-4d78175d-cc2d-482e-93f9-bd7783f27694'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.759850 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:20.769273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] The token cache is being invalidate because project e76b081c02814da98ab62bfc2fe5536b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:01:20.769504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.770136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:20.771633 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4243/8482] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:01:20 2022] DELETE /identity/v3/projects/e76b081c02814da98ab62bfc2fe5536b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:01:20.775893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:20.786210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d0b08-e2cd-4a1a-b009-1b08238d9a8f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:20.841697 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:20.842856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:20.843130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:20.843397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] PATH_INFO: `/v3/users/af133a2f86f54dfe92d70c06628e8a70` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:20.844494 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af133a2f86f54dfe92d70c06628e8a70)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:20.846409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:21.017282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af133a2f86f54dfe92d70c06628e8a70'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:21.024699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af133a2f86f54dfe92d70c06628e8a70'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:21.026177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af133a2f86f54dfe92d70c06628e8a70'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:21.129248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af133a2f86f54dfe92d70c06628e8a70'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:21.129883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-4cb6d15f-1ca8-44d2-b104-5e4c1e800465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af133a2f86f54dfe92d70c06628e8a70'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:21.148628 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4240/8483] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:01:20 2022] DELETE /identity/v3/users/af133a2f86f54dfe92d70c06628e8a70 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:01:21.787618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:01:21.792410 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:01:21.805664 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78175d-cc2d-482e-93f9-bd7783f27694 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:01:21.865687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:01:21.866411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:01:21.866729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:01:21.867005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] PATH_INFO: `/v3/projects/02231c13740447c1815861f1b190350d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:01:21.868159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02231c13740447c1815861f1b190350d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:01:21.870104 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:01:21.985818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02231c13740447c1815861f1b190350d', 'request_id': 'req-fecc61f9-336d-4efc-85a8-442316f47552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:21.991855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02231c13740447c1815861f1b190350d', 'request_id': 'req-fecc61f9-336d-4efc-85a8-442316f47552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:22.100304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02231c13740447c1815861f1b190350d', 'request_id': 'req-fecc61f9-336d-4efc-85a8-442316f47552'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:22.111722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] The token cache is being invalidate because project 02231c13740447c1815861f1b190350d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:01:22.112005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:22.112638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:01:22.114152 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4244/8484] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:01:21 2022] DELETE /identity/v3/projects/02231c13740447c1815861f1b190350d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:01:31.144602 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:01:32.108764 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:18.181619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:18.182183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:18.182183 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:18.200869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] MFA Rules not processed for user `f2967d0d8c134d269c9bbe51c90f803a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:03:18.202092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:18.255490 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4241/8485] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:03:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:03:18.589500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:18.589500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:18.643640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc61f9-336d-4efc-85a8-442316f47552 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:18.647260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:18.647859 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:18.648135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:18.648409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:18.650143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:18.662017 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:18.663440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:18.673828 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4245/8486] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:22.671375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:22.673051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:22.686437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a98d5-3a3e-42cb-8d57-93e95f0a120a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:22.690731 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:22.691354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:22.691633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:22.691954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:22.693806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:22.708293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:22.710036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:22.721811 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4242/8487] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:03:28.667792 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=26 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:32.714978 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=31 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:40.972242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:40.980757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6ca44-8aad-4625-a9da-a70ea0d02d85 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:40.984353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:40.984944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:40.985221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:40.985491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:40.987258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:41.073356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:41.074824 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:41.093454 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4246/8488] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:03:43.070783 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:03:43.072248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:43.157212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe1a99-3c17-487b-b3f6-2c5c524d98e5 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:03:43.162932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:03:43.163536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:03:43.163810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:03:43.164077 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:03:43.165789 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:03:43.180746 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:03:43.182490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:03:43.196496 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4243/8489] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:03:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:03:51.090951 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=43 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:03:53.188801 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=38 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:17.064213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:17.065638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:17.146210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a15cec-d6a8-4965-b745-cb1bb14c9df2 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:17.151431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:17.151586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:17.152042 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:17.152319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:17.152589 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:17.153331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:17.154371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:17.169005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:17.170546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf4b2-315f-44d7-9c4b-50ce29700cdf service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:17.170687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:17.175459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:17.176052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:17.176329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:17.176596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:17.178286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:17.183075 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4247/8490] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:17.192281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:17.193815 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:17.206894 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4244/8491] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:05:27.176299 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=36 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:27.199389 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:47.181282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:47.199673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcc606-4ba8-4efb-9f2b-8150e20092da service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:47.203270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:47.204351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:47.204629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:47.204902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:47.206616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:47.217521 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:47.219577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:47.228445 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4248/8492] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:48.131396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:05:48.147346 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f061b1-5965-45bd-ac16-36f9467acc7e service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:05:48.153531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:05:48.154322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:05:48.154602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:05:48.154911 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:05:48.157148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:05:48.173536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:05:48.175072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:05:48.189426 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4245/8493] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:05:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:57.224295 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:58.183617 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:09.820766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:09.829264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884fbd-5f54-4f4c-97d1-9df969f5fe10 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:09.833606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:09.833606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:09.833861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:09.834072 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:09.835759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:09.849617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:09.851060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:09.862564 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4249/8494] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:14.425583 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:14.435157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40c5e5-c8d3-495e-8a70-af16f64270cf service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:14.439094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:14.439773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:14.440049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:14.440319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:14.442475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:14.517239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:14.518768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:14.538621 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4246/8495] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:18.405765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:18.420541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec93c6-3518-4472-a446-e0b67ed10d9f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:18.425749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:18.426400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:18.426669 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:18.427020 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:18.434071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:18.443573 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:18.445139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:18.458226 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4250/8496] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:21.992909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:22.007387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c24702-0922-476d-9fc5-3e3ec333c21f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:22.012655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:22.013260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:22.015032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:22.015032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:22.015619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:22.030904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:22.032547 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:22.045392 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4247/8497] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:22.126898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:22.128568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:22.143785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698da2-bea0-47af-971c-fc5ba50f4129 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:22.148587 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:22.149208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:22.149487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:22.149785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] PATH_INFO: `/v3/users/f2967d0d8c134d269c9bbe51c90f803a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:22.150948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2967d0d8c134d269c9bbe51c90f803a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:22.152844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:22.355458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2967d0d8c134d269c9bbe51c90f803a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.362331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2967d0d8c134d269c9bbe51c90f803a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.363264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2967d0d8c134d269c9bbe51c90f803a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.435324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2967d0d8c134d269c9bbe51c90f803a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.435890 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2967d0d8c134d269c9bbe51c90f803a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.453924 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4251/8498] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:06:22 2022] DELETE /identity/v3/users/f2967d0d8c134d269c9bbe51c90f803a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:22.703522 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:22.715471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bf779-af6c-4f2f-a4ff-f295a19e9d32 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:22.772107 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:22.772771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:22.773050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:22.773321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] PATH_INFO: `/v3/projects/b1ec0b5ecaa741eaaf40a50f1415e7f9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:22.774481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ec0b5ecaa741eaaf40a50f1415e7f9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:22.776360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:22.898860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'request_id': 'req-eeee01b3-562e-4c71-9709-3b82e473233b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.904318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'request_id': 'req-eeee01b3-562e-4c71-9709-3b82e473233b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.961437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ec0b5ecaa741eaaf40a50f1415e7f9', 'request_id': 'req-eeee01b3-562e-4c71-9709-3b82e473233b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.972907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] The token cache is being invalidate because project b1ec0b5ecaa741eaaf40a50f1415e7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:06:22.973193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.973819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:22.977119 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4248/8499] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:06:22 2022] DELETE /identity/v3/projects/b1ec0b5ecaa741eaaf40a50f1415e7f9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:22.981349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:22.982800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:22.996458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b55dc-7684-4c3c-8c6a-8ac70777e19b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:23.052681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:23.053303 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:23.053583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:23.053855 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] PATH_INFO: `/v3/users/13997879ffb0487bbdce6d258b125b46` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:23.055011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13997879ffb0487bbdce6d258b125b46)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:23.056937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:23.220242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13997879ffb0487bbdce6d258b125b46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.221338 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:23.227564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13997879ffb0487bbdce6d258b125b46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.228275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13997879ffb0487bbdce6d258b125b46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.304156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13997879ffb0487bbdce6d258b125b46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.305008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8f277180-467f-4025-8bf2-573cf25c7b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13997879ffb0487bbdce6d258b125b46'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.322677 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4252/8500] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:06:22 2022] DELETE /identity/v3/users/13997879ffb0487bbdce6d258b125b46 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:23.592242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:23.594031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:23.602785 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:23.615836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee01b3-562e-4c71-9709-3b82e473233b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:23.672280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:23.672913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:23.673304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:23.674218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] PATH_INFO: `/v3/projects/a454e848a4e34c61901ab5aaaacdb2d9` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:23.675428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a454e848a4e34c61901ab5aaaacdb2d9)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:23.677331 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:23.796151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a454e848a4e34c61901ab5aaaacdb2d9', 'request_id': 'req-a2748f20-2a65-4105-a057-541b21608b55'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.801545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a454e848a4e34c61901ab5aaaacdb2d9', 'request_id': 'req-a2748f20-2a65-4105-a057-541b21608b55'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.864092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a454e848a4e34c61901ab5aaaacdb2d9', 'request_id': 'req-a2748f20-2a65-4105-a057-541b21608b55'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.875530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] The token cache is being invalidate because project a454e848a4e34c61901ab5aaaacdb2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:06:23.875816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.876440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-a2748f20-2a65-4105-a057-541b21608b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:23.878005 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4249/8501] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:06:23 2022] DELETE /identity/v3/projects/a454e848a4e34c61901ab5aaaacdb2d9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:33.327452 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69e97-5f98-4eec-b8b2-316c5c1f1980 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.328026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69e97-5f98-4eec-b8b2-316c5c1f1980 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.328026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69e97-5f98-4eec-b8b2-316c5c1f1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.366807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c1e69e97-5f98-4eec-b8b2-316c5c1f1980 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:33.368003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c1e69e97-5f98-4eec-b8b2-316c5c1f1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:33.426099 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4253/8502] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:33.436659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb08d-915d-4cae-8d38-3f5c5bf5d1fa None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.437143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb08d-915d-4cae-8d38-3f5c5bf5d1fa None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.437239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fb08d-915d-4cae-8d38-3f5c5bf5d1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.457451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2d4fb08d-915d-4cae-8d38-3f5c5bf5d1fa None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:33.458112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d4fb08d-915d-4cae-8d38-3f5c5bf5d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:33.466242 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4250/8503] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:33.483451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69e97-5f98-4eec-b8b2-316c5c1f1980 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:33.493227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69e97-5f98-4eec-b8b2-316c5c1f1980 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:33.497828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:33.498451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.498730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.499002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.499651 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:06:33.499953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:33.501574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:33.512951 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4254/8504] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:06:33.533182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb08d-915d-4cae-8d38-3f5c5bf5d1fa None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:33.542528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fb08d-915d-4cae-8d38-3f5c5bf5d1fa None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:33.547112 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:33.547710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.548011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.548255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.548873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:33.550785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:33.640143 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4251/8505] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:06:33 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:06:33.644367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:33.654467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8423af-fe4a-4f22-99f5-678d9e0d3353 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:33.710878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:33.711732 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.712010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.712375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.713009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:33.714987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:33.787051 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4255/8506] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:06:33 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:06:33.790971 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:33.804551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f41c0-eff3-4b32-9707-c29d6531c09b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:33.809153 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:33.809802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.810170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.810440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.811072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:33.812641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:33.822613 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4252/8507] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:06:33.826724 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:33.837437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eec12d-9e5b-45e4-ba05-6f0065708a8b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:33.842191 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae5d1-1bff-46b9-a220-d9fd77af29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:33.842734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae5d1-1bff-46b9-a220-d9fd77af29dd admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.843032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae5d1-1bff-46b9-a220-d9fd77af29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.843298 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae5d1-1bff-46b9-a220-d9fd77af29dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.843976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae5d1-1bff-46b9-a220-d9fd77af29dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:33.846224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae5d1-1bff-46b9-a220-d9fd77af29dd admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:33.856995 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4256/8508] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:06:33.861233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:33.871672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4c53-e3e9-4125-8bd9-0b4cdf79b058 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:33.876720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:33.877355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:33.877631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:33.877901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] PATH_INFO: `/v3/projects/7660d3c1008542f3ab77272a14ce22e3/users/de23711530a443e094f868c93cf9d26d/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:33.892990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7660d3c1008542f3ab77272a14ce22e3, user_id=de23711530a443e094f868c93cf9d26d, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:33.895631 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:33.989387 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4253/8509] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:06:33 2022] PUT /identity/v3/projects/7660d3c1008542f3ab77272a14ce22e3/users/de23711530a443e094f868c93cf9d26d/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:34.000718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9ee7-7748-4edf-a25e-b05df36d56c1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.001003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9ee7-7748-4edf-a25e-b05df36d56c1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.001768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9ee7-7748-4edf-a25e-b05df36d56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.029745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a2db9ee7-7748-4edf-a25e-b05df36d56c1 None None] MFA Rules not processed for user `de23711530a443e094f868c93cf9d26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:34.030973 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a2db9ee7-7748-4edf-a25e-b05df36d56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:34.034908 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:34.095658 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4257/8510] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:34.100222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:34.120869 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:34.161276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b36bc-df99-46f1-a607-1c65f79b70b3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:34.165880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:34.166508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.166784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.167055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.167670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:34.169559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:34.259955 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4254/8511] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:06:34 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:06:34.264037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9ee7-7748-4edf-a25e-b05df36d56c1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:34.274763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9ee7-7748-4edf-a25e-b05df36d56c1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:34.329840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:34.330489 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.330731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.331003 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.331631 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:34.333530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:34.441801 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4258/8512] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:06:34 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:06:34.445471 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:34.455711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341185e-e840-4438-b424-1be23b56df64 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:34.460283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:34.460876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.461150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.461668 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.462339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:34.463901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:34.474593 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4255/8513] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:06:34.478808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:34.489314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9e04-7fe5-4adb-a552-b265f1924cec admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:34.494390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:34.495047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.495323 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.495594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] PATH_INFO: `/v3/projects/440ef83894cd405db4cecf8f4f9af712/users/eb8f7dc9addc4a87a8ab86f4f5b06f8a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.510860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=440ef83894cd405db4cecf8f4f9af712, user_id=eb8f7dc9addc4a87a8ab86f4f5b06f8a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:34.513503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:34.572430 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4259/8514] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:06:34 2022] PUT /identity/v3/projects/440ef83894cd405db4cecf8f4f9af712/users/eb8f7dc9addc4a87a8ab86f4f5b06f8a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:06:34.576412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:34.586507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e247e9-e359-4079-8e55-7a66817026c8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:34.642546 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7652-67f9-4ed1-bc80-f7b51508c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:34.643143 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7652-67f9-4ed1-bc80-f7b51508c6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.643418 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7652-67f9-4ed1-bc80-f7b51508c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.643681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7652-67f9-4ed1-bc80-f7b51508c6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.644350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7652-67f9-4ed1-bc80-f7b51508c6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:34.645947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7652-67f9-4ed1-bc80-f7b51508c6ed admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:34.655593 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4256/8515] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:06:34.660406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:34.670409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55777c05-0453-4f51-ae53-6d7569d855ab admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:34.674974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927d27-bfb7-4ca2-a13a-ff14e793c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:34.675610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927d27-bfb7-4ca2-a13a-ff14e793c2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.675885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927d27-bfb7-4ca2-a13a-ff14e793c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.676157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927d27-bfb7-4ca2-a13a-ff14e793c2a4 admin admin] PATH_INFO: `/v3/projects/440ef83894cd405db4cecf8f4f9af712/users/eb8f7dc9addc4a87a8ab86f4f5b06f8a/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.678094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2927d27-bfb7-4ca2-a13a-ff14e793c2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440ef83894cd405db4cecf8f4f9af712, user_id=eb8f7dc9addc4a87a8ab86f4f5b06f8a, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:34.680742 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2927d27-bfb7-4ca2-a13a-ff14e793c2a4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:34.691380 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4260/8516] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:06:34 2022] PUT /identity/v3/projects/440ef83894cd405db4cecf8f4f9af712/users/eb8f7dc9addc4a87a8ab86f4f5b06f8a/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:34.701703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.701958 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.702258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.732375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] MFA Rules not processed for user `eb8f7dc9addc4a87a8ab86f4f5b06f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:34.734475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:34.803699 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4257/8517] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:34.817401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978e70f-b494-4949-a43d-88eea3a23784 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.817679 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978e70f-b494-4949-a43d-88eea3a23784 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.817948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978e70f-b494-4949-a43d-88eea3a23784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:34.837878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0978e70f-b494-4949-a43d-88eea3a23784 None None] MFA Rules not processed for user `de23711530a443e094f868c93cf9d26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:34.839093 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0978e70f-b494-4949-a43d-88eea3a23784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:34.896819 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4261/8518] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:34.913462 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:34.914988 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:34.933025 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:34.990406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f888d0-049a-48a7-8ab7-f314d10cc2bd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:34.996032 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:34.996637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:34.996916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:34.997188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:35.006109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:35.007713 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:35.016615 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4258/8519] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:35.046556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868827-3b3e-4c05-ae35-77e47a3c7df5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:35.046841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868827-3b3e-4c05-ae35-77e47a3c7df5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:35.047138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868827-3b3e-4c05-ae35-77e47a3c7df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:35.052967 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:35.108687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-38868827-3b3e-4c05-ae35-77e47a3c7df5 None None] MFA Rules not processed for user `42c76c07d0cf43d2b230e4afa9709bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:35.109883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-38868827-3b3e-4c05-ae35-77e47a3c7df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:35.170468 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4262/8520] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Oct 23 02:06:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:35.176704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:35.185672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0928-0796-4d4d-8a6b-5c009e3803c4 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:35.189341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:35.189935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:35.190249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:35.190518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:35.192196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:35.208475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:35.209878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:35.224099 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4259/8521] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:36.987457 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3242e4-c216-415d-a614-c60b60965c43 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:36.987888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3242e4-c216-415d-a614-c60b60965c43 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:36.988036 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3242e4-c216-415d-a614-c60b60965c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:36.998679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:37.000177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:37.009156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-db3242e4-c216-415d-a614-c60b60965c43 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:37.013885 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-db3242e4-c216-415d-a614-c60b60965c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:37.060191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088ecce-b54e-4cf4-817b-e8316e61c36a service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:37.065341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030085ea-ed2f-46a6-8b6b-bb7a60611fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:37.066037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030085ea-ed2f-46a6-8b6b-bb7a60611fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:37.066321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030085ea-ed2f-46a6-8b6b-bb7a60611fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:37.066591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030085ea-ed2f-46a6-8b6b-bb7a60611fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:37.068280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-030085ea-ed2f-46a6-8b6b-bb7a60611fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:37.074366 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4263/8522] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 02:06:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:37.080473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3242e4-c216-415d-a614-c60b60965c43 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:37.085283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030085ea-ed2f-46a6-8b6b-bb7a60611fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:37.087606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030085ea-ed2f-46a6-8b6b-bb7a60611fc1 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:37.091208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3242e4-c216-415d-a614-c60b60965c43 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:37.097917 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:37.098703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:37.098984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:37.099255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:37.100990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:37.102189 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4260/8523] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:06:37.113268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:37.114898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:37.124909 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4264/8524] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:06:38.485430 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aacb0-c1c7-44f2-aa97-9ad9274acf5e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:38.486008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aacb0-c1c7-44f2-aa97-9ad9274acf5e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:38.486008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aacb0-c1c7-44f2-aa97-9ad9274acf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:38.506381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fb7aacb0-c1c7-44f2-aa97-9ad9274acf5e None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:38.507560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fb7aacb0-c1c7-44f2-aa97-9ad9274acf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:38.515829 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4261/8525] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 23 02:06:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:06:38.533607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:38.534974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:38.549904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454c1d1-5efd-4058-8284-e43e9e0e4afb service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:38.554987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:38.555574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:38.555850 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:38.556116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:38.564548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:38.566114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:38.575565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4265/8526] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:47.020227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7aacb0-c1c7-44f2-aa97-9ad9274acf5e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:47.035038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7aacb0-c1c7-44f2-aa97-9ad9274acf5e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:47.040611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2b6d-9b6a-424d-a94c-da3827c3584b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:47.041214 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2b6d-9b6a-424d-a94c-da3827c3584b service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:47.041489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2b6d-9b6a-424d-a94c-da3827c3584b service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:47.041755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2b6d-9b6a-424d-a94c-da3827c3584b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:47.043590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-20bc2b6d-9b6a-424d-a94c-da3827c3584b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:47.058897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2b6d-9b6a-424d-a94c-da3827c3584b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:47.060463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2b6d-9b6a-424d-a94c-da3827c3584b service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:47.074324 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4262/8527] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:48.571500 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=82 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:49.886626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:49.902128 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e6063-97e4-4939-8761-33fa914a7df8 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:49.907519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:49.908106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:49.908383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:49.908650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:49.916496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:49.918067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:49.927261 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4266/8528] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:49.942489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda1fb-ccb0-450c-8d98-63ae2db96063 None None] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:49.942953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda1fb-ccb0-450c-8d98-63ae2db96063 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:49.943059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda1fb-ccb0-450c-8d98-63ae2db96063 None None] PATH_INFO: `/` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:49.944356 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4263/8529] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 02:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:49.948676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] Authenticating service token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 02:06:49.962723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:49.970763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f87d04-ee6e-48c7-b216-abc0026dac41 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:49.975280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28cb51-bea9-4e16-bd5a-94722a359753 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '440ef83894cd405db4cecf8f4f9af712', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:49.975883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28cb51-bea9-4e16-bd5a-94722a359753 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:49.976158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28cb51-bea9-4e16-bd5a-94722a359753 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:49.976429 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28cb51-bea9-4e16-bd5a-94722a359753 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] PATH_INFO: `/v3/projects/440ef83894cd405db4cecf8f4f9af712` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:49.977540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28cb51-bea9-4e16-bd5a-94722a359753 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] RBAC: Authorizing `identity:get_project(project_id=440ef83894cd405db4cecf8f4f9af712)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:49.979294 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28cb51-bea9-4e16-bd5a-94722a359753 tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:49.980871 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4267/8530] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 02:06:49 2022] GET /identity/v3/projects/440ef83894cd405db4cecf8f4f9af712 => generated 387 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:06:50.220238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda1fb-ccb0-450c-8d98-63ae2db96063 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:50.231126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda1fb-ccb0-450c-8d98-63ae2db96063 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:50.234667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:50.235770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:50.236041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:50.236309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:50.238038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:50.249853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:50.251909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:50.262241 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4264/8531] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:06:50.491514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea57f-3e95-43cf-83ea-f78498bd0bcf None None] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:50.491803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea57f-3e95-43cf-83ea-f78498bd0bcf None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:50.492082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea57f-3e95-43cf-83ea-f78498bd0bcf None None] PATH_INFO: `/` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:50.493417 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4268/8532] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 23 02:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 02:06:50.498516 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] Authenticating service token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 23 02:06:50.499650 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:50.517870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:50.527296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53970-f44e-4274-88d6-d60b369b3869 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:50.532393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6365a-e7cd-4434-bb9b-bd94378a858e tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '440ef83894cd405db4cecf8f4f9af712', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:50.533017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6365a-e7cd-4434-bb9b-bd94378a858e tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:50.533299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6365a-e7cd-4434-bb9b-bd94378a858e tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:50.533604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6365a-e7cd-4434-bb9b-bd94378a858e tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] PATH_INFO: `/v3/projects/440ef83894cd405db4cecf8f4f9af712` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:50.534772 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6365a-e7cd-4434-bb9b-bd94378a858e tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] RBAC: Authorizing `identity:get_project(project_id=440ef83894cd405db4cecf8f4f9af712)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:50.536525 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6365a-e7cd-4434-bb9b-bd94378a858e tempest-ServersAdminNegativeTestJSON-1628204 tempest-ServersAdminNegativeTestJSON-1628204-project-admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:50.538228 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4265/8533] 10.222.0.42 () {58 vars in 1443 bytes} [Sun Oct 23 02:06:50 2022] GET /identity/v3/projects/440ef83894cd405db4cecf8f4f9af712 => generated 387 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:06:54.764778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ea57f-3e95-43cf-83ea-f78498bd0bcf None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:54.827399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ea57f-3e95-43cf-83ea-f78498bd0bcf None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:54.832447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:54.833069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:54.833344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:54.833614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] PATH_INFO: `/v3/users/de23711530a443e094f868c93cf9d26d` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:54.834750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de23711530a443e094f868c93cf9d26d)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:54.836947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:54.988328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de23711530a443e094f868c93cf9d26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:54.995267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de23711530a443e094f868c93cf9d26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:54.995879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de23711530a443e094f868c93cf9d26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.055510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de23711530a443e094f868c93cf9d26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.056136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de23711530a443e094f868c93cf9d26d'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.073381 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4269/8534] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:06:54 2022] DELETE /identity/v3/users/de23711530a443e094f868c93cf9d26d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:06:55.077898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:55.078424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:55.078540 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:55.097549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:55.098779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:55.142022 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:55.157516 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4266/8535] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:55.167437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:55.168907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:55.227466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378138f-8cfa-4083-ae8d-954c930b5b34 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:55.231180 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:55.231777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:55.232056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:55.232339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:55.241137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:55.242592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:55.247492 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:55.252045 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4270/8536] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:06:55.476752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:55.478315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:55.491325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd807d91-3dd5-45c4-8a86-a5ec8b4ba9ff None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:55.496250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:55.496981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:55.497326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:55.497659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] PATH_INFO: `/v3/projects/7660d3c1008542f3ab77272a14ce22e3` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:55.498868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7660d3c1008542f3ab77272a14ce22e3)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:55.501395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:55.590543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7660d3c1008542f3ab77272a14ce22e3', 'request_id': 'req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.596582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7660d3c1008542f3ab77272a14ce22e3', 'request_id': 'req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.686753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7660d3c1008542f3ab77272a14ce22e3', 'request_id': 'req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.698763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] The token cache is being invalidate because project 7660d3c1008542f3ab77272a14ce22e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:06:55.699049 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.699672 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.701155 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4267/8537] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:06:55 2022] DELETE /identity/v3/projects/7660d3c1008542f3ab77272a14ce22e3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:55.705157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:55.715099 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465b2b8-70f2-489f-a67a-c0dbd619c379 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:55.770255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:55.770906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:55.771065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:55.771331 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] PATH_INFO: `/v3/users/eb8f7dc9addc4a87a8ab86f4f5b06f8a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:55.772434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8f7dc9addc4a87a8ab86f4f5b06f8a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:55.774350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:55.928831 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.935716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.936375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.989335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:55.989956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-d0cdb790-c228-46d5-a8bf-05f5d9005f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8f7dc9addc4a87a8ab86f4f5b06f8a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:56.007052 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4271/8538] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:06:55 2022] DELETE /identity/v3/users/eb8f7dc9addc4a87a8ab86f4f5b06f8a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:56.406117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:56.407651 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:56.421683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daa7c5-8edb-4163-8d26-63bda0e0e6d2 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:56.482170 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:56.482866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:56.483145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:56.483422 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] PATH_INFO: `/v3/projects/440ef83894cd405db4cecf8f4f9af712` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:56.484569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440ef83894cd405db4cecf8f4f9af712)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:56.486539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:56.593893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440ef83894cd405db4cecf8f4f9af712', 'request_id': 'req-248bc61f-5fe9-4a9a-a246-349cb6320b76'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:56.599397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440ef83894cd405db4cecf8f4f9af712', 'request_id': 'req-248bc61f-5fe9-4a9a-a246-349cb6320b76'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:56.666862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440ef83894cd405db4cecf8f4f9af712', 'request_id': 'req-248bc61f-5fe9-4a9a-a246-349cb6320b76'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:56.678443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] The token cache is being invalidate because project 440ef83894cd405db4cecf8f4f9af712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:06:56.678736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:56.679392 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-248bc61f-5fe9-4a9a-a246-349cb6320b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:06:56.680929 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4268/8539] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:06:56 2022] DELETE /identity/v3/projects/440ef83894cd405db4cecf8f4f9af712 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:56.687011 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b657cf-7fa9-4e60-8d0a-c8687c3291d8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:56.687297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b657cf-7fa9-4e60-8d0a-c8687c3291d8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:56.687574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b657cf-7fa9-4e60-8d0a-c8687c3291d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:56.708335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-d3b657cf-7fa9-4e60-8d0a-c8687c3291d8 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:56.709525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d3b657cf-7fa9-4e60-8d0a-c8687c3291d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:56.767699 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4272/8540] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:56.776071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931971ef-5020-40b5-bc9f-e098e0fb1fb2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:56.776361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931971ef-5020-40b5-bc9f-e098e0fb1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:56.776639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931971ef-5020-40b5-bc9f-e098e0fb1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:56.784277 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:56.796863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-931971ef-5020-40b5-bc9f-e098e0fb1fb2 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:56.798625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-931971ef-5020-40b5-bc9f-e098e0fb1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:56.806631 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4269/8541] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:56.811001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b657cf-7fa9-4e60-8d0a-c8687c3291d8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:56.821321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b657cf-7fa9-4e60-8d0a-c8687c3291d8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:56.825842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:56.826487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:56.826763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:56.827031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:56.827692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:06:56.827992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:56.829571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:56.841150 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4273/8542] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:06:56.845405 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931971ef-5020-40b5-bc9f-e098e0fb1fb2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:56.854897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931971ef-5020-40b5-bc9f-e098e0fb1fb2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:56.860147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:56.860775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:56.861053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:56.861323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:56.861959 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:56.863863 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:56.954252 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4270/8543] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:06:56 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:06:56.958265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:56.968614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695f3a-2d24-4c6f-ab17-50ba7ab5872c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:56.972188 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:57.024826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:57.025424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:57.025698 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:57.025965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:57.026611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:57.028542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:57.089907 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4274/8544] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:06:56 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:06:57.094750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:57.105416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e743ee-1a97-43d3-90a1-4ce911446ccb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:57.110703 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:57.111310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:57.111589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:57.111860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:57.112527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:57.114177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:57.124213 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4271/8545] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:06:57.128136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:57.137998 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2ba10-8ba3-4c5e-8d2a-222986204924 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:57.142643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9290c9e-3535-4f8e-a9d7-2333e0be9083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:57.143234 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9290c9e-3535-4f8e-a9d7-2333e0be9083 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:57.143509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9290c9e-3535-4f8e-a9d7-2333e0be9083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:57.143778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9290c9e-3535-4f8e-a9d7-2333e0be9083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:57.144414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9290c9e-3535-4f8e-a9d7-2333e0be9083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:57.146005 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9290c9e-3535-4f8e-a9d7-2333e0be9083 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:57.158054 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4275/8546] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:06:57.162029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:57.171913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb06983-4d97-4530-a369-7b2b33cbdb90 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:57.177103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:57.177761 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:57.178078 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:57.178359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] PATH_INFO: `/v3/projects/7eb4fc36e36248ada12e6841dcda0b71/users/0b855154444b4859a13b3ca5f91298e7/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:57.192515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb4fc36e36248ada12e6841dcda0b71, user_id=0b855154444b4859a13b3ca5f91298e7, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:57.195299 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:57.281122 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4272/8547] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:06:57 2022] PUT /identity/v3/projects/7eb4fc36e36248ada12e6841dcda0b71/users/0b855154444b4859a13b3ca5f91298e7/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:06:57.286743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc12cf-b85d-48aa-a5e6-7424574ad481 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:57.287032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc12cf-b85d-48aa-a5e6-7424574ad481 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:57.287307 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc12cf-b85d-48aa-a5e6-7424574ad481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:57.306204 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-20cc12cf-b85d-48aa-a5e6-7424574ad481 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:06:57.307400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-20cc12cf-b85d-48aa-a5e6-7424574ad481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:57.365469 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4276/8548] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:06:57.374895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:06:57.377045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:06:57.432328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e97b43-f1ca-4232-b61a-ced241932777 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:06:57.436020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb26f1-57f6-4a17-abee-6cfb3021e18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:06:57.436620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb26f1-57f6-4a17-abee-6cfb3021e18d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:06:57.436901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb26f1-57f6-4a17-abee-6cfb3021e18d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:06:57.437178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb26f1-57f6-4a17-abee-6cfb3021e18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:06:57.446156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb26f1-57f6-4a17-abee-6cfb3021e18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:06:57.447561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb26f1-57f6-4a17-abee-6cfb3021e18d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:06:57.457344 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4273/8549] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:07:02.664893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:02.665415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:02.665532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:02.722912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] MFA Rules not processed for user `0b855154444b4859a13b3ca5f91298e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:02.724158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:02.800765 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4277/8550] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:07:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:02.812406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:02.813007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:02.813007 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:02.833572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] MFA Rules not processed for user `0b855154444b4859a13b3ca5f91298e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:02.834941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:02.842810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4274/8551] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:07:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:02.857192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:02.858692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:02.879151 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:02.939495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61177d4c-b7f6-4a1f-b1b9-963ea80d46f8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:02.945746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:02.946409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:02.952487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:02.952487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:02.955920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:02.957523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:02.967571 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4278/8552] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:07:03.629378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:03.630976 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:03.713590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479a34-e0af-4ab8-8d45-85cbb017fb8d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:03.719326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b0119-d969-4217-9c23-200144b1701c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:03.719991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b0119-d969-4217-9c23-200144b1701c service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:03.720277 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b0119-d969-4217-9c23-200144b1701c service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:03.720661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b0119-d969-4217-9c23-200144b1701c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:03.722417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0c3b0119-d969-4217-9c23-200144b1701c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:03.735193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b0119-d969-4217-9c23-200144b1701c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:03.736781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b0119-d969-4217-9c23-200144b1701c service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:03.748414 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4275/8553] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:07:12.972320 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=27 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:13.743479 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:15.764111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:15.773969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048bbb-fdd2-4286-9e2a-8b6be3f23623 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:15.777830 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:15.778463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:15.778740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:15.779006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:15.780779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:15.793721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:15.795162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:15.805576 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4279/8554] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:07:15.912887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d12f4-b2a5-4f56-a488-88e8d1f9dc7a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:15.913409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d12f4-b2a5-4f56-a488-88e8d1f9dc7a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:15.913409 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d12f4-b2a5-4f56-a488-88e8d1f9dc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:15.932445 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-963d12f4-b2a5-4f56-a488-88e8d1f9dc7a None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:15.933637 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-963d12f4-b2a5-4f56-a488-88e8d1f9dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:15.942661 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4276/8555] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:07:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:15.954478 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:15.969085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01009933-feb1-423a-b00a-b74e97d5ca4d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:15.974109 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34490084-5c3c-402f-91dd-2e50ea37f136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:15.974703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34490084-5c3c-402f-91dd-2e50ea37f136 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:15.974982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34490084-5c3c-402f-91dd-2e50ea37f136 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:15.975253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34490084-5c3c-402f-91dd-2e50ea37f136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:15.983371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34490084-5c3c-402f-91dd-2e50ea37f136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:15.984954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34490084-5c3c-402f-91dd-2e50ea37f136 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:15.994335 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4280/8556] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:07:16.231677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d12f4-b2a5-4f56-a488-88e8d1f9dc7a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:16.241340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d12f4-b2a5-4f56-a488-88e8d1f9dc7a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:16.244967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:16.245563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:16.245840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:16.246147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:16.247840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:16.264014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:16.265507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:16.278715 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4277/8557] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:07:17.074853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffac88-23e7-433b-8f02-c2421e305e86 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:17.075384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffac88-23e7-433b-8f02-c2421e305e86 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:17.075384 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffac88-23e7-433b-8f02-c2421e305e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:17.097198 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-50ffac88-23e7-433b-8f02-c2421e305e86 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:07:17.098431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-50ffac88-23e7-433b-8f02-c2421e305e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:17.107803 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4281/8558] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 23 02:07:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:07:17.124010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:07:17.125366 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:07:17.138936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff3de8-61db-4b4c-9da6-643bc686346f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:07:17.144350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:07:17.144941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:07:17.145219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:07:17.145488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:07:17.153589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:07:17.158421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:07:17.165988 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4278/8559] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:07:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:07:27.091094 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=15 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:07:27.161917 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=15 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:00.796703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffac88-23e7-433b-8f02-c2421e305e86 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:00.809404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffac88-23e7-433b-8f02-c2421e305e86 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:00.814896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:00.815544 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:00.815814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:00.816085 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] PATH_INFO: `/v3/users/0b855154444b4859a13b3ca5f91298e7` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:00.817262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b855154444b4859a13b3ca5f91298e7)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:00.819215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:00.998620 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b855154444b4859a13b3ca5f91298e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.005968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b855154444b4859a13b3ca5f91298e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.006652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b855154444b4859a13b3ca5f91298e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.073990 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b855154444b4859a13b3ca5f91298e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.074642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ffa72083-59d5-4cb9-bddf-a099b9a9d066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b855154444b4859a13b3ca5f91298e7'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.093307 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4282/8560] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:08:00 2022] DELETE /identity/v3/users/0b855154444b4859a13b3ca5f91298e7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:08:01.333159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:01.344125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b22f-d43c-4915-a04d-9dee38abb650 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:01.401393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:01.402062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:01.402340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:01.402609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] PATH_INFO: `/v3/projects/7eb4fc36e36248ada12e6841dcda0b71` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:01.403712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb4fc36e36248ada12e6841dcda0b71)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:01.405667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:01.517777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb4fc36e36248ada12e6841dcda0b71', 'request_id': 'req-04af052c-6509-4b0b-a50b-ebef85787083'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.523300 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb4fc36e36248ada12e6841dcda0b71', 'request_id': 'req-04af052c-6509-4b0b-a50b-ebef85787083'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.599838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb4fc36e36248ada12e6841dcda0b71', 'request_id': 'req-04af052c-6509-4b0b-a50b-ebef85787083'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.611875 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] The token cache is being invalidate because project 7eb4fc36e36248ada12e6841dcda0b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:08:01.612173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.612824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-04af052c-6509-4b0b-a50b-ebef85787083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:08:01.614356 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4279/8561] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:08:01 2022] DELETE /identity/v3/projects/7eb4fc36e36248ada12e6841dcda0b71 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:08:01.619499 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa8bed-3d03-4f17-95d7-c8f25dc501da None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:01.619789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa8bed-3d03-4f17-95d7-c8f25dc501da None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:01.620063 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa8bed-3d03-4f17-95d7-c8f25dc501da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:01.639471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0eaa8bed-3d03-4f17-95d7-c8f25dc501da None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:01.640656 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0eaa8bed-3d03-4f17-95d7-c8f25dc501da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:01.698728 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4283/8562] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:01.707581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0b20-ebe5-4278-905f-2a37fcf8d477 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:01.707892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0b20-ebe5-4278-905f-2a37fcf8d477 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:01.708186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0b20-ebe5-4278-905f-2a37fcf8d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:01.728312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1a0f0b20-ebe5-4278-905f-2a37fcf8d477 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:01.729490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1a0f0b20-ebe5-4278-905f-2a37fcf8d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:01.737867 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4280/8563] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:01.742151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa8bed-3d03-4f17-95d7-c8f25dc501da None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:01.751741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa8bed-3d03-4f17-95d7-c8f25dc501da None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:01.756237 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:01.756826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:01.757103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:01.757372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:01.758030 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:08:01.758837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:01.760765 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:01.772162 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4284/8564] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:08:01.776456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f0b20-ebe5-4278-905f-2a37fcf8d477 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:01.786223 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f0b20-ebe5-4278-905f-2a37fcf8d477 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:01.790928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:01.791529 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:01.791804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:01.792072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:01.792693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:01.794609 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:01.893207 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4281/8565] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:08:01.897374 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:01.908145 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44436fee-c6ab-4a08-8a73-2e05fc757e1a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:01.962984 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:01.963578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:01.963851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:01.964119 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:01.964739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:01.966665 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:01.975254 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:02.051372 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4285/8566] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:08:01 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:08:02.055558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:02.065794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9da16-53f5-4597-af14-5a3ad46a6405 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:02.070696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:02.071304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:02.071582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:02.071849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:02.072610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:02.074168 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:02.084633 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4282/8567] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:08:02.088801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:02.099142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63ba94-9219-48be-ad50-1d059711b675 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:02.103694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058bef3-56dc-47d8-be0c-9910802fca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:02.104283 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bef3-56dc-47d8-be0c-9910802fca29 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:02.104559 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bef3-56dc-47d8-be0c-9910802fca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:02.104825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bef3-56dc-47d8-be0c-9910802fca29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:02.105491 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058bef3-56dc-47d8-be0c-9910802fca29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:02.107103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058bef3-56dc-47d8-be0c-9910802fca29 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:02.117572 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4286/8568] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:08:02.121760 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:02.131683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18068-c97f-4ea6-a896-ab51ed193b82 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:02.136216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:02.136860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:02.137139 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:02.137411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] PATH_INFO: `/v3/projects/a7e6cc6175414fbcb1c0323ef3299901/users/bae1f007536546b98ae09de345781a0a/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:02.153227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e6cc6175414fbcb1c0323ef3299901, user_id=bae1f007536546b98ae09de345781a0a, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:02.154806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:02.249587 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4283/8569] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:08:02 2022] PUT /identity/v3/projects/a7e6cc6175414fbcb1c0323ef3299901/users/bae1f007536546b98ae09de345781a0a/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:08:02.255332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad762668-84ad-4abb-ac6f-8d04e7a48443 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:02.255614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad762668-84ad-4abb-ac6f-8d04e7a48443 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:02.255888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad762668-84ad-4abb-ac6f-8d04e7a48443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:02.276240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ad762668-84ad-4abb-ac6f-8d04e7a48443 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:02.277419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ad762668-84ad-4abb-ac6f-8d04e7a48443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:02.334892 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4287/8570] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:02.344912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:02.346628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:02.377053 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:02.402810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e368-c6cb-4587-9b05-513ea205e751 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:02.406510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4904-9af5-46c7-8467-e4158e8d1c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:02.407062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4904-9af5-46c7-8467-e4158e8d1c27 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:02.407342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4904-9af5-46c7-8467-e4158e8d1c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:02.407612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4904-9af5-46c7-8467-e4158e8d1c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:02.416718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d4904-9af5-46c7-8467-e4158e8d1c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:02.418162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d4904-9af5-46c7-8467-e4158e8d1c27 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:02.427368 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4284/8571] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:08:07.595607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:07.600248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:07.600248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:07.626386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] MFA Rules not processed for user `bae1f007536546b98ae09de345781a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:07.627638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:07.711813 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4288/8572] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:08:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:07.723304 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b00e-95b7-4ca3-9ca7-f8d8c664f9a3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:07.723787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b00e-95b7-4ca3-9ca7-f8d8c664f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:07.723922 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b00e-95b7-4ca3-9ca7-f8d8c664f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:07.746268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-62e6b00e-95b7-4ca3-9ca7-f8d8c664f9a3 None None] MFA Rules not processed for user `bae1f007536546b98ae09de345781a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:07.747526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-62e6b00e-95b7-4ca3-9ca7-f8d8c664f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:07.754684 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4285/8573] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:08:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:07.768670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:07.770113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:07.852002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbff5c6-6bcb-4fbc-96b4-273b7ef5c9c3 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:07.857723 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8a48-a266-4333-9719-c55e702bca77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:07.860060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8a48-a266-4333-9719-c55e702bca77 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:07.860060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8a48-a266-4333-9719-c55e702bca77 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:07.860060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8a48-a266-4333-9719-c55e702bca77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:07.864884 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:07.869027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc8a48-a266-4333-9719-c55e702bca77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:07.870755 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc8a48-a266-4333-9719-c55e702bca77 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:07.881166 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4289/8574] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:08:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:08:17.740302 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=17 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:17.763753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d65f3-b9d5-44dc-9deb-b37ddd69cb7c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:17.764060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d65f3-b9d5-44dc-9deb-b37ddd69cb7c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:17.764355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d65f3-b9d5-44dc-9deb-b37ddd69cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:17.803865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-603d65f3-b9d5-44dc-9deb-b37ddd69cb7c None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:17.805066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-603d65f3-b9d5-44dc-9deb-b37ddd69cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:17.816068 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4286/8575] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 02:08:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:18.011378 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:18.995405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:18.995689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:18.995974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:19.015512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:19.016687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:19.026477 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4290/8576] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 02:08:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:27.136736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec311b-e422-4bd6-a8c1-31207d578296 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:27.137274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec311b-e422-4bd6-a8c1-31207d578296 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:27.137274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec311b-e422-4bd6-a8c1-31207d578296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:27.156237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-82ec311b-e422-4bd6-a8c1-31207d578296 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:27.157416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-82ec311b-e422-4bd6-a8c1-31207d578296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:27.167002 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4287/8577] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:08:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:27.178189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:27.179608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:27.190695 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828e0a-29b1-475c-a652-b58b2babe379 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:27.194277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:27.194873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:27.195151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:27.195423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:27.205203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:27.206637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:27.217342 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4291/8578] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:08:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:08:28.389913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f70e0-ef1c-4d2a-b371-bdf4eaf84871 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:28.390400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f70e0-ef1c-4d2a-b371-bdf4eaf84871 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:28.390512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f70e0-ef1c-4d2a-b371-bdf4eaf84871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:28.410884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2c8f70e0-ef1c-4d2a-b371-bdf4eaf84871 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:28.412082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2c8f70e0-ef1c-4d2a-b371-bdf4eaf84871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:28.421190 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4288/8579] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:08:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:28.431781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:28.440150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ec2c0-960e-4d81-87db-be6abc43662d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:28.443707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:28.444290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:28.444562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:28.444828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:28.455053 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:28.456458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:28.467096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4292/8580] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:08:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:08:38.404918 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=15 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:38.462224 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=15 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:08:57.995296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a970-833f-48a9-9228-c761b57490ea None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:57.995688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a970-833f-48a9-9228-c761b57490ea None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:57.995887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a970-833f-48a9-9228-c761b57490ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:58.034367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6278a970-833f-48a9-9228-c761b57490ea None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:08:58.035588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6278a970-833f-48a9-9228-c761b57490ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:58.042149 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4289/8581] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 23 02:08:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:08:58.058565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:58.067247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c647ac-09bb-483a-aabe-55194e351cb4 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:58.070870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916cdf4-721e-463e-b2be-a894d33e5125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:58.071500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916cdf4-721e-463e-b2be-a894d33e5125 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:58.071775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916cdf4-721e-463e-b2be-a894d33e5125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:58.072043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916cdf4-721e-463e-b2be-a894d33e5125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:58.079379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916cdf4-721e-463e-b2be-a894d33e5125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:58.081325 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916cdf4-721e-463e-b2be-a894d33e5125 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:58.089870 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4293/8582] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:08:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:08:58.624680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a970-833f-48a9-9228-c761b57490ea None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:08:58.633062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a970-833f-48a9-9228-c761b57490ea None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:08:58.636740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:08:58.637374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:08:58.637630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:08:58.637894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:08:58.639614 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:08:58.651638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:08:58.653043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:08:58.664088 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4290/8583] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:08:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:05.700757 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754e476-e73a-40c5-81bc-ddb063edf531 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:05.701296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754e476-e73a-40c5-81bc-ddb063edf531 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:05.701605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754e476-e73a-40c5-81bc-ddb063edf531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:05.722319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0754e476-e73a-40c5-81bc-ddb063edf531 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:05.723541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0754e476-e73a-40c5-81bc-ddb063edf531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:05.733025 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4294/8584] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:09:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:05.745615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:05.759532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da878a-4384-43a6-a02f-f213937f9170 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:05.765126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:05.765739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:05.766045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:05.766321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:05.776968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:05.779274 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:05.790729 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4291/8585] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:09.637087 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064f080-7e9b-4461-9681-74bbea742365 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:09.637655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064f080-7e9b-4461-9681-74bbea742365 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:09.637655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064f080-7e9b-4461-9681-74bbea742365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:09.657278 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3064f080-7e9b-4461-9681-74bbea742365 None None] MFA Rules not processed for user `bae1f007536546b98ae09de345781a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:09.658518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3064f080-7e9b-4461-9681-74bbea742365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:09.665374 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4295/8586] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:09:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:09.929621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:09.939025 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046a7c-4042-45a1-a983-8117e911350b service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:09.942788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:09.943396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:09.943711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:09.943941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:09.945641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:09.958045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:09.959493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:09.971218 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4292/8587] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:13.570567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab64283-8ab8-4c82-8c76-c67a43fe686d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:13.571121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab64283-8ab8-4c82-8c76-c67a43fe686d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:13.571247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab64283-8ab8-4c82-8c76-c67a43fe686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:13.602447 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-cab64283-8ab8-4c82-8c76-c67a43fe686d None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:13.603644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-cab64283-8ab8-4c82-8c76-c67a43fe686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:13.613929 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4296/8588] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 23 02:09:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:13.626893 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:13.638048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffd0c9-c9f6-4d8a-8e86-e3c54e902447 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:13.641689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:13.642325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:13.642604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:13.642871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:13.651594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:13.653285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:13.662259 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4293/8589] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:09:23.612009 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=21 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:23.658426 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=35 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:56.007844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6acfd-f506-4273-ac78-a26b0d6062b5 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:56.008534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6acfd-f506-4273-ac78-a26b0d6062b5 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:56.008534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6acfd-f506-4273-ac78-a26b0d6062b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:56.039487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4bc6acfd-f506-4273-ac78-a26b0d6062b5 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:09:56.040681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4bc6acfd-f506-4273-ac78-a26b0d6062b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:09:56.096563 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4297/8590] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:09:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:09:56.132696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:09:56.152985 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8961-555f-4e20-b174-d5af559bcbd4 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:09:56.159185 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:09:56.159999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:09:56.160282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:09:56.160559 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:09:56.170314 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:09:56.172262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:09:56.183718 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4294/8591] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:09:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:10:06.086511 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=26 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:06.178647 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=9 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:12.224301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6acfd-f506-4273-ac78-a26b0d6062b5 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:12.235088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6acfd-f506-4273-ac78-a26b0d6062b5 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:12.240141 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:12.240768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:12.241219 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:12.241497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] PATH_INFO: `/v3/users/bae1f007536546b98ae09de345781a0a` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:12.242638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae1f007536546b98ae09de345781a0a)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:12.244541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:12.407844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae1f007536546b98ae09de345781a0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:12.414873 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae1f007536546b98ae09de345781a0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:12.415561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae1f007536546b98ae09de345781a0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:12.487024 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae1f007536546b98ae09de345781a0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:12.487672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-63b1d3da-a621-46e2-86f4-a542d006f37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae1f007536546b98ae09de345781a0a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:12.506398 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4298/8592] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:10:12 2022] DELETE /identity/v3/users/bae1f007536546b98ae09de345781a0a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:10:12.755387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:12.760394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf69e0-d133-423d-a681-0d01851fdc32 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:12.820986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:12.821622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:12.821908 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:12.822212 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] PATH_INFO: `/v3/projects/a7e6cc6175414fbcb1c0323ef3299901` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:12.823349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e6cc6175414fbcb1c0323ef3299901)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:12.825303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:12.926000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e6cc6175414fbcb1c0323ef3299901', 'request_id': 'req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:12.931520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e6cc6175414fbcb1c0323ef3299901', 'request_id': 'req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:12.992440 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e6cc6175414fbcb1c0323ef3299901', 'request_id': 'req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:13.004292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] The token cache is being invalidate because project a7e6cc6175414fbcb1c0323ef3299901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:10:13.004574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:13.005196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5a248c3d-f531-4d7b-9f5a-bbef82c63ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:10:13.008610 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4295/8593] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:10:12 2022] DELETE /identity/v3/projects/a7e6cc6175414fbcb1c0323ef3299901 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:10:13.011770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c358a2-52b4-4380-b03f-da79d75c467f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.012107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c358a2-52b4-4380-b03f-da79d75c467f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.012382 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c358a2-52b4-4380-b03f-da79d75c467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.033712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-53c358a2-52b4-4380-b03f-da79d75c467f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:10:13.036061 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-53c358a2-52b4-4380-b03f-da79d75c467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:13.092002 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4299/8594] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:10:13.100419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087775b5-bd34-4645-b264-1a1e400176ef None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.100701 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087775b5-bd34-4645-b264-1a1e400176ef None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.100999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087775b5-bd34-4645-b264-1a1e400176ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.120207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-087775b5-bd34-4645-b264-1a1e400176ef None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:10:13.121400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-087775b5-bd34-4645-b264-1a1e400176ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:13.129284 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4296/8595] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:10:13.133267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c358a2-52b4-4380-b03f-da79d75c467f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:13.143164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c358a2-52b4-4380-b03f-da79d75c467f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:13.147746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:13.148333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.148608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.148879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.149513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:10:13.149813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:13.151417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:13.163316 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4300/8596] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:10:13.167312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087775b5-bd34-4645-b264-1a1e400176ef None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:13.176709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087775b5-bd34-4645-b264-1a1e400176ef None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:13.181475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:13.182134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.182411 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.182680 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.183307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:13.185199 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:13.288796 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4297/8597] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:10:13 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:10:13.292769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:13.302749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823ed6e-0621-4d50-b5c2-4367538fae52 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:13.357527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:13.358151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.358433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.358706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.359329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:13.361258 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:13.369073 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:13.426640 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4301/8598] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:10:13 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:10:13.430813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:13.441623 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add826f6-11a9-41d7-9b59-8929e0652ebe admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:13.446262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:13.446865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.447148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.447428 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.448095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:13.449727 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:13.460383 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4298/8599] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:10:13.466136 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:13.476426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f1886-f48c-4261-a0c9-1c6deb00d415 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:13.481537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ce80b-97d7-445d-9fba-a7edc9c43f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:13.482488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ce80b-97d7-445d-9fba-a7edc9c43f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.482488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ce80b-97d7-445d-9fba-a7edc9c43f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.482882 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ce80b-97d7-445d-9fba-a7edc9c43f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.483531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ce80b-97d7-445d-9fba-a7edc9c43f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:13.485130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ce80b-97d7-445d-9fba-a7edc9c43f13 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:13.496090 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4302/8600] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:10:13.500378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:13.510774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9e74c-5fa8-42c8-a98d-3ea4a11d1da8 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:13.515431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:13.516083 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.516364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.516633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] PATH_INFO: `/v3/projects/03ca20e778cf488baea3d1e0505cd492/users/8d11ce8077ca4566ba823eac0882c34f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.531917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ca20e778cf488baea3d1e0505cd492, user_id=8d11ce8077ca4566ba823eac0882c34f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:13.534699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:13.627189 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4299/8601] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:10:13 2022] PUT /identity/v3/projects/03ca20e778cf488baea3d1e0505cd492/users/8d11ce8077ca4566ba823eac0882c34f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:10:13.632274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c5a4-a89c-436b-a4b5-97f2e402191b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.632557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c5a4-a89c-436b-a4b5-97f2e402191b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.632832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c5a4-a89c-436b-a4b5-97f2e402191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.652397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6bf4c5a4-a89c-436b-a4b5-97f2e402191b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:10:13.653581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6bf4c5a4-a89c-436b-a4b5-97f2e402191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:13.711203 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4303/8602] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:10:13.721050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:13.722740 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:13.753832 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:13.779413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90afe9-e17b-460c-b418-710e2b811af4 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:13.783780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:13.784388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:13.784664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:13.784931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:13.794333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:13.795799 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:13.805801 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4300/8603] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:10:18.996200 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d055-1f7e-40a6-95bd-9f0e8c3bee1c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:18.996774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d055-1f7e-40a6-95bd-9f0e8c3bee1c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:18.996774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d055-1f7e-40a6-95bd-9f0e8c3bee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:19.027326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-dab4d055-1f7e-40a6-95bd-9f0e8c3bee1c None None] MFA Rules not processed for user `8d11ce8077ca4566ba823eac0882c34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:10:19.028800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-dab4d055-1f7e-40a6-95bd-9f0e8c3bee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:19.102474 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4304/8604] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:10:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:10:19.119400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:19.121092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:19.196702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113a1f3-7126-46fd-b145-4e98fa05e315 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:19.202222 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70d0d4-c982-4a2d-b64f-66ee0a9538ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:19.206132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d0d4-c982-4a2d-b64f-66ee0a9538ae service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:19.206132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d0d4-c982-4a2d-b64f-66ee0a9538ae service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:19.206132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d0d4-c982-4a2d-b64f-66ee0a9538ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:19.211868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70d0d4-c982-4a2d-b64f-66ee0a9538ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:19.213902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70d0d4-c982-4a2d-b64f-66ee0a9538ae service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:19.223773 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4301/8605] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:10:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:10:21.618470 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:21.618979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:21.619079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:21.638753 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] MFA Rules not processed for user `8d11ce8077ca4566ba823eac0882c34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:10:21.640007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:21.647017 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4305/8606] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:10:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:10:21.970244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d70bd-b25e-4422-bfb6-45d4b4d20c36 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:21.975710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d70bd-b25e-4422-bfb6-45d4b4d20c36 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:21.975710 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d70bd-b25e-4422-bfb6-45d4b4d20c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:21.991102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8d2d70bd-b25e-4422-bfb6-45d4b4d20c36 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:10:21.992298 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8d2d70bd-b25e-4422-bfb6-45d4b4d20c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:21.999110 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4302/8607] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:10:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:10:22.011610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:22.013078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:22.025557 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c14d3-838b-4943-86cc-f281b416c0be None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:22.029329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:22.033336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:22.033336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:22.033336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:22.037967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:22.039561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:22.047496 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4306/8608] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:10:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:10:31.984922 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=51 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:32.043941 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:INSERT=3,keystone:SELECT=75 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:37.582955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529ddf0-5349-4c76-97ba-170155402b99 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:37.583452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529ddf0-5349-4c76-97ba-170155402b99 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:37.583534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529ddf0-5349-4c76-97ba-170155402b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:37.603507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4529ddf0-5349-4c76-97ba-170155402b99 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:10:37.604806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4529ddf0-5349-4c76-97ba-170155402b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:37.614556 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4303/8609] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:10:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:10:37.626880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:10:37.628815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:10:37.645444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f731a-5c12-403c-a07e-9ad604efe1a1 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:10:37.650883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:10:37.651485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:10:37.651759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:10:37.652026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:10:37.661643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:10:37.663276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:10:37.675047 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4307/8610] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:10:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:10:47.597855 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:47.669550 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:14.333394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76950-473e-4ccd-8a52-97fa4d81ba65 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.334632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76950-473e-4ccd-8a52-97fa4d81ba65 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.334854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76950-473e-4ccd-8a52-97fa4d81ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.374051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-27d76950-473e-4ccd-8a52-97fa4d81ba65 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:14.375240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-27d76950-473e-4ccd-8a52-97fa4d81ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:14.382280 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4304/8611] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:14.393227 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:14.402649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de86683-6216-4d77-b7d0-425c9f249402 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:14.406201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:14.406786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.407060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.407326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.414101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:14.415505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:14.423187 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4308/8612] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:14.829255 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.830942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.830942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.862416 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:14.863612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:14.873722 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4305/8613] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:14.883413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:14.891808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93409f-3d1f-40c0-a2c0-818a0075e165 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:14.895404 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe83a5-4729-48e8-9e49-386e5d931c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:14.895988 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe83a5-4729-48e8-9e49-386e5d931c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:14.896260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe83a5-4729-48e8-9e49-386e5d931c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:14.896525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe83a5-4729-48e8-9e49-386e5d931c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:14.906368 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe83a5-4729-48e8-9e49-386e5d931c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:14.907775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe83a5-4729-48e8-9e49-386e5d931c60 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:14.918556 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4309/8614] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:24.857540 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=16 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:24.914027 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=12 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:40.618580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:11:40.620012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:40.845335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528573a-a536-4304-9c14-e0d8f912b140 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:11:40.850766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871e3e1-6ce7-43a6-9aea-ed3bcf32a617 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:11:40.851378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e3e1-6ce7-43a6-9aea-ed3bcf32a617 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:40.851654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e3e1-6ce7-43a6-9aea-ed3bcf32a617 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:40.851924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e3e1-6ce7-43a6-9aea-ed3bcf32a617 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:40.853694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5871e3e1-6ce7-43a6-9aea-ed3bcf32a617 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:40.865037 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871e3e1-6ce7-43a6-9aea-ed3bcf32a617 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:11:40.866738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871e3e1-6ce7-43a6-9aea-ed3bcf32a617 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:11:40.876263 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4306/8615] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:11:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:11:46.332471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ab72-5a8d-4785-a249-ebcc14922d06 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:11:46.333007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ab72-5a8d-4785-a249-ebcc14922d06 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:11:46.333007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ab72-5a8d-4785-a249-ebcc14922d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:11:46.354750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-e2e7ab72-5a8d-4785-a249-ebcc14922d06 None None] MFA Rules not processed for user `8d11ce8077ca4566ba823eac0882c34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:11:46.355967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e2e7ab72-5a8d-4785-a249-ebcc14922d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:11:46.363170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4310/8616] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:11:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:11:50.872862 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=37 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:56.349423 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:30.103394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836b22-2097-4007-bd6a-03247b39b357 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:30.103846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836b22-2097-4007-bd6a-03247b39b357 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:30.103954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836b22-2097-4007-bd6a-03247b39b357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.140354 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fa836b22-2097-4007-bd6a-03247b39b357 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:12:30.141554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fa836b22-2097-4007-bd6a-03247b39b357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.150488 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4307/8617] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 23 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:12:30.156395 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ab72-5a8d-4785-a249-ebcc14922d06 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:30.168578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ab72-5a8d-4785-a249-ebcc14922d06 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:30.173476 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:30.174102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:30.174377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:30.174648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:30.176315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:30.187249 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:30.188801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:30.198307 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4311/8618] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:40.137804 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=9 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:40.194294 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:45.568063 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa836b22-2097-4007-bd6a-03247b39b357 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:45.579152 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa836b22-2097-4007-bd6a-03247b39b357 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:45.584240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d7e6-5c19-4b60-b98d-6856d61b0493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:45.584853 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d7e6-5c19-4b60-b98d-6856d61b0493 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:45.585128 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d7e6-5c19-4b60-b98d-6856d61b0493 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:45.585542 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d7e6-5c19-4b60-b98d-6856d61b0493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:45.587263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9356d7e6-5c19-4b60-b98d-6856d61b0493 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:45.598628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356d7e6-5c19-4b60-b98d-6856d61b0493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:45.600176 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356d7e6-5c19-4b60-b98d-6856d61b0493 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:45.610089 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4308/8619] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:45.942932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:12:45.953260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cd0a1-8776-447c-b01e-1701489b143c service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:12:45.958247 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:12:45.958843 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:12:45.959121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:12:45.959392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:12:45.961619 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:12:45.972860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:12:45.974474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:12:45.984617 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4312/8620] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:12:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:12:55.606127 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:55.980625 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:04.367195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843bb11-548a-4f1c-bc81-176e06a9ea01 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:04.367195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843bb11-548a-4f1c-bc81-176e06a9ea01 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:04.367195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843bb11-548a-4f1c-bc81-176e06a9ea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:04.384674 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a843bb11-548a-4f1c-bc81-176e06a9ea01 None None] MFA Rules not processed for user `8d11ce8077ca4566ba823eac0882c34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:13:04.385876 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a843bb11-548a-4f1c-bc81-176e06a9ea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:04.392845 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4309/8621] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:13:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:13:05.352635 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:05.363308 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846dc98-1b6b-4a0a-85ed-c6d75b8ec107 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:05.369014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:05.369658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:05.369937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:05.370248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:05.372114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:05.384798 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:05.386500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:05.396948 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4313/8622] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:14.379633 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:15.392412 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:53.479188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843bb11-548a-4f1c-bc81-176e06a9ea01 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:53.489551 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843bb11-548a-4f1c-bc81-176e06a9ea01 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:53.493321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:53.494045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:53.494325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:53.494594 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:53.497012 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:53.510476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:53.512800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:53.532065 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4310/8623] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:13:54.719423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:13:54.729344 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef55d-e4b5-4032-aca9-7806f2460329 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:13:54.733069 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:13:54.733666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:13:54.733938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:13:54.734235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:13:54.735916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:13:54.751002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:13:54.752474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:13:54.765130 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4314/8624] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:13:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:03.529438 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:04.758814 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:13.857343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:13.865666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373990c-84cc-41bc-bc1f-6c6a67f1e022 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:13.869208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:13.869844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:13.870151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:13.870420 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:13.872081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:13.881284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:13.882728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:13.890774 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4311/8625] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:14.354241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:14.362628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106eed-d79b-4b95-afc3-36ba5c81ba25 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:14.366271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f7130-e665-4129-966a-9289469766f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:14.366864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7130-e665-4129-966a-9289469766f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:14.369836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7130-e665-4129-966a-9289469766f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:14.369836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f7130-e665-4129-966a-9289469766f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:14.369836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8a7f7130-e665-4129-966a-9289469766f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:14.378881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f7130-e665-4129-966a-9289469766f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:14.380327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f7130-e665-4129-966a-9289469766f1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:14.388777 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4315/8626] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:14:21.137902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:14:21.150536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1ead4-9dac-4e69-93e0-e5e0862d8c99 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:14:21.156079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20814d3f-b89a-4689-b00a-2ad7305b3efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:14:21.156686 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20814d3f-b89a-4689-b00a-2ad7305b3efc service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:21.156962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20814d3f-b89a-4689-b00a-2ad7305b3efc service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:21.157231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20814d3f-b89a-4689-b00a-2ad7305b3efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:21.158995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-20814d3f-b89a-4689-b00a-2ad7305b3efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:21.171566 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20814d3f-b89a-4689-b00a-2ad7305b3efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:14:21.173123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20814d3f-b89a-4689-b00a-2ad7305b3efc service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:14:21.184092 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4312/8627] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:14:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:14:24.384713 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:31.179269 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=12 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:32.676640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78944c1e-56d6-4301-8ecc-d3204c6fddeb None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:14:32.677111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78944c1e-56d6-4301-8ecc-d3204c6fddeb None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:14:32.677208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78944c1e-56d6-4301-8ecc-d3204c6fddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:14:32.696598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-78944c1e-56d6-4301-8ecc-d3204c6fddeb None None] MFA Rules not processed for user `8d11ce8077ca4566ba823eac0882c34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:14:32.697814 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78944c1e-56d6-4301-8ecc-d3204c6fddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:14:32.704732 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4316/8628] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:14:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:14:42.691558 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:22.168082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7ba2-9c40-44b9-98ce-90fd5c0c0901 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:22.170762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7ba2-9c40-44b9-98ce-90fd5c0c0901 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:22.170762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7ba2-9c40-44b9-98ce-90fd5c0c0901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:22.220289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4dfd7ba2-9c40-44b9-98ce-90fd5c0c0901 None None] MFA Rules not processed for user `1a5599baadee4192ae45c1891b7f00f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:15:22.221527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4dfd7ba2-9c40-44b9-98ce-90fd5c0c0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:15:22.280566 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4313/8629] 10.222.0.42 () {58 vars in 1060 bytes} [Sun Oct 23 02:15:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:15:22.286690 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78944c1e-56d6-4301-8ecc-d3204c6fddeb None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:15:22.296810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78944c1e-56d6-4301-8ecc-d3204c6fddeb None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:15:22.300432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:15:22.301032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:15:22.301311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:15:22.301583 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:15:22.309728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:15:22.311169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:15:22.319761 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4317/8630] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:15:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:15:32.277243 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=38 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:32.315802 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:01.689450 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd7ba2-9c40-44b9-98ce-90fd5c0c0901 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:01.702367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd7ba2-9c40-44b9-98ce-90fd5c0c0901 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:01.707931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:01.708534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:01.708811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:01.709081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:01.710805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:01.722661 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:01.728553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:01.734805 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4314/8631] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:11.730145 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:47.154816 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:47.175522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29ad58-0362-445c-b213-85bb7b770c66 service cinder] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:47.180565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27242586-ea78-4411-a7bd-3ae8e470b8e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:47.181151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242586-ea78-4411-a7bd-3ae8e470b8e0 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:47.181424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242586-ea78-4411-a7bd-3ae8e470b8e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:47.181689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242586-ea78-4411-a7bd-3ae8e470b8e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:47.190361 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27242586-ea78-4411-a7bd-3ae8e470b8e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:47.191912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27242586-ea78-4411-a7bd-3ae8e470b8e0 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:47.201924 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4318/8632] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:53.429554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:53.448811 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79047587-8b7a-4252-a9e1-056d5d2b6ea1 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:53.452485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:53.453104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:53.453380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:53.453645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:53.463455 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:53.464895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:53.503698 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4315/8633] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:57.052791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291592-7adf-44ad-b165-7c033d9c8224 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.055051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291592-7adf-44ad-b165-7c033d9c8224 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.055051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291592-7adf-44ad-b165-7c033d9c8224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.086846 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-51291592-7adf-44ad-b165-7c033d9c8224 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:57.088096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-51291592-7adf-44ad-b165-7c033d9c8224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:57.099166 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4319/8634] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:16:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:57.113263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.124925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2444e-bc3b-4cfd-9b7b-a2fe2690401e service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.130310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.131046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.131322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.131615 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.141820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.143543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.154957 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4316/8635] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:16:57.186878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291592-7adf-44ad-b165-7c033d9c8224 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.204720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291592-7adf-44ad-b165-7c033d9c8224 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.209192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.209933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.210255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.210531 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] PATH_INFO: `/v3/users/8d11ce8077ca4566ba823eac0882c34f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.211738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d11ce8077ca4566ba823eac0882c34f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.213683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.370686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d11ce8077ca4566ba823eac0882c34f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.378134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d11ce8077ca4566ba823eac0882c34f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.378806 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d11ce8077ca4566ba823eac0882c34f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.420375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d11ce8077ca4566ba823eac0882c34f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.421009 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ae1056a8-2b2a-46e0-80ca-7023e2087c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d11ce8077ca4566ba823eac0882c34f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.438762 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4320/8636] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:16:57 2022] DELETE /identity/v3/users/8d11ce8077ca4566ba823eac0882c34f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:57.674091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:57.685735 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e309d91-d887-41f6-b3fb-1c98cfee57df service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:57.743160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:57.743733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.744031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.744318 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] PATH_INFO: `/v3/projects/03ca20e778cf488baea3d1e0505cd492` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:57.745421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ca20e778cf488baea3d1e0505cd492)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:57.747960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:57.866967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ca20e778cf488baea3d1e0505cd492', 'request_id': 'req-5ad7324e-b5f0-4d37-b822-459e0890ba35'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.873081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ca20e778cf488baea3d1e0505cd492', 'request_id': 'req-5ad7324e-b5f0-4d37-b822-459e0890ba35'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.923803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ca20e778cf488baea3d1e0505cd492', 'request_id': 'req-5ad7324e-b5f0-4d37-b822-459e0890ba35'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.947391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] The token cache is being invalidate because project 03ca20e778cf488baea3d1e0505cd492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:16:57.947682 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.948313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5ad7324e-b5f0-4d37-b822-459e0890ba35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:16:57.949794 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4317/8637] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:16:57 2022] DELETE /identity/v3/projects/03ca20e778cf488baea3d1e0505cd492 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:57.954759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc733ab-67c1-4c5b-842d-39397cfce4c6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:57.955045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc733ab-67c1-4c5b-842d-39397cfce4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:57.955322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc733ab-67c1-4c5b-842d-39397cfce4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.002111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-5dc733ab-67c1-4c5b-842d-39397cfce4c6 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:58.003238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5dc733ab-67c1-4c5b-842d-39397cfce4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:58.061895 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4321/8638] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:58.069995 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f097d3-7369-403e-9cd8-944c681b8966 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.070324 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f097d3-7369-403e-9cd8-944c681b8966 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.070593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f097d3-7369-403e-9cd8-944c681b8966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.090986 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-99f097d3-7369-403e-9cd8-944c681b8966 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:58.092184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-99f097d3-7369-403e-9cd8-944c681b8966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:58.099841 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4318/8639] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:58.103848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc733ab-67c1-4c5b-842d-39397cfce4c6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.113924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc733ab-67c1-4c5b-842d-39397cfce4c6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.118537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.119130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.119406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.119676 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.120315 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:16:58.120615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.122251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.130661 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:58.134345 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4322/8640] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:16:58.138620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f097d3-7369-403e-9cd8-944c681b8966 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.148042 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f097d3-7369-403e-9cd8-944c681b8966 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.153393 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.154061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.154338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.154605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.155257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.157126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.178087 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:58.239570 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4319/8641] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:58.243880 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.253887 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e630d83-3c98-4326-abfd-16ad643e0351 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.308976 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.309581 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.309858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.310161 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.310817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.312707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.375611 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4323/8642] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:16:58.380051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.390280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4077b94-8a58-401e-911d-9f64735c9487 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.394803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.395403 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.395681 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.395951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.396641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.398240 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.408356 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4320/8643] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:58.413749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.424156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7a05-258f-4caa-88d8-fe67c54fd988 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.429019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb90d78-ccec-4b28-b255-66d943791475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.429615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90d78-ccec-4b28-b255-66d943791475 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.429891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90d78-ccec-4b28-b255-66d943791475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.430268 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90d78-ccec-4b28-b255-66d943791475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.430902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb90d78-ccec-4b28-b255-66d943791475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.432503 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb90d78-ccec-4b28-b255-66d943791475 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.442491 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4324/8644] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:16:58.446378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.456611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98637102-6ee8-4e73-8157-3287219eb115 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.461164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.461812 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.462122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.462398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] PATH_INFO: `/v3/projects/91c3d346c6c043c7b725f6c8c6bfc559/users/040db1cb2f524d67a9344884d8e2fdbb/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.478076 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c3d346c6c043c7b725f6c8c6bfc559, user_id=040db1cb2f524d67a9344884d8e2fdbb, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.480736 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.541142 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4321/8645] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:16:58 2022] PUT /identity/v3/projects/91c3d346c6c043c7b725f6c8c6bfc559/users/040db1cb2f524d67a9344884d8e2fdbb/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:16:58.551066 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648473ae-edff-4f16-9c5a-d1b1d4adf71f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.551351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648473ae-edff-4f16-9c5a-d1b1d4adf71f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.551626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648473ae-edff-4f16-9c5a-d1b1d4adf71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.570526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-648473ae-edff-4f16-9c5a-d1b1d4adf71f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:16:58.571716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-648473ae-edff-4f16-9c5a-d1b1d4adf71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:58.629935 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4325/8646] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:16:58.640241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:16:58.641881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:16:58.696638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417469e-8b3d-46d8-bbd8-8d8f05b3a8af admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:16:58.700728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5db905-983f-4a2b-9705-5a2bd95592d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:16:58.701316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5db905-983f-4a2b-9705-5a2bd95592d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:16:58.701591 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5db905-983f-4a2b-9705-5a2bd95592d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:16:58.701859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5db905-983f-4a2b-9705-5a2bd95592d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:16:58.711001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5db905-983f-4a2b-9705-5a2bd95592d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:16:58.712402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5db905-983f-4a2b-9705-5a2bd95592d6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:16:58.722470 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4322/8647] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:17:03.771572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:03.772157 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:03.772271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:03.802422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] MFA Rules not processed for user `040db1cb2f524d67a9344884d8e2fdbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:03.803707 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:03.875957 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4326/8648] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:17:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:17:03.886157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e424c-4489-4f8e-8c25-c5e47dad688a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:03.886705 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e424c-4489-4f8e-8c25-c5e47dad688a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:03.886827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e424c-4489-4f8e-8c25-c5e47dad688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:03.906424 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d73e424c-4489-4f8e-8c25-c5e47dad688a None None] MFA Rules not processed for user `040db1cb2f524d67a9344884d8e2fdbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:03.907755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d73e424c-4489-4f8e-8c25-c5e47dad688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:03.917455 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4323/8649] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:17:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:03.931879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:03.933335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:03.945710 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:04.012556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be387-54b1-448b-849d-bcbfc9addce8 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:04.018262 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a3268-f32d-4838-984d-aab128e84f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:04.018888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a3268-f32d-4838-984d-aab128e84f0e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:04.019201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a3268-f32d-4838-984d-aab128e84f0e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:04.019463 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a3268-f32d-4838-984d-aab128e84f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:04.028932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a3268-f32d-4838-984d-aab128e84f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:04.030706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a3268-f32d-4838-984d-aab128e84f0e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:04.040451 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4327/8650] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:04.292457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e424c-4489-4f8e-8c25-c5e47dad688a None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:04.302531 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e424c-4489-4f8e-8c25-c5e47dad688a None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:04.306020 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:04.306618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:04.306891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:04.307155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:04.308838 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:04.317831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:04.319267 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:04.326946 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4324/8651] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:14.089710 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=30 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:14.323568 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:20.763075 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c91e-1b24-4276-b8d4-d0568e04da50 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:20.763641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c91e-1b24-4276-b8d4-d0568e04da50 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:20.763756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c91e-1b24-4276-b8d4-d0568e04da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:20.783483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b553c91e-1b24-4276-b8d4-d0568e04da50 None None] MFA Rules not processed for user `040db1cb2f524d67a9344884d8e2fdbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:20.784731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b553c91e-1b24-4276-b8d4-d0568e04da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:20.791645 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4328/8652] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:17:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:30.777195 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:34.249870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:34.251373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:34.320489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b996efe-0449-4924-948b-52cd67e5f51b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:34.325369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:34.326004 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:34.326276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:34.326543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:34.328711 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:34.339793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:34.341599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:34.352061 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4325/8653] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:36.604488 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108c8b9-0ded-4ee8-b0f1-20a6686c53f4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:36.605029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108c8b9-0ded-4ee8-b0f1-20a6686c53f4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:36.605029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108c8b9-0ded-4ee8-b0f1-20a6686c53f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:36.623967 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-c108c8b9-0ded-4ee8-b0f1-20a6686c53f4 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:36.625144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c108c8b9-0ded-4ee8-b0f1-20a6686c53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:36.631503 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4329/8654] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:17:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:36.643172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:36.652336 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeeb0a-aed3-47ed-8252-34ba6fdd36ba service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:36.655884 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:36.657125 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:36.657402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:36.657670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:36.664512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:36.665907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:36.673695 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4326/8655] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:45.485199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108c8b9-0ded-4ee8-b0f1-20a6686c53f4 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:45.502837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108c8b9-0ded-4ee8-b0f1-20a6686c53f4 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:45.508142 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:45.508594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:45.509082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:45.509350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] PATH_INFO: `/v3/users/040db1cb2f524d67a9344884d8e2fdbb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:45.510691 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=040db1cb2f524d67a9344884d8e2fdbb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:45.512509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:45.690387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040db1cb2f524d67a9344884d8e2fdbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:45.697076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040db1cb2f524d67a9344884d8e2fdbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:45.697727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040db1cb2f524d67a9344884d8e2fdbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:45.774080 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040db1cb2f524d67a9344884d8e2fdbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:45.774638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-c82a0527-3a63-45ec-aa6a-5d08af5db63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040db1cb2f524d67a9344884d8e2fdbb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:45.792052 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4330/8656] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:17:45 2022] DELETE /identity/v3/users/040db1cb2f524d67a9344884d8e2fdbb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:46.021165 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.034978 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42bbb-4546-4dc3-841d-a46878a2a21d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.091649 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.092279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.092558 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.092831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] PATH_INFO: `/v3/projects/91c3d346c6c043c7b725f6c8c6bfc559` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.094575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c3d346c6c043c7b725f6c8c6bfc559)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.096476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.179678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c3d346c6c043c7b725f6c8c6bfc559', 'request_id': 'req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.185197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c3d346c6c043c7b725f6c8c6bfc559', 'request_id': 'req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.271333 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c3d346c6c043c7b725f6c8c6bfc559', 'request_id': 'req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.283213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] The token cache is being invalidate because project 91c3d346c6c043c7b725f6c8c6bfc559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:17:46.283526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.284154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-cf36d11a-6e4d-418d-bcbc-786c8bc3d4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:17:46.285646 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4327/8657] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:17:46 2022] DELETE /identity/v3/projects/91c3d346c6c043c7b725f6c8c6bfc559 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:46.290812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47adf2-c3a7-4ad8-be18-81e82ef8fb0a None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.291096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47adf2-c3a7-4ad8-be18-81e82ef8fb0a None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.294972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47adf2-c3a7-4ad8-be18-81e82ef8fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.445539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-7b47adf2-c3a7-4ad8-be18-81e82ef8fb0a None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:46.446779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7b47adf2-c3a7-4ad8-be18-81e82ef8fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:46.505253 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4331/8658] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:46.513363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae2bd-d674-4f4f-bcd4-b36401f9c985 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.513646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae2bd-d674-4f4f-bcd4-b36401f9c985 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.513920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae2bd-d674-4f4f-bcd4-b36401f9c985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.528444 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:46.534569 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-691ae2bd-d674-4f4f-bcd4-b36401f9c985 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:46.539103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-691ae2bd-d674-4f4f-bcd4-b36401f9c985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:46.544044 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4328/8659] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:46.548282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47adf2-c3a7-4ad8-be18-81e82ef8fb0a None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.557783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47adf2-c3a7-4ad8-be18-81e82ef8fb0a None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.562291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.562879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.563154 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.563424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.564056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:17:46.564360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.565918 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.577239 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4332/8660] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:17:46.587604 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae2bd-d674-4f4f-bcd4-b36401f9c985 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.598123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae2bd-d674-4f4f-bcd4-b36401f9c985 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.603194 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.603794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.604072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.604473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.605099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.607027 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.672804 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4329/8661] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:17:46 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:46.676972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.686928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f156-9298-47fa-aaed-10ca2479f29a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.735187 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:46.744333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.744964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.745254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.745514 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.746176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.748102 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.838063 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4333/8662] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:17:46 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:17:46.842461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.853284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72113f77-261e-4802-acf0-a2f80e87d592 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.858079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.858675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.858947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.859862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.860497 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.862102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.871915 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4330/8663] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:46.875972 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.885696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a5855-0b39-409a-a098-83b5b36fa1ad admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.890350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb27580-89ab-4f5e-87e6-6f9481f7b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.890941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27580-89ab-4f5e-87e6-6f9481f7b890 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.891221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27580-89ab-4f5e-87e6-6f9481f7b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.891493 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27580-89ab-4f5e-87e6-6f9481f7b890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.892120 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb27580-89ab-4f5e-87e6-6f9481f7b890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.893717 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb27580-89ab-4f5e-87e6-6f9481f7b890 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:46.903416 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4334/8664] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:17:46.907857 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:46.917493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975734-c0ca-4628-93d7-a3911b16b606 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:46.922665 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:46.923302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:46.923577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:46.923847 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] PATH_INFO: `/v3/projects/cdb54d49c6f641f68dea4e199f189d97/users/47375e24c4434b3689eb5369f6a46996/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:46.937793 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb54d49c6f641f68dea4e199f189d97, user_id=47375e24c4434b3689eb5369f6a46996, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:46.940413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:47.003245 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4331/8665] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:17:46 2022] PUT /identity/v3/projects/cdb54d49c6f641f68dea4e199f189d97/users/47375e24c4434b3689eb5369f6a46996/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:17:47.013406 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083404-35cc-4107-8eea-cdf1c69cdeda None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:47.013689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083404-35cc-4107-8eea-cdf1c69cdeda None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:47.013966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083404-35cc-4107-8eea-cdf1c69cdeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:47.041112 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-72083404-35cc-4107-8eea-cdf1c69cdeda None None] MFA Rules not processed for user `47375e24c4434b3689eb5369f6a46996`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:47.042339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-72083404-35cc-4107-8eea-cdf1c69cdeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:47.105404 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4335/8666] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:17:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:47.115578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:47.117230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:47.173073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d992-5823-482d-b554-1a8a47256d5e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:47.176693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:47.177292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:47.177571 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:47.177854 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:47.185951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:47.187419 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:47.196090 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4332/8667] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:17:53.934238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35df8-02db-4758-9342-1812ad8f7283 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:53.934878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35df8-02db-4758-9342-1812ad8f7283 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:53.934878 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35df8-02db-4758-9342-1812ad8f7283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:53.962164 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-88b35df8-02db-4758-9342-1812ad8f7283 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:17:53.963729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-88b35df8-02db-4758-9342-1812ad8f7283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.059877 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4336/8668] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:17:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:17:54.074947 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:17:54.076753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:17:54.094974 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28b05-cb27-4500-9de0-d071158aafa8 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:17:54.105508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22b3e6-327d-48f2-8962-66018479b220 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:17:54.105508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22b3e6-327d-48f2-8962-66018479b220 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:17:54.105508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22b3e6-327d-48f2-8962-66018479b220 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:17:54.105508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22b3e6-327d-48f2-8962-66018479b220 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:17:54.114394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22b3e6-327d-48f2-8962-66018479b220 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:17:54.116458 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22b3e6-327d-48f2-8962-66018479b220 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:17:54.128865 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4333/8669] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:17:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:04.043815 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:04.123069 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:04.611221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35df8-02db-4758-9342-1812ad8f7283 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:04.673437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35df8-02db-4758-9342-1812ad8f7283 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:04.678079 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:04.678783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:04.679135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:04.679480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] PATH_INFO: `/v3/users/47375e24c4434b3689eb5369f6a46996` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:04.680668 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47375e24c4434b3689eb5369f6a46996)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:04.682801 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:04.815507 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47375e24c4434b3689eb5369f6a46996'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:04.822439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47375e24c4434b3689eb5369f6a46996'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:04.823097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47375e24c4434b3689eb5369f6a46996'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:04.876373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47375e24c4434b3689eb5369f6a46996'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:04.876980 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47375e24c4434b3689eb5369f6a46996'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:04.894169 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4337/8670] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:04 2022] DELETE /identity/v3/users/47375e24c4434b3689eb5369f6a46996 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:04.898633 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:04.898943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:04.899247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:04.920151 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:04.922001 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:04.978791 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4334/8671] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:04.989150 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:04.990585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:05.053596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a642bb0-0fd2-496a-a277-cde4b454593e admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:05.057301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50327284-bba1-426a-8bba-8576de451254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:05.057906 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327284-bba1-426a-8bba-8576de451254 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:05.058259 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327284-bba1-426a-8bba-8576de451254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:05.058527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50327284-bba1-426a-8bba-8576de451254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:05.067510 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50327284-bba1-426a-8bba-8576de451254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:05.068926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50327284-bba1-426a-8bba-8576de451254 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:05.078914 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4338/8672] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:05.307238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:05.308728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:05.320913 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2545-6dc4-466e-b085-8765f2fe7802 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:05.326227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:05.327723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:05.327998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:05.328439 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] PATH_INFO: `/v3/projects/cdb54d49c6f641f68dea4e199f189d97` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:05.329568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb54d49c6f641f68dea4e199f189d97)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:05.331486 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:05.431208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb54d49c6f641f68dea4e199f189d97', 'request_id': 'req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:05.437262 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb54d49c6f641f68dea4e199f189d97', 'request_id': 'req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:05.511576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb54d49c6f641f68dea4e199f189d97', 'request_id': 'req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:05.523960 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] The token cache is being invalidate because project cdb54d49c6f641f68dea4e199f189d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:05.526979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:05.526979 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0e56fb92-cb53-4ba1-9e60-1e7675ea16e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:05.526979 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4335/8673] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:05 2022] DELETE /identity/v3/projects/cdb54d49c6f641f68dea4e199f189d97 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:05.531523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b492ee-dda4-4a04-921d-edce422d26a0 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:05.531807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b492ee-dda4-4a04-921d-edce422d26a0 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:05.532074 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b492ee-dda4-4a04-921d-edce422d26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:05.552762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-28b492ee-dda4-4a04-921d-edce422d26a0 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:05.553888 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-28b492ee-dda4-4a04-921d-edce422d26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:05.570789 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:05.612192 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4339/8674] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:05.624520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e8c1-7508-4633-bb5b-ea540b72713d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:05.624802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e8c1-7508-4633-bb5b-ea540b72713d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:05.625070 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e8c1-7508-4633-bb5b-ea540b72713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:05.645493 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-28a1e8c1-7508-4633-bb5b-ea540b72713d None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:05.646846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-28a1e8c1-7508-4633-bb5b-ea540b72713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:05.654779 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4336/8675] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:05.659103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b492ee-dda4-4a04-921d-edce422d26a0 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:05.668875 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b492ee-dda4-4a04-921d-edce422d26a0 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:05.673495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:05.675347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:05.675347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:05.675347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:05.675347 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:05.675710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:05.677264 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:05.689021 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4340/8676] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 02:18:05.693520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1e8c1-7508-4633-bb5b-ea540b72713d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:05.703320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1e8c1-7508-4633-bb5b-ea540b72713d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:05.708161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:05.708756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:05.709031 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:05.709341 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:05.709968 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:05.711862 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:05.791670 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4337/8677] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:05 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:05.796021 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:05.805961 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7845-b3a5-4209-bc8a-78250f7039aa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:05.862519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:05.863116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:05.863388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:05.863712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:05.864333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:05.866244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:06.003195 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4341/8678] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:05 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:06.007321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:06.017506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5dcf4-143d-4956-9ec2-000d59f9a4dc admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:06.022174 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:06.022785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:06.023064 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:06.023340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:06.024016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:06.025644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:06.035359 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4338/8679] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:18:06.039214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:06.049319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128996-f12f-49ab-8120-f5f566c341d8 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:06.053835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4e99-4a22-4461-9b1e-04c8cf62238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:06.054442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4e99-4a22-4461-9b1e-04c8cf62238d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:06.054714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4e99-4a22-4461-9b1e-04c8cf62238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:06.054979 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4e99-4a22-4461-9b1e-04c8cf62238d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:06.055605 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a4e99-4a22-4461-9b1e-04c8cf62238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:06.057274 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a4e99-4a22-4461-9b1e-04c8cf62238d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:06.068108 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4342/8680] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:18:06.072197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:06.081919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae49f64-5d2d-45db-be78-84022d78606a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:06.086602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:06.087245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:06.087519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:06.087792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] PATH_INFO: `/v3/projects/9f25d645620e4cdc9e9fa6347428c686/users/9374f8db84eb44aa92afc937be1417cb/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:06.102101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f25d645620e4cdc9e9fa6347428c686, user_id=9374f8db84eb44aa92afc937be1417cb, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:06.104725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:06.208211 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4339/8681] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:06 2022] PUT /identity/v3/projects/9f25d645620e4cdc9e9fa6347428c686/users/9374f8db84eb44aa92afc937be1417cb/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:06.219640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a890-8382-43a2-95a9-39018dbc42df None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:06.219919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a890-8382-43a2-95a9-39018dbc42df None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:06.220187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a890-8382-43a2-95a9-39018dbc42df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:06.248350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-74b0a890-8382-43a2-95a9-39018dbc42df None None] MFA Rules not processed for user `9374f8db84eb44aa92afc937be1417cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:06.249561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-74b0a890-8382-43a2-95a9-39018dbc42df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:06.311319 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4343/8682] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:06.321610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:06.323374 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:06.345408 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:06.379675 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d821-7ca5-4750-994f-3ff3572b641e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:06.383464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13399821-1a02-4c8a-9a80-da83edc0edbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:06.384109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13399821-1a02-4c8a-9a80-da83edc0edbe service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:06.384627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13399821-1a02-4c8a-9a80-da83edc0edbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:06.385056 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13399821-1a02-4c8a-9a80-da83edc0edbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:06.394219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13399821-1a02-4c8a-9a80-da83edc0edbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:06.399210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13399821-1a02-4c8a-9a80-da83edc0edbe service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:06.404574 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4340/8683] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:12.688821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a890-8382-43a2-95a9-39018dbc42df None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:12.708218 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:12.751134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a890-8382-43a2-95a9-39018dbc42df None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:12.755570 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:12.756195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:12.756471 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:12.756749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] PATH_INFO: `/v3/users/9374f8db84eb44aa92afc937be1417cb` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:12.757863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9374f8db84eb44aa92afc937be1417cb)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:12.759786 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:12.895290 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9374f8db84eb44aa92afc937be1417cb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.902317 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9374f8db84eb44aa92afc937be1417cb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.902985 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9374f8db84eb44aa92afc937be1417cb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.961992 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9374f8db84eb44aa92afc937be1417cb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.962643 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9374f8db84eb44aa92afc937be1417cb'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:12.981190 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4344/8684] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:18:12 2022] DELETE /identity/v3/users/9374f8db84eb44aa92afc937be1417cb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:12.986335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:12.986822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:12.986945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.006955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:13.008161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:13.068675 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4341/8685] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:13.078438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:13.079908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:13.136860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14eb6e-3171-4a1b-8418-7c5699bb4f58 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:13.140519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7332c-d3c2-4ab4-b7e3-07dd1ffda9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:13.141121 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7332c-d3c2-4ab4-b7e3-07dd1ffda9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.141398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7332c-d3c2-4ab4-b7e3-07dd1ffda9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.141670 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7332c-d3c2-4ab4-b7e3-07dd1ffda9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.150748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7332c-d3c2-4ab4-b7e3-07dd1ffda9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:13.152372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7332c-d3c2-4ab4-b7e3-07dd1ffda9a4 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:13.162446 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4345/8686] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:13.398402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:13.399858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:13.412495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e42b-6a99-475c-a28c-bc3e016734a3 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:13.417283 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:13.417915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.418224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.418492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] PATH_INFO: `/v3/projects/9f25d645620e4cdc9e9fa6347428c686` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.419606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f25d645620e4cdc9e9fa6347428c686)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:13.421552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:13.523586 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f25d645620e4cdc9e9fa6347428c686', 'request_id': 'req-71aab0ba-12a4-47fd-8649-8f1e29cd2427'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.529096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f25d645620e4cdc9e9fa6347428c686', 'request_id': 'req-71aab0ba-12a4-47fd-8649-8f1e29cd2427'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.613718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f25d645620e4cdc9e9fa6347428c686', 'request_id': 'req-71aab0ba-12a4-47fd-8649-8f1e29cd2427'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.625612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] The token cache is being invalidate because project 9f25d645620e4cdc9e9fa6347428c686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:18:13.625897 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.626617 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-71aab0ba-12a4-47fd-8649-8f1e29cd2427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:18:13.628174 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4342/8687] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:18:13 2022] DELETE /identity/v3/projects/9f25d645620e4cdc9e9fa6347428c686 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:13.633419 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5278-5bab-45f3-8818-d4fa129db67b None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.633706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5278-5bab-45f3-8818-d4fa129db67b None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.633993 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5278-5bab-45f3-8818-d4fa129db67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.653658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-123f5278-5bab-45f3-8818-d4fa129db67b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:13.655579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-123f5278-5bab-45f3-8818-d4fa129db67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:13.688645 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:13.713535 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4346/8688] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:13.721779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a8aa-edbd-4922-90e8-56db057522fd None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.722114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a8aa-edbd-4922-90e8-56db057522fd None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.722387 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a8aa-edbd-4922-90e8-56db057522fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.742309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9943a8aa-edbd-4922-90e8-56db057522fd None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:13.743554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9943a8aa-edbd-4922-90e8-56db057522fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:13.751860 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4343/8689] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:13.756158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f5278-5bab-45f3-8818-d4fa129db67b None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:13.766487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f5278-5bab-45f3-8818-d4fa129db67b None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:13.771207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:13.771796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.772117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.772653 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.773515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:18:13.774203 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:13.775738 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:13.786994 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4347/8690] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:18:13.791203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a8aa-edbd-4922-90e8-56db057522fd None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:13.800353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a8aa-edbd-4922-90e8-56db057522fd None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:13.805009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:13.805605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.805886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.806192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.806819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:13.808739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:13.877810 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4344/8691] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:13 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:13.881780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:13.892535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c235d04-3292-4a49-949e-9cc6aba416c0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:13.945716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:13.946339 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:13.946621 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:13.946889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:13.947509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:13.949379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.007627 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4348/8692] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:13 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:14.011741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.022659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e36f-c87c-4e8a-a107-abc88804f34a admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.027367 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.027912 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.028186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.028454 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.029084 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.030709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.040460 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4345/8693] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:14.044357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.054638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e28952-b54e-44e6-a967-cd5f996bd8aa admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.059064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7bfbd-ff29-417d-a710-97a06c1bb47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.060090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7bfbd-ff29-417d-a710-97a06c1bb47e admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.060090 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7bfbd-ff29-417d-a710-97a06c1bb47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.060291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7bfbd-ff29-417d-a710-97a06c1bb47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.060796 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7bfbd-ff29-417d-a710-97a06c1bb47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.062933 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7bfbd-ff29-417d-a710-97a06c1bb47e admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.074515 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4349/8694] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:14.079316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.089208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d27f3-aecc-497a-b7cb-e2c02a0364af admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.094008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.094653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.094946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.095203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] PATH_INFO: `/v3/projects/6ed1446559e0468399a0e47775c47baa/users/c950bbf395604092937f0800037da97f/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.097377 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:14.111413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed1446559e0468399a0e47775c47baa, user_id=c950bbf395604092937f0800037da97f, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.114208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.191260 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4346/8695] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:14 2022] PUT /identity/v3/projects/6ed1446559e0468399a0e47775c47baa/users/c950bbf395604092937f0800037da97f/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:14.196525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46589-1251-42eb-8d65-86eb9636bb69 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.196835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46589-1251-42eb-8d65-86eb9636bb69 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.197139 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46589-1251-42eb-8d65-86eb9636bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.215699 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6ae46589-1251-42eb-8d65-86eb9636bb69 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:14.217140 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6ae46589-1251-42eb-8d65-86eb9636bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:14.274170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4350/8696] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:14.283737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:14.285483 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:14.340513 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33646bc2-f0ab-409c-aac1-a8f1332f38b5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:14.344375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:14.344972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:14.345248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:14.345517 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:14.354180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:14.355573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:14.365240 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4347/8697] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:19.502795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa879-268c-4ad2-b98b-c7527af62681 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.503666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa879-268c-4ad2-b98b-c7527af62681 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.503938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa879-268c-4ad2-b98b-c7527af62681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.534226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-099fa879-268c-4ad2-b98b-c7527af62681 None None] MFA Rules not processed for user `c950bbf395604092937f0800037da97f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:19.535696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-099fa879-268c-4ad2-b98b-c7527af62681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:19.572176 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:19.603934 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4351/8698] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:19.608550 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:19.618949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8a946-6fe8-4a94-b1e5-91466615e7bf service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:19.623780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:19.626246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.626246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.626246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.626246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:19.627576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:19.719725 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4348/8699] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:18:19 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:19.722224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa879-268c-4ad2-b98b-c7527af62681 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:19.733618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa879-268c-4ad2-b98b-c7527af62681 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:19.794919 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:19.795649 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.795922 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.796189 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.796817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:19.798741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:19.882998 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4352/8700] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:18:19 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:18:19.886905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:19.898369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce4641-58fd-4c5c-a5d7-586048eb1d39 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:19.903234 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:19.903848 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.904122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.904388 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.905094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:19.906726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:19.918481 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4349/8701] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:18:19.922749 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:19.933686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb54d-af40-449b-b4ea-ff21c9b4c46b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:19.939255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:19.939930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:19.940210 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:19.940485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] PATH_INFO: `/v3/projects/27d38810820c41fb81dec3bd8dfe55ee/users/f4076f34f15d44eba7a7c5cd2fca8723/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:19.957149 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d38810820c41fb81dec3bd8dfe55ee, user_id=f4076f34f15d44eba7a7c5cd2fca8723, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:19.959750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.025466 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4353/8702] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:19 2022] PUT /identity/v3/projects/27d38810820c41fb81dec3bd8dfe55ee/users/f4076f34f15d44eba7a7c5cd2fca8723/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:18:20.029712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.040196 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286c2d5-e17b-4708-ad60-16a8ebbd862e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.100059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0e5d6-11f6-4925-9e4a-47b0e451656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.100676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e5d6-11f6-4925-9e4a-47b0e451656c admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.100952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e5d6-11f6-4925-9e4a-47b0e451656c admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.101220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e5d6-11f6-4925-9e4a-47b0e451656c admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.101858 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e5d6-11f6-4925-9e4a-47b0e451656c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.103489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e5d6-11f6-4925-9e4a-47b0e451656c admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.114222 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4350/8703] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:18:20.118708 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:20.130046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58c966-728e-4b77-8576-ba10e962ed8c admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:20.134994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:20.135692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:20.135966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:20.136250 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] PATH_INFO: `/v3/projects/27d38810820c41fb81dec3bd8dfe55ee/users/f4076f34f15d44eba7a7c5cd2fca8723/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:20.138246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d38810820c41fb81dec3bd8dfe55ee, user_id=f4076f34f15d44eba7a7c5cd2fca8723, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:20.140945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:20.151834 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4354/8704] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:18:20 2022] PUT /identity/v3/projects/27d38810820c41fb81dec3bd8dfe55ee/users/f4076f34f15d44eba7a7c5cd2fca8723/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:18:25.223231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668f39f-5d49-410b-a0ff-b6a7edfb26c3 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:25.223820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668f39f-5d49-410b-a0ff-b6a7edfb26c3 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:25.223820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668f39f-5d49-410b-a0ff-b6a7edfb26c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:25.252606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-0668f39f-5d49-410b-a0ff-b6a7edfb26c3 None None] MFA Rules not processed for user `f4076f34f15d44eba7a7c5cd2fca8723`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:25.253920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0668f39f-5d49-410b-a0ff-b6a7edfb26c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:25.293202 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:25.323934 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4351/8705] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:18:25.342836 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:25.344637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:25.425220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36060b45-f793-4b34-a682-feb07ee66f08 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:25.430834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:25.431451 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:25.431726 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:25.431997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:25.460559 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:25.497851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:25.502838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:25.508941 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4355/8706] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:25.675699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:25.675983 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:25.676259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:25.696866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] MFA Rules not processed for user `c950bbf395604092937f0800037da97f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:18:25.698106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:25.705067 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4352/8707] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:18:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:18:26.426740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:26.428296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:26.516029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f4a9b-0ebb-4481-81eb-94147f47ea7b service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:26.521242 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:26.521886 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:26.522195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:26.522464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:26.524220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:26.536232 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:26.537818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:26.548502 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4356/8708] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:35.691098 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=15 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:36.543672 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=48 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:40.522780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:40.524195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:40.579369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c337f-bd60-4b55-aa5d-cad47e9e4449 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:40.582950 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:40.583548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:40.583823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:40.584089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:40.592944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:40.594404 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:40.603506 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4353/8709] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:18:50.599404 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=26 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:56.054752 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:18:56.063764 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b4410-ecdb-44d9-ad4b-af053969a9da service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:18:56.067346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16687d6-84e9-4700-a246-268f83011a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:18:56.067935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16687d6-84e9-4700-a246-268f83011a31 service cinder] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:18:56.068215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16687d6-84e9-4700-a246-268f83011a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:18:56.068487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16687d6-84e9-4700-a246-268f83011a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:18:56.070211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f16687d6-84e9-4700-a246-268f83011a31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:18:56.084314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16687d6-84e9-4700-a246-268f83011a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:18:56.087772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16687d6-84e9-4700-a246-268f83011a31 service cinder] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:18:56.097504 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4357/8710] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:18:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:01.793769 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:01.802211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2a98-91f4-41a0-b8f3-99d5096bb8d5 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:01.805755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5599baadee4192ae45c1891b7f00f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:01.806459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:01.806742 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:01.807016 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:01.808714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:01.822038 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:01.823446 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:01.834832 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4354/8711] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:06.092584 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:09.616144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8189-4415-42e1-a644-302619e78376 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:09.616745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8189-4415-42e1-a644-302619e78376 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:09.616745 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d8189-4415-42e1-a644-302619e78376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:09.635474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b88d8189-4415-42e1-a644-302619e78376 None None] MFA Rules not processed for user `c950bbf395604092937f0800037da97f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:09.636711 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b88d8189-4415-42e1-a644-302619e78376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:09.644033 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4358/8712] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:19:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:10.305732 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:10.317075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff894d-6436-470c-be4d-7beece080d46 service cinder] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:10.322060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d5de-bff6-4565-af4a-a82bd113fd4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:10.322664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d5de-bff6-4565-af4a-a82bd113fd4d service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:10.322942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d5de-bff6-4565-af4a-a82bd113fd4d service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:10.323208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d5de-bff6-4565-af4a-a82bd113fd4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:10.325431 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ffa2d5de-bff6-4565-af4a-a82bd113fd4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:10.337090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d5de-bff6-4565-af4a-a82bd113fd4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:10.338688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d5de-bff6-4565-af4a-a82bd113fd4d service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:10.349497 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4355/8713] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:14.152825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8189-4415-42e1-a644-302619e78376 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:14.154209 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b88d8189-4415-42e1-a644-302619e78376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:14.224213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d8189-4415-42e1-a644-302619e78376 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:14.227953 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:14.228634 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:14.228911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:14.229177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:14.231490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:14.240477 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:14.241877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:14.250288 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4359/8714] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:19:20.345822 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=12 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:24.246129 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=35 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:53.388505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64c9f-e44f-4af1-8b13-0d19170ebaa2 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:53.396014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64c9f-e44f-4af1-8b13-0d19170ebaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:53.396014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64c9f-e44f-4af1-8b13-0d19170ebaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:53.408898 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-b6c64c9f-e44f-4af1-8b13-0d19170ebaa2 None None] MFA Rules not processed for user `c950bbf395604092937f0800037da97f`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:19:53.410144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b6c64c9f-e44f-4af1-8b13-0d19170ebaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:53.416938 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4356/8715] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:19:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:19:57.045386 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:19:57.061335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657847c-5ed1-42bc-afc3-f79424e562d9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:19:57.065027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:19:57.066010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:19:57.066010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:19:57.066221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:19:57.067910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:19:57.088496 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:19:57.090565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:19:57.099010 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4360/8716] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:19:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:20:03.403597 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:04.598784 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64c9f-e44f-4af1-8b13-0d19170ebaa2 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:04.637545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64c9f-e44f-4af1-8b13-0d19170ebaa2 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:04.643166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:04.643767 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:04.644044 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:04.644313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:04.646100 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:04.658496 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:04.660055 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:04.670667 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4357/8717] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:20:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:20:07.095094 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=13 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:14.666327 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=18 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:43.868813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:43.932287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f405-ed04-43d3-9f6b-f8c3e348b90d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:43.936858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:43.937482 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:43.937761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:43.938064 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] PATH_INFO: `/v3/users/c950bbf395604092937f0800037da97f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:43.939187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c950bbf395604092937f0800037da97f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:43.941076 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:44.075903 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c950bbf395604092937f0800037da97f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.082734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c950bbf395604092937f0800037da97f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.083396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c950bbf395604092937f0800037da97f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.136375 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c950bbf395604092937f0800037da97f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.136924 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c950bbf395604092937f0800037da97f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.155550 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4361/8718] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:20:43 2022] DELETE /identity/v3/users/c950bbf395604092937f0800037da97f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:20:44.423827 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:44.435250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4cb01-1756-4623-8817-8d7bf151db19 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:44.491310 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:44.491939 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:44.492213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:44.492482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] PATH_INFO: `/v3/projects/6ed1446559e0468399a0e47775c47baa` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:44.493607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed1446559e0468399a0e47775c47baa)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:44.495577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:44.628173 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed1446559e0468399a0e47775c47baa', 'request_id': 'req-24e76149-5055-45c2-8897-162d32fc0c69'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.633660 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed1446559e0468399a0e47775c47baa', 'request_id': 'req-24e76149-5055-45c2-8897-162d32fc0c69'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.723079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed1446559e0468399a0e47775c47baa', 'request_id': 'req-24e76149-5055-45c2-8897-162d32fc0c69'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.735423 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] The token cache is being invalidate because project 6ed1446559e0468399a0e47775c47baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:20:44.735709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.736340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:44.737826 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4358/8719] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:20:44 2022] DELETE /identity/v3/projects/6ed1446559e0468399a0e47775c47baa => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:20:44.742002 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:44.743392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:44.756618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ffcee-fd53-4cab-9a38-fafc2e145006 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:44.810734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:44.811353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:44.811632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:44.811902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] PATH_INFO: `/v3/users/f4076f34f15d44eba7a7c5cd2fca8723` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:44.813031 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4076f34f15d44eba7a7c5cd2fca8723)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:44.814986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:44.835451 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:44.996239 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4076f34f15d44eba7a7c5cd2fca8723'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.003773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4076f34f15d44eba7a7c5cd2fca8723'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.004502 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4076f34f15d44eba7a7c5cd2fca8723'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.056233 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4076f34f15d44eba7a7c5cd2fca8723'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.056860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b3442edc-c017-41dc-8f89-248f23409372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4076f34f15d44eba7a7c5cd2fca8723'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.075007 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4362/8720] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:20:44 2022] DELETE /identity/v3/users/f4076f34f15d44eba7a7c5cd2fca8723 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:20:45.309768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:45.311233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:45.325941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e76149-5055-45c2-8897-162d32fc0c69 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:45.384880 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:45.385539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:45.385814 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:45.386111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] PATH_INFO: `/v3/projects/27d38810820c41fb81dec3bd8dfe55ee` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:45.387206 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d38810820c41fb81dec3bd8dfe55ee)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:45.389075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:45.474801 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:45.486763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d38810820c41fb81dec3bd8dfe55ee', 'request_id': 'req-349f564b-389e-4023-b37c-169ca5df1c79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.492227 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d38810820c41fb81dec3bd8dfe55ee', 'request_id': 'req-349f564b-389e-4023-b37c-169ca5df1c79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.536676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d38810820c41fb81dec3bd8dfe55ee', 'request_id': 'req-349f564b-389e-4023-b37c-169ca5df1c79'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.547905 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] The token cache is being invalidate because project 27d38810820c41fb81dec3bd8dfe55ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:20:45.548191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.548843 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-349f564b-389e-4023-b37c-169ca5df1c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:20:45.550364 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4359/8721] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:20:45 2022] DELETE /identity/v3/projects/27d38810820c41fb81dec3bd8dfe55ee => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:20:45.555518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eee1f-595b-4c6e-817e-81b23767b738 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:45.555743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eee1f-595b-4c6e-817e-81b23767b738 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:45.556015 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eee1f-595b-4c6e-817e-81b23767b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:45.585254 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-aa4eee1f-595b-4c6e-817e-81b23767b738 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:20:45.586469 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa4eee1f-595b-4c6e-817e-81b23767b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:45.643816 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4363/8722] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:20:45.651729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d727-9c16-4109-a55b-15b4002b3c1b None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:45.652009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d727-9c16-4109-a55b-15b4002b3c1b None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:45.652280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d727-9c16-4109-a55b-15b4002b3c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:45.671918 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-d6a1d727-9c16-4109-a55b-15b4002b3c1b None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:20:45.673101 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-d6a1d727-9c16-4109-a55b-15b4002b3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:45.680777 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4360/8723] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:20:45.684947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eee1f-595b-4c6e-817e-81b23767b738 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:45.694692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eee1f-595b-4c6e-817e-81b23767b738 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:45.699184 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:45.700271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:45.700547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:45.700841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:45.701505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:20:45.701802 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:45.703417 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:45.714610 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4364/8724] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:20:45.719538 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d727-9c16-4109-a55b-15b4002b3c1b None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:45.728526 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d727-9c16-4109-a55b-15b4002b3c1b None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:45.733094 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:45.733677 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:45.733949 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:45.734245 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:45.734872 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:45.736719 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:45.822612 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4361/8725] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:20:45 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:20:45.828134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:45.837907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389b0e2-6ce9-49ff-b066-99a4e6613a9b admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:45.893876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:45.894500 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:45.894777 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:45.895045 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:45.895657 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:45.897532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:45.970652 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4365/8726] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:20:45 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:20:45.974782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:45.985123 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878f7c-0353-43ba-9f7b-eb768e701c23 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:45.989794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:45.990434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:45.990717 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:45.990990 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:45.991628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:45.993235 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:46.003522 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4362/8727] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:20:46.007541 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:46.018134 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85534-b8a4-4534-93c6-91c98d151e09 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:46.022807 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125a8e5-70c3-4c05-902c-dbb4aff574af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:46.023399 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125a8e5-70c3-4c05-902c-dbb4aff574af admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:46.023677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125a8e5-70c3-4c05-902c-dbb4aff574af admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:46.023951 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125a8e5-70c3-4c05-902c-dbb4aff574af admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:46.024586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125a8e5-70c3-4c05-902c-dbb4aff574af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:46.026213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125a8e5-70c3-4c05-902c-dbb4aff574af admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:46.027455 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:46.037205 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4366/8728] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:20:46.041309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:46.051232 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bdff5-9aa9-4fdd-8314-0fbe4e7c0f77 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:46.055800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:46.056444 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:46.056721 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:46.056999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] PATH_INFO: `/v3/projects/dd9a5526b8c7450a9227d266ecf33487/users/722e7b72a173401fa175378ab373c26e/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:46.071699 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9a5526b8c7450a9227d266ecf33487, user_id=722e7b72a173401fa175378ab373c26e, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:46.077362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:46.177051 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4363/8729] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:20:46 2022] PUT /identity/v3/projects/dd9a5526b8c7450a9227d266ecf33487/users/722e7b72a173401fa175378ab373c26e/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:20:46.182257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be37b-e797-4454-82b7-ba57b955458c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:46.182761 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be37b-e797-4454-82b7-ba57b955458c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:46.183265 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be37b-e797-4454-82b7-ba57b955458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:46.203135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-2f9be37b-e797-4454-82b7-ba57b955458c None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:20:46.204376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2f9be37b-e797-4454-82b7-ba57b955458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:46.263463 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4367/8730] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:20:46.273099 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:46.274819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:46.331413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ef13-e94e-4c76-a630-26f75611062b admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:46.335051 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:46.335658 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:46.335938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:46.336207 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:46.345481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:46.346963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:46.356922 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4364/8731] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:20:51.399240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614422f-ba66-4e38-9e1d-96cf7cfc01d1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:51.399687 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614422f-ba66-4e38-9e1d-96cf7cfc01d1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:51.399785 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614422f-ba66-4e38-9e1d-96cf7cfc01d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:51.433068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-3614422f-ba66-4e38-9e1d-96cf7cfc01d1 None None] MFA Rules not processed for user `722e7b72a173401fa175378ab373c26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:20:51.434355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-3614422f-ba66-4e38-9e1d-96cf7cfc01d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:51.511391 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4368/8732] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:20:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:20:51.516645 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:51.526696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e0ef-074f-495f-ab76-bd10b4affd4a service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:51.532248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:51.532865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:51.533145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:51.533421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:51.534190 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:51.535998 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:51.613340 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4365/8733] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:20:51 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:20:51.617405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614422f-ba66-4e38-9e1d-96cf7cfc01d1 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:51.628864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614422f-ba66-4e38-9e1d-96cf7cfc01d1 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:51.687187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:51.687813 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:51.688094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:51.688367 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:51.689037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:51.690997 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:51.776187 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4369/8734] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:20:51 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:20:51.781045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:51.792371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272694f-00ba-4261-90ad-d1c2379a13d0 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:51.797161 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:51.797780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:51.798106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:51.798378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:51.799021 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:51.800640 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:51.812116 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4366/8735] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:20:51.816490 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:51.827774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664d55-b3fc-49c1-92ae-7419cf80ecaf admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:51.832914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:51.833580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:51.833854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:51.834151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] PATH_INFO: `/v3/projects/8463b34058ce4362ad360714fd7e398b/users/2ac23caa7b3549c68b9325e44b4255ff/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:51.848342 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:51.851377 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8463b34058ce4362ad360714fd7e398b, user_id=2ac23caa7b3549c68b9325e44b4255ff, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:51.854044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:51.943187 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4370/8736] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:20:51 2022] PUT /identity/v3/projects/8463b34058ce4362ad360714fd7e398b/users/2ac23caa7b3549c68b9325e44b4255ff/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:20:51.947484 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:51.958647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83d8e7-9d99-4b09-9f1d-9e5cab5d5886 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:51.982549 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:52.015555 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ec9b-12db-4769-a155-0076e1ebe6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:52.016102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ec9b-12db-4769-a155-0076e1ebe6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:52.016382 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ec9b-12db-4769-a155-0076e1ebe6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:52.016654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ec9b-12db-4769-a155-0076e1ebe6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:52.017284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638ec9b-12db-4769-a155-0076e1ebe6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:52.018951 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638ec9b-12db-4769-a155-0076e1ebe6e3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:52.028722 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4367/8737] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:20:52.033101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:52.043479 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad785d0c-fd9b-48e2-85fd-0db8ff9a7379 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:52.048187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:52.048834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:52.049105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:52.049373 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] PATH_INFO: `/v3/projects/8463b34058ce4362ad360714fd7e398b/users/2ac23caa7b3549c68b9325e44b4255ff/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:52.051512 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8463b34058ce4362ad360714fd7e398b, user_id=2ac23caa7b3549c68b9325e44b4255ff, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:52.054223 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:52.065195 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4371/8738] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:20:52 2022] PUT /identity/v3/projects/8463b34058ce4362ad360714fd7e398b/users/2ac23caa7b3549c68b9325e44b4255ff/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:20:57.433059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60048-3789-4eb2-a83b-1bf71d971b09 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:57.433708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60048-3789-4eb2-a83b-1bf71d971b09 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:57.433708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60048-3789-4eb2-a83b-1bf71d971b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:57.464188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-3cf60048-3789-4eb2-a83b-1bf71d971b09 None None] MFA Rules not processed for user `2ac23caa7b3549c68b9325e44b4255ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:20:57.465955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3cf60048-3789-4eb2-a83b-1bf71d971b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:57.540477 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4368/8739] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:20:57.573937 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:57.576767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:57.657955 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51016e21-b98d-491f-9246-b295cccfec6f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:57.661632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11143bd0-9210-486d-a75b-62d56cd2b1f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:57.662270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143bd0-9210-486d-a75b-62d56cd2b1f1 service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:57.662548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143bd0-9210-486d-a75b-62d56cd2b1f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:57.662818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143bd0-9210-486d-a75b-62d56cd2b1f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:57.719556 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11143bd0-9210-486d-a75b-62d56cd2b1f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:57.721143 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11143bd0-9210-486d-a75b-62d56cd2b1f1 service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:57.732200 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4372/8740] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:20:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:20:58.041459 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59726d2-06c4-4198-aa8e-1048a01c56f7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:58.042144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59726d2-06c4-4198-aa8e-1048a01c56f7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:58.042144 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59726d2-06c4-4198-aa8e-1048a01c56f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:58.097785 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-e59726d2-06c4-4198-aa8e-1048a01c56f7 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:20:58.099130 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-e59726d2-06c4-4198-aa8e-1048a01c56f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:58.169851 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4369/8741] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:20:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:20:58.322817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cee7b-6e03-46e6-9559-20b25b2acad1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:58.323105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cee7b-6e03-46e6-9559-20b25b2acad1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:58.323383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cee7b-6e03-46e6-9559-20b25b2acad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:58.395832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fb6cee7b-6e03-46e6-9559-20b25b2acad1 None None] MFA Rules not processed for user `8d2725c03b7e40c39b3db1cd9c45ed71`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:20:58.397297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fb6cee7b-6e03-46e6-9559-20b25b2acad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:20:58.445427 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:58.482486 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4373/8742] 10.222.0.42 () {58 vars in 1040 bytes} [Sun Oct 23 02:20:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:20:58.483600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59726d2-06c4-4198-aa8e-1048a01c56f7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:20:58.497061 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59726d2-06c4-4198-aa8e-1048a01c56f7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:20:58.502163 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e59a25-56a3-420e-93e1-f74271dbf354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:20:58.502779 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e59a25-56a3-420e-93e1-f74271dbf354 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:20:58.503052 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e59a25-56a3-420e-93e1-f74271dbf354 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:20:58.503320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e59a25-56a3-420e-93e1-f74271dbf354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:20:58.513204 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e59a25-56a3-420e-93e1-f74271dbf354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:20:58.514840 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e59a25-56a3-420e-93e1-f74271dbf354 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:20:58.523908 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4370/8743] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:20:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:21:08.490395 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=11 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:08.519982 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:09.058803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16321fc3-bbde-45d9-b98b-cfb7b1764622 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:21:09.059116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16321fc3-bbde-45d9-b98b-cfb7b1764622 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:21:09.059390 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16321fc3-bbde-45d9-b98b-cfb7b1764622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:21:09.079407 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-16321fc3-bbde-45d9-b98b-cfb7b1764622 None None] MFA Rules not processed for user `722e7b72a173401fa175378ab373c26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:21:09.080593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-16321fc3-bbde-45d9-b98b-cfb7b1764622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:21:09.087633 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4374/8744] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:21:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:21:12.503737 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:21:12.504193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:21:12.504289 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:21:12.524932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:21:12.526172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:21:12.533767 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4371/8745] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:21:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:21:12.548286 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16321fc3-bbde-45d9-b98b-cfb7b1764622 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:21:12.561098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16321fc3-bbde-45d9-b98b-cfb7b1764622 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:21:12.566153 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:21:12.566751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:21:12.567027 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:21:12.567314 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:21:12.576379 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:21:12.578055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:21:12.586368 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4375/8746] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:21:21.675394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:21:21.676975 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:21:21.765851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225ca7c-a658-43fc-841a-e33255c54ca9 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:21:21.771285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:21:21.771832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:21:21.772237 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:21:21.772510 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:21:21.774352 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:21:21.786219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:21:21.787770 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:21:21.798584 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4372/8747] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:21:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:21:22.582918 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:31.794068 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=42 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:48.434857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:21:48.436257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:21:48.503546 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397d48-0425-4a26-95b9-436bfed2636a service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:21:48.507082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:21:48.507677 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:21:48.507950 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:21:48.508213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:21:48.516826 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:21:48.518284 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:21:48.527321 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4376/8748] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:21:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:21:50.657762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:21:50.669647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7c98-8882-45f7-9dfd-2d4a56826388 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:21:50.675927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:21:50.676574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:21:50.676926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:21:50.677292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:21:50.679293 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:21:50.692089 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:21:50.693709 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:21:50.705490 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4373/8749] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:21:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:21:58.523225 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=31 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:00.700188 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:41.532511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:22:41.534484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:22:41.613056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b992-3c71-4d27-9f9d-abcdd01dfbd9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:22:41.618007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:22:41.618615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:22:41.618893 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:22:41.619162 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:22:41.620861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:22:41.631700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:22:41.633261 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:22:41.643253 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4377/8750] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:22:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:22:42.098034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:22:42.099868 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:22:42.114060 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d36e-c483-4ca8-8676-da791ae20ca6 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:22:42.119364 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:22:42.121764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:22:42.121764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:22:42.121764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:22:42.122488 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:22:42.134915 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:22:42.136603 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:22:42.147252 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4374/8751] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:22:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:22:51.638900 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=37 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:52.142400 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:41.437176 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:24:41.446346 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287d6d4-b1be-4565-9053-7166e4e8ca84 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:24:41.449925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:24:41.450561 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:24:41.450840 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:24:41.451111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:24:41.452797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:24:41.462770 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:24:41.464179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:24:41.472500 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4378/8752] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:24:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:24:49.980726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:24:49.990342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841b1af-775e-4f39-830a-35cc24522f62 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:24:49.994519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e16d2-31af-46ec-b59f-957f27504f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:24:49.995118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e16d2-31af-46ec-b59f-957f27504f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:24:49.995396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e16d2-31af-46ec-b59f-957f27504f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:24:49.995666 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e16d2-31af-46ec-b59f-957f27504f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:24:49.997395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a01e16d2-31af-46ec-b59f-957f27504f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:24:50.011251 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e16d2-31af-46ec-b59f-957f27504f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:24:50.012654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e16d2-31af-46ec-b59f-957f27504f97 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:24:50.033135 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4375/8753] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:24:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:24:51.468659 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:00.030664 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:02.608057 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:02.616735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360bd5-2855-42e5-a494-aeb1aaf62146 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:02.620769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:02.621353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:02.621626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:02.621895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:02.623596 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:02.637535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:02.638964 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:02.649351 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4379/8754] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:25:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:25:06.222328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8e13-51c4-438d-a2ec-065d2172401a None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:06.222777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8e13-51c4-438d-a2ec-065d2172401a None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:06.222900 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8e13-51c4-438d-a2ec-065d2172401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:06.242378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f81d8e13-51c4-438d-a2ec-065d2172401a None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:25:06.244116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f81d8e13-51c4-438d-a2ec-065d2172401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:06.251208 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4376/8755] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:25:06.291639 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:06.302371 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a5ba4-fc05-48e6-87cd-20e2f8381e84 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:06.307740 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:06.309746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:06.309746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:06.309746 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:06.316636 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:06.318214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:06.326565 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4380/8756] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:25:07.495536 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c2297-3ae8-4cf1-ac68-5f161243c15d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:07.495996 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c2297-3ae8-4cf1-ac68-5f161243c15d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:07.496106 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c2297-3ae8-4cf1-ac68-5f161243c15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:07.515479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-c27c2297-3ae8-4cf1-ac68-5f161243c15d None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:25:07.516673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c27c2297-3ae8-4cf1-ac68-5f161243c15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:07.523793 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4377/8757] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:25:07.536415 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:07.547082 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc14e4c-a8fb-41c3-9c84-477fae4dbc22 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:07.552392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:07.553019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:07.553324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:07.553594 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:07.564260 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:07.566037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:07.575170 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4381/8758] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:25:17.501676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288735d6-3a96-4883-8309-c730fe313f02 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:17.502221 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288735d6-3a96-4883-8309-c730fe313f02 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:17.502355 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288735d6-3a96-4883-8309-c730fe313f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:17.521272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-288735d6-3a96-4883-8309-c730fe313f02 None None] MFA Rules not processed for user `722e7b72a173401fa175378ab373c26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:25:17.522508 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-288735d6-3a96-4883-8309-c730fe313f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:17.530199 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4378/8759] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:25:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:25:17.571105 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=18 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:17.790768 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:17.800197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fc325-0bd5-492f-9783-07dd6fb654af service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:17.803795 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be7306-1575-41ee-99c0-1866d8ec858c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:17.804388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be7306-1575-41ee-99c0-1866d8ec858c service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:17.804661 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be7306-1575-41ee-99c0-1866d8ec858c service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:17.805158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be7306-1575-41ee-99c0-1866d8ec858c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:17.810282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f1be7306-1575-41ee-99c0-1866d8ec858c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:17.816952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be7306-1575-41ee-99c0-1866d8ec858c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:17.818380 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be7306-1575-41ee-99c0-1866d8ec858c service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:17.826517 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4382/8760] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:25:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:25:18.233851 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288735d6-3a96-4883-8309-c730fe313f02 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:18.246466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288735d6-3a96-4883-8309-c730fe313f02 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:18.251521 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:18.252208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:18.252548 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:18.252879 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:18.254741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:18.267492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:18.269033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:18.284100 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4379/8761] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:25:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:25:21.047022 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2fb9-c485-4ebd-af62-c58ac88b9b23 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:21.047535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2fb9-c485-4ebd-af62-c58ac88b9b23 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:21.047652 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2fb9-c485-4ebd-af62-c58ac88b9b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:21.068615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-43ed2fb9-c485-4ebd-af62-c58ac88b9b23 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:25:21.069858 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-43ed2fb9-c485-4ebd-af62-c58ac88b9b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:21.077849 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4383/8762] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:25:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:25:21.090917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:21.102197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be102-3f12-4a70-a016-15e8acaf59b0 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:21.107309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:21.107933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:21.108210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:21.108479 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:21.117332 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:21.118955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:21.128067 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4380/8763] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:25:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:25:29.005572 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed2fb9-c485-4ebd-af62-c58ac88b9b23 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:29.014756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed2fb9-c485-4ebd-af62-c58ac88b9b23 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:29.018547 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:29.019160 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:29.019438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:29.019704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:29.021534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:29.030968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:29.032385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:29.039997 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4384/8764] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:25:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:25:31.124612 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=21 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:36.014780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:36.026530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a85d23-9e3c-4a54-8a5f-389a78d1973b service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:36.032361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:36.035552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:36.035552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:36.035552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:36.035552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:25:36.047321 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:36.048916 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:36.059306 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4381/8765] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:25:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:25:39.036587 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=15 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:46.054974 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:57.495938 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:25:57.504475 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cda930-7c33-4aca-821a-3506d0f64011 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:25:57.508037 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:25:57.508624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:25:57.508895 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:25:57.509166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:25:57.517604 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:25:57.518986 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:25:57.527628 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4385/8766] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:25:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:26:07.523571 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:58.726689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:26:58.728757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:26:58.744524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db75059-b972-49be-8291-cdca3734e46e service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:26:58.757098 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652c0e0-396a-4c43-97b7-e9a9ca43478b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:26:58.757745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652c0e0-396a-4c43-97b7-e9a9ca43478b service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:26:58.758247 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652c0e0-396a-4c43-97b7-e9a9ca43478b service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:26:58.758528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652c0e0-396a-4c43-97b7-e9a9ca43478b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:26:58.775834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652c0e0-396a-4c43-97b7-e9a9ca43478b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:26:58.775834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652c0e0-396a-4c43-97b7-e9a9ca43478b service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:26:58.786608 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4382/8767] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:26:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:08.779838 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:11.881588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:11.894645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4592-be66-4521-a588-6396ddeb484b service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:11.900280 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:11.900879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:11.901156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:11.901424 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:11.910591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:11.915591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:11.922696 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4386/8768] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:14.115375 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3445-ec51-4689-8e84-dd8bb7f7db54 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:14.118452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3445-ec51-4689-8e84-dd8bb7f7db54 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:14.118452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3445-ec51-4689-8e84-dd8bb7f7db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:14.145644 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-a7ba3445-ec51-4689-8e84-dd8bb7f7db54 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:27:14.146859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a7ba3445-ec51-4689-8e84-dd8bb7f7db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:14.153920 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4383/8769] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 02:27:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:27:14.193808 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:14.205275 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615ffa5-5068-4f0d-b3f9-6afd9ddb855e service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:14.210353 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:14.210939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:14.211216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:14.211486 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:14.219340 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:14.220827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:14.228886 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4387/8770] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:27:15.080953 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3445-ec51-4689-8e84-dd8bb7f7db54 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:15.099646 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3445-ec51-4689-8e84-dd8bb7f7db54 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:15.103417 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:15.104009 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:15.104282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:15.104549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:15.172656 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:15.174648 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:15.192797 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4384/8771] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:27:18.744474 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:18.765174 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4e682-0676-4fe2-a278-24b891306642 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:18.770508 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:18.771103 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:18.771376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:18.771644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:18.773357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:18.786299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:18.787911 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:18.798683 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4388/8772] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:22.334702 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:22.346157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5cfa0-d790-414c-b1eb-c18c8d02e29e service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:22.351195 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:22.352075 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:22.352350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:22.352627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:22.354380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:22.365926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:22.371655 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:22.378338 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4385/8773] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:22.447923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:22.462221 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746533-005f-497e-ad4d-bb587843ad24 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:22.464194 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:22.464821 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:22.465228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:22.465506 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] PATH_INFO: `/v3/users/722e7b72a173401fa175378ab373c26e` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:22.466638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=722e7b72a173401fa175378ab373c26e)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:22.468568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:22.665442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722e7b72a173401fa175378ab373c26e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:22.672240 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722e7b72a173401fa175378ab373c26e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:22.673427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722e7b72a173401fa175378ab373c26e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:22.745891 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722e7b72a173401fa175378ab373c26e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:22.746533 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722e7b72a173401fa175378ab373c26e'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:22.764431 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4389/8774] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:27:22 2022] DELETE /identity/v3/users/722e7b72a173401fa175378ab373c26e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:27:23.015826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:23.029096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041105a-8686-42b7-bd2c-897c93b51e0d service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:23.088931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:23.089557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:23.089836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:23.090147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] PATH_INFO: `/v3/projects/dd9a5526b8c7450a9227d266ecf33487` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:23.091248 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9a5526b8c7450a9227d266ecf33487)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:23.093150 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:23.177563 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:23.183618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9a5526b8c7450a9227d266ecf33487', 'request_id': 'req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.188981 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9a5526b8c7450a9227d266ecf33487', 'request_id': 'req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.239919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9a5526b8c7450a9227d266ecf33487', 'request_id': 'req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.263752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] The token cache is being invalidate because project dd9a5526b8c7450a9227d266ecf33487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:27:23.263970 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.264589 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.266066 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4386/8775] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:27:23 2022] DELETE /identity/v3/projects/dd9a5526b8c7450a9227d266ecf33487 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:27:23.270101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:23.271597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:23.284743 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f01b6-afb2-4579-a8ac-d77751054fba admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:23.339156 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:23.339778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:23.340051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:23.340319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] PATH_INFO: `/v3/users/2ac23caa7b3549c68b9325e44b4255ff` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:23.341431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac23caa7b3549c68b9325e44b4255ff)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:23.343341 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:23.441229 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:23.541565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac23caa7b3549c68b9325e44b4255ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.548811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac23caa7b3549c68b9325e44b4255ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.549759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac23caa7b3549c68b9325e44b4255ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.617519 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac23caa7b3549c68b9325e44b4255ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.618168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f3c379c7-9f6c-4df7-a31e-a4eccf2e9bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac23caa7b3549c68b9325e44b4255ff'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:23.636553 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4390/8776] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:27:23 2022] DELETE /identity/v3/users/2ac23caa7b3549c68b9325e44b4255ff => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:27:23.884882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:23.886384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:23.900670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8dad9-10c1-4c72-b3a3-90253efb57cd admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:23.957581 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:23.958238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:23.958511 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:23.958776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] PATH_INFO: `/v3/projects/8463b34058ce4362ad360714fd7e398b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:23.959899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8463b34058ce4362ad360714fd7e398b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:23.961755 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:24.072323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8463b34058ce4362ad360714fd7e398b', 'request_id': 'req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:24.077693 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8463b34058ce4362ad360714fd7e398b', 'request_id': 'req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:24.134733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8463b34058ce4362ad360714fd7e398b', 'request_id': 'req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:24.147361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] The token cache is being invalidate because project 8463b34058ce4362ad360714fd7e398b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:27:24.147653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:24.148286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-8d0947e8-f8a9-4cc8-996c-530ddc9b4b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:27:24.149785 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4387/8777] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:27:23 2022] DELETE /identity/v3/projects/8463b34058ce4362ad360714fd7e398b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:27:24.155001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e66f-7c76-405c-9048-39eca3627287 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.155282 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e66f-7c76-405c-9048-39eca3627287 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.155554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e66f-7c76-405c-9048-39eca3627287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.202381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-1477e66f-7c76-405c-9048-39eca3627287 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:27:24.203574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1477e66f-7c76-405c-9048-39eca3627287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:24.261082 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4391/8778] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:27:24.268768 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5e9a-6bd1-4246-8482-faa978382723 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.269058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5e9a-6bd1-4246-8482-faa978382723 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.269334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5e9a-6bd1-4246-8482-faa978382723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.288754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8c5b5e9a-6bd1-4246-8482-faa978382723 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:27:24.289935 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8c5b5e9a-6bd1-4246-8482-faa978382723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:24.298271 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4388/8779] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:27:24.302333 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477e66f-7c76-405c-9048-39eca3627287 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:24.311662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477e66f-7c76-405c-9048-39eca3627287 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:24.316766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:24.317355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.317629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.317896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.318577 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81936) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:27:24.318874 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:24.320439 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:24.331876 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4392/8780] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:27:24.336157 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b5e9a-6bd1-4246-8482-faa978382723 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:24.345453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b5e9a-6bd1-4246-8482-faa978382723 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:24.350129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:24.350754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.351033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.351560 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.352177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:24.354073 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:24.447231 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4389/8781] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:27:24 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:27:24.451578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:24.461901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140ecff-1b48-41ac-a271-d188ec923de4 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:24.518169 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:24.518778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.519056 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.519324 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.519952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:24.521841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:24.612381 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:24.618280 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4393/8782] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:27:24 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:27:24.622421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:24.632605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5cbc-54b6-406e-959c-bfb8189bc235 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:24.637148 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:24.637745 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.638122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.638397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.639122 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:24.640696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:24.645982 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:24.650861 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4390/8783] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:27:24.654590 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:24.664673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a167b-7736-46d6-8fa1-03c5fc404fb7 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:24.669703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121426ee-8e93-479c-8d3d-060edcabbda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:24.670327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121426ee-8e93-479c-8d3d-060edcabbda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.670606 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121426ee-8e93-479c-8d3d-060edcabbda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.670876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121426ee-8e93-479c-8d3d-060edcabbda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.671504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121426ee-8e93-479c-8d3d-060edcabbda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:24.673727 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121426ee-8e93-479c-8d3d-060edcabbda8 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:24.684097 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4394/8784] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:27:24.688268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:24.698427 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a71a-02a4-4916-984d-6a2fe858e8ad admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:24.703319 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:24.703964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.704244 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.707902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] PATH_INFO: `/v3/projects/028ee2f0bfd246d0a4abebdcbea26588/users/e44ce41e0ba0434a91710af395b8af29/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.718729 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028ee2f0bfd246d0a4abebdcbea26588, user_id=e44ce41e0ba0434a91710af395b8af29, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:24.721830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:24.808989 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4391/8785] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:27:24 2022] PUT /identity/v3/projects/028ee2f0bfd246d0a4abebdcbea26588/users/e44ce41e0ba0434a91710af395b8af29/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:27:24.820426 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1062-8dc1-4692-bcc3-be20a398f753 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.820712 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1062-8dc1-4692-bcc3-be20a398f753 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.820982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1062-8dc1-4692-bcc3-be20a398f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.849338 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-103a1062-8dc1-4692-bcc3-be20a398f753 None None] MFA Rules not processed for user `e44ce41e0ba0434a91710af395b8af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:27:24.850582 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-103a1062-8dc1-4692-bcc3-be20a398f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:24.913953 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4395/8786] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:27:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:27:24.918502 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:24.981944 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f161ea-7467-4d16-8b14-48cbf77f2130 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:24.986670 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:24.987275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:24.987554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:24.987825 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] PATH_INFO: `/v3/projects` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:24.988447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:24.990587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:25.105633 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4392/8787] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:27:24 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:27:25.109527 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1062-8dc1-4692-bcc3-be20a398f753 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:25.120132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1062-8dc1-4692-bcc3-be20a398f753 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:25.176130 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:25.176730 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:25.177006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:25.177276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:25.177912 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:25.179829 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:25.269403 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4396/8788] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:27:25 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:27:25.273819 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:25.284973 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1864d16-089c-4fbf-9ffc-1d9b3abd731e admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:25.289673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:25.290307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:25.290587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:25.290886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:25.291518 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:25.293085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:25.303362 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4393/8789] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:27:25.307464 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:25.317735 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f294699-593f-4214-9a2e-ad19f1bd15e5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:25.322256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:25.322892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:25.323167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:25.323434 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] PATH_INFO: `/v3/projects/baf8689565db4d239a516ada0f26a514/users/2d7c1d92410843d098c595ab1fe32269/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:25.338623 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf8689565db4d239a516ada0f26a514, user_id=2d7c1d92410843d098c595ab1fe32269, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:25.341228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:25.405491 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4397/8790] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:27:25 2022] PUT /identity/v3/projects/baf8689565db4d239a516ada0f26a514/users/2d7c1d92410843d098c595ab1fe32269/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:27:25.409373 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:25.419412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6492e-24ee-43bd-aaff-310d1d6a4e89 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:25.474188 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec37477-0d53-41dd-812d-fe54664d28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:25.474798 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37477-0d53-41dd-812d-fe54664d28b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:25.475072 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37477-0d53-41dd-812d-fe54664d28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:25.475339 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37477-0d53-41dd-812d-fe54664d28b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:25.475967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec37477-0d53-41dd-812d-fe54664d28b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:25.477804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec37477-0d53-41dd-812d-fe54664d28b6 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:25.488180 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4394/8791] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:27:25.497158 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:25.508131 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506500-2990-49b4-9b7c-648b6fd35a1f admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:25.512662 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:25.513304 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:25.513579 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:25.513848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] PATH_INFO: `/v3/projects/baf8689565db4d239a516ada0f26a514/users/2d7c1d92410843d098c595ab1fe32269/roles/084c71d449aa4c209afa646584a16293` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:25.515812 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf8689565db4d239a516ada0f26a514, user_id=2d7c1d92410843d098c595ab1fe32269, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:25.519073 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:25.529167 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4398/8792] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:27:25 2022] PUT /identity/v3/projects/baf8689565db4d239a516ada0f26a514/users/2d7c1d92410843d098c595ab1fe32269/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:27:25.538800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:25.539086 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:25.539358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:25.567085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] MFA Rules not processed for user `2d7c1d92410843d098c595ab1fe32269`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:27:25.568285 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:25.601060 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:25.634516 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4395/8793] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:27:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:27:25.650747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:25.652432 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:25.683983 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:25.726051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aa3e8-1dcb-422e-91f6-d42b46820991 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:25.731932 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc84601-591e-4c08-8252-59d7c979ac87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:25.732523 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc84601-591e-4c08-8252-59d7c979ac87 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:25.732797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc84601-591e-4c08-8252-59d7c979ac87 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:25.733060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc84601-591e-4c08-8252-59d7c979ac87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:25.787182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc84601-591e-4c08-8252-59d7c979ac87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:25.788681 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc84601-591e-4c08-8252-59d7c979ac87 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:25.797467 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4399/8794] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:30.619463 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:30.620945 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:30.679684 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d13c8-1742-4b04-8810-afda2d4ae83c None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:30.683391 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:30.683933 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:30.684208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:30.684476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:30.694288 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:30.695765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:30.705728 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4396/8795] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:34.075253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946cad-c9ce-4e9d-a880-ca190a146e62 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:34.076199 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946cad-c9ce-4e9d-a880-ca190a146e62 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:34.076537 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946cad-c9ce-4e9d-a880-ca190a146e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:34.100270 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-fb946cad-c9ce-4e9d-a880-ca190a146e62 None None] MFA Rules not processed for user `e44ce41e0ba0434a91710af395b8af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:27:34.101248 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-fb946cad-c9ce-4e9d-a880-ca190a146e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:34.109193 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4400/8796] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:27:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:27:35.958342 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:35.959794 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:36.045252 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34f621-b357-4bff-a48f-831a27c403b6 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:36.050887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:36.051499 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:36.051777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:36.052045 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:36.054065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:36.067191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:36.068895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:36.079616 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4397/8797] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:44.092689 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=46 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:46.074788 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=71 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:48.129115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946cad-c9ce-4e9d-a880-ca190a146e62 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:48.140790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946cad-c9ce-4e9d-a880-ca190a146e62 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:48.146458 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1484227-4e76-4a13-bc56-a739dbb5cc3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:48.147127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1484227-4e76-4a13-bc56-a739dbb5cc3e service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:48.147405 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1484227-4e76-4a13-bc56-a739dbb5cc3e service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:48.147673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1484227-4e76-4a13-bc56-a739dbb5cc3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:48.149385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c1484227-4e76-4a13-bc56-a739dbb5cc3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:48.161552 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1484227-4e76-4a13-bc56-a739dbb5cc3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:48.163159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1484227-4e76-4a13-bc56-a739dbb5cc3e service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:48.173460 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4401/8798] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:48.782220 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:27:48.793780 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049aa59-7efb-4ec5-9f6b-176b0222de27 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:27:48.798948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:27:48.799568 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:27:48.799873 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:27:48.800296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:27:48.802146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:27:48.814938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:27:48.816534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:27:48.827660 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4398/8799] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:27:58.168862 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:27:58.822956 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:28:47.130376 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:28:47.131435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:28:47.131435 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:28:47.151571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] MFA Rules not processed for user `e44ce41e0ba0434a91710af395b8af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:28:47.152778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:28:47.160018 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4402/8800] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:28:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:28:57.145687 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:29:50.507941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:29:50.520134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f9f0d-45db-47e3-9a21-69888353cb3c service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:29:50.523955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:29:50.524557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:29:50.524856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:29:50.525129 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:29:50.526890 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:29:50.550268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:29:50.551679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:29:50.562956 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4399/8801] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:29:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:30:00.558175 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=12 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:29.304335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:30:29.307944 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:30:29.346926 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98156ac4-495f-4eef-850b-3cf04b8efc60 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:30:29.351213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea5515-dfe2-44b1-8f1f-1810f2eafeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:30:29.351818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5515-dfe2-44b1-8f1f-1810f2eafeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:30:29.352101 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5515-dfe2-44b1-8f1f-1810f2eafeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:30:29.352365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5515-dfe2-44b1-8f1f-1810f2eafeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:30:29.354645 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-27ea5515-dfe2-44b1-8f1f-1810f2eafeb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:30:29.364126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea5515-dfe2-44b1-8f1f-1810f2eafeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:30:29.365603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea5515-dfe2-44b1-8f1f-1810f2eafeb4 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:30:29.373468 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4403/8802] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:30:29.653160 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:30:29.671477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03cdca-8089-467f-b299-5a929308d526 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:30:29.675169 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:30:29.675778 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:30:29.676053 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:30:29.676323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:30:29.678092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:30:29.720114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:30:29.721549 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:30:29.732741 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4400/8803] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:30:39.370098 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=19 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:39.727664 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=21 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:45.889644 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e6169-025f-4797-a29c-27cee1306cea None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:30:45.890269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e6169-025f-4797-a29c-27cee1306cea None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:30:45.890269 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e6169-025f-4797-a29c-27cee1306cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:30:45.910396 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-499e6169-025f-4797-a29c-27cee1306cea None None] MFA Rules not processed for user `e44ce41e0ba0434a91710af395b8af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:30:45.911595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-499e6169-025f-4797-a29c-27cee1306cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:30:45.918944 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4404/8804] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:30:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:30:46.330348 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:30:46.347124 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a37a7-074c-407a-b0eb-329c0490a877 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:30:46.352830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:30:46.353841 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:30:46.355137 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:30:46.355410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:30:46.357281 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:30:46.369849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:30:46.378202 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:30:46.387799 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4401/8805] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:30:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:30:50.233495 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e6169-025f-4797-a29c-27cee1306cea None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:30:50.246010 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e6169-025f-4797-a29c-27cee1306cea None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:30:50.249611 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32abf3f-eea3-4d65-9969-23bc3d5d2ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:30:50.250281 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32abf3f-eea3-4d65-9969-23bc3d5d2ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:30:50.250554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32abf3f-eea3-4d65-9969-23bc3d5d2ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:30:50.250818 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32abf3f-eea3-4d65-9969-23bc3d5d2ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:30:50.252538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-e32abf3f-eea3-4d65-9969-23bc3d5d2ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:30:50.262775 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32abf3f-eea3-4d65-9969-23bc3d5d2ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:30:50.264388 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32abf3f-eea3-4d65-9969-23bc3d5d2ac1 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:30:50.273096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4405/8806] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:30:56.383991 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:30:57.601322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:30:57.615272 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84119b97-ffb2-4f39-8750-8227d522f0b0 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:30:57.621512 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:30:57.622155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:30:57.622434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:30:57.622708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:30:57.624452 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:30:57.636611 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:30:57.638216 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:30:57.648555 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4402/8807] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:30:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:31:00.269012 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=9 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:07.644251 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:36.944114 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4115d-7eab-4be5-98b8-58e0ae614d53 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:31:36.944650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4115d-7eab-4be5-98b8-58e0ae614d53 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:31:36.944650 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4115d-7eab-4be5-98b8-58e0ae614d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:31:36.992783 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-adb4115d-7eab-4be5-98b8-58e0ae614d53 None None] MFA Rules not processed for user `0991c7d338f54d97a489eb19d6378b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:31:36.993991 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-adb4115d-7eab-4be5-98b8-58e0ae614d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:31:37.001028 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4406/8808] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:31:37.013340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:31:37.022475 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103724e1-be06-44b3-a64c-006e0c914146 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:31:37.025902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:31:37.026803 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:31:37.027087 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:31:37.027359 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:31:37.034058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:31:37.035461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:31:37.042967 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4403/8809] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:31:37.181238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eba47-aac8-40ce-a914-0e20221da5b4 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:31:37.181518 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eba47-aac8-40ce-a914-0e20221da5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:31:37.181792 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eba47-aac8-40ce-a914-0e20221da5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:31:37.219628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-269eba47-aac8-40ce-a914-0e20221da5b4 None None] MFA Rules not processed for user `9e0b68b23114466a8c7fd4eaf4cfd593`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:31:37.220834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-269eba47-aac8-40ce-a914-0e20221da5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:31:37.229548 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4407/8810] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:31:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:31:37.241179 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:31:37.253489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c49ed0-3936-4640-b6dc-ed8f0a085d33 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:31:37.258689 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:31:37.259320 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:31:37.259598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:31:37.260102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:31:37.269146 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:31:37.270743 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:31:37.280336 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4404/8811] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:31:37.569827 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a99f-0e5e-4e7a-bbd7-bb9c7b7a5e8d None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:31:37.570172 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a99f-0e5e-4e7a-bbd7-bb9c7b7a5e8d None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:31:37.570444 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1a99f-0e5e-4e7a-bbd7-bb9c7b7a5e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:31:37.621614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-8af1a99f-0e5e-4e7a-bbd7-bb9c7b7a5e8d None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:31:37.623473 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8af1a99f-0e5e-4e7a-bbd7-bb9c7b7a5e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:31:37.632470 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4408/8812] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:31:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:31:37.644082 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:31:37.653370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8849f-5d1d-4962-b302-13d501635e63 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:31:37.656878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:31:37.657473 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:31:37.657753 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:31:37.658059 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:31:37.667878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:31:37.669786 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:31:37.680270 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4405/8813] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:31:37.740418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1a99f-0e5e-4e7a-bbd7-bb9c7b7a5e8d None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:31:37.752296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1a99f-0e5e-4e7a-bbd7-bb9c7b7a5e8d None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:31:37.757916 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:31:37.758540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:31:37.758810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:31:37.759144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:31:37.760781 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:31:37.772433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:31:37.774288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:31:37.784994 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4409/8814] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:31:47.675704 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=18 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:31:47.780403 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=42 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:27.920895 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:27.932708 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1aee4-ed3f-44db-8bca-f068b9f56909 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:27.938231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:27.941456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:27.941456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:27.941456 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:27.947159 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:27.948712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:27.957761 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4406/8815] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:32:35.352355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:35.374322 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6ff0c-28b3-400c-ba4d-60eb77a675c0 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:35.380088 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:35.380722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:35.381007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:35.381277 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:35.383178 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:32:35.395773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:35.399071 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:35.408990 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4410/8816] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:32:37.953667 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:42.743018 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:42.754739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7860ea-ca29-4b1d-ab21-46c7b893e28e service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:42.760014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3eda8-aa32-45b6-be06-b9c854fa1268 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:42.760688 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3eda8-aa32-45b6-be06-b9c854fa1268 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:42.761058 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3eda8-aa32-45b6-be06-b9c854fa1268 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:42.761398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3eda8-aa32-45b6-be06-b9c854fa1268 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:42.763241 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c8c3eda8-aa32-45b6-be06-b9c854fa1268 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:32:42.789250 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3eda8-aa32-45b6-be06-b9c854fa1268 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:42.790948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3eda8-aa32-45b6-be06-b9c854fa1268 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:42.801105 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4407/8817] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:32:45.403860 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:32:48.264466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:48.274351 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa234cc0-b9fe-4847-b0e8-8ca5a7d2c124 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:48.277966 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:48.278598 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:48.278982 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:48.279129 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:48.288466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:48.290041 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:48.299575 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4411/8818] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:32:51.676296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefab3-bb46-4daf-ab98-c034a7dfb845 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:51.676765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefab3-bb46-4daf-ab98-c034a7dfb845 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:51.677442 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefab3-bb46-4daf-ab98-c034a7dfb845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:51.705134 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-fdaefab3-bb46-4daf-ab98-c034a7dfb845 None None] MFA Rules not processed for user `e44ce41e0ba0434a91710af395b8af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:32:51.706606 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fdaefab3-bb46-4daf-ab98-c034a7dfb845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:32:51.716204 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4408/8819] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:32:52.072485 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:52.081907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d20c9-5434-46ce-b61b-e97cb265db7d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:52.085674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:52.086310 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:52.086585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:52.086857 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:52.088588 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:32:52.111213 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:52.112733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:52.120876 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4412/8820] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:32:52.535903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefab3-bb46-4daf-ab98-c034a7dfb845 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:52.548297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefab3-bb46-4daf-ab98-c034a7dfb845 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:52.557226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:52.557226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:52.557226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:52.557226 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:52.565836 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:52.567810 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:52.579528 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4409/8821] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:32:53.738834 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:53.741132 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:32:53.757202 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55ba2f-5781-4656-beb3-09beac703d57 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:53.764766 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:53.765433 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:53.765716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:53.766008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:53.775962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:53.777584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:53.793884 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4413/8822] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:32:54.787381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:32:54.799642 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b8c16-ef70-4258-9ed0-b7dc8be6946b service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:32:54.804993 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:32:54.805641 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:32:54.805920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:32:54.806231 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:32:54.818413 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:32:54.820043 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:32:54.830896 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4410/8823] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:32:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:33:03.791041 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=23 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:33:04.826115 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=26 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:29.928672 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:34:29.941666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b16256-5c4c-40cc-b64d-adbfc254888b service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:34:29.948956 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a18a-827e-4c93-b2a3-1db97dda299e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:34:29.949563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a18a-827e-4c93-b2a3-1db97dda299e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:34:29.949853 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a18a-827e-4c93-b2a3-1db97dda299e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:34:29.950263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a18a-827e-4c93-b2a3-1db97dda299e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:34:29.953641 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f8c3a18a-827e-4c93-b2a3-1db97dda299e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:34:29.966638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a18a-827e-4c93-b2a3-1db97dda299e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:34:29.968271 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a18a-827e-4c93-b2a3-1db97dda299e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:34:29.983238 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4414/8824] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:34:37.249599 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:34:37.260627 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3cb4-3834-4b52-bba4-34569ead07bb service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:34:37.265601 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:34:37.266225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:34:37.266506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:34:37.266776 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:34:37.268470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:34:37.279869 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:34:37.281395 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:34:37.291461 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4411/8825] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:34:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:34:39.974608 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:45.684138 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc01ab-ec85-460e-bac9-acd6bdd3dac6 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:34:45.684842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc01ab-ec85-460e-bac9-acd6bdd3dac6 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:34:45.684842 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc01ab-ec85-460e-bac9-acd6bdd3dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:34:45.704381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-33bc01ab-ec85-460e-bac9-acd6bdd3dac6 None None] MFA Rules not processed for user `e44ce41e0ba0434a91710af395b8af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:34:45.705400 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-33bc01ab-ec85-460e-bac9-acd6bdd3dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:34:45.729128 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4415/8826] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:34:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:34:47.287956 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:34:52.297909 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:34:52.307728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9fee-2b46-4472-a431-c0f770556303 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:34:52.311349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:34:52.311934 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:34:52.312205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:34:52.312470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:34:52.323266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:34:52.324669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:34:52.345589 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4412/8827] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:34:55.698860 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=3 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:02.342883 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:37.925778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc01ab-ec85-460e-bac9-acd6bdd3dac6 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:37.935731 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc01ab-ec85-460e-bac9-acd6bdd3dac6 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:37.939398 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b018a-539c-4a5f-ab0c-48c82e4b34b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:37.939995 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b018a-539c-4a5f-ab0c-48c82e4b34b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:37.940267 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b018a-539c-4a5f-ab0c-48c82e4b34b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:37.940532 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b018a-539c-4a5f-ab0c-48c82e4b34b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:37.950939 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b018a-539c-4a5f-ab0c-48c82e4b34b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:37.952349 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b018a-539c-4a5f-ab0c-48c82e4b34b5 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:37.963518 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4416/8828] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:35:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:35:47.958268 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:52.056806 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:52.117191 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db93-51b1-46fa-bbb8-c353170aa6e3 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:52.122117 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:52.122733 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:52.123010 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:52.123280 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] PATH_INFO: `/v3/users/e44ce41e0ba0434a91710af395b8af29` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:52.124379 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44ce41e0ba0434a91710af395b8af29)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:52.126317 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:52.329943 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44ce41e0ba0434a91710af395b8af29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:52.336696 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44ce41e0ba0434a91710af395b8af29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:52.337353 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44ce41e0ba0434a91710af395b8af29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:52.425369 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44ce41e0ba0434a91710af395b8af29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:52.426024 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44ce41e0ba0434a91710af395b8af29'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:52.444445 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4413/8829] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:35:52 2022] DELETE /identity/v3/users/e44ce41e0ba0434a91710af395b8af29 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:35:52.449096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:52.449578 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:52.449683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:52.468655 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:35:52.469892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:52.529042 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4417/8830] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:35:52.538932 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:52.540937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:52.596620 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3275-4ca1-43fc-a649-a5dfa76af697 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:52.600322 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:52.600928 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:52.601203 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:52.601470 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:52.611977 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:52.613398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:52.622600 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4414/8831] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:35:52.862029 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:52.865436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:52.877959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d957d-28ca-403b-90f0-54c9e949ec75 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:52.882595 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:52.883257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:52.883534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:52.883804 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] PATH_INFO: `/v3/projects/028ee2f0bfd246d0a4abebdcbea26588` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:52.884935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=028ee2f0bfd246d0a4abebdcbea26588)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:52.887008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:52.968312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028ee2f0bfd246d0a4abebdcbea26588', 'request_id': 'req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:52.973688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028ee2f0bfd246d0a4abebdcbea26588', 'request_id': 'req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.013930 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028ee2f0bfd246d0a4abebdcbea26588', 'request_id': 'req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.026660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] The token cache is being invalidate because project 028ee2f0bfd246d0a4abebdcbea26588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:35:53.026994 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.027626 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.029113 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4418/8832] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:35:52 2022] DELETE /identity/v3/projects/028ee2f0bfd246d0a4abebdcbea26588 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:35:53.033325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:53.042859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb2fa-8fb0-4004-a60e-31ae183d85e2 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:53.060387 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:53.098296 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:53.098920 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:53.099197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:53.099466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] PATH_INFO: `/v3/users/2d7c1d92410843d098c595ab1fe32269` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:53.100596 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7c1d92410843d098c595ab1fe32269)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:53.102524 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:53.244398 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7c1d92410843d098c595ab1fe32269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.251575 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7c1d92410843d098c595ab1fe32269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.252242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7c1d92410843d098c595ab1fe32269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.299362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7c1d92410843d098c595ab1fe32269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.299972 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-ba81cb83-cae1-4b00-aac3-847da9fc2ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7c1d92410843d098c595ab1fe32269'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.317216 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4415/8833] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:35:53 2022] DELETE /identity/v3/users/2d7c1d92410843d098c595ab1fe32269 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:35:53.678001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:53.683733 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:53.695553 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f883b1-f3c1-4ef5-b57d-8bf3408baaab admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:53.753788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:53.754450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:53.754728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:53.754999 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] PATH_INFO: `/v3/projects/baf8689565db4d239a516ada0f26a514` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:53.756296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf8689565db4d239a516ada0f26a514)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:53.758387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:53.826285 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:53.841935 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf8689565db4d239a516ada0f26a514', 'request_id': 'req-cf46406b-2638-4df1-bfab-972d253fed60'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.847427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf8689565db4d239a516ada0f26a514', 'request_id': 'req-cf46406b-2638-4df1-bfab-972d253fed60'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.893769 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf8689565db4d239a516ada0f26a514', 'request_id': 'req-cf46406b-2638-4df1-bfab-972d253fed60'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.905054 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] The token cache is being invalidate because project baf8689565db4d239a516ada0f26a514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:35:53.906216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.906680 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-cf46406b-2638-4df1-bfab-972d253fed60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:35:53.908214 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4419/8834] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:35:53 2022] DELETE /identity/v3/projects/baf8689565db4d239a516ada0f26a514 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:35:53.913528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ca8b-d088-494a-856e-07ab173ef420 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:53.913820 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ca8b-d088-494a-856e-07ab173ef420 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:53.914136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ca8b-d088-494a-856e-07ab173ef420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:53.934738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-1cd9ca8b-d088-494a-856e-07ab173ef420 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:35:53.935938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-1cd9ca8b-d088-494a-856e-07ab173ef420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:53.994981 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4416/8835] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:35:54.003393 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e56d-9f79-4255-a9da-a78c9efef90f None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.003674 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e56d-9f79-4255-a9da-a78c9efef90f None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.003945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42e56d-9f79-4255-a9da-a78c9efef90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.023327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-ea42e56d-9f79-4255-a9da-a78c9efef90f None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:35:54.024438 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea42e56d-9f79-4255-a9da-a78c9efef90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:54.032304 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4420/8836] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:35:54.036565 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9ca8b-d088-494a-856e-07ab173ef420 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:54.046653 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9ca8b-d088-494a-856e-07ab173ef420 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:54.051184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:54.051777 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.052054 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.052326 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.052964 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:35:54.053291 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:54.054894 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:54.066715 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4417/8837] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:35:54.070975 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42e56d-9f79-4255-a9da-a78c9efef90f None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:54.080256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42e56d-9f79-4255-a9da-a78c9efef90f None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:54.084778 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:54.085362 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.086018 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.086301 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.086915 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:54.089273 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:54.193816 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4421/8838] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:35:54 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 02:35:54.198033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:54.208172 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e971f-a92b-4b30-a3da-479c7eaceb49 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:54.235001 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:35:54.264155 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:54.264773 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.265033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.265303 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.265926 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:54.267856 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:54.363664 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4418/8839] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:35:54 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:35:54.368038 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:54.378355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f1670-23f0-48fa-bb20-f67cdeef1f8a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:54.383014 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:54.383615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.383897 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.384168 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.384864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:54.386509 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:54.396544 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4422/8840] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:35:54.401015 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:54.411466 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf505-574f-43e5-acd1-ac9529a8f368 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:54.416882 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803bca0-e18d-445a-b5f1-a90332274245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:54.417477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bca0-e18d-445a-b5f1-a90332274245 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.417757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bca0-e18d-445a-b5f1-a90332274245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.418062 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bca0-e18d-445a-b5f1-a90332274245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.418700 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803bca0-e18d-445a-b5f1-a90332274245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:54.420282 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803bca0-e18d-445a-b5f1-a90332274245 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:54.430321 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4419/8841] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 02:35:54.434516 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:54.444660 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927281-451c-4360-82a9-585745211a2d admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:54.449779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:54.450501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.450837 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.451115 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] PATH_INFO: `/v3/projects/5e890001bec0490b9b30f77183adb688/users/2d9860012bc34d4dab2679d24d51266b/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.466465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e890001bec0490b9b30f77183adb688, user_id=2d9860012bc34d4dab2679d24d51266b, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:54.469105 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:54.538895 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4423/8842] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:35:54 2022] PUT /identity/v3/projects/5e890001bec0490b9b30f77183adb688/users/2d9860012bc34d4dab2679d24d51266b/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:35:54.545739 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779096fd-2363-4c47-918c-4d486e032525 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.546048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779096fd-2363-4c47-918c-4d486e032525 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.546323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779096fd-2363-4c47-918c-4d486e032525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.566276 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-779096fd-2363-4c47-918c-4d486e032525 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:35:54.567461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-779096fd-2363-4c47-918c-4d486e032525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:54.625676 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4420/8843] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:35:54.635863 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:35:54.637571 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:35:54.692418 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e84ec-3127-4eb0-a3f4-c2e146dfef98 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:35:54.696238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:35:54.697364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:35:54.697642 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:35:54.697913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:35:54.707004 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:35:54.708414 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:35:54.718474 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4424/8844] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:36:00.042257 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e64bc-7a6c-4214-acab-1803c8dd18d6 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:00.042758 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e64bc-7a6c-4214-acab-1803c8dd18d6 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:00.043109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e64bc-7a6c-4214-acab-1803c8dd18d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:00.076520 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-538e64bc-7a6c-4214-acab-1803c8dd18d6 None None] MFA Rules not processed for user `2d9860012bc34d4dab2679d24d51266b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:36:00.077831 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-538e64bc-7a6c-4214-acab-1803c8dd18d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:00.153459 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4421/8845] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:36:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:36:00.158067 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:00.169593 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005dfa3-b1ab-4ee8-a01e-a7749e188722 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:00.176901 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:00.177535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:00.177815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:00.178713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:00.179422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:00.181538 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:00.250055 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4425/8846] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:36:00 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:36:00.254259 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e64bc-7a6c-4214-acab-1803c8dd18d6 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:00.265578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e64bc-7a6c-4214-acab-1803c8dd18d6 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:00.303122 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:00.325860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:00.326503 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:00.326775 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:00.327048 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:00.327676 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:00.329554 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:00.388427 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4422/8847] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:36:00 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:36:00.389718 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:00.406797 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229f2a-0e4c-45db-a373-7debdb16ecb5 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:00.412113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:00.412762 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:00.413035 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:00.413300 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:00.413945 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:00.416978 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:00.429452 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4426/8848] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:36:00.433625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:00.445046 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c646ee-9ce5-4ba4-96c2-bba60b448ce9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:00.450287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:00.451036 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:00.451315 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:00.451585 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] PATH_INFO: `/v3/projects/a3cf5b7dacc644d88c3ec4f030898e6f/users/480336a05a194675971f513fdc5b04fb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:00.467149 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cf5b7dacc644d88c3ec4f030898e6f, user_id=480336a05a194675971f513fdc5b04fb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:00.469822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:00.539640 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4423/8849] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:36:00 2022] PUT /identity/v3/projects/a3cf5b7dacc644d88c3ec4f030898e6f/users/480336a05a194675971f513fdc5b04fb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:36:00.543591 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:00.553968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1353e-29aa-4827-afc2-73d899c7fad3 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:00.570103 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:00.609441 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd366fe9-bf0a-42da-ac48-7780311be202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:00.610070 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd366fe9-bf0a-42da-ac48-7780311be202 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:00.610345 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd366fe9-bf0a-42da-ac48-7780311be202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:00.610609 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd366fe9-bf0a-42da-ac48-7780311be202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:00.611235 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd366fe9-bf0a-42da-ac48-7780311be202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:00.612799 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd366fe9-bf0a-42da-ac48-7780311be202 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:00.622628 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4427/8850] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:36:00.626802 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:00.637826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d96cfd-b67d-43fb-b41d-c5c8053597d3 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:00.642712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:00.643457 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:00.643800 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:00.644145 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] PATH_INFO: `/v3/projects/a3cf5b7dacc644d88c3ec4f030898e6f/users/480336a05a194675971f513fdc5b04fb/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:00.646182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cf5b7dacc644d88c3ec4f030898e6f, user_id=480336a05a194675971f513fdc5b04fb, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:00.648792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:00.660369 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4424/8851] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:36:00 2022] PUT /identity/v3/projects/a3cf5b7dacc644d88c3ec4f030898e6f/users/480336a05a194675971f513fdc5b04fb/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:36:06.070316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21fe8-d925-4c78-aaf5-0c201dbfee0c None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:06.070815 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21fe8-d925-4c78-aaf5-0c201dbfee0c None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:06.070963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21fe8-d925-4c78-aaf5-0c201dbfee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:06.100848 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-a4a21fe8-d925-4c78-aaf5-0c201dbfee0c None None] MFA Rules not processed for user `480336a05a194675971f513fdc5b04fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:36:06.102091 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-a4a21fe8-d925-4c78-aaf5-0c201dbfee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:06.186150 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4428/8852] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:36:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:36:06.203844 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:06.205618 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:06.286871 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a4d4f-d131-447b-9313-8d72cfc6f6cf admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:06.293200 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:06.293892 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:06.294197 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:06.294461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:06.355286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:06.356901 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:06.367138 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4425/8853] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:36:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:36:08.769847 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe49c-935f-4ca7-9e4f-bfd10daf3fd7 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:08.774165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe49c-935f-4ca7-9e4f-bfd10daf3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:08.774165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe49c-935f-4ca7-9e4f-bfd10daf3fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:08.790767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-489fe49c-935f-4ca7-9e4f-bfd10daf3fd7 None None] MFA Rules not processed for user `2d9860012bc34d4dab2679d24d51266b`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:36:08.791963 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-489fe49c-935f-4ca7-9e4f-bfd10daf3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:08.798936 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4429/8854] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:36:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:36:09.114866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:09.116287 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:09.147311 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:09.174861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14881ec4-4546-4577-b370-9f3ea28c202d service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:09.178561 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:09.179461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:09.180071 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:09.180425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:09.182246 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:09.191723 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:09.193132 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:09.200829 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4426/8855] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:36:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:36:12.858050 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe49c-935f-4ca7-9e4f-bfd10daf3fd7 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:12.864913 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe49c-935f-4ca7-9e4f-bfd10daf3fd7 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:12.868565 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:12.869279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:12.869555 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:12.869833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:12.871584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:12.881100 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:12.882616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:12.890421 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4430/8856] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:36:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:36:18.939592 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:18.953519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac85b-b232-48ec-83af-3a8e4434c09d service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:18.959275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:18.959885 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:18.960164 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:18.960436 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:18.962425 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:36:18.975835 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:18.977410 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:18.989010 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4427/8857] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:36:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:36:21.516580 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:36:21.525137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c28c7-7059-49ee-a50f-987f1b1be69d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:36:21.528703 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:36:21.529292 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:36:21.529574 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:36:21.529867 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:36:21.538942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:36:21.540359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:36:21.550311 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4431/8858] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:36:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:36:28.984596 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=20 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:36:31.545959 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=69 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:00.106925 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:00.108726 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:00.186887 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3206-e341-4602-b0e6-e8fd9978e1b0 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:00.191991 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225bee0-777e-440b-913b-a482a45aaf4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:00.192597 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225bee0-777e-440b-913b-a482a45aaf4c service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:00.192870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225bee0-777e-440b-913b-a482a45aaf4c service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:00.193135 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225bee0-777e-440b-913b-a482a45aaf4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:00.194859 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-0225bee0-777e-440b-913b-a482a45aaf4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:00.206426 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225bee0-777e-440b-913b-a482a45aaf4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:00.207967 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225bee0-777e-440b-913b-a482a45aaf4c service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:00.218057 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4428/8859] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:02.758094 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:02.769256 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3898e9-9fe5-4011-956b-0220b1becd31 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:02.774360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:02.774949 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:02.775224 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:02.775492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:02.777714 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:02.788704 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:02.790296 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:02.800427 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4432/8860] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:10.213499 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=36 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:12.796517 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:34.647573 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1495-6549-4696-8d2e-a27275bf977d None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:34.648114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1495-6549-4696-8d2e-a27275bf977d None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:34.648114 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1495-6549-4696-8d2e-a27275bf977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:34.707278 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f96c1495-6549-4696-8d2e-a27275bf977d None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:38:34.708505 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f96c1495-6549-4696-8d2e-a27275bf977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:34.772986 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4429/8861] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:38:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:38:34.889618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:34.891047 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:34.977810 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be10359-b17c-4205-8f70-3df2738add0e service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:34.983425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c6cb-4714-4032-b6ee-f5cdabec6058 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:34.984106 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c6cb-4714-4032-b6ee-f5cdabec6058 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:34.984288 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c6cb-4714-4032-b6ee-f5cdabec6058 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:34.984554 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c6cb-4714-4032-b6ee-f5cdabec6058 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:34.992754 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c6cb-4714-4032-b6ee-f5cdabec6058 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:34.994365 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c6cb-4714-4032-b6ee-f5cdabec6058 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:35.002317 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4433/8862] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:38:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:38:44.769889 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=44 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:44.999080 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=41 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:38:49.754659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1495-6549-4696-8d2e-a27275bf977d None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:49.773378 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1495-6549-4696-8d2e-a27275bf977d None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:49.777572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:49.778211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:49.778491 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:49.778762 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:49.780443 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:49.789567 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:49.791008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:49.798725 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4430/8863] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:50.290954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904c805-27fc-480f-a014-191e64a48517 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:50.291568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904c805-27fc-480f-a014-191e64a48517 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:50.291568 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904c805-27fc-480f-a014-191e64a48517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:50.312534 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6904c805-27fc-480f-a014-191e64a48517 None None] MFA Rules not processed for user `0e79dda089d944818b999e25bb6f8207`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:38:50.313751 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6904c805-27fc-480f-a014-191e64a48517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:50.323290 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4434/8864] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 23 02:38:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:38:50.335041 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:50.336515 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:50.420828 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4cb4-a366-441a-a7cc-445a6674b2d9 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:50.424437 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:50.425035 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:50.425309 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:50.425577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:50.435962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:50.437363 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:50.447920 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4431/8865] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:38:50.655780 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904c805-27fc-480f-a014-191e64a48517 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:50.665321 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904c805-27fc-480f-a014-191e64a48517 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:50.669562 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:50.670190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:50.670468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:50.670739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:50.672465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:50.681673 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:50.683116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:50.690755 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4435/8866] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:50.763883 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:50.773069 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a922b-3a78-42e7-850c-8e65174f587d service glance] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:50.777065 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:50.777664 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:50.777942 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:50.778239 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:50.779940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:50.793158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:50.794607 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:50.805480 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4432/8867] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:50.866567 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:50.867942 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:50.882592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8d9d6-04d6-4a96-9e76-d68ddf951581 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:50.887472 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:50.888211 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:50.888585 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:50.888854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:50.890543 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:50.901468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:50.903535 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:50.913006 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4436/8868] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:52.466441 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:52.474989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306daccf-f450-4068-95fd-b7b852cfc710 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:52.478652 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63c77b-1c44-4d97-928a-47eb826c528d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:52.479242 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63c77b-1c44-4d97-928a-47eb826c528d service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:52.479519 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63c77b-1c44-4d97-928a-47eb826c528d service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:52.479938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63c77b-1c44-4d97-928a-47eb826c528d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:52.481625 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5f63c77b-1c44-4d97-928a-47eb826c528d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:52.491829 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63c77b-1c44-4d97-928a-47eb826c528d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:52.493275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63c77b-1c44-4d97-928a-47eb826c528d service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:52.501071 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4433/8869] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:53.979923 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:53.981511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:54.001151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea239cd6-372f-46d5-979a-aaf4f5bba40b service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:54.009392 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:54.010043 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:54.010326 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:54.011575 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:54.012877 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:54.025356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:54.027734 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:54.038451 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4437/8870] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:38:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:38:54.784904 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362f183-0607-4972-87b5-fe0253d18dbb None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:54.785384 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362f183-0607-4972-87b5-fe0253d18dbb None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:54.785532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362f183-0607-4972-87b5-fe0253d18dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:54.805186 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-8362f183-0607-4972-87b5-fe0253d18dbb None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:38:54.806495 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8362f183-0607-4972-87b5-fe0253d18dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:38:54.814833 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4434/8871] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:38:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:38:54.826548 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:38:54.837741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086946a-c596-4422-831e-2cb2965d064e service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:38:54.842889 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:38:54.843492 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:38:54.843772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:38:54.844044 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:38:54.852483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:38:54.854215 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:38:54.863292 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4438/8872] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:38:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:39:04.799549 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=60 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:39:04.859568 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=27 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:39:12.983931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787693bd-19d4-4751-909d-3af684b4b359 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:39:12.984453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787693bd-19d4-4751-909d-3af684b4b359 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:39:12.984453 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787693bd-19d4-4751-909d-3af684b4b359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:39:13.003833 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-787693bd-19d4-4751-909d-3af684b4b359 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:39:13.005029 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-787693bd-19d4-4751-909d-3af684b4b359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:39:13.012640 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4435/8873] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:39:13.025159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:39:13.036196 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927533c-b5a2-46b5-9005-23d45681d9cc service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:39:13.041289 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:39:13.041898 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:39:13.042216 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:39:13.042487 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:39:13.050817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:39:13.052437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:39:13.061744 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4439/8874] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:39:22.998814 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:39:23.057480 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:28.285647 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787693bd-19d4-4751-909d-3af684b4b359 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:40:28.299492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787693bd-19d4-4751-909d-3af684b4b359 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:40:28.305997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c466e3f-8ee0-4d1f-8115-34b520beba00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:40:28.309337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466e3f-8ee0-4d1f-8115-34b520beba00 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:40:28.309337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466e3f-8ee0-4d1f-8115-34b520beba00 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:40:28.309337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466e3f-8ee0-4d1f-8115-34b520beba00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:40:28.309337 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8c466e3f-8ee0-4d1f-8115-34b520beba00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:40:28.322530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c466e3f-8ee0-4d1f-8115-34b520beba00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:40:28.324118 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c466e3f-8ee0-4d1f-8115-34b520beba00 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:40:28.335564 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4436/8875] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:40:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:40:29.850381 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:40:29.870257 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2ef4-33ec-4811-8ef2-9429148d1d50 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:40:29.873789 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:40:29.874411 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:40:29.874685 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:40:29.874948 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:40:29.876722 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:40:29.939861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:40:29.941291 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:40:29.952630 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4440/8876] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:40:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:40:35.994394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b3c8f-a015-4e43-a337-d6ff3e2a24d7 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:40:35.994940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b3c8f-a015-4e43-a337-d6ff3e2a24d7 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:40:35.994940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b3c8f-a015-4e43-a337-d6ff3e2a24d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:40:36.014593 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-5e1b3c8f-a015-4e43-a337-d6ff3e2a24d7 None None] MFA Rules not processed for user `2d9860012bc34d4dab2679d24d51266b`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:40:36.015823 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5e1b3c8f-a015-4e43-a337-d6ff3e2a24d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:40:36.022641 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4437/8877] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:40:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:40:39.947800 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=31 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:46.090056 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=9 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:40:57.803287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:40:57.811734 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b3c8f-a015-4e43-a337-d6ff3e2a24d7 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:40:57.814586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a0d6d-a3c1-4bd6-ae0e-47f756d86f87 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:40:57.820750 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:40:57.821391 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:40:57.821671 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:40:57.821792 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b3c8f-a015-4e43-a337-d6ff3e2a24d7 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:40:57.821941 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:40:57.824246 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:40:57.825969 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:40:57.826750 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:40:57.833325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:40:57.833325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:40:57.833325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:40:57.836159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:40:57.838097 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:40:57.844126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:40:57.845545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:40:57.849159 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4441/8878] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:40:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:40:57.857913 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4438/8879] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:40:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:41:05.966214 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:41:05.975774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ccfa-05b0-4a72-9aa2-82dce4be370f service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:41:05.979925 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:41:05.980513 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:41:05.980788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:41:05.981058 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:41:05.989692 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:41:05.991192 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:41:06.003209 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4442/8880] 10.222.0.42 () {60 vars in 1396 bytes} [Sun Oct 23 02:41:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:41:07.852779 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:41:15.998498 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=12 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:41:18.516175 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:41:18.524741 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589786-fc9e-4373-971a-1a5a2223930b service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:41:18.528500 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:41:18.529079 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:41:18.529358 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:41:18.529628 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:41:18.536545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:41:18.537962 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:41:18.546153 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4439/8881] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:41:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:41:21.515654 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:41:21.524207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d92b-b92c-401b-ac8c-b24c55bd024d service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:41:21.527868 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:41:21.528460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:41:21.528739 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:41:21.529013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:41:21.537771 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:41:21.539220 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:41:21.549026 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4443/8882] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:41:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:41:28.542717 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:41:31.544762 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:43:05.021728 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:43:05.033574 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac927e48-f28c-48fe-af75-ef532ab586c9 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:43:05.038544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:43:05.039141 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:43:05.039421 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:43:05.039695 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:43:05.048102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:43:05.049704 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:43:05.059497 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4440/8883] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:43:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:43:09.815334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:43:09.826696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787897a-185e-40b3-8d3f-c8b5be7f2742 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:43:09.831658 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:43:09.832263 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:43:09.832540 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:43:09.832811 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:43:09.841828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:43:09.843522 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:43:09.853669 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4444/8884] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:43:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:43:15.055353 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:43:19.849323 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=6 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:44:05.966396 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:44:05.975532 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b78a4-060e-40e8-882c-0de18c075947 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:44:05.979774 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:44:05.980334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:44:05.980613 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:44:05.980899 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:44:05.988192 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:44:05.992605 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:44:05.997355 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4441/8885] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:44:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:44:06.374683 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:44:06.384748 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eaf24-f52f-4bb3-b468-3c0de94282e3 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:44:06.388413 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:44:06.395774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:44:06.396065 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:44:06.398208 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:44:06.404032 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:44:06.405465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:44:06.413496 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4445/8886] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:44:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 02:44:07.047429 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:44:07.060788 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f857e-f7c6-425c-9f70-a878cee47111 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:44:07.066233 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:44:07.066826 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:44:07.067102 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:44:07.067371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:44:07.076011 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:44:07.077553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:44:07.087672 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4442/8887] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:44:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:44:07.551484 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:44:07.560177 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f554-b630-445a-980f-3cc1fe189530 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:44:07.563854 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:44:07.564456 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:44:07.564736 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:44:07.565013 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:44:07.576372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:44:07.577881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:44:07.592994 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4446/8888] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:44:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:44:07.675229 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:44:07.686478 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb22e70-c57a-4d7f-bbbe-595e2f967842 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:44:07.691415 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:44:07.692002 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:44:07.692275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:44:07.692539 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:44:07.701158 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:44:07.702747 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:44:07.712903 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4443/8889] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:44:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:44:17.564721 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:44:17.573841 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ee44-ef08-402e-9d4d-5e347333518e service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:44:17.577747 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:44:17.578460 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:44:17.578737 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:44:17.579007 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:44:17.585910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:44:17.587943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:44:17.595702 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4447/8890] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:44:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:44:17.708228 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=18 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:44:27.592146 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=18 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:07.725937 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:07.735096 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8290a2-b525-4571-8c52-bf6f7cd501a8 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:07.738891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:07.739481 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:07.739754 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:07.740017 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:07.741781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:07.819673 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:07.821092 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:07.838804 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4444/8891] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:08.760666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:08.762348 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:08.863908 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34de8f-76d3-4179-be3a-90a5c3982149 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:08.869713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:08.870350 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:08.870627 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:08.870902 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:08.880729 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:08.882335 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:08.892812 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4448/8892] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:09.164752 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:09.219312 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdca296-c0ba-4649-851e-338cfd404d90 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:09.222952 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:09.223553 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:09.223824 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:09.224091 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:09.235787 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:09.237292 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:09.287461 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4445/8893] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:10.444201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:10.445791 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:10.471689 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0790e-a6c3-4c71-9b8b-f9ca83421282 service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:10.478078 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:10.478832 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:10.479113 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:10.479383 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:10.493299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:10.496515 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:10.505863 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4449/8894] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:18.828659 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:18.830385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:18.841654 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c479-64f5-47b5-ac56-b29cf19a34cf service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:18.845334 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:18.845931 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:18.846263 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:18.846530 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:18.848325 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:18.919836 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=100 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:18.934005 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:18.935994 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:18.955603 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4446/8895] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:20.501079 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=54 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:22.905536 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:22.916640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dca499-b958-4268-84cb-0fba2d13c1ba service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:22.922352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:22.922954 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:22.923230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:22.923501 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:22.925226 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:22.951364 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:22.953001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:22.963034 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4450/8896] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:26.396667 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:26.398329 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:26.410796 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53da4b-0d54-4763-9caa-ab359888770f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:26.415447 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:26.416080 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:26.416368 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:26.416630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] PATH_INFO: `/v3/users/2d9860012bc34d4dab2679d24d51266b` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:26.417907 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9860012bc34d4dab2679d24d51266b)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:26.420085 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:26.595371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9860012bc34d4dab2679d24d51266b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:26.602557 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9860012bc34d4dab2679d24d51266b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:26.603266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9860012bc34d4dab2679d24d51266b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:26.682258 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9860012bc34d4dab2679d24d51266b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:26.682850 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9860012bc34d4dab2679d24d51266b'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:26.706314 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4447/8897] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:46:26 2022] DELETE /identity/v3/users/2d9860012bc34d4dab2679d24d51266b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:46:26.934851 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:26.944610 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6142-f9df-4dbe-8db3-cfa817aef606 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:27.001425 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:27.002086 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:27.002359 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:27.002625 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] PATH_INFO: `/v3/projects/5e890001bec0490b9b30f77183adb688` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:27.003716 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e890001bec0490b9b30f77183adb688)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:27.005616 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:27.108803 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e890001bec0490b9b30f77183adb688', 'request_id': 'req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.114498 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e890001bec0490b9b30f77183adb688', 'request_id': 'req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.175909 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e890001bec0490b9b30f77183adb688', 'request_id': 'req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.187167 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] The token cache is being invalidate because project 5e890001bec0490b9b30f77183adb688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:46:27.187387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.188008 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.189478 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4451/8898] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:46:26 2022] DELETE /identity/v3/projects/5e890001bec0490b9b30f77183adb688 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:46:27.193578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:27.194999 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:27.207534 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86a8e-af45-46e6-903c-c647c2aafbf5 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:27.264177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:27.264804 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:27.265088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:27.265362 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] PATH_INFO: `/v3/users/480336a05a194675971f513fdc5b04fb` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:27.278830 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480336a05a194675971f513fdc5b04fb)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:27.280738 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:27.462007 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:27.467917 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480336a05a194675971f513fdc5b04fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.475156 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480336a05a194675971f513fdc5b04fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.475878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480336a05a194675971f513fdc5b04fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.544576 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480336a05a194675971f513fdc5b04fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.545210 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-0a8746a3-8c42-4269-8e0e-5f9c734bdf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480336a05a194675971f513fdc5b04fb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:27.562559 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4448/8899] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:46:27 2022] DELETE /identity/v3/users/480336a05a194675971f513fdc5b04fb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:46:27.795607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:27.801763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:27.809542 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f633a8e-efb8-43ef-997c-5e4b0e3bd79a admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:27.866563 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:27.867190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:27.867467 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:27.867741 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] PATH_INFO: `/v3/projects/a3cf5b7dacc644d88c3ec4f030898e6f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:27.875787 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:27.878244 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cf5b7dacc644d88c3ec4f030898e6f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:27.880148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.032788 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cf5b7dacc644d88c3ec4f030898e6f', 'request_id': 'req-8775a0e0-4e47-49bb-a644-c9593dba2248'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:28.038201 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cf5b7dacc644d88c3ec4f030898e6f', 'request_id': 'req-8775a0e0-4e47-49bb-a644-c9593dba2248'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:28.104675 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cf5b7dacc644d88c3ec4f030898e6f', 'request_id': 'req-8775a0e0-4e47-49bb-a644-c9593dba2248'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:28.116864 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] The token cache is being invalidate because project a3cf5b7dacc644d88c3ec4f030898e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81936) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:46:28.117144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:28.117759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-8775a0e0-4e47-49bb-a644-c9593dba2248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:46:28.119267 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4452/8900] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:46:27 2022] DELETE /identity/v3/projects/a3cf5b7dacc644d88c3ec4f030898e6f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 02:46:28.124467 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1d412-04d4-4f53-b664-23b44ff67ee4 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.124756 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1d412-04d4-4f53-b664-23b44ff67ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.125028 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1d412-04d4-4f53-b664-23b44ff67ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.181683 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-64a1d412-04d4-4f53-b664-23b44ff67ee4 None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:46:28.182914 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-64a1d412-04d4-4f53-b664-23b44ff67ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:28.240389 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4449/8901] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:46:28.248320 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2950fd-b05e-4810-a3b5-9f6ea9cb57ec None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.248602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2950fd-b05e-4810-a3b5-9f6ea9cb57ec None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.248876 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2950fd-b05e-4810-a3b5-9f6ea9cb57ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.268422 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-0d2950fd-b05e-4810-a3b5-9f6ea9cb57ec None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:46:28.269603 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0d2950fd-b05e-4810-a3b5-9f6ea9cb57ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:28.277347 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4453/8902] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:46:28.281881 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1d412-04d4-4f53-b664-23b44ff67ee4 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:28.291610 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1d412-04d4-4f53-b664-23b44ff67ee4 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:28.296147 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:28.296771 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.297050 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.297323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] PATH_INFO: `/v3/domains` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.297955 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81937) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 02:46:28.298286 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:28.299865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.311555 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4450/8903] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 23 02:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 02:46:28.315025 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2950fd-b05e-4810-a3b5-9f6ea9cb57ec None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:28.324165 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2950fd-b05e-4810-a3b5-9f6ea9cb57ec None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:28.329329 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:28.329943 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.330255 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.330526 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.331144 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:28.333019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.440613 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4454/8904] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:46:28 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:46:28.444902 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:28.455543 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb03b-3f09-4372-95d3-20107289f918 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:28.512269 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:28.513506 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.513679 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.513948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.514598 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:28.516476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.582751 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4451/8905] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:46:28 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:46:28.586962 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:28.597276 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74501159-df13-472b-a38a-49b04ab48cb0 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:28.601862 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:28.602483 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.602759 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.603026 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.603663 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:28.605287 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.615324 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4455/8906] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:46:28.619178 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:28.625858 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:28.629528 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c57a-4ec6-4fb8-8a62-1647acf29859 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:28.634166 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a49cb-b90b-406e-b975-f0403507f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:28.639014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a49cb-b90b-406e-b975-f0403507f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.639014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a49cb-b90b-406e-b975-f0403507f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.639014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a49cb-b90b-406e-b975-f0403507f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.639014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a49cb-b90b-406e-b975-f0403507f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:28.639014 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a49cb-b90b-406e-b975-f0403507f2dd admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.649472 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4452/8907] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:46:28.653861 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:28.663774 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542942-652f-4e4d-b002-1cea6b327cf9 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:28.668416 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:28.669068 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] REQUEST_METHOD: `PUT` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.669336 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.669607 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] PATH_INFO: `/v3/projects/df930ec48af34ab988097274a950a70a/users/6203993a83b2402ca8789188cf27c578/roles/287b5be651514a5785a2f6e2d58fa5bc` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.684137 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df930ec48af34ab988097274a950a70a, user_id=6203993a83b2402ca8789188cf27c578, role_id=287b5be651514a5785a2f6e2d58fa5bc)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:28.687355 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.754180 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4456/8908] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:46:28 2022] PUT /identity/v3/projects/df930ec48af34ab988097274a950a70a/users/6203993a83b2402ca8789188cf27c578/roles/287b5be651514a5785a2f6e2d58fa5bc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:46:28.759208 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446633d-d4b2-4201-8bba-236a4af960de None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.759490 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446633d-d4b2-4201-8bba-236a4af960de None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.759764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446633d-d4b2-4201-8bba-236a4af960de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.778929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-f446633d-d4b2-4201-8bba-236a4af960de None None] MFA Rules not processed for user `aff16e16e402486ab43ace4b1e3cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:46:28.780113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-f446633d-d4b2-4201-8bba-236a4af960de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:28.839094 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4453/8909] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:46:28.849279 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:28.851019 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:28.906678 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351df53-dc6b-4d9d-9a10-9ff10d971feb admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:28.910305 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:28.910907 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:28.911185 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:28.911455 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:28.920360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:28.921772 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:28.931120 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4457/8910] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:34.162381 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985956d-400a-463a-b057-ef505cf922ef None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:34.162860 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985956d-400a-463a-b057-ef505cf922ef None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:34.162948 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985956d-400a-463a-b057-ef505cf922ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:34.195279 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-9985956d-400a-463a-b057-ef505cf922ef None None] MFA Rules not processed for user `6203993a83b2402ca8789188cf27c578`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:46:34.196492 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-9985956d-400a-463a-b057-ef505cf922ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:34.279717 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4454/8911] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:46:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:46:34.283756 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:34.293525 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fb1f-7cd9-4168-afd7-e3219411590f service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:34.298437 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:34.299040 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:34.299316 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:34.299586 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:34.300217 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:34.302125 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:34.317919 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:34.410201 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4458/8912] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 23 02:46:34 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:46:34.411350 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985956d-400a-463a-b057-ef505cf922ef None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:34.423302 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985956d-400a-463a-b057-ef505cf922ef None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:34.487187 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:34.487809 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:34.488865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:34.488865 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] PATH_INFO: `/v3/users` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:34.489205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:34.491184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:34.568049 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4455/8913] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 23 02:46:34 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 02:46:34.572197 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:34.583332 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5c8f-f36c-450b-8a65-211022e25780 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:34.588046 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:34.588640 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:34.588914 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:34.589182 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:34.589817 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:34.591445 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:34.602303 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4459/8914] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:46:34.606929 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:34.617340 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239a4fc-37e3-45e2-b432-07d7d7b5e78f admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:34.622590 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:34.623260 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:34.623541 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:34.623816 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] PATH_INFO: `/v3/projects/5220ee0dfcc7413493da0351ffbf6413/users/5595f9bb354b4f43ae2071148bea076f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:34.636357 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:34.641313 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5220ee0dfcc7413493da0351ffbf6413, user_id=5595f9bb354b4f43ae2071148bea076f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:34.644111 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:34.725588 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4456/8915] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:46:34 2022] PUT /identity/v3/projects/5220ee0dfcc7413493da0351ffbf6413/users/5595f9bb354b4f43ae2071148bea076f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:46:34.729776 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:34.745238 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1a1b-a9ff-49af-a853-9c0b1b80e390 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:34.811879 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b9f8a-daee-4336-9482-354cd75b7858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:34.812505 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b9f8a-daee-4336-9482-354cd75b7858 admin admin] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:34.812833 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b9f8a-daee-4336-9482-354cd75b7858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:34.813051 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b9f8a-daee-4336-9482-354cd75b7858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:34.813697 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b9f8a-daee-4336-9482-354cd75b7858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:34.815357 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b9f8a-daee-4336-9482-354cd75b7858 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:34.826445 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4460/8916] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 23 02:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 02:46:34.830632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:34.841927 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58d84f-7dca-4715-9265-3d6018fff780 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:34.846757 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:34.847402 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:34.847678 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:34.847941 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] PATH_INFO: `/v3/projects/5220ee0dfcc7413493da0351ffbf6413/users/5595f9bb354b4f43ae2071148bea076f/roles/084c71d449aa4c209afa646584a16293` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:34.849852 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5220ee0dfcc7413493da0351ffbf6413, user_id=5595f9bb354b4f43ae2071148bea076f, role_id=084c71d449aa4c209afa646584a16293)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:34.853284 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:34.865118 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4457/8917] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 23 02:46:34 2022] PUT /identity/v3/projects/5220ee0dfcc7413493da0351ffbf6413/users/5595f9bb354b4f43ae2071148bea076f/roles/084c71d449aa4c209afa646584a16293 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:46:40.281098 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b52e-cddd-44e1-9320-9c40aac19ea1 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:40.281629 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b52e-cddd-44e1-9320-9c40aac19ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:40.281881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25b52e-cddd-44e1-9320-9c40aac19ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:40.314628 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6b25b52e-cddd-44e1-9320-9c40aac19ea1 None None] MFA Rules not processed for user `5595f9bb354b4f43ae2071148bea076f`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:46:40.315904 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6b25b52e-cddd-44e1-9320-9c40aac19ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:40.402515 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4461/8918] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:46:40.420327 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:40.422198 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:40.511316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a840576-86c2-4c60-ab8f-fef9d9a3b8f9 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:40.519397 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:40.520116 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:40.520461 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:40.520805 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:40.590834 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:40.592580 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:40.606470 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4458/8919] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:43.216083 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:43.216728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:43.216728 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:43.237052 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] MFA Rules not processed for user `6203993a83b2402ca8789188cf27c578`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:46:43.238397 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:43.246029 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4462/8920] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:46:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:46:43.578266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:43.634720 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf4b2e-7081-427e-a0a8-d1625b2b993d service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:43.638966 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:43.639582 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:43.639919 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:43.640136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:43.641886 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:43.652126 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:43.653600 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:43.662425 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4459/8921] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:44.089187 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:44.090624 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:44.187986 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=100 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:44.195170 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9420b11-952e-4bea-8062-21d74a804755 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:44.200328 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:44.200910 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:44.201111 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:44.201385 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:44.203183 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:44.216006 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:44.218372 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:44.230188 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4463/8922] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:47.565782 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:47.567370 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:47.577866 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096db30-47a7-48b9-afbc-441957c8928f service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:47.581781 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:47.582434 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:47.582714 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:47.582989 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:47.584712 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:47.594578 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:47.596307 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:47.604064 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4460/8923] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:48.392312 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:48.406450 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922bbf2-b8d4-4ef8-9a3f-7a9cd88576a4 service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:48.412442 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:48.413048 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:48.413327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:48.413597 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:48.415440 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:46:48.428179 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:48.429947 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:48.441881 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4464/8924] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:55.954266 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:46:55.958238 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:46:55.963154 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a1a54-10f4-4d0c-b78f-a969618e0d90 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:46:55.967343 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:46:55.967938 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:46:55.968213 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:46:55.968482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:46:55.977182 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:46:55.978619 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:46:55.988237 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4461/8925] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:46:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:46:58.437206 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=11 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:47:06.015949 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=5 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:48:12.170195 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:48:12.171566 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:48:12.194710 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2de4-c204-4626-9dcb-c5abe21b700a service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:48:12.199638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b1b54-4a60-463b-83ab-d3c2f39d4641 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:48:12.200225 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1b54-4a60-463b-83ab-d3c2f39d4641 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:48:12.200497 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1b54-4a60-463b-83ab-d3c2f39d4641 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:48:12.200760 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1b54-4a60-463b-83ab-d3c2f39d4641 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:48:12.202431 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-2e9b1b54-4a60-463b-83ab-d3c2f39d4641 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:48:12.214860 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b1b54-4a60-463b-83ab-d3c2f39d4641 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:48:12.216409 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b1b54-4a60-463b-83ab-d3c2f39d4641 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:48:12.226509 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4465/8926] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:48:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:48:12.787177 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:48:12.798297 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a7b9e-c026-4b48-965b-295d13d1ec87 service neutron] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:48:12.803763 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:48:12.804351 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:48:12.804635 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:48:12.804903 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:48:12.806630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:48:12.818338 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:48:12.819867 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:48:12.829943 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4462/8927] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:48:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:48:22.221899 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:48:22.825666 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:00.343617 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8df3-5e1d-4004-859f-0c2d50c772e3 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:00.344118 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8df3-5e1d-4004-859f-0c2d50c772e3 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:00.344228 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8df3-5e1d-4004-859f-0c2d50c772e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:00.404763 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-f3be8df3-5e1d-4004-859f-0c2d50c772e3 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:49:00.405928 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f3be8df3-5e1d-4004-859f-0c2d50c772e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:49:00.470972 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4466/8928] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 02:49:00.650639 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:49:00.652068 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:49:00.748230 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441b33c-fd42-49dd-a1b9-71b7540a5ca6 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:49:00.753545 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:49:00.754205 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:00.754489 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:00.754764 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:00.764316 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:49:00.766066 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:49:00.775486 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4463/8929] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:49:10.467646 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=44 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:10.772038 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=41 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:11.260313 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7949bd-69ea-42fa-a062-aff5de32e683 None None] REQUEST_METHOD: `POST` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:11.260618 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7949bd-69ea-42fa-a062-aff5de32e683 None None] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:11.260896 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7949bd-69ea-42fa-a062-aff5de32e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:11.279468 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.auth.core [None req-6f7949bd-69ea-42fa-a062-aff5de32e683 None None] MFA Rules not processed for user `6203993a83b2402ca8789188cf27c578`. Rule list: `[]` (Enabled: `True`). {{(pid=81936) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:49:11.280648 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-6f7949bd-69ea-42fa-a062-aff5de32e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:49:11.287365 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4467/8930] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 23 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:49:13.339380 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:49:13.350822 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721d1b7-9811-481f-9711-a76ce5040176 service swift] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:49:13.355718 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebd5fb-d88f-4de6-b358-67945e096e0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:49:13.356328 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5fb-d88f-4de6-b358-67945e096e0b service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:13.356602 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5fb-d88f-4de6-b358-67945e096e0b service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:13.356870 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5fb-d88f-4de6-b358-67945e096e0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:13.358544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-adebd5fb-d88f-4de6-b358-67945e096e0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:49:13.370482 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebd5fb-d88f-4de6-b358-67945e096e0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:49:13.372022 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebd5fb-d88f-4de6-b358-67945e096e0b service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:49:13.382205 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4464/8931] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:49:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:49:16.382311 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7949bd-69ea-42fa-a062-aff5de32e683 None None] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:49:16.395632 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7949bd-69ea-42fa-a062-aff5de32e683 None None] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:49:16.401686 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:49:16.402592 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:16.402696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:16.402965 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:16.404696 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:49:16.417360 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:49:16.418959 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:49:16.429322 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4468/8932] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:49:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:49:19.173104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c999d-ae14-4a54-9718-4e4e0898aa7f None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:19.173587 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c999d-ae14-4a54-9718-4e4e0898aa7f None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:19.173669 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c999d-ae14-4a54-9718-4e4e0898aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:19.193552 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-bf1c999d-ae14-4a54-9718-4e4e0898aa7f None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:49:19.195034 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-bf1c999d-ae14-4a54-9718-4e4e0898aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:49:19.202370 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4465/8933] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:49:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:49:19.216306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:49:19.227193 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4f06-4375-4c22-b30e-bc8dc08959fd service nova] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:49:19.232319 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:49:19.233089 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:19.233212 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:19.233423 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:19.242602 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:49:19.244166 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:49:19.252549 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4469/8934] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:49:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:49:27.792924 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c999d-ae14-4a54-9718-4e4e0898aa7f None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:49:27.811725 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c999d-ae14-4a54-9718-4e4e0898aa7f None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:49:27.815371 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60208-088a-42d3-9340-fbcd1d3f7643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:49:27.815963 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60208-088a-42d3-9340-fbcd1d3f7643 service neutron] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:49:27.816238 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60208-088a-42d3-9340-fbcd1d3f7643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:49:27.816507 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60208-088a-42d3-9340-fbcd1d3f7643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:49:27.818225 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-6ec60208-088a-42d3-9340-fbcd1d3f7643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:49:27.828406 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec60208-088a-42d3-9340-fbcd1d3f7643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:49:27.829861 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec60208-088a-42d3-9340-fbcd1d3f7643 service neutron] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:49:27.837679 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4466/8935] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:49:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:49:29.248998 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=15 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:49:37.834233 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=19 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:17.394306 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:17.395694 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:17.509001 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d65ce-1681-4f24-83c7-9c005cb64eb1 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:17.513135 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42c76c07d0cf43d2b230e4afa9709bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:17.515354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:17.515354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:17.515354 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:17.516116 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:17.556465 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:17.558230 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:17.569096 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4470/8936] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:51:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:51:21.752846 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae33c-6609-4234-84be-32bc67509176 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:21.753311 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae33c-6609-4234-84be-32bc67509176 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:21.753412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ae33c-6609-4234-84be-32bc67509176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:21.775638 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-270ae33c-6609-4234-84be-32bc67509176 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:51:21.776813 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-270ae33c-6609-4234-84be-32bc67509176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:21.784703 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4467/8937] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 23 02:51:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:51:21.824825 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:21.835974 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a45054-da81-41e6-b951-94604661d0ee service glance] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:21.840952 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:21.841549 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:21.841828 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:21.842146 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:21.850327 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:21.851929 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:21.860387 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4471/8938] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:51:31.840433 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=3 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:31.857109 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=66 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:32.376630 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8a6e6-3c09-4a40-93f7-c63669977576 None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:32.377008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8a6e6-3c09-4a40-93f7-c63669977576 None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:32.377360 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8a6e6-3c09-4a40-93f7-c63669977576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:32.407563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-02e8a6e6-3c09-4a40-93f7-c63669977576 None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:51:32.407563 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-02e8a6e6-3c09-4a40-93f7-c63669977576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:32.407563 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4468/8939] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:51:32.417148 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:32.428352 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2b80-46b0-4d2f-a101-5c6214f39214 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:32.434096 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:32.434688 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:32.434987 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:32.435251 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:32.443920 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:32.445466 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:32.453308 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4472/8940] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:51:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:51:34.302344 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8a6e6-3c09-4a40-93f7-c63669977576 None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:34.317275 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8a6e6-3c09-4a40-93f7-c63669977576 None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:34.326954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddbb32-843e-4f98-9938-c3596e482744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:34.326954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddbb32-843e-4f98-9938-c3596e482744 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:34.326954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddbb32-843e-4f98-9938-c3596e482744 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:34.326954 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddbb32-843e-4f98-9938-c3596e482744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:34.327249 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-c5ddbb32-843e-4f98-9938-c3596e482744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:34.340224 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddbb32-843e-4f98-9938-c3596e482744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:34.341791 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddbb32-843e-4f98-9938-c3596e482744 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:34.353125 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4469/8941] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:51:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:51:34.743133 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:34.752969 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd981b0-215d-42c7-b0be-9687881fb723 service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:34.757637 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:34.758299 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:34.758576 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:34.758844 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:34.760713 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:34.774720 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:34.776126 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:34.787595 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4473/8942] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:51:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:51:38.283184 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94cfd7-6560-4a76-bd35-07b279cec52e None None] REQUEST_METHOD: `POST` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:38.283621 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94cfd7-6560-4a76-bd35-07b279cec52e None None] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:38.283766 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94cfd7-6560-4a76-bd35-07b279cec52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:38.303412 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.auth.core [None req-ed94cfd7-6560-4a76-bd35-07b279cec52e None None] MFA Rules not processed for user `dfa33bd9a95046b68371e1107a5507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81937) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 02:51:38.304595 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-ed94cfd7-6560-4a76-bd35-07b279cec52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:38.312312 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4470/8943] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 23 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 02:51:38.324504 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:38.335401 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1becc2-9893-442f-bc66-0bdb9b733411 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:38.340638 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2725c03b7e40c39b3db1cd9c45ed71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:38.341253 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:38.341530 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:38.341800 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:38.349838 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:38.351427 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:38.359808 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4474/8944] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 23 02:51:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 02:51:40.727103 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94cfd7-6560-4a76-bd35-07b279cec52e None None] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:40.740878 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94cfd7-6560-4a76-bd35-07b279cec52e None None] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:40.746464 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e79dda089d944818b999e25bb6f8207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:40.747081 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:40.747361 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:40.747632 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:40.756033 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:40.758003 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:40.768414 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4471/8945] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:51:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:51:46.162159 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:46.172117 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e37dc-d303-4b7e-88a8-94521ba7e1fb service swift] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:46.175706 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0991c7d338f54d97a489eb19d6378b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:46.176293 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:46.176569 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:46.176835 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:46.235449 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:46.236892 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:46.246741 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4475/8946] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:51:49.793400 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:49.805090 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27fd8e-3b27-46bc-9efa-4c23d107dc34 service nova] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:49.810243 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:49.810832 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:49.811113 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:49.811385 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:49.813095 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:49.826008 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:49.827622 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:49.837774 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4472/8947] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:51:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:51:53.375055 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:53.385190 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffb0d7-1454-47ef-83df-382465d668a9 service neutron] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:53.392883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:53.392883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:53.392883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:53.392883 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] PATH_INFO: `/v3/users/6203993a83b2402ca8789188cf27c578` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:53.393241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6203993a83b2402ca8789188cf27c578)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:53.394151 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:53.712564 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6203993a83b2402ca8789188cf27c578'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:53.720615 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6203993a83b2402ca8789188cf27c578'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:53.721297 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6203993a83b2402ca8789188cf27c578'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:53.834107 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6203993a83b2402ca8789188cf27c578'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:53.834715 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6203993a83b2402ca8789188cf27c578'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:53.853125 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4476/8948] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:51:53 2022] DELETE /identity/v3/users/6203993a83b2402ca8789188cf27c578 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:51:54.380694 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:54.394588 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850a10-3717-4ab7-b847-efaa79edac46 service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:54.451057 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:54.451612 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:54.451891 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:54.452162 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] PATH_INFO: `/v3/projects/df930ec48af34ab988097274a950a70a` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:54.453268 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=df930ec48af34ab988097274a950a70a)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:54.455180 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:54.556109 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df930ec48af34ab988097274a950a70a', 'request_id': 'req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.562394 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df930ec48af34ab988097274a950a70a', 'request_id': 'req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.634088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df930ec48af34ab988097274a950a70a', 'request_id': 'req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.646193 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] The token cache is being invalidate because project df930ec48af34ab988097274a950a70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:51:54.646477 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.647140 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.648639 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4473/8949] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:51:54 2022] DELETE /identity/v3/projects/df930ec48af34ab988097274a950a70a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:51:54.652667 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:54.655127 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:54.666790 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9479341-ff36-43c6-a7df-d036530c6c71 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:54.689873 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:54.721356 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:54.721900 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:54.722207 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:54.722480 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] PATH_INFO: `/v3/users/5595f9bb354b4f43ae2071148bea076f` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:54.723608 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5595f9bb354b4f43ae2071148bea076f)` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:54.725511 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:54.892881 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5595f9bb354b4f43ae2071148bea076f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.899779 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5595f9bb354b4f43ae2071148bea076f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.900436 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5595f9bb354b4f43ae2071148bea076f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.970968 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5595f9bb354b4f43ae2071148bea076f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.971666 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.notifications [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5595f9bb354b4f43ae2071148bea076f'} {{(pid=81936) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:54.989553 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4477/8950] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 23 02:51:54 2022] DELETE /identity/v3/users/5595f9bb354b4f43ae2071148bea076f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:51:55.247349 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:51:55.248807 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:51:55.261577 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009afac-1ae9-4bdb-a2cb-20aa48a01abb admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:51:55.296521 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:51:55.318946 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff16e16e402486ab43ace4b1e3cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598c49694334495883fc0f61f918bb99', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:51:55.319572 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:51:55.319849 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:51:55.320120 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] PATH_INFO: `/v3/projects/5220ee0dfcc7413493da0351ffbf6413` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:51:55.321219 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5220ee0dfcc7413493da0351ffbf6413)` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:51:55.323133 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:51:55.431579 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5220ee0dfcc7413493da0351ffbf6413', 'request_id': 'req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:55.438765 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5220ee0dfcc7413493da0351ffbf6413', 'request_id': 'req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:55.520997 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5220ee0dfcc7413493da0351ffbf6413', 'request_id': 'req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723'} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:55.533256 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] The token cache is being invalidate because project 5220ee0dfcc7413493da0351ffbf6413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81937) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 02:51:55.533544 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:55.534211 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.notifications [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81937) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 02:51:55.535692 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4474/8951] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 23 02:51:55 2022] DELETE /identity/v3/projects/5220ee0dfcc7413493da0351ffbf6413 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 02:52:04.986100 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:52:05.530117 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:53:18.037241 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:53:18.038700 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:53:18.106870 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c9f26-d5f3-4118-b59e-bff729387b52 admin admin] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:53:18.164387 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:53:18.168614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:53:18.168614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:53:18.168614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:53:18.168614 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.fernet_utils [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81936) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:53:18.178584 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:53:18.180181 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:53:18.190523 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4478/8952] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:53:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:53:18.735000 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:53:18.736451 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:53:18.751088 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f204-6ddc-4ec5-93b7-1edc75ca1723 admin admin] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:53:18.756335 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:53:18.756940 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:53:18.757218 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:53:18.757485 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:53:18.759136 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.fernet_utils [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81937) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 02:53:18.770930 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:53:18.772476 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:53:18.782710 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4475/8953] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:53:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:53:28.186357 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=58 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:53:28.778674 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=6 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:58:23.987773 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] Authenticating user token {{(pid=81936) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:58:24.007539 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961c86e-c32e-4803-980c-72ff0c226b7f service placement] Validating token access rules against request {{(pid=81936) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:58:24.012443 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72bd9a-9307-4183-9b6e-c4ed4c0911d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81936) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:58:24.013060 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72bd9a-9307-4183-9b6e-c4ed4c0911d5 service placement] REQUEST_METHOD: `GET` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:58:24.013334 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72bd9a-9307-4183-9b6e-c4ed4c0911d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:58:24.013601 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72bd9a-9307-4183-9b6e-c4ed4c0911d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81936) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:58:24.021767 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72bd9a-9307-4183-9b6e-c4ed4c0911d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:58:24.023366 n-d-master-1 devstack@keystone.service[81936]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72bd9a-9307-4183-9b6e-c4ed4c0911d5 service placement] RBAC: Authorization granted {{(pid=81936) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:58:24.033270 n-d-master-1 devstack@keystone.service[81936]: [pid: 81936|app: 0|req: 4479/8954] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:58:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:58:26.715749 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] Authenticating user token {{(pid=81937) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 02:58:26.735980 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b159-5fc9-4d9d-8a6e-d479c6609c4b service placement] Validating token access rules against request {{(pid=81937) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 02:58:26.740936 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc5d73-4182-4098-9f50-a9ec5d143923 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0b68b23114466a8c7fd4eaf4cfd593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccfe2faaaeaa488eb31b979b891fa58e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81937) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 02:58:26.741527 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc5d73-4182-4098-9f50-a9ec5d143923 service placement] REQUEST_METHOD: `GET` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 02:58:26.741801 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc5d73-4182-4098-9f50-a9ec5d143923 service placement] SCRIPT_NAME: `/identity` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 02:58:26.742104 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc5d73-4182-4098-9f50-a9ec5d143923 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81937) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 02:58:26.751323 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc5d73-4182-4098-9f50-a9ec5d143923 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 02:58:26.752874 n-d-master-1 devstack@keystone.service[81937]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc5d73-4182-4098-9f50-a9ec5d143923 service placement] RBAC: Authorization granted {{(pid=81937) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 02:58:26.762467 n-d-master-1 devstack@keystone.service[81937]: [pid: 81937|app: 0|req: 4476/8955] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 23 02:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 02:58:34.028824 n-d-master-1 devstack@keystone.service[81936]: DEBUG dbcounter [-] [81936] Writing DB stats keystone:SELECT=10 {{(pid=81936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:58:36.758386 n-d-master-1 devstack@keystone.service[81937]: DEBUG dbcounter [-] [81937] Writing DB stats keystone:SELECT=10 {{(pid=81937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}